[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2022224327A1 - Dispositif d'entrée d'opération, dispositif de traitement d'informations et procédé d'entrée d'opération - Google Patents

Dispositif d'entrée d'opération, dispositif de traitement d'informations et procédé d'entrée d'opération Download PDF

Info

Publication number
WO2022224327A1
WO2022224327A1 PCT/JP2021/015937 JP2021015937W WO2022224327A1 WO 2022224327 A1 WO2022224327 A1 WO 2022224327A1 JP 2021015937 W JP2021015937 W JP 2021015937W WO 2022224327 A1 WO2022224327 A1 WO 2022224327A1
Authority
WO
WIPO (PCT)
Prior art keywords
amount
operation knob
information
knob
gripping
Prior art date
Application number
PCT/JP2021/015937
Other languages
English (en)
Japanese (ja)
Inventor
真也 吉岡
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to PCT/JP2021/015937 priority Critical patent/WO2022224327A1/fr
Priority to JP2023515910A priority patent/JPWO2022224327A1/ja
Publication of WO2022224327A1 publication Critical patent/WO2022224327A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0362—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Definitions

  • the present disclosure relates to an operation input device, an information processing device, and an operation input method.
  • Patent Literature 1 describes an operation input device that includes an operator, which is a dial switch or a rotary switch, and a finger sensor that detects the number of fingers holding the operator.
  • the operation input device identifies the number of fingers gripping the operator based on the detection result of the finger sensor, and switches the operation command for the operation input according to the number of fingers gripping the operator.
  • the operation input device described in Patent Document 1 has the problem of poor operability because it is necessary to change the number of fingers that hold the operator when switching to another operation. For example, even if the manipulator is easier to rotate with a larger number of fingers, it may be necessary to unnaturally rotate the manipulator with a smaller number of fingers depending on the function to be executed. Further, if the finger touches the manipulator while rotating the manipulator, a function different from the function to be executed may be erroneously executed.
  • the present disclosure is intended to solve the above problems, and provides an operation input device, an information processing device, and an operation input method that enable an operation corresponding to a desired function to be performed regardless of the number of fingers that hold the operator. for the purpose.
  • An operation input device includes an operation knob provided rotatably on a touch panel, an operation element having a detection unit that detects the amount of gripping and bending the operation knob, and an operation using the operation element. an operation information generation unit that generates operation information and outputs the operation information to a function execution unit that executes a function corresponding to the operation; Generate operation information according to
  • an operator having an operation knob and a detection unit, an operation information generator that generates operation information indicating an operation using the operator, and outputs the operation information to a function execution unit,
  • the information generation unit generates operation information according to the amount of grip of the operation knob that is detected by the detection unit. Since the function to be executed can be specified by a natural operation of bending the operation knob by changing the gripping force, the operation input device according to the present disclosure can perform the desired function regardless of the number of fingers gripping the operation element. Corresponding operations can be performed.
  • FIG. 1 is a block diagram showing a configuration example of an information processing apparatus according to Embodiment 1;
  • FIG. FIG. 2A is a perspective view showing the manipulator, and
  • FIG. 2B is a configuration diagram showing the internal configuration of the manipulator.
  • FIG. 3A is a configuration diagram showing the internal configuration of the manipulator before an operation to bend the operation knob by holding it, and
  • FIG. 5A is a schematic diagram showing the change in the adjustment amount when the operation knob is rotated without being bent, and
  • FIG. 5B is a schematic diagram showing the adjustment amount when the operation knob is bent with a small holding amount and rotated.
  • FIG. 5A is a schematic diagram showing the change in the adjustment amount when the operation knob is rotated without being bent
  • FIG. 5B is a schematic diagram showing the adjustment amount when the operation knob is bent with a small holding amount and rotated.
  • FIG. 5C is a schematic diagram showing the amount of change
  • FIG. 5C is a schematic diagram showing the amount of change in the adjustment amount when the operation knob is flexed and rotated by a large grasp amount
  • FIG. 6A is a schematic diagram showing the menu selection screen when the operation knob is rotated without being bent
  • FIG. 6B is a schematic diagram showing the menu selection screen when the operation knob is rotated while being bent with a small gripping amount
  • FIG. 6C is a schematic diagram showing a menu selection screen when the operation knob is rotated while being flexed by a large grip amount
  • 7A is a block diagram showing a hardware configuration that implements the functions of the operation input device according to Embodiment 1, and FIG.
  • FIG. 7B shows a hardware configuration that implements the functions of the operation input device according to Embodiment 1.
  • FIG. 3 is a block diagram showing a hardware configuration;
  • FIG. FIG. 11 is a block diagram showing a configuration example of an information processing apparatus according to Embodiment 2;
  • FIG. 9 is a front view showing a configuration example of an operation input device according to Embodiment 2;
  • FIG. 10 is a screen diagram showing a display example when CD playback processing is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and an amount of gripping the operation knob;
  • FIG. 3 is a block diagram showing a hardware configuration
  • FIG. 11 is a block diagram showing a configuration example of an information processing apparatus according to Embodiment 2
  • FIG. 9 is a front view showing a configuration example of an operation input device according to Embodiment 2
  • FIG. 10 is a screen diagram showing a display example when CD playback processing is performed by an operation combining a sliding
  • FIG. 10 is a screen diagram showing a display example when a process of rotating a map around the vehicle is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob.
  • FIG. 10 is a screen diagram showing a display example when a process of changing the position of the vehicle on the route is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob.
  • 7 is a graph showing the relationship between changes in the adjustment amount according to the gripping amount of the operation knob, and changes in vibration intensity and frequency according to the adjustment amount.
  • FIG. 7 is a graph showing the relationship between changes in the adjustment amount according to the grip amount of the operation knob and changes in vibration strength according to the adjustment amount.
  • 7 is a graph showing the relationship between changes in the amount of adjustment according to the amount of gripping the operation knob and changes in the number of vibrations according to the amount of adjustment.
  • 7 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob and the change in the frequency of vibration according to the adjustment amount.
  • 7 is a graph showing the relationship between changes in adjustment amount according to the gripping amount of the operation knob and changes in vibration application time according to the adjustment amount.
  • FIG. 11 is a screen diagram showing switching of an operation target according to the gripping amount of the operation knob on the audio playback screen;
  • FIG. 11 is a screen diagram showing switching of an operation target according to the gripping amount of the operation knob on the audio playback screen;
  • FIG. 10 is a screen diagram showing a display example (1) when a process of selecting item information from the item selection screen is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob; .
  • FIG. 10 is a screen diagram showing a display example (2) when a process of selecting item information from the item selection screen is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob; .
  • FIG. 11 is a screen diagram showing a display example (3) when a process of selecting item information from the item selection screen is performed by an operation combining the operation of sliding the operation knob, the operation of bending the operation knob, and the gripping amount of the operation knob; .
  • FIG. 10 is a screen diagram showing a display example when a process of selecting item information from the item selection screen is performed by an operation combining a rotation operation of the operation knob, an operation of bending the operation knob, and a grip
  • FIG. 1 is a block diagram showing a configuration example of an information processing apparatus 1 according to Embodiment 1.
  • an information processing device 1 executes a function corresponding to an operation input received by an operation input device 2 .
  • the information processing device 1 is a navigation device, an air conditioner, or an audio device.
  • the information processing device 1 includes an operation input device 2, a touch panel 3, a liquid crystal display (hereinafter referred to as LCD) 4, and a function execution unit 5, as shown in FIG.
  • LCD liquid crystal display
  • the touch panel 3 is a capacitive touch panel that detects a change in capacitance on the panel surface, and generates operation information from the position information of the portion where the change in capacitance is detected on the panel surface and the pressing information on the panel surface. Output to the unit 22 .
  • the LCD 4 is a display section provided with the touch panel 3 . For example, the LCD 4 displays video information output from the operation input device 2 . If the information processing device 1 is a navigation device having an LCD 4, the LCD 4 is installed, for example, in the center of the front seat in the vehicle.
  • the function execution unit 5 executes a function corresponding to the operation indicated by the operation information.
  • the operation input device 2 is a device that receives an operation input using an operator 21 provided on the touch surface of the touch panel 3, and includes an operator 21, an operation information generator 22, and a display processor 23.
  • the operator 21 includes an operation knob 211 and a detector 212 .
  • FIG. 2A is a perspective view showing the manipulator 21.
  • FIG. The operation knob 211 is a dial-shaped member, as shown in FIG. 2A.
  • the operation knob 211 is rotatably provided on the touch surface of the touch panel 3, and is gripped and operated by the user's hand. Further, the operation knob 211 is made of a conductive material.
  • FIG. 2B is a configuration diagram showing the internal configuration of the manipulator 21.
  • the operation knob 211 includes an outer frame portion 211A and an inner frame portion 211B arranged inside the outer frame portion 211A.
  • the outer frame portion 211A is configured by a conductive member having flexibility that bends according to the gripping force of the user.
  • the switches 212a, 212b, and 212c are the detection unit 212 that detects the grip amount of gripping and bending the operation knob 211 as a pressing force.
  • the switches 212a, 212b and 212c incorporate pressure sensors for detecting pressing forces.
  • the switches 212a, 212b and 212c are provided between the inner wall surface of the outer frame portion 211A and the outer wall surface of the inner frame portion 211B.
  • the switches 212a, 212b, and 212c are evenly arranged in the outer diameter direction of the inner frame portion 211B, with the button portion facing the outer frame portion 211A side and the switch body portion facing the inner frame portion 211B side. . Accordingly, no matter which portion of the outer frame portion 211A of the operation knob 211 is pressed, any one of the switches 212a, 212b, and 212c can detect the gripping amount for bending the outer frame portion 211A.
  • the operation knob 211 that has detected the amount of grip outputs a detection signal of the amount of grip to the operation information generator 22 .
  • the operation knob 211 is arranged on the touch surface of the touch panel 3 .
  • contact portions 213a, 213b and 213c are provided on the bottom surface of the outer frame portion 211A.
  • the contact portions 213 a , 213 b and 213 c are made of a conductive material, and are in contact with the touch surface of the touch panel 3 while conducting with the operation knob 211 .
  • the contact portions 213a, 213b, and 213c move on the touch surface of the touch panel 3 while being in contact with the touch surface.
  • the touch panel 3 detects the rotational trajectory of the contact portions 213a, 213b, and 213c due to the rotation of the operation knob 211, and outputs the detected rotational trajectory to the operation information generating section 22 as a rotational operation amount in the rotational direction.
  • the operation input device 2 receives a rotation operation of the operation knob 211 when the operation information generation unit 22 inputs a signal indicating the amount of rotation operation.
  • the operation knob 211 shown in FIGS. 2A and 2B has an annular shape with a hole in the center. It may be in shape. Also, although the outer frame portion 211A has three contact portions 213a, 213b, and 213c provided on the bottom surface, the number of contact portions provided on the outer frame portion 211A may be two or more. The position at which the contact portion is provided may be arbitrary. Furthermore, if the operation knob 211 has a structure that allows conduction between the user's hand, the operation knob 211, and the contact portions 213a, 213b, and 213c, the outer frame portion 211A is made of a member other than a conductive member. may be
  • FIG. 3A is a configuration diagram showing the internal configuration of the manipulator 21 before the operation of bending the manipulation knob 211 by gripping it.
  • FIG. 3B is a configuration diagram showing the internal configuration of the manipulator 21 in which the manipulation knob 211 is bent by being gripped.
  • none of the switches 212a, 212b, and 212c detect the grip amount unless the outer frame portion 211A is bent.
  • a triangle T1 formed by connecting the contact portion 213a, the contact portion 213b, and the contact portion 213c in order with a dashed imaginary line is, for example, an equilateral triangle.
  • the outer frame portion 211A bends in the arrow A1 direction and the arrow A2 direction, as shown in FIG. 3B.
  • the triangle T2 formed by connecting the contact portion 213a, the contact portion 213b and the contact portion 213c in order with a dashed virtual line deforms into a triangle other than an equilateral triangle.
  • at least one of switches 212a, 212b and 212c detects the grip amount. For example, as shown in FIG. 3B, the inner wall of the outer frame portion 211A pushed in the arrow A1 direction presses the switch 212c, whereby the switch 212c detects the amount of grip.
  • the operation input device 2 receives information indicating the gripping amount for bending the operation knob 211 by acquiring the gripping amount detection signal output from the detection unit 212 .
  • the operation information generator 22 generates operation information indicating an operation using the manipulator 21 .
  • the operation information generation unit 22 generates operation information according to the grip amount of the operation knob 211 detected by any one of the switches 212 a , 212 b and 212 c and outputs the generated operation information to the function execution unit 5 .
  • the function execution unit 5 receives the operation information generated by the operation information generation unit 22 and executes the function corresponding to the operation indicated by the input operation information. Display information related to the functions executed by the function execution unit 5 is output to the display processing unit 23 .
  • the display processing unit 23 displays a screen corresponding to the function executed by the function executing unit 5 on the LCD 4 provided with the touch panel 3 . For example, when the function executing section 5 executes the CD playing function, the display processing section 23 displays the CD playing screen on the LCD 4 .
  • the touch panel 3 may be used to detect the grip amount. As shown in FIGS. 3A and 3B, due to the bending of the operation knob 211, a triangle T1 formed by connecting the contact portions 213a, 213b, and 213c in order with a virtual line is transformed into a triangle T2.
  • the touch panel 3 can detect the deformation of the triangle T1 as a change in the position of the contact portion on the touch surface. That is, the touch panel 3 can detect the grip amount of the operation knob 211 based on the amount of change in the position of the contact portion on the touch surface. In this case, the touch panel 3 functions as a detection unit that detects the grip amount of gripping and bending the operation knob 211 .
  • FIG. 4 is a flowchart showing the operation input method according to Embodiment 1, showing the operation of the operation input device 2.
  • the operation information generator 22 determines whether or not an operation using the operator 21 has been performed (step ST1). For example, when the operation information generation unit 22 acquires detection information of an operation using the operation element 21 from at least one of the touch panel 3 and the detection unit 212 and determines that the acquired detection information is valid, the operation information generation unit 22 21 has been performed.
  • the operation information generation unit 22 determines that the detection information of the rotation operation of the operation knob 211 is valid, and determines that the rotation operation amount is valid. If the manipulated variable is less than the threshold, it is determined that the detection information is invalid. Further, when the grip amount detected by any of the switches 212a, 212b, and 212c is equal to or greater than the threshold value, the operation information generation unit 22 determines that the detection information of the operation to bend the operation knob 211 is valid, If the grip amount is less than the threshold, it is determined that the detection information is invalid.
  • step ST1 When determining that an operation using the manipulator 21 has not been performed (step ST1; NO), the operation information generation unit 22 repeats the determination of step ST1 until an operation using the manipulator 21 is performed. When it is determined that an operation using the manipulator 21 has been performed (step ST1; YES), the operation information generation unit 22 determines whether or not the manipulation using the manipulator 21 is an operation to bend the manipulation knob 211. (step ST2).
  • the operation information generation unit 22 determines that the operation using the operation element 21 is an operation to bend the operation knob 211. Further, when the valid detection information is acquired from the touch panel 3, the operation information generation unit 22 determines that the operation using the operation knob 21 is not the operation to bend the operation knob 211, and the operation using the operation element 21 It is determined that it is a rotation operation of
  • step ST2 When the operation information generating unit 22 determines that the operation using the manipulator 21 is an operation to bend the operation knob 211 (step ST2; YES), the operation information including the grip amount by which the operation knob 211 is bent by gripping. Information is generated (step ST3). Further, when it is determined that the operation using the manipulator 21 is not the operation of bending the operation knob 211 (step ST2; NO), the operation information generation unit 22 performs the operation using the operation knob 211 without bending it. Operation information is generated (step ST4).
  • the operation information includes, for example, the XY coordinates of the operation knob 211 calculated based on the position coordinates of the contact portions 213a to 213c of the operation knob 211 on the touch surface, the rotation direction and amount of rotation of the operation knob 211, and the switches 212a to 213c.
  • 212c includes information indicating the grip amount detected.
  • the operation information generation unit 22 generates operation information using valid detection information acquired from the time when valid detection information is first acquired until the reference time for determining one operation has passed. For example, if the detection information acquired within the reference time is the detection information of an operation of bending the operation knob 211, the operation information generation unit 22 moves the operation knob 211 once, similar to a mouse click operation. Operation information indicating an operation of selecting target information by bending is generated.
  • the operation information generation unit 22 performs By bending the operation knob 211 twice at short intervals, operation information indicating an operation of selecting target information is generated. If the detection information acquired within the reference time is the detection information of an operation of bending the operation knob 211 three times at short intervals, the operation information generation unit 22 generates the operation knob in the same manner as the triple-click operation of the mouse. By bending 211 three times at short intervals, operation information indicating an operation for selecting target information is generated.
  • the operation information generation unit 22 If the detection information acquired within the reference time is the detection information of an operation of bending the operation knob 211 four times or more at short intervals, the operation information generation unit 22 generates an operation similar to a long-click operation of the mouse. By flexing the knob 211 four times or more at short intervals, operation information indicating an operation for selecting target information is generated. Further, when the detection information acquired within the reference time is a rotation operation of the operation knob 211 in a flexed state, the operation information generation unit 22 generates an operation similar to a drag-and-drop operation using a mouse, for example. , generates operation information indicating an operation to move the target information on the display screen.
  • the operation information generation unit 22 outputs the generated operation information to the function execution unit 5 (step ST5).
  • the function execution unit 5 acquires operation information from the operation information generation unit 22, executes a function corresponding to the operation indicated by the acquired operation information, and transmits display information corresponding to the function being executed to the display processing unit 23. Output.
  • the display processing unit 23 displays display information on the LCD 4 .
  • the LCD 4 displays a map screen, a camera screen, a menu screen, or an audio playback screen.
  • Function execution unit 5 outputs display information indicating operation details such as the XY coordinates of operation knob 211 , the rotation direction and amount of rotation of operation knob 211 included in the operation information to display processing unit 23 .
  • the display processing unit 23 reflects the content of the operation based on the display information in the screen display of the function corresponding to the operation indicated by the operation information.
  • the operation information generation unit 22 determines whether or not the gripping amount of the operation knob 211 has been changed (step ST6). When the amount of grip detected by the detection unit 212 changes from the amount of grip included in the operation information generated in the previous step, the operation information generation unit 22 determines that the amount of grip of the operation knob 211 has changed. If the gripping amount of the operation knob 211 is changed (step ST6; YES), the operation information generator 22 returns to the process of step ST3 and generates the operation information including the gripping amount after the change. If the gripping amount of the operation knob 211 has not been changed (step ST6; NO), the process of FIG. 4 ends.
  • FIG. 5A is a schematic diagram showing the amount of change in the adjustment amount when the operation knob 211 is rotated without bending.
  • FIG. 5B is a schematic diagram showing the amount of change in the adjustment amount when the operation knob 211 is flexed with a small grasp amount and rotated.
  • FIG. 5C is a schematic diagram showing a change in the amount of adjustment when the operation knob 211 is flexed by a large amount of grip and rotated.
  • the adjustment amount corresponding to the amount of rotation of the operation knob 211 is represented by scales.
  • the operation input device 2 generates operation information for increasing the adjustment amount of the adjustment function corresponding to the operation of bending the operation knob 211 in accordance with an increase in the gripping amount of the operation knob 211 .
  • the adjustment amount increases by one scale from the initial value, as indicated by an arrow B1.
  • the adjustment amount increases by two scales from the initial value as indicated by the arrow B2.
  • the adjustment amount is , is increased by 4 scales from the initial value. In this way, the operation input device 2 can change the adjustment amount in the adjustment function executed by the function execution unit 5 by a natural operation of bending the operation knob 211 .
  • FIG. 6A is a schematic diagram showing the menu selection screen when the operation knob 211 is rotated without bending.
  • FIG. 6B is a schematic diagram showing a menu selection screen when the operation knob 211 is rotated while being flexed by a small gripping amount.
  • FIG. 6C is a schematic diagram showing a menu selection screen when the operation knob 211 is bent while being rotated by a large grasp amount.
  • menu selection screen 30 is a screen for selecting target menu information from a list in which a plurality of item information (menu information) are registered, and is displayed on LCD 4 provided with touch panel 3. be done.
  • the operation input device 2 generates operation information for increasing the amount of movement of the cursor for selecting menu information from the menu selection screen 30 in accordance with an increase in the grip amount of the operation knob 211 .
  • the menu selection screen 30 before the operation knob 211 is gripped has the cursor at the position of the menu information C and the menu information C is a selection candidate, as shown in FIG. 6A. From this state, when the operation knob 211 bent by the first holding amount is rotated by the rotation amount R1, the cursor is positioned at the position of the menu information D adjacent to the menu information C, as indicated by the arrow C1 in FIG. 6B. The display order of menu information C and menu information D is changed on the menu selection screen 30 .
  • the operation input device 2 can perform complicated processing such as changing the display order of menu information on the menu selection screen 30 by a natural operation of bending the operation knob 211 .
  • the operation input device 2 includes a processing circuit for executing the processing from step ST1 to step ST6 shown in FIG.
  • the processing circuit may be dedicated hardware, or may be a CPU that executes a program stored in memory.
  • FIG. 7A is a block diagram showing the hardware configuration that implements the functions of the operation input device 2.
  • FIG. 7B is a block diagram showing a hardware configuration for executing software realizing the functions of the operation input device 2.
  • the input interface 100 includes detection information output from the detection unit 212 included in the touch panel 3 or the operator 21 to the operation information generation unit 22, or output from the function execution unit 5 to the display processing unit 23. It is an interface that relays display information.
  • the output interface 101 is an interface that relays operation information output from the operation information generation unit 22 to the function execution unit 5 .
  • the processing circuit 102 may be, for example, a single circuit, multiple circuits, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or any of these. A combination of is applicable.
  • the functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 may be realized by separate processing circuits, or these functions may be collectively realized by one processing circuit.
  • the processing circuit is the processor 103 shown in FIG. 5B
  • the functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 are realized by software, firmware, or a combination of software and firmware. Note that software or firmware is written as a program and stored in the memory 104 .
  • the processor 103 implements the functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 by reading and executing the programs stored in the memory 104 .
  • the operation input device 2 includes a memory 104 for storing a program that, when executed by the processor 103, results in the processing of steps ST1 to ST6 shown in FIG. These programs cause the computer to execute the procedures or methods of the processing performed by the operation information generating section 22 and the display processing section 23 .
  • the memory 104 may be a computer-readable storage medium storing a program for causing a computer to function as the operation information generating section 22 and the display processing section 23.
  • the memory 104 corresponds to, for example, nonvolatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, EEPROM, magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD, and the like.
  • a part of the functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 may be realized by dedicated hardware, and a part may be realized by software or firmware.
  • the operation information generation unit 22 realizes its functions by the processing circuit 102, which is dedicated hardware
  • the display processing unit 23 implements its functions by the processor 103 reading and executing a program stored in the memory 104.
  • the processing circuitry may implement the above functions in hardware, software, firmware, or a combination thereof.
  • the operation input device 2 includes an operation knob provided rotatably on the touch panel and an operation element having a detection unit that detects the amount of gripping and bending the operation knob, an operation information generation unit that generates operation information indicating an operation using the operator and outputs the operation information to a function execution unit that executes a function corresponding to the operation, wherein the operation information generation unit is detected by the detection unit; Operation information is generated according to the amount of gripping that bends the operation knob.
  • a function to be executed can be designated by a natural operation of bending the operation knob 211 by changing the gripping force.
  • the operation input device 2 can perform an operation corresponding to a desired function regardless of the number of fingers holding the operator.
  • the information processing apparatus 1 including the operation input device 2 reduces the possibility of erroneously executing a function different from the intended function.
  • the operation information generation unit 22 generates operation information for changing the adjustment amount of the adjustment function executed by the function execution unit 5 according to the amount of gripping and bending the operation knob 211. to generate Thereby, the operation input device 2 can change the adjustment amount in the adjustment function executed by the function execution unit 5 by a natural operation of bending the operation knob 211 .
  • FIG. 8 is a block diagram showing a configuration example of an information processing device 1A according to the second embodiment.
  • the information processing device 1A executes a function corresponding to the operation input received by the operation input device 2A.
  • the information processing device 1A is a navigation device, an air conditioner, or an audio device.
  • the information processing apparatus 1A includes an operation input device 2A, a touch panel 3, an LCD 4, and a function execution section 5, as shown in FIG.
  • the operation input device 2A is a device that receives an operation input using the operator 21A provided on the touch surface of the touch panel 3, and includes the operator 21A, an operation information generator 22, and a display processor 23.
  • 21 A of manipulators are provided with the operation knob 211, the detection part 212, and the vibration part 213.
  • the vibrating section 213 is a vibrator that vibrates the operation knob 211 .
  • the vibration section 213 vibrates the operation knob 211 according to the adjustment amount of the adjustment function executed by the function execution section 5 .
  • the adjustment amount of the adjustment function executed by the function execution unit 5 changes according to the gripping amount detected by the detection unit 212 . Therefore, the vibrating section 213 vibrates according to the gripping amount detected by the detecting section 212 .
  • the vibrating section 213 changes at least one of the number of times of vibration, the strength of vibration, the frequency of vibration, and the application time of vibration according to the grip amount of the operation knob 211 .
  • FIG. 9 is a front view showing a configuration example of the operation input device 2A.
  • the operation knob 211 included in the operation input device 2A is provided so as to be slidably operated in a pendulum shape on the touch surface of the touch panel 3 .
  • the LCD 4 is provided with an arm 7 .
  • One end of the arm 7 is rotatably supported on the back side of the LCD 4 , and the other end is bent toward the front side of the LCD 4 .
  • An operation knob 211 is connected to the end portion of the arm 7 bent toward the front side of the LCD 4 .
  • the operation knob 211 is slidable in the direction of arrow B on the touch surface of the touch panel 3 with one end of the arm 7 as the center of rotation. Further, the user can rotate the operating knob 211 while sliding the gripped operating knob 211 in the arrow B direction. A slide operation of the operation knob 211 is detected by the touch panel 3 . As shown in FIG. 9, a spring 7A and a spring 7B are attached to the arm 7 on the rear side of the LCD 4. As shown in FIG. When the user releases the operation knob 211, the arm 7 returns to a position where the load of the spring 7A and the load of the spring 7B are balanced, and the operation knob 211 returns to the central position of the slide movement locus.
  • the mechanism for returning the operation knob 211 to the central position is not limited to the springs 7A and 7B, and magnets, dampers, or the like may be used.
  • the operation knob 211 may return to the central position by the weight of the arm 7 and the operation knob 211 .
  • FIG. 10 is a screen diagram showing a display example when CD playback processing is performed by a combination of the operation of sliding the operation knob 211, the operation of bending the operation knob 211, and the amount of gripping the operation knob 211.
  • FIG. A CD playback screen 31 is a screen for selecting a track (T), volume adjustment (V) and playback speed adjustment (S), and is displayed on the LCD 4 .
  • the function execution unit 5 changes the adjustment amount of the adjustment item on the CD playback screen 31 according to the rotation operation of the operation knob 211 , and selects the adjustment item on the CD playback screen 31 according to the slide operation of the operation knob 211 .
  • the display processing unit 23 displays on the LCD 4 a CD playback screen 31 on which adjustment amounts of adjustment items are changed and adjustment items are selected.
  • a slide bar image 32 on the CD playback screen 31 is an image indicating the current sound volume.
  • the screen shown on the side (A) of FIG. 10 with the dashed line as the boundary is the CD playback screen when the volume adjustment amount in the volume adjustment (V) is changed according to the amount of gripping and bending the operation knob 211. 31 is shown. Also, the screen shown on the (B) side of the dashed line is displayed when the CD playback screen 31 shown on the (A) side is displayed on the LCD 4, the operation knob 211 is released, and the operation knob 211 is slid. It shows the CD playback screen 31 when returning to the center position of the movement locus.
  • the CD playback screen 31 shown in the center of side (A) shows the screen when the operation knob 211 at the center position of the slide movement trajectory is not being rotated. From this state, when the operation knob 211 bent by the first grip amount is rotated by the first amount in the rotation direction D1, the slide bar image 32 slides in the direction of the arrow E1 by the first amount of movement, Volume is set to minimum. Note that the vibrating section 213 may vibrate the operation knob 211 when the volume is set to the minimum value or the maximum value.
  • the operation knob 211 bent by the second gripping amount larger than the first gripping amount is rotated by the first rotation amount in the rotation direction D2.
  • the slide bar image 32 slides in the direction of the arrow E2 by a second amount of movement larger than the first amount of movement, and the volume is increased.
  • the operation input device 2A can change the adjustment amount in the adjustment function executed by the function executing section 5 according to the gripping amount by which the operation knob 211 is bent.
  • the display processing unit 23 changes the track from the state in which the volume adjustment (V) is selected on the CD playback screen 31. (T) is selected. Further, when the operation knob 211 restored from the bending is slid in the direction of the arrow F2 from the center position of the slide movement locus, the display processing unit 23 displays the CD playback screen 31 in the state where the volume adjustment (V) is selected. to the state where the reproduction speed adjustment (S) is selected.
  • the operation input device 2A can change the adjustment item by a natural operation of sliding the operation knob 211 .
  • FIG. 11 shows a display example when a process of rotating the map around the vehicle is performed by an operation combining the operation of sliding the operation knob 211, the operation of bending the operation knob 211, and the gripping amount of the operation knob 211.
  • FIG. 11 is a screen figure.
  • the display processing unit 23 displays the map screen 33 on the LCD 4 .
  • the map screen 33 displays an image 33A showing the current position of the vehicle and a route 33B.
  • the display processing unit 23 rotates the map screen 33 in accordance with the gripping amount for bending the operation knob 211 and the rotation operation of the operation knob 211 .
  • Each screen shown on the (A) side of the dashed line in FIG. 11 shows the map screen 33 when the operation knob 211 is gripped by the first gripping amount and rotated while being deflected.
  • the screen drawn on the (B) side of the dashed line shows the map screen 33 when the map screen 33 is gripped with a second gripping amount larger than the first gripping amount and rotated while being bent.
  • the display processing unit 23 rotates the map screen 33 by the rotation amount H1, as shown in FIG. Further, when the operation knob 211 bent by the first grip amount is rotated in the direction of the arrow G2, the display processing unit 23 rotates the map screen 33 by the rotation amount H2.
  • the amount of rotation H1 and the amount of rotation H2 are the same value.
  • the operation input device 2A can change the orientation of the map by a natural operation of bending and rotating the operation knob 211 .
  • the display processing unit 23 causes the map screen 33 to be rotated by the amount of rotation I1 larger than the amount of rotation H1, as shown in FIG. rotate. Further, when the operation knob 211 bent by the second gripping amount is rotated in the direction of the arrow G2, the display processing unit 23 rotates the map screen 33 by the amount of rotation I2 larger than the amount of rotation H2. In this manner, the operation input device 2A can change the amount of change in the orientation of the map according to the amount by which the operation knob 211 is gripped.
  • FIG. 12 shows an example of a display when a process of changing the position of the vehicle on the route is performed by an operation combining the operation of sliding the operation knob 211, the operation of bending the operation knob 211, and the amount of gripping the operation knob 211. It is a screen diagram showing .
  • the display processing unit 23 displays the map screen 33 on the LCD 4 .
  • the map screen 33 displays an image 33A showing the current position of the vehicle and a route 33B.
  • the display processing unit 23 slides the map screen 33 in accordance with the gripping amount for bending the operation knob 211 and the sliding operation of the operation knob 211 .
  • Each screen shown on the (A) side of the dashed line in FIG. 12 shows the map screen 33 when the operation knob 211 is gripped by the first gripping amount and slid while being bent.
  • the screen drawn on the (B) side of the dashed line shows the map screen 33 when the slide operation is performed while holding and bending with a second holding amount larger than the first holding amount.
  • the display processing unit 23 slides the map screen 33 by the movement amount K1, as shown in FIG. Further, when the operation knob 211 bent by the first grip amount is slid in the direction of arrow J2, the display processing unit 23 slides the map screen 33 by the movement amount K2.
  • the movement amount K1 and the movement amount K2 are the same value.
  • the operation input device 2A can slide the map screen by a natural operation of bending and sliding the operation knob 211 .
  • the display processing unit 23 moves the map screen 33 to the position of the movement amount L1 larger than the movement amount K1, as shown in FIG. to slide. Further, when the operation knob 211 bent by the second grip amount is slid in the direction of arrow J2, the display processing unit 23 slides the map screen 33 by a movement amount L2 larger than the movement amount K2. In this manner, the operation input device 2A can change the amount of slide movement of the map screen according to the grip amount of the operation knob 211 .
  • FIG. 13 is a graph showing the relationship between changes in the amount of adjustment according to the amount of gripping of the operation knob 211 and changes in the strength and frequency of vibration according to the amount of adjustment.
  • the upper graph in FIG. 13 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 .
  • the adjustment amount is volume or playback speed.
  • the adjustment amount may be the movement amount of the cursor on the selection screen.
  • the straight line M1 indicates the gripping amount of the operation knob 211 that is linearly increased.
  • a straight line M2 indicates the grip amount of the operation knob 211 that is linearly decreased.
  • the lower graph in FIG. 13 shows changes in the intensity of vibration according to the gripping amount of the operation knob 211 .
  • the strength of vibration is the strength of vibration applied to the operation knob 211 by the vibrating section 213 .
  • the vibrating section 213 applies vibration to the operation knob 211 with a strength corresponding to the change in the adjustment amount.
  • a change in the adjustment amount may be a stepwise change, a linear change, or a non-linear change.
  • the vibrating section 213 may apply vibration intensity to the operation knob 211 according to the changed adjustment amount, or may vibrate the operation knob 211 in a vibration pattern corresponding to the change direction (decrease or increase direction) of the adjustment amount. Vibration may be given.
  • the vibration pattern may be, for example, a combination of the number of vibrations, frequency and application time, or any one of these patterns.
  • the vibrating section 213 does not vibrate the operation knob 211 when the operation knob 211 is not gripped.
  • the vibrating section 213 vibrates the operation knob 211 with a strength corresponding to the vibration application condition (1).
  • Vibration application condition (1) is, for example, as shown in the lower graph in FIG. is applied to the operation knob 211 twice.
  • Vibration applying condition (2) is, for example, as shown in the lower graph in FIG. is applied to the operation knob 211 twice.
  • Vibration applying condition (3) is, for example, as shown in the lower graph in FIG. is applied to the operation knob 211 twice.
  • Vibration applying condition (4) is, for example, as shown in the lower graph in FIG. is applied to the operation knob 211 twice.
  • Vibration application condition (5) is, for example, as shown in the lower graph in FIG. This is a condition for applying vibration to the operation knob 211 once.
  • Vibration applying condition (6) is, for example, as shown in the lower graph in FIG. This is a condition for applying vibration to the operation knob 211 once.
  • Vibration application condition (7) is, for example, as shown in the lower graph in FIG. This is a condition for applying vibration to the operation knob 211 once.
  • the vibrating section 213 does not vibrate the operation knob 211 according to the vibration application condition (8). Under the vibration applying condition (8), the vibrating section 213 does not apply vibration to the operation knob 211 .
  • FIG. 14 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob 211 and the change in the strength of vibration according to the adjustment amount.
  • the upper graph in FIG. 14 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 .
  • a straight line N indicates the grip amount of the operation knob 211 that is linearly increased.
  • the lower graph in FIG. 14 shows changes in the intensity of vibration according to the gripping amount of the operation knob 211 .
  • the vibrating section 213 does not vibrate the operation knob 211 when the adjustment amount is less than the threshold Th1. Further, when the adjustment amount is equal to the threshold value Th1, the vibrating section 213 applies weak vibration equal to or greater than the threshold value Th to the operation knob 211 . When the adjustment amount is equal to the threshold Th2, which is larger than the threshold Th1, the vibrating section 213 vibrates the operation knob 211 with moderate strength. When the adjustment amount is equal to the threshold Th3, which is larger than the threshold Th2, the vibrating section 213 vibrates the operation knob 211 with a stronger vibration (strong) than medium strength.
  • FIG. 15 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob 211 and the change in the number of vibrations according to the adjustment amount.
  • the upper graph in FIG. 15 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 .
  • a straight line N indicates the grip amount of the operation knob 211 that is linearly increased.
  • the lower graph in FIG. 15 shows changes in the intensity of vibration according to the gripping amount of the operation knob 211 .
  • the vibrating section 213 does not vibrate the operation knob 211 when the adjustment amount is less than the threshold Th1. Further, when the adjustment amount is equal to the threshold value Th1, the vibrating section 213 vibrates the operation knob 211 once with a strength equal to or greater than the threshold value Th. When the adjustment amount is equal to the threshold Th2, which is larger than the threshold Th1, the vibrating section 213 vibrates the operation knob 211 twice with an intensity equal to or greater than the threshold Th. When the adjustment amount is equal to the threshold Th3, which is larger than the threshold Th2, the vibrating section 213 vibrates the operation knob 211 three times with an intensity equal to or greater than the threshold Th.
  • FIG. 16 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob 211 and the change in the vibration frequency according to the adjustment amount.
  • the upper graph in FIG. 16 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 .
  • a straight line N indicates the grip amount of the operation knob 211 that is linearly increased.
  • the lower graph in FIG. 16 shows changes in the intensity of vibration according to the grip amount of the operation knob 211 .
  • the vibrating section 213 does not vibrate the operation knob 211 when the adjustment amount is less than the threshold Th1. Further, when the adjustment amount is equal to the threshold value Th1, the vibrating section 213 vibrates the operation knob 211 with a strength equal to or greater than the threshold value Th and a frequency of 100 Hz. When the adjustment amount is equal to the threshold Th2, which is larger than the threshold Th1, the vibrating section 213 vibrates the operation knob 211 with an intensity equal to or greater than the threshold Th and a frequency of 200 Hz. When the adjustment amount is equal to the threshold Th3, which is larger than the threshold Th2, the vibrating section 213 vibrates the operation knob 211 with an intensity equal to or greater than the threshold Th and a frequency of 300 Hz.
  • FIG. 17 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob 211 and the change in the vibration application time according to the adjustment amount.
  • the upper graph in FIG. 17 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 .
  • a straight line N indicates the grip amount of the operation knob 211 that is linearly increased.
  • the lower graph in FIG. 17 shows changes in the intensity of vibration according to the grip amount of the operation knob 211 .
  • the vibrating section 213 does not vibrate the operation knob 211 when the adjustment amount is less than the threshold Th1. Further, when the adjustment amount is equal to the threshold value Th1, the vibration unit 213 applies vibration having a strength equal to or greater than the threshold value Th to the operation knob 211 for 200 milliseconds (ms). When the adjustment amount is equal to the threshold Th2, which is larger than the threshold Th1, the vibrating section 213 applies vibration having a strength equal to or greater than the threshold Th to the operation knob 211 for 400 milliseconds (ms). When the adjustment amount is equal to the threshold Th3, which is larger than the threshold Th2, the vibrating section 213 applies vibration having a strength equal to or greater than the threshold Th to the operation knob 211 for 600 milliseconds (ms).
  • FIG. 18 is a screen diagram showing switching of the operation target according to the grip amount of the operation knob 211 on the audio playback screen.
  • Each screen shown in FIG. 18 includes an audio source list 34A and an audio playback screen 34B.
  • the audio source list 34A is a list from which a plurality of audio sources can be selected, and CD, radio (FM or AM), television (TV), etc. are set.
  • the audio playback screen 34B is a screen for playback of the audio source selected from the audio source list 34A.
  • the function execution unit 5 adjusts the volume displayed on the audio playback screen 34B according to the amount of rotation of the operation knob 211.
  • the display processing unit 23 displays on the LCD 4 an audio playback screen 34B in which the volume adjustment (V) is active. Further, when the operation knob 211 flexed with the grip amount “small” is rotated by the rotation amount K1, the function execution unit 5 adjusts the playback speed displayed on the audio playback screen 34B according to the rotation amount of the operation knob 211. Adjust (S).
  • the display processing unit 23 displays on the LCD 4 an audio playback screen 34B in which playback speed adjustment (S) is active, as shown on the right side of FIG.
  • the function execution unit 5 reproduces the track (T) displayed on the audio playback screen 34B according to the rotation amount of the operation knob 211. selection (song selection).
  • the display processing unit 23 displays on the LCD 4 an audio playback screen 34B in which the track (T) is active, as shown in the center of FIG.
  • the function execution unit 5 selects an audio source from the audio source list 34A according to the rotation amount of the operation knob 211 .
  • the display processing unit 23 displays an audio source list 34A in which audio source selection is active on the LCD 4, as shown on the left side of FIG.
  • the operation input device 2A can perform audio reproduction by a natural operation of changing the grip amount of the operation knob 211 that rotates.
  • FIG. 19 shows a display example (1) when a process of selecting item information from the item selection screen is performed by an operation combining the operation of sliding the operation knob 211, the operation of bending the operation knob 211, and the amount of grip of the operation knob 211. It is a screen diagram showing .
  • the menu selection screen shown in FIG. 19 is an item selection screen for selecting target menu information from a plurality of menu information, and is displayed on LCD 4 provided with touch panel 3 .
  • a first list 35A and a second list 35B are displayed on the menu selection screen.
  • the first list 35A is a list in which a plurality of selection candidates of menu information are displayed side by side.
  • the second list 35B is a list in which a plurality of pieces of menu information in the first list 35A are displayed vertically.
  • the menu selection screen shown on the (A) side of FIG. 19 with the dashed line as the boundary shows the menu selection screen when the operation knob 211 bent by the first gripping amount is slid.
  • the menu selection screen shown on the (B) side of the dashed line shows the menu selection screen when the operation knob 211 is slid while being bent by the second gripping amount larger than the first gripping amount.
  • the function execution unit 5 selects menu information in the first list 8A and the second list 8B according to the slide operation of the operation knob 211 that is being bent. For example, in the menu selection screen shown in the center of (A) side and (B) side, menu information D is selected in the first list 35A and the second list 35B. Menu information D is menu information displayed at the central position in the first list 35A and the second list 35B.
  • the function execution unit 5 moves the first list 35A and the second list 35A according to the slide movement amount of the operation knob 211.
  • the display processing unit 23 displays on the LCD 4 the first list 35A and the second list 35B in which the menu information A is selected.
  • the function executing unit 5 retrieves the menu information in the first list 35A according to the slide movement amount of the operation knob 211. Select F and select menu information F in the second list 35B accordingly.
  • the display processing unit 23 displays on the LCD 4 the first list 35A and the second list 35B in which the menu information F is selected.
  • the display processing unit 23 displays the previously selected menu information according to the slide movement amount of the operation knob 211.
  • the display position of D is moved to the top (leftmost) of the first list 35A and moved to the top (uppermost) of the second list 35B.
  • the display processing unit 23 displays the previously selected menu information according to the slide movement amount of the operation knob 211.
  • the display position of D is moved to the end (rightmost side) of the first list 35A and to the end (lowermost side) of the second list 35B.
  • the operation input device 2A displays the menu information selected by the slide operation of the operation knob 211 at the center position of the list by the natural operation of changing the gripping amount of bending the operation knob 211 . Thereby, the user can accurately visually recognize the menu information selected by the slide operation of the operation knob 211 .
  • FIG. 20 shows a display example (2 ) is a screen view showing.
  • a menu selection screen 36 shown in FIG. 20 is an item selection screen for selecting target menu information from a plurality of item information (menu information), and is displayed on the LCD 4 provided with the touch panel 3 .
  • menu information items A to L are arranged in a 3 ⁇ 4 matrix.
  • the rows of menu information I to L are closest to the operation knob 211, the rows of menu information E to H are next closest, and the rows of menu information A to D are the furthest.
  • the menu selection screen 36 shown on the (A) side of the dashed line in FIG. 20 shows the screen when the operation knob 211 bent by the first gripping amount is slid.
  • a menu selection screen 36 shown on the (B) side of the dashed line shows a screen when the operation knob 211 is slid while being bent by a second gripping amount larger than the first gripping amount.
  • Menu information J is selected from the rows of menu information I to L at the position.
  • the display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information J is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • the function execution unit 5 moves the operation knob 211 closest to the operation knob 211 according to the amount of slide movement P2 of the operation knob 211.
  • Menu information I is selected from the row of menu information I to L at the position.
  • the display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information I is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • Menu information B is selected from the rows of menu information A to D in the position.
  • the display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information B is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • Menu information D is selected from the rows of menu information A to D in the position.
  • the display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information D is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • the operation input device 2A can select target menu information from the menu selection screen 36 by a natural operation of changing the gripping amount of the operation knob 211 for sliding operation.
  • FIG. 21 shows a display example (3 ) is a screen view showing.
  • a menu selection screen 36 shown in FIG. 21 is an item selection screen for selecting target menu information from a plurality of item information (menu information), and is displayed on the LCD 4 provided with the touch panel 3 .
  • menu information items A to L are arranged in a 3 ⁇ 4 matrix.
  • the rows of menu information I to L are closest to the operation knob 211, the rows of menu information E to H are next closest, and the rows of menu information A to D are the furthest.
  • the menu selection screen 36 shown on the (A) side of the dashed line in FIG. 21 shows the screen when the operation knob 211 is bent by the first gripping amount and is slid.
  • a menu selection screen 36 shown on the (B) side of the dashed line shows a screen when the operation knob 211 is slid while being bent by a second gripping amount larger than the first gripping amount.
  • the direction of sliding the operation knob 211 and the direction of moving the cursor for selecting menu information from the menu selection screen 36 are reversed from those shown in FIG.
  • the function execution unit 5 moves the operation knob 211 according to the slide movement amount P1.
  • the cursor is moved from the opposite side (right side) to the direction of the arrow to select menu information K.
  • FIG. The display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information K is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • the function execution unit 5 moves the operation knob 211 closest to the operation knob 211 according to the amount of slide movement P2 of the operation knob 211.
  • the cursor is moved from the opposite side (right side) to the direction of the arrow to select menu information L.
  • the display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information L is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • the function execution unit 5 moves the operation knob 211 according to the slide movement amount P1.
  • the cursor is moved from the opposite side (right side) of the arrow direction to select menu information C.
  • FIG. The display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information C is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • the display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information A is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • the operation input device 2A can select desired menu information from the menu selection screen 36 by such a natural operation of changing the grip amount of the operation knob 211 that slides.
  • FIG. 22 shows a display example when a process of selecting item information from the item selection screen is performed by an operation combining the operation of rotating the operation knob 211, the operation of bending the operation knob 211, and the gripping amount of the operation knob 211.
  • FIG. 21 is an item selection screen for selecting target menu information from a plurality of item information (menu information), and is displayed on the LCD 4 provided with the touch panel 3 .
  • a fan-shaped list 40 having the operation knob 211 as a main part is displayed on the menu selection screen.
  • the wrist 40 has an arcuate wrist portion 40a located farthest from the operation knob 211, an arcuate wrist portion 40b located next to the wrist portion 40a and located furthest from the operation knob 211, and an arcuate wrist portion 40b located at a position closest to the operation knob 211. It has an arcuate wrist portion 40c.
  • the screen shown on the (A) side of the dashed line in FIG. 22 shows the list 40 when the operation knob 211 is flexed by the largest first gripping amount and is rotated. Also, the screen shown on the (B) side of the dashed line shows the list 40 when the operation knob 211 is flexed by the second gripping amount smaller than the first gripping amount and is rotated. Further, the screen shown on the (C) side of the dashed line shows the list 40 when the operation knob 211 is flexed by the third gripping amount smaller than the second gripping amount and is rotated.
  • the function execution unit 5 retrieves the menu information from the list unit 40a according to the amount of rotation R1 of the operation knob 211. select.
  • the display processing section 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list section 40a.
  • the function execution unit 5 retrieves the menu information from the list unit 40a according to the amount of rotation R2 of the operation knob 211. select.
  • the display processing section 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list section 40a.
  • the function execution unit 5 retrieves the menu information from the list unit 40b in accordance with the amount of rotation R1 of the operation knob 211. select.
  • the display processing section 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list section 40b.
  • the function execution unit 5 retrieves the menu information from the list unit 40b in accordance with the amount of rotation R2 of the operation knob 211. select.
  • the display processing section 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list section 40b.
  • the function execution unit 5 retrieves the menu information from the list unit 40c according to the amount of rotation R1 of the operation knob 211. select.
  • the display processing unit 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list portion 40c.
  • the function execution unit 5 retrieves the menu information from the list unit 40c according to the amount of rotation R2 of the operation knob 211. select.
  • the display processing unit 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list portion 40c.
  • the operation input device 2A can select target menu information from the list 40 by a natural operation of changing the gripping amount of the rotating operation knob 211 .
  • the audio playback screen is composed of the list 40
  • a large category such as input source switching is assigned to the list section 40a.
  • Switching songs (tracks) is assigned to the list portion 40b.
  • the list portion 40c is assigned bar movement of the playback position.
  • the number of list parts may be three, two, or four or more.
  • a list expressed not only in two dimensions but also in three dimensions may be used. For example, by sliding and rotating the operating knob 211 and bending the operating knob 211, the adjustment amounts set for the XYZ axes are changed.
  • menu information is arranged.
  • complicated menu information that can be operated while the vehicle is stopped may be arranged in the list section on the passenger seat side.
  • Complicated menu information may include, for example, destination setting, switching processing between a camera imaging screen and a navigation screen, and the like.
  • Simple menu information that can be operated while the vehicle is running may be arranged in the list section on the driver's seat side. For example, menu information such as volume control, air conditioner temperature control, or screen brightness change can be considered.
  • the vibration section 213 vibrates the operation knob 211 according to the adjustment amount of the adjustment function executed by the function execution section 5. Since vibration corresponding to the adjustment amount of the adjustment function is applied to the operation knob 211, it is possible to feed back to the user how much the adjustment amount has been changed by the operation using the manipulator 21A.
  • the operation information generation unit 22 generates operation information for switching the operation target according to the grip amount of gripping and bending the operation knob 211 .
  • the operation input device 2A can perform an operation corresponding to a desired function regardless of the number of fingers holding the operation element 21.
  • the display processing unit 23 changes the display position of the operation target on the screen of the LCD 4 according to the gripping amount of gripping and bending the operation knob 211 .
  • the operation input device 2A can change the display position of the operation target by a natural operation of changing the gripping amount of the operation knob 211 .
  • the operation input device can be used, for example, in a navigation device mounted on a vehicle.
  • 1 Information processing device 1A Information processing device, 2, 2A Operation input device, 3 Touch panel, 4 LCD, 5 Function execution part, 7 Arm, 7A, 7B Spring, 8A, 35A First list, 8B, 35B Second list, 21, 21A operator, 22 operation information generator, 23 display processor, 30, 36 menu selection screen, 31 CD playback screen, 32 slide bar image, 33 map screen, 33A image, 33B route, 34A audio source list , 34B audio playback screen, 40 list, 40a to 40c list part, 41 cursor, 100 input interface, 101 output interface, 102 processing circuit, 103 processor, 104 memory, 211 operation knob, 211A outer frame part, 211B inner frame part, 212 detection unit, 212a to 212c switch, 213 vibration unit, 213a to 213c contact unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

Ce dispositif d'entrée d'opération (2) comprend : un opérateur (21) comprenant un bouton d'actionnement (211) monté rotatif sur un écran tactile (3) et une unité de détection (212) pour détecter la quantité de préhension avec laquelle le bouton d'actionnement (211) est saisi et plié ; et une unité de génération d'informations d'opération (22) qui génère des informations d'opération indiquant une opération utilisant l'opérateur (21) et qui délivre les informations d'opération à une unité d'exécution de fonction (5) qui exécute une fonction correspondant à l'opération. L'unité de génération d'informations d'opération (22) génère les informations d'opération en fonction de la quantité de préhension avec laquelle le bouton d'actionnement (211) est plié, ladite quantité de préhension ayant été détectée par l'unité de détection (212).
PCT/JP2021/015937 2021-04-20 2021-04-20 Dispositif d'entrée d'opération, dispositif de traitement d'informations et procédé d'entrée d'opération WO2022224327A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2021/015937 WO2022224327A1 (fr) 2021-04-20 2021-04-20 Dispositif d'entrée d'opération, dispositif de traitement d'informations et procédé d'entrée d'opération
JP2023515910A JPWO2022224327A1 (fr) 2021-04-20 2021-04-20

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/015937 WO2022224327A1 (fr) 2021-04-20 2021-04-20 Dispositif d'entrée d'opération, dispositif de traitement d'informations et procédé d'entrée d'opération

Publications (1)

Publication Number Publication Date
WO2022224327A1 true WO2022224327A1 (fr) 2022-10-27

Family

ID=83722015

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/015937 WO2022224327A1 (fr) 2021-04-20 2021-04-20 Dispositif d'entrée d'opération, dispositif de traitement d'informations et procédé d'entrée d'opération

Country Status (2)

Country Link
JP (1) JPWO2022224327A1 (fr)
WO (1) WO2022224327A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160294387A1 (en) * 2013-12-18 2016-10-06 Diehl Ako Stiftung & Co. Kg Operating device and appliance having the device
WO2019073538A1 (fr) * 2017-10-11 2019-04-18 三菱電機株式会社 Dispositif d'affichage de type panneau tactile

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5489922A (en) * 1993-12-08 1996-02-06 Hewlett-Packard Company Hand worn remote computer mouse
JP2011003074A (ja) * 2009-06-19 2011-01-06 Sharp Corp 入力方法、入力装置及び電気機器
DE102013008567A1 (de) * 2013-05-17 2014-11-20 Diehl Ako Stiftung & Co. Kg Betätigungselement
US9766705B2 (en) * 2015-06-15 2017-09-19 Motorola Solutions, Inc. Stationary interface control and method for using the same
JP2017138738A (ja) * 2016-02-02 2017-08-10 富士通テン株式会社 入力装置、表示装置および入力装置の制御方法
WO2019073537A1 (fr) * 2017-10-11 2019-04-18 三菱電機株式会社 Dispositif de commande d'affichage, procédé de commande d'affichage, programme de commande d'affichage, et dispositif électronique

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160294387A1 (en) * 2013-12-18 2016-10-06 Diehl Ako Stiftung & Co. Kg Operating device and appliance having the device
WO2019073538A1 (fr) * 2017-10-11 2019-04-18 三菱電機株式会社 Dispositif d'affichage de type panneau tactile

Also Published As

Publication number Publication date
JPWO2022224327A1 (fr) 2022-10-27

Similar Documents

Publication Publication Date Title
US10596908B1 (en) Input apparatus for vehicle
JP5784061B2 (ja) 入力装置、入力方法及び入力プログラム
JP5295328B2 (ja) スクリーンパッドによる入力が可能なユーザインタフェース装置、入力処理方法及びプログラム
US20190064996A1 (en) Method and apparatus for generating a haptic effect in response to flex gesturing
CN101326482B (zh) 可使用触摸和拖操作控制的移动装置和操作方法
CN104881175B (zh) 具有动态触觉效应的多触摸装置
US20110169750A1 (en) Multi-touchpad multi-touch user interface
US7196688B2 (en) Haptic devices using electroactive polymers
JP4447823B2 (ja) 携帯情報機器
US20100194693A1 (en) Electronic apparatus, method and computer program with adaptable user interface environment
JP2018063700A (ja) コンテキスト型圧力検知触覚応答
US9280265B2 (en) Input control device, input control method, and input control program for controlling display target upon receiving input on display screen of display device
CN102129312A (zh) 用于触摸设备的虚拟触摸板
JP5667002B2 (ja) コンピュータの入力装置および携帯式コンピュータ
JP2004070920A (ja) 情報処理プログラム、情報処理プログラムを記録したコンピュータ読み取り可能な記録媒体、情報処理方法、及び情報処理装置
WO1997018543A1 (fr) Appareil et procede permettant un message en retour audible a partir d'un peripherique d'entree
JP2009536385A (ja) スクロール付き多機能キー
JP2015170282A (ja) 車両用操作装置
JP2017045330A (ja) 入力装置および車載装置
KR20040081697A (ko) 마우스식 터치패드
WO2022224327A1 (fr) Dispositif d'entrée d'opération, dispositif de traitement d'informations et procédé d'entrée d'opération
JP2020510254A (ja) 表示情報及び／又はデータの同時多機能操作を可能とするディスプレイを備えたスマートデバイス
CN107450719A (zh) 车辆显示设备
JPH09160713A (ja) 信号変換装置、信号入力装置及び力電気変換装置
JP6210055B2 (ja) 情報処理システム、情報処理装置、情報処理方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21937825

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2023515910

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21937825

Country of ref document: EP

Kind code of ref document: A1