[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2022224327A1 - Operation input device, information processing device and operation input method - Google Patents

Operation input device, information processing device and operation input method Download PDF

Info

Publication number
WO2022224327A1
WO2022224327A1 PCT/JP2021/015937 JP2021015937W WO2022224327A1 WO 2022224327 A1 WO2022224327 A1 WO 2022224327A1 JP 2021015937 W JP2021015937 W JP 2021015937W WO 2022224327 A1 WO2022224327 A1 WO 2022224327A1
Authority
WO
WIPO (PCT)
Prior art keywords
amount
operation knob
information
knob
gripping
Prior art date
Application number
PCT/JP2021/015937
Other languages
French (fr)
Japanese (ja)
Inventor
真也 吉岡
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to PCT/JP2021/015937 priority Critical patent/WO2022224327A1/en
Priority to JP2023515910A priority patent/JPWO2022224327A1/ja
Publication of WO2022224327A1 publication Critical patent/WO2022224327A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0362—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Definitions

  • the present disclosure relates to an operation input device, an information processing device, and an operation input method.
  • Patent Literature 1 describes an operation input device that includes an operator, which is a dial switch or a rotary switch, and a finger sensor that detects the number of fingers holding the operator.
  • the operation input device identifies the number of fingers gripping the operator based on the detection result of the finger sensor, and switches the operation command for the operation input according to the number of fingers gripping the operator.
  • the operation input device described in Patent Document 1 has the problem of poor operability because it is necessary to change the number of fingers that hold the operator when switching to another operation. For example, even if the manipulator is easier to rotate with a larger number of fingers, it may be necessary to unnaturally rotate the manipulator with a smaller number of fingers depending on the function to be executed. Further, if the finger touches the manipulator while rotating the manipulator, a function different from the function to be executed may be erroneously executed.
  • the present disclosure is intended to solve the above problems, and provides an operation input device, an information processing device, and an operation input method that enable an operation corresponding to a desired function to be performed regardless of the number of fingers that hold the operator. for the purpose.
  • An operation input device includes an operation knob provided rotatably on a touch panel, an operation element having a detection unit that detects the amount of gripping and bending the operation knob, and an operation using the operation element. an operation information generation unit that generates operation information and outputs the operation information to a function execution unit that executes a function corresponding to the operation; Generate operation information according to
  • an operator having an operation knob and a detection unit, an operation information generator that generates operation information indicating an operation using the operator, and outputs the operation information to a function execution unit,
  • the information generation unit generates operation information according to the amount of grip of the operation knob that is detected by the detection unit. Since the function to be executed can be specified by a natural operation of bending the operation knob by changing the gripping force, the operation input device according to the present disclosure can perform the desired function regardless of the number of fingers gripping the operation element. Corresponding operations can be performed.
  • FIG. 1 is a block diagram showing a configuration example of an information processing apparatus according to Embodiment 1;
  • FIG. FIG. 2A is a perspective view showing the manipulator, and
  • FIG. 2B is a configuration diagram showing the internal configuration of the manipulator.
  • FIG. 3A is a configuration diagram showing the internal configuration of the manipulator before an operation to bend the operation knob by holding it, and
  • FIG. 5A is a schematic diagram showing the change in the adjustment amount when the operation knob is rotated without being bent, and
  • FIG. 5B is a schematic diagram showing the adjustment amount when the operation knob is bent with a small holding amount and rotated.
  • FIG. 5A is a schematic diagram showing the change in the adjustment amount when the operation knob is rotated without being bent
  • FIG. 5B is a schematic diagram showing the adjustment amount when the operation knob is bent with a small holding amount and rotated.
  • FIG. 5C is a schematic diagram showing the amount of change
  • FIG. 5C is a schematic diagram showing the amount of change in the adjustment amount when the operation knob is flexed and rotated by a large grasp amount
  • FIG. 6A is a schematic diagram showing the menu selection screen when the operation knob is rotated without being bent
  • FIG. 6B is a schematic diagram showing the menu selection screen when the operation knob is rotated while being bent with a small gripping amount
  • FIG. 6C is a schematic diagram showing a menu selection screen when the operation knob is rotated while being flexed by a large grip amount
  • 7A is a block diagram showing a hardware configuration that implements the functions of the operation input device according to Embodiment 1, and FIG.
  • FIG. 7B shows a hardware configuration that implements the functions of the operation input device according to Embodiment 1.
  • FIG. 3 is a block diagram showing a hardware configuration;
  • FIG. FIG. 11 is a block diagram showing a configuration example of an information processing apparatus according to Embodiment 2;
  • FIG. 9 is a front view showing a configuration example of an operation input device according to Embodiment 2;
  • FIG. 10 is a screen diagram showing a display example when CD playback processing is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and an amount of gripping the operation knob;
  • FIG. 3 is a block diagram showing a hardware configuration
  • FIG. 11 is a block diagram showing a configuration example of an information processing apparatus according to Embodiment 2
  • FIG. 9 is a front view showing a configuration example of an operation input device according to Embodiment 2
  • FIG. 10 is a screen diagram showing a display example when CD playback processing is performed by an operation combining a sliding
  • FIG. 10 is a screen diagram showing a display example when a process of rotating a map around the vehicle is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob.
  • FIG. 10 is a screen diagram showing a display example when a process of changing the position of the vehicle on the route is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob.
  • 7 is a graph showing the relationship between changes in the adjustment amount according to the gripping amount of the operation knob, and changes in vibration intensity and frequency according to the adjustment amount.
  • FIG. 7 is a graph showing the relationship between changes in the adjustment amount according to the grip amount of the operation knob and changes in vibration strength according to the adjustment amount.
  • 7 is a graph showing the relationship between changes in the amount of adjustment according to the amount of gripping the operation knob and changes in the number of vibrations according to the amount of adjustment.
  • 7 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob and the change in the frequency of vibration according to the adjustment amount.
  • 7 is a graph showing the relationship between changes in adjustment amount according to the gripping amount of the operation knob and changes in vibration application time according to the adjustment amount.
  • FIG. 11 is a screen diagram showing switching of an operation target according to the gripping amount of the operation knob on the audio playback screen;
  • FIG. 11 is a screen diagram showing switching of an operation target according to the gripping amount of the operation knob on the audio playback screen;
  • FIG. 10 is a screen diagram showing a display example (1) when a process of selecting item information from the item selection screen is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob; .
  • FIG. 10 is a screen diagram showing a display example (2) when a process of selecting item information from the item selection screen is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob; .
  • FIG. 11 is a screen diagram showing a display example (3) when a process of selecting item information from the item selection screen is performed by an operation combining the operation of sliding the operation knob, the operation of bending the operation knob, and the gripping amount of the operation knob; .
  • FIG. 10 is a screen diagram showing a display example when a process of selecting item information from the item selection screen is performed by an operation combining a rotation operation of the operation knob, an operation of bending the operation knob, and a grip
  • FIG. 1 is a block diagram showing a configuration example of an information processing apparatus 1 according to Embodiment 1.
  • an information processing device 1 executes a function corresponding to an operation input received by an operation input device 2 .
  • the information processing device 1 is a navigation device, an air conditioner, or an audio device.
  • the information processing device 1 includes an operation input device 2, a touch panel 3, a liquid crystal display (hereinafter referred to as LCD) 4, and a function execution unit 5, as shown in FIG.
  • LCD liquid crystal display
  • the touch panel 3 is a capacitive touch panel that detects a change in capacitance on the panel surface, and generates operation information from the position information of the portion where the change in capacitance is detected on the panel surface and the pressing information on the panel surface. Output to the unit 22 .
  • the LCD 4 is a display section provided with the touch panel 3 . For example, the LCD 4 displays video information output from the operation input device 2 . If the information processing device 1 is a navigation device having an LCD 4, the LCD 4 is installed, for example, in the center of the front seat in the vehicle.
  • the function execution unit 5 executes a function corresponding to the operation indicated by the operation information.
  • the operation input device 2 is a device that receives an operation input using an operator 21 provided on the touch surface of the touch panel 3, and includes an operator 21, an operation information generator 22, and a display processor 23.
  • the operator 21 includes an operation knob 211 and a detector 212 .
  • FIG. 2A is a perspective view showing the manipulator 21.
  • FIG. The operation knob 211 is a dial-shaped member, as shown in FIG. 2A.
  • the operation knob 211 is rotatably provided on the touch surface of the touch panel 3, and is gripped and operated by the user's hand. Further, the operation knob 211 is made of a conductive material.
  • FIG. 2B is a configuration diagram showing the internal configuration of the manipulator 21.
  • the operation knob 211 includes an outer frame portion 211A and an inner frame portion 211B arranged inside the outer frame portion 211A.
  • the outer frame portion 211A is configured by a conductive member having flexibility that bends according to the gripping force of the user.
  • the switches 212a, 212b, and 212c are the detection unit 212 that detects the grip amount of gripping and bending the operation knob 211 as a pressing force.
  • the switches 212a, 212b and 212c incorporate pressure sensors for detecting pressing forces.
  • the switches 212a, 212b and 212c are provided between the inner wall surface of the outer frame portion 211A and the outer wall surface of the inner frame portion 211B.
  • the switches 212a, 212b, and 212c are evenly arranged in the outer diameter direction of the inner frame portion 211B, with the button portion facing the outer frame portion 211A side and the switch body portion facing the inner frame portion 211B side. . Accordingly, no matter which portion of the outer frame portion 211A of the operation knob 211 is pressed, any one of the switches 212a, 212b, and 212c can detect the gripping amount for bending the outer frame portion 211A.
  • the operation knob 211 that has detected the amount of grip outputs a detection signal of the amount of grip to the operation information generator 22 .
  • the operation knob 211 is arranged on the touch surface of the touch panel 3 .
  • contact portions 213a, 213b and 213c are provided on the bottom surface of the outer frame portion 211A.
  • the contact portions 213 a , 213 b and 213 c are made of a conductive material, and are in contact with the touch surface of the touch panel 3 while conducting with the operation knob 211 .
  • the contact portions 213a, 213b, and 213c move on the touch surface of the touch panel 3 while being in contact with the touch surface.
  • the touch panel 3 detects the rotational trajectory of the contact portions 213a, 213b, and 213c due to the rotation of the operation knob 211, and outputs the detected rotational trajectory to the operation information generating section 22 as a rotational operation amount in the rotational direction.
  • the operation input device 2 receives a rotation operation of the operation knob 211 when the operation information generation unit 22 inputs a signal indicating the amount of rotation operation.
  • the operation knob 211 shown in FIGS. 2A and 2B has an annular shape with a hole in the center. It may be in shape. Also, although the outer frame portion 211A has three contact portions 213a, 213b, and 213c provided on the bottom surface, the number of contact portions provided on the outer frame portion 211A may be two or more. The position at which the contact portion is provided may be arbitrary. Furthermore, if the operation knob 211 has a structure that allows conduction between the user's hand, the operation knob 211, and the contact portions 213a, 213b, and 213c, the outer frame portion 211A is made of a member other than a conductive member. may be
  • FIG. 3A is a configuration diagram showing the internal configuration of the manipulator 21 before the operation of bending the manipulation knob 211 by gripping it.
  • FIG. 3B is a configuration diagram showing the internal configuration of the manipulator 21 in which the manipulation knob 211 is bent by being gripped.
  • none of the switches 212a, 212b, and 212c detect the grip amount unless the outer frame portion 211A is bent.
  • a triangle T1 formed by connecting the contact portion 213a, the contact portion 213b, and the contact portion 213c in order with a dashed imaginary line is, for example, an equilateral triangle.
  • the outer frame portion 211A bends in the arrow A1 direction and the arrow A2 direction, as shown in FIG. 3B.
  • the triangle T2 formed by connecting the contact portion 213a, the contact portion 213b and the contact portion 213c in order with a dashed virtual line deforms into a triangle other than an equilateral triangle.
  • at least one of switches 212a, 212b and 212c detects the grip amount. For example, as shown in FIG. 3B, the inner wall of the outer frame portion 211A pushed in the arrow A1 direction presses the switch 212c, whereby the switch 212c detects the amount of grip.
  • the operation input device 2 receives information indicating the gripping amount for bending the operation knob 211 by acquiring the gripping amount detection signal output from the detection unit 212 .
  • the operation information generator 22 generates operation information indicating an operation using the manipulator 21 .
  • the operation information generation unit 22 generates operation information according to the grip amount of the operation knob 211 detected by any one of the switches 212 a , 212 b and 212 c and outputs the generated operation information to the function execution unit 5 .
  • the function execution unit 5 receives the operation information generated by the operation information generation unit 22 and executes the function corresponding to the operation indicated by the input operation information. Display information related to the functions executed by the function execution unit 5 is output to the display processing unit 23 .
  • the display processing unit 23 displays a screen corresponding to the function executed by the function executing unit 5 on the LCD 4 provided with the touch panel 3 . For example, when the function executing section 5 executes the CD playing function, the display processing section 23 displays the CD playing screen on the LCD 4 .
  • the touch panel 3 may be used to detect the grip amount. As shown in FIGS. 3A and 3B, due to the bending of the operation knob 211, a triangle T1 formed by connecting the contact portions 213a, 213b, and 213c in order with a virtual line is transformed into a triangle T2.
  • the touch panel 3 can detect the deformation of the triangle T1 as a change in the position of the contact portion on the touch surface. That is, the touch panel 3 can detect the grip amount of the operation knob 211 based on the amount of change in the position of the contact portion on the touch surface. In this case, the touch panel 3 functions as a detection unit that detects the grip amount of gripping and bending the operation knob 211 .
  • FIG. 4 is a flowchart showing the operation input method according to Embodiment 1, showing the operation of the operation input device 2.
  • the operation information generator 22 determines whether or not an operation using the operator 21 has been performed (step ST1). For example, when the operation information generation unit 22 acquires detection information of an operation using the operation element 21 from at least one of the touch panel 3 and the detection unit 212 and determines that the acquired detection information is valid, the operation information generation unit 22 21 has been performed.
  • the operation information generation unit 22 determines that the detection information of the rotation operation of the operation knob 211 is valid, and determines that the rotation operation amount is valid. If the manipulated variable is less than the threshold, it is determined that the detection information is invalid. Further, when the grip amount detected by any of the switches 212a, 212b, and 212c is equal to or greater than the threshold value, the operation information generation unit 22 determines that the detection information of the operation to bend the operation knob 211 is valid, If the grip amount is less than the threshold, it is determined that the detection information is invalid.
  • step ST1 When determining that an operation using the manipulator 21 has not been performed (step ST1; NO), the operation information generation unit 22 repeats the determination of step ST1 until an operation using the manipulator 21 is performed. When it is determined that an operation using the manipulator 21 has been performed (step ST1; YES), the operation information generation unit 22 determines whether or not the manipulation using the manipulator 21 is an operation to bend the manipulation knob 211. (step ST2).
  • the operation information generation unit 22 determines that the operation using the operation element 21 is an operation to bend the operation knob 211. Further, when the valid detection information is acquired from the touch panel 3, the operation information generation unit 22 determines that the operation using the operation knob 21 is not the operation to bend the operation knob 211, and the operation using the operation element 21 It is determined that it is a rotation operation of
  • step ST2 When the operation information generating unit 22 determines that the operation using the manipulator 21 is an operation to bend the operation knob 211 (step ST2; YES), the operation information including the grip amount by which the operation knob 211 is bent by gripping. Information is generated (step ST3). Further, when it is determined that the operation using the manipulator 21 is not the operation of bending the operation knob 211 (step ST2; NO), the operation information generation unit 22 performs the operation using the operation knob 211 without bending it. Operation information is generated (step ST4).
  • the operation information includes, for example, the XY coordinates of the operation knob 211 calculated based on the position coordinates of the contact portions 213a to 213c of the operation knob 211 on the touch surface, the rotation direction and amount of rotation of the operation knob 211, and the switches 212a to 213c.
  • 212c includes information indicating the grip amount detected.
  • the operation information generation unit 22 generates operation information using valid detection information acquired from the time when valid detection information is first acquired until the reference time for determining one operation has passed. For example, if the detection information acquired within the reference time is the detection information of an operation of bending the operation knob 211, the operation information generation unit 22 moves the operation knob 211 once, similar to a mouse click operation. Operation information indicating an operation of selecting target information by bending is generated.
  • the operation information generation unit 22 performs By bending the operation knob 211 twice at short intervals, operation information indicating an operation of selecting target information is generated. If the detection information acquired within the reference time is the detection information of an operation of bending the operation knob 211 three times at short intervals, the operation information generation unit 22 generates the operation knob in the same manner as the triple-click operation of the mouse. By bending 211 three times at short intervals, operation information indicating an operation for selecting target information is generated.
  • the operation information generation unit 22 If the detection information acquired within the reference time is the detection information of an operation of bending the operation knob 211 four times or more at short intervals, the operation information generation unit 22 generates an operation similar to a long-click operation of the mouse. By flexing the knob 211 four times or more at short intervals, operation information indicating an operation for selecting target information is generated. Further, when the detection information acquired within the reference time is a rotation operation of the operation knob 211 in a flexed state, the operation information generation unit 22 generates an operation similar to a drag-and-drop operation using a mouse, for example. , generates operation information indicating an operation to move the target information on the display screen.
  • the operation information generation unit 22 outputs the generated operation information to the function execution unit 5 (step ST5).
  • the function execution unit 5 acquires operation information from the operation information generation unit 22, executes a function corresponding to the operation indicated by the acquired operation information, and transmits display information corresponding to the function being executed to the display processing unit 23. Output.
  • the display processing unit 23 displays display information on the LCD 4 .
  • the LCD 4 displays a map screen, a camera screen, a menu screen, or an audio playback screen.
  • Function execution unit 5 outputs display information indicating operation details such as the XY coordinates of operation knob 211 , the rotation direction and amount of rotation of operation knob 211 included in the operation information to display processing unit 23 .
  • the display processing unit 23 reflects the content of the operation based on the display information in the screen display of the function corresponding to the operation indicated by the operation information.
  • the operation information generation unit 22 determines whether or not the gripping amount of the operation knob 211 has been changed (step ST6). When the amount of grip detected by the detection unit 212 changes from the amount of grip included in the operation information generated in the previous step, the operation information generation unit 22 determines that the amount of grip of the operation knob 211 has changed. If the gripping amount of the operation knob 211 is changed (step ST6; YES), the operation information generator 22 returns to the process of step ST3 and generates the operation information including the gripping amount after the change. If the gripping amount of the operation knob 211 has not been changed (step ST6; NO), the process of FIG. 4 ends.
  • FIG. 5A is a schematic diagram showing the amount of change in the adjustment amount when the operation knob 211 is rotated without bending.
  • FIG. 5B is a schematic diagram showing the amount of change in the adjustment amount when the operation knob 211 is flexed with a small grasp amount and rotated.
  • FIG. 5C is a schematic diagram showing a change in the amount of adjustment when the operation knob 211 is flexed by a large amount of grip and rotated.
  • the adjustment amount corresponding to the amount of rotation of the operation knob 211 is represented by scales.
  • the operation input device 2 generates operation information for increasing the adjustment amount of the adjustment function corresponding to the operation of bending the operation knob 211 in accordance with an increase in the gripping amount of the operation knob 211 .
  • the adjustment amount increases by one scale from the initial value, as indicated by an arrow B1.
  • the adjustment amount increases by two scales from the initial value as indicated by the arrow B2.
  • the adjustment amount is , is increased by 4 scales from the initial value. In this way, the operation input device 2 can change the adjustment amount in the adjustment function executed by the function execution unit 5 by a natural operation of bending the operation knob 211 .
  • FIG. 6A is a schematic diagram showing the menu selection screen when the operation knob 211 is rotated without bending.
  • FIG. 6B is a schematic diagram showing a menu selection screen when the operation knob 211 is rotated while being flexed by a small gripping amount.
  • FIG. 6C is a schematic diagram showing a menu selection screen when the operation knob 211 is bent while being rotated by a large grasp amount.
  • menu selection screen 30 is a screen for selecting target menu information from a list in which a plurality of item information (menu information) are registered, and is displayed on LCD 4 provided with touch panel 3. be done.
  • the operation input device 2 generates operation information for increasing the amount of movement of the cursor for selecting menu information from the menu selection screen 30 in accordance with an increase in the grip amount of the operation knob 211 .
  • the menu selection screen 30 before the operation knob 211 is gripped has the cursor at the position of the menu information C and the menu information C is a selection candidate, as shown in FIG. 6A. From this state, when the operation knob 211 bent by the first holding amount is rotated by the rotation amount R1, the cursor is positioned at the position of the menu information D adjacent to the menu information C, as indicated by the arrow C1 in FIG. 6B. The display order of menu information C and menu information D is changed on the menu selection screen 30 .
  • the operation input device 2 can perform complicated processing such as changing the display order of menu information on the menu selection screen 30 by a natural operation of bending the operation knob 211 .
  • the operation input device 2 includes a processing circuit for executing the processing from step ST1 to step ST6 shown in FIG.
  • the processing circuit may be dedicated hardware, or may be a CPU that executes a program stored in memory.
  • FIG. 7A is a block diagram showing the hardware configuration that implements the functions of the operation input device 2.
  • FIG. 7B is a block diagram showing a hardware configuration for executing software realizing the functions of the operation input device 2.
  • the input interface 100 includes detection information output from the detection unit 212 included in the touch panel 3 or the operator 21 to the operation information generation unit 22, or output from the function execution unit 5 to the display processing unit 23. It is an interface that relays display information.
  • the output interface 101 is an interface that relays operation information output from the operation information generation unit 22 to the function execution unit 5 .
  • the processing circuit 102 may be, for example, a single circuit, multiple circuits, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or any of these. A combination of is applicable.
  • the functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 may be realized by separate processing circuits, or these functions may be collectively realized by one processing circuit.
  • the processing circuit is the processor 103 shown in FIG. 5B
  • the functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 are realized by software, firmware, or a combination of software and firmware. Note that software or firmware is written as a program and stored in the memory 104 .
  • the processor 103 implements the functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 by reading and executing the programs stored in the memory 104 .
  • the operation input device 2 includes a memory 104 for storing a program that, when executed by the processor 103, results in the processing of steps ST1 to ST6 shown in FIG. These programs cause the computer to execute the procedures or methods of the processing performed by the operation information generating section 22 and the display processing section 23 .
  • the memory 104 may be a computer-readable storage medium storing a program for causing a computer to function as the operation information generating section 22 and the display processing section 23.
  • the memory 104 corresponds to, for example, nonvolatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, EEPROM, magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD, and the like.
  • a part of the functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 may be realized by dedicated hardware, and a part may be realized by software or firmware.
  • the operation information generation unit 22 realizes its functions by the processing circuit 102, which is dedicated hardware
  • the display processing unit 23 implements its functions by the processor 103 reading and executing a program stored in the memory 104.
  • the processing circuitry may implement the above functions in hardware, software, firmware, or a combination thereof.
  • the operation input device 2 includes an operation knob provided rotatably on the touch panel and an operation element having a detection unit that detects the amount of gripping and bending the operation knob, an operation information generation unit that generates operation information indicating an operation using the operator and outputs the operation information to a function execution unit that executes a function corresponding to the operation, wherein the operation information generation unit is detected by the detection unit; Operation information is generated according to the amount of gripping that bends the operation knob.
  • a function to be executed can be designated by a natural operation of bending the operation knob 211 by changing the gripping force.
  • the operation input device 2 can perform an operation corresponding to a desired function regardless of the number of fingers holding the operator.
  • the information processing apparatus 1 including the operation input device 2 reduces the possibility of erroneously executing a function different from the intended function.
  • the operation information generation unit 22 generates operation information for changing the adjustment amount of the adjustment function executed by the function execution unit 5 according to the amount of gripping and bending the operation knob 211. to generate Thereby, the operation input device 2 can change the adjustment amount in the adjustment function executed by the function execution unit 5 by a natural operation of bending the operation knob 211 .
  • FIG. 8 is a block diagram showing a configuration example of an information processing device 1A according to the second embodiment.
  • the information processing device 1A executes a function corresponding to the operation input received by the operation input device 2A.
  • the information processing device 1A is a navigation device, an air conditioner, or an audio device.
  • the information processing apparatus 1A includes an operation input device 2A, a touch panel 3, an LCD 4, and a function execution section 5, as shown in FIG.
  • the operation input device 2A is a device that receives an operation input using the operator 21A provided on the touch surface of the touch panel 3, and includes the operator 21A, an operation information generator 22, and a display processor 23.
  • 21 A of manipulators are provided with the operation knob 211, the detection part 212, and the vibration part 213.
  • the vibrating section 213 is a vibrator that vibrates the operation knob 211 .
  • the vibration section 213 vibrates the operation knob 211 according to the adjustment amount of the adjustment function executed by the function execution section 5 .
  • the adjustment amount of the adjustment function executed by the function execution unit 5 changes according to the gripping amount detected by the detection unit 212 . Therefore, the vibrating section 213 vibrates according to the gripping amount detected by the detecting section 212 .
  • the vibrating section 213 changes at least one of the number of times of vibration, the strength of vibration, the frequency of vibration, and the application time of vibration according to the grip amount of the operation knob 211 .
  • FIG. 9 is a front view showing a configuration example of the operation input device 2A.
  • the operation knob 211 included in the operation input device 2A is provided so as to be slidably operated in a pendulum shape on the touch surface of the touch panel 3 .
  • the LCD 4 is provided with an arm 7 .
  • One end of the arm 7 is rotatably supported on the back side of the LCD 4 , and the other end is bent toward the front side of the LCD 4 .
  • An operation knob 211 is connected to the end portion of the arm 7 bent toward the front side of the LCD 4 .
  • the operation knob 211 is slidable in the direction of arrow B on the touch surface of the touch panel 3 with one end of the arm 7 as the center of rotation. Further, the user can rotate the operating knob 211 while sliding the gripped operating knob 211 in the arrow B direction. A slide operation of the operation knob 211 is detected by the touch panel 3 . As shown in FIG. 9, a spring 7A and a spring 7B are attached to the arm 7 on the rear side of the LCD 4. As shown in FIG. When the user releases the operation knob 211, the arm 7 returns to a position where the load of the spring 7A and the load of the spring 7B are balanced, and the operation knob 211 returns to the central position of the slide movement locus.
  • the mechanism for returning the operation knob 211 to the central position is not limited to the springs 7A and 7B, and magnets, dampers, or the like may be used.
  • the operation knob 211 may return to the central position by the weight of the arm 7 and the operation knob 211 .
  • FIG. 10 is a screen diagram showing a display example when CD playback processing is performed by a combination of the operation of sliding the operation knob 211, the operation of bending the operation knob 211, and the amount of gripping the operation knob 211.
  • FIG. A CD playback screen 31 is a screen for selecting a track (T), volume adjustment (V) and playback speed adjustment (S), and is displayed on the LCD 4 .
  • the function execution unit 5 changes the adjustment amount of the adjustment item on the CD playback screen 31 according to the rotation operation of the operation knob 211 , and selects the adjustment item on the CD playback screen 31 according to the slide operation of the operation knob 211 .
  • the display processing unit 23 displays on the LCD 4 a CD playback screen 31 on which adjustment amounts of adjustment items are changed and adjustment items are selected.
  • a slide bar image 32 on the CD playback screen 31 is an image indicating the current sound volume.
  • the screen shown on the side (A) of FIG. 10 with the dashed line as the boundary is the CD playback screen when the volume adjustment amount in the volume adjustment (V) is changed according to the amount of gripping and bending the operation knob 211. 31 is shown. Also, the screen shown on the (B) side of the dashed line is displayed when the CD playback screen 31 shown on the (A) side is displayed on the LCD 4, the operation knob 211 is released, and the operation knob 211 is slid. It shows the CD playback screen 31 when returning to the center position of the movement locus.
  • the CD playback screen 31 shown in the center of side (A) shows the screen when the operation knob 211 at the center position of the slide movement trajectory is not being rotated. From this state, when the operation knob 211 bent by the first grip amount is rotated by the first amount in the rotation direction D1, the slide bar image 32 slides in the direction of the arrow E1 by the first amount of movement, Volume is set to minimum. Note that the vibrating section 213 may vibrate the operation knob 211 when the volume is set to the minimum value or the maximum value.
  • the operation knob 211 bent by the second gripping amount larger than the first gripping amount is rotated by the first rotation amount in the rotation direction D2.
  • the slide bar image 32 slides in the direction of the arrow E2 by a second amount of movement larger than the first amount of movement, and the volume is increased.
  • the operation input device 2A can change the adjustment amount in the adjustment function executed by the function executing section 5 according to the gripping amount by which the operation knob 211 is bent.
  • the display processing unit 23 changes the track from the state in which the volume adjustment (V) is selected on the CD playback screen 31. (T) is selected. Further, when the operation knob 211 restored from the bending is slid in the direction of the arrow F2 from the center position of the slide movement locus, the display processing unit 23 displays the CD playback screen 31 in the state where the volume adjustment (V) is selected. to the state where the reproduction speed adjustment (S) is selected.
  • the operation input device 2A can change the adjustment item by a natural operation of sliding the operation knob 211 .
  • FIG. 11 shows a display example when a process of rotating the map around the vehicle is performed by an operation combining the operation of sliding the operation knob 211, the operation of bending the operation knob 211, and the gripping amount of the operation knob 211.
  • FIG. 11 is a screen figure.
  • the display processing unit 23 displays the map screen 33 on the LCD 4 .
  • the map screen 33 displays an image 33A showing the current position of the vehicle and a route 33B.
  • the display processing unit 23 rotates the map screen 33 in accordance with the gripping amount for bending the operation knob 211 and the rotation operation of the operation knob 211 .
  • Each screen shown on the (A) side of the dashed line in FIG. 11 shows the map screen 33 when the operation knob 211 is gripped by the first gripping amount and rotated while being deflected.
  • the screen drawn on the (B) side of the dashed line shows the map screen 33 when the map screen 33 is gripped with a second gripping amount larger than the first gripping amount and rotated while being bent.
  • the display processing unit 23 rotates the map screen 33 by the rotation amount H1, as shown in FIG. Further, when the operation knob 211 bent by the first grip amount is rotated in the direction of the arrow G2, the display processing unit 23 rotates the map screen 33 by the rotation amount H2.
  • the amount of rotation H1 and the amount of rotation H2 are the same value.
  • the operation input device 2A can change the orientation of the map by a natural operation of bending and rotating the operation knob 211 .
  • the display processing unit 23 causes the map screen 33 to be rotated by the amount of rotation I1 larger than the amount of rotation H1, as shown in FIG. rotate. Further, when the operation knob 211 bent by the second gripping amount is rotated in the direction of the arrow G2, the display processing unit 23 rotates the map screen 33 by the amount of rotation I2 larger than the amount of rotation H2. In this manner, the operation input device 2A can change the amount of change in the orientation of the map according to the amount by which the operation knob 211 is gripped.
  • FIG. 12 shows an example of a display when a process of changing the position of the vehicle on the route is performed by an operation combining the operation of sliding the operation knob 211, the operation of bending the operation knob 211, and the amount of gripping the operation knob 211. It is a screen diagram showing .
  • the display processing unit 23 displays the map screen 33 on the LCD 4 .
  • the map screen 33 displays an image 33A showing the current position of the vehicle and a route 33B.
  • the display processing unit 23 slides the map screen 33 in accordance with the gripping amount for bending the operation knob 211 and the sliding operation of the operation knob 211 .
  • Each screen shown on the (A) side of the dashed line in FIG. 12 shows the map screen 33 when the operation knob 211 is gripped by the first gripping amount and slid while being bent.
  • the screen drawn on the (B) side of the dashed line shows the map screen 33 when the slide operation is performed while holding and bending with a second holding amount larger than the first holding amount.
  • the display processing unit 23 slides the map screen 33 by the movement amount K1, as shown in FIG. Further, when the operation knob 211 bent by the first grip amount is slid in the direction of arrow J2, the display processing unit 23 slides the map screen 33 by the movement amount K2.
  • the movement amount K1 and the movement amount K2 are the same value.
  • the operation input device 2A can slide the map screen by a natural operation of bending and sliding the operation knob 211 .
  • the display processing unit 23 moves the map screen 33 to the position of the movement amount L1 larger than the movement amount K1, as shown in FIG. to slide. Further, when the operation knob 211 bent by the second grip amount is slid in the direction of arrow J2, the display processing unit 23 slides the map screen 33 by a movement amount L2 larger than the movement amount K2. In this manner, the operation input device 2A can change the amount of slide movement of the map screen according to the grip amount of the operation knob 211 .
  • FIG. 13 is a graph showing the relationship between changes in the amount of adjustment according to the amount of gripping of the operation knob 211 and changes in the strength and frequency of vibration according to the amount of adjustment.
  • the upper graph in FIG. 13 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 .
  • the adjustment amount is volume or playback speed.
  • the adjustment amount may be the movement amount of the cursor on the selection screen.
  • the straight line M1 indicates the gripping amount of the operation knob 211 that is linearly increased.
  • a straight line M2 indicates the grip amount of the operation knob 211 that is linearly decreased.
  • the lower graph in FIG. 13 shows changes in the intensity of vibration according to the gripping amount of the operation knob 211 .
  • the strength of vibration is the strength of vibration applied to the operation knob 211 by the vibrating section 213 .
  • the vibrating section 213 applies vibration to the operation knob 211 with a strength corresponding to the change in the adjustment amount.
  • a change in the adjustment amount may be a stepwise change, a linear change, or a non-linear change.
  • the vibrating section 213 may apply vibration intensity to the operation knob 211 according to the changed adjustment amount, or may vibrate the operation knob 211 in a vibration pattern corresponding to the change direction (decrease or increase direction) of the adjustment amount. Vibration may be given.
  • the vibration pattern may be, for example, a combination of the number of vibrations, frequency and application time, or any one of these patterns.
  • the vibrating section 213 does not vibrate the operation knob 211 when the operation knob 211 is not gripped.
  • the vibrating section 213 vibrates the operation knob 211 with a strength corresponding to the vibration application condition (1).
  • Vibration application condition (1) is, for example, as shown in the lower graph in FIG. is applied to the operation knob 211 twice.
  • Vibration applying condition (2) is, for example, as shown in the lower graph in FIG. is applied to the operation knob 211 twice.
  • Vibration applying condition (3) is, for example, as shown in the lower graph in FIG. is applied to the operation knob 211 twice.
  • Vibration applying condition (4) is, for example, as shown in the lower graph in FIG. is applied to the operation knob 211 twice.
  • Vibration application condition (5) is, for example, as shown in the lower graph in FIG. This is a condition for applying vibration to the operation knob 211 once.
  • Vibration applying condition (6) is, for example, as shown in the lower graph in FIG. This is a condition for applying vibration to the operation knob 211 once.
  • Vibration application condition (7) is, for example, as shown in the lower graph in FIG. This is a condition for applying vibration to the operation knob 211 once.
  • the vibrating section 213 does not vibrate the operation knob 211 according to the vibration application condition (8). Under the vibration applying condition (8), the vibrating section 213 does not apply vibration to the operation knob 211 .
  • FIG. 14 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob 211 and the change in the strength of vibration according to the adjustment amount.
  • the upper graph in FIG. 14 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 .
  • a straight line N indicates the grip amount of the operation knob 211 that is linearly increased.
  • the lower graph in FIG. 14 shows changes in the intensity of vibration according to the gripping amount of the operation knob 211 .
  • the vibrating section 213 does not vibrate the operation knob 211 when the adjustment amount is less than the threshold Th1. Further, when the adjustment amount is equal to the threshold value Th1, the vibrating section 213 applies weak vibration equal to or greater than the threshold value Th to the operation knob 211 . When the adjustment amount is equal to the threshold Th2, which is larger than the threshold Th1, the vibrating section 213 vibrates the operation knob 211 with moderate strength. When the adjustment amount is equal to the threshold Th3, which is larger than the threshold Th2, the vibrating section 213 vibrates the operation knob 211 with a stronger vibration (strong) than medium strength.
  • FIG. 15 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob 211 and the change in the number of vibrations according to the adjustment amount.
  • the upper graph in FIG. 15 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 .
  • a straight line N indicates the grip amount of the operation knob 211 that is linearly increased.
  • the lower graph in FIG. 15 shows changes in the intensity of vibration according to the gripping amount of the operation knob 211 .
  • the vibrating section 213 does not vibrate the operation knob 211 when the adjustment amount is less than the threshold Th1. Further, when the adjustment amount is equal to the threshold value Th1, the vibrating section 213 vibrates the operation knob 211 once with a strength equal to or greater than the threshold value Th. When the adjustment amount is equal to the threshold Th2, which is larger than the threshold Th1, the vibrating section 213 vibrates the operation knob 211 twice with an intensity equal to or greater than the threshold Th. When the adjustment amount is equal to the threshold Th3, which is larger than the threshold Th2, the vibrating section 213 vibrates the operation knob 211 three times with an intensity equal to or greater than the threshold Th.
  • FIG. 16 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob 211 and the change in the vibration frequency according to the adjustment amount.
  • the upper graph in FIG. 16 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 .
  • a straight line N indicates the grip amount of the operation knob 211 that is linearly increased.
  • the lower graph in FIG. 16 shows changes in the intensity of vibration according to the grip amount of the operation knob 211 .
  • the vibrating section 213 does not vibrate the operation knob 211 when the adjustment amount is less than the threshold Th1. Further, when the adjustment amount is equal to the threshold value Th1, the vibrating section 213 vibrates the operation knob 211 with a strength equal to or greater than the threshold value Th and a frequency of 100 Hz. When the adjustment amount is equal to the threshold Th2, which is larger than the threshold Th1, the vibrating section 213 vibrates the operation knob 211 with an intensity equal to or greater than the threshold Th and a frequency of 200 Hz. When the adjustment amount is equal to the threshold Th3, which is larger than the threshold Th2, the vibrating section 213 vibrates the operation knob 211 with an intensity equal to or greater than the threshold Th and a frequency of 300 Hz.
  • FIG. 17 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob 211 and the change in the vibration application time according to the adjustment amount.
  • the upper graph in FIG. 17 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 .
  • a straight line N indicates the grip amount of the operation knob 211 that is linearly increased.
  • the lower graph in FIG. 17 shows changes in the intensity of vibration according to the grip amount of the operation knob 211 .
  • the vibrating section 213 does not vibrate the operation knob 211 when the adjustment amount is less than the threshold Th1. Further, when the adjustment amount is equal to the threshold value Th1, the vibration unit 213 applies vibration having a strength equal to or greater than the threshold value Th to the operation knob 211 for 200 milliseconds (ms). When the adjustment amount is equal to the threshold Th2, which is larger than the threshold Th1, the vibrating section 213 applies vibration having a strength equal to or greater than the threshold Th to the operation knob 211 for 400 milliseconds (ms). When the adjustment amount is equal to the threshold Th3, which is larger than the threshold Th2, the vibrating section 213 applies vibration having a strength equal to or greater than the threshold Th to the operation knob 211 for 600 milliseconds (ms).
  • FIG. 18 is a screen diagram showing switching of the operation target according to the grip amount of the operation knob 211 on the audio playback screen.
  • Each screen shown in FIG. 18 includes an audio source list 34A and an audio playback screen 34B.
  • the audio source list 34A is a list from which a plurality of audio sources can be selected, and CD, radio (FM or AM), television (TV), etc. are set.
  • the audio playback screen 34B is a screen for playback of the audio source selected from the audio source list 34A.
  • the function execution unit 5 adjusts the volume displayed on the audio playback screen 34B according to the amount of rotation of the operation knob 211.
  • the display processing unit 23 displays on the LCD 4 an audio playback screen 34B in which the volume adjustment (V) is active. Further, when the operation knob 211 flexed with the grip amount “small” is rotated by the rotation amount K1, the function execution unit 5 adjusts the playback speed displayed on the audio playback screen 34B according to the rotation amount of the operation knob 211. Adjust (S).
  • the display processing unit 23 displays on the LCD 4 an audio playback screen 34B in which playback speed adjustment (S) is active, as shown on the right side of FIG.
  • the function execution unit 5 reproduces the track (T) displayed on the audio playback screen 34B according to the rotation amount of the operation knob 211. selection (song selection).
  • the display processing unit 23 displays on the LCD 4 an audio playback screen 34B in which the track (T) is active, as shown in the center of FIG.
  • the function execution unit 5 selects an audio source from the audio source list 34A according to the rotation amount of the operation knob 211 .
  • the display processing unit 23 displays an audio source list 34A in which audio source selection is active on the LCD 4, as shown on the left side of FIG.
  • the operation input device 2A can perform audio reproduction by a natural operation of changing the grip amount of the operation knob 211 that rotates.
  • FIG. 19 shows a display example (1) when a process of selecting item information from the item selection screen is performed by an operation combining the operation of sliding the operation knob 211, the operation of bending the operation knob 211, and the amount of grip of the operation knob 211. It is a screen diagram showing .
  • the menu selection screen shown in FIG. 19 is an item selection screen for selecting target menu information from a plurality of menu information, and is displayed on LCD 4 provided with touch panel 3 .
  • a first list 35A and a second list 35B are displayed on the menu selection screen.
  • the first list 35A is a list in which a plurality of selection candidates of menu information are displayed side by side.
  • the second list 35B is a list in which a plurality of pieces of menu information in the first list 35A are displayed vertically.
  • the menu selection screen shown on the (A) side of FIG. 19 with the dashed line as the boundary shows the menu selection screen when the operation knob 211 bent by the first gripping amount is slid.
  • the menu selection screen shown on the (B) side of the dashed line shows the menu selection screen when the operation knob 211 is slid while being bent by the second gripping amount larger than the first gripping amount.
  • the function execution unit 5 selects menu information in the first list 8A and the second list 8B according to the slide operation of the operation knob 211 that is being bent. For example, in the menu selection screen shown in the center of (A) side and (B) side, menu information D is selected in the first list 35A and the second list 35B. Menu information D is menu information displayed at the central position in the first list 35A and the second list 35B.
  • the function execution unit 5 moves the first list 35A and the second list 35A according to the slide movement amount of the operation knob 211.
  • the display processing unit 23 displays on the LCD 4 the first list 35A and the second list 35B in which the menu information A is selected.
  • the function executing unit 5 retrieves the menu information in the first list 35A according to the slide movement amount of the operation knob 211. Select F and select menu information F in the second list 35B accordingly.
  • the display processing unit 23 displays on the LCD 4 the first list 35A and the second list 35B in which the menu information F is selected.
  • the display processing unit 23 displays the previously selected menu information according to the slide movement amount of the operation knob 211.
  • the display position of D is moved to the top (leftmost) of the first list 35A and moved to the top (uppermost) of the second list 35B.
  • the display processing unit 23 displays the previously selected menu information according to the slide movement amount of the operation knob 211.
  • the display position of D is moved to the end (rightmost side) of the first list 35A and to the end (lowermost side) of the second list 35B.
  • the operation input device 2A displays the menu information selected by the slide operation of the operation knob 211 at the center position of the list by the natural operation of changing the gripping amount of bending the operation knob 211 . Thereby, the user can accurately visually recognize the menu information selected by the slide operation of the operation knob 211 .
  • FIG. 20 shows a display example (2 ) is a screen view showing.
  • a menu selection screen 36 shown in FIG. 20 is an item selection screen for selecting target menu information from a plurality of item information (menu information), and is displayed on the LCD 4 provided with the touch panel 3 .
  • menu information items A to L are arranged in a 3 ⁇ 4 matrix.
  • the rows of menu information I to L are closest to the operation knob 211, the rows of menu information E to H are next closest, and the rows of menu information A to D are the furthest.
  • the menu selection screen 36 shown on the (A) side of the dashed line in FIG. 20 shows the screen when the operation knob 211 bent by the first gripping amount is slid.
  • a menu selection screen 36 shown on the (B) side of the dashed line shows a screen when the operation knob 211 is slid while being bent by a second gripping amount larger than the first gripping amount.
  • Menu information J is selected from the rows of menu information I to L at the position.
  • the display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information J is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • the function execution unit 5 moves the operation knob 211 closest to the operation knob 211 according to the amount of slide movement P2 of the operation knob 211.
  • Menu information I is selected from the row of menu information I to L at the position.
  • the display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information I is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • Menu information B is selected from the rows of menu information A to D in the position.
  • the display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information B is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • Menu information D is selected from the rows of menu information A to D in the position.
  • the display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information D is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • the operation input device 2A can select target menu information from the menu selection screen 36 by a natural operation of changing the gripping amount of the operation knob 211 for sliding operation.
  • FIG. 21 shows a display example (3 ) is a screen view showing.
  • a menu selection screen 36 shown in FIG. 21 is an item selection screen for selecting target menu information from a plurality of item information (menu information), and is displayed on the LCD 4 provided with the touch panel 3 .
  • menu information items A to L are arranged in a 3 ⁇ 4 matrix.
  • the rows of menu information I to L are closest to the operation knob 211, the rows of menu information E to H are next closest, and the rows of menu information A to D are the furthest.
  • the menu selection screen 36 shown on the (A) side of the dashed line in FIG. 21 shows the screen when the operation knob 211 is bent by the first gripping amount and is slid.
  • a menu selection screen 36 shown on the (B) side of the dashed line shows a screen when the operation knob 211 is slid while being bent by a second gripping amount larger than the first gripping amount.
  • the direction of sliding the operation knob 211 and the direction of moving the cursor for selecting menu information from the menu selection screen 36 are reversed from those shown in FIG.
  • the function execution unit 5 moves the operation knob 211 according to the slide movement amount P1.
  • the cursor is moved from the opposite side (right side) to the direction of the arrow to select menu information K.
  • FIG. The display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information K is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • the function execution unit 5 moves the operation knob 211 closest to the operation knob 211 according to the amount of slide movement P2 of the operation knob 211.
  • the cursor is moved from the opposite side (right side) to the direction of the arrow to select menu information L.
  • the display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information L is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • the function execution unit 5 moves the operation knob 211 according to the slide movement amount P1.
  • the cursor is moved from the opposite side (right side) of the arrow direction to select menu information C.
  • FIG. The display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information C is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • the display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information A is active, that is, the menu selection screen 36 selected as the display location to be operated.
  • the operation input device 2A can select desired menu information from the menu selection screen 36 by such a natural operation of changing the grip amount of the operation knob 211 that slides.
  • FIG. 22 shows a display example when a process of selecting item information from the item selection screen is performed by an operation combining the operation of rotating the operation knob 211, the operation of bending the operation knob 211, and the gripping amount of the operation knob 211.
  • FIG. 21 is an item selection screen for selecting target menu information from a plurality of item information (menu information), and is displayed on the LCD 4 provided with the touch panel 3 .
  • a fan-shaped list 40 having the operation knob 211 as a main part is displayed on the menu selection screen.
  • the wrist 40 has an arcuate wrist portion 40a located farthest from the operation knob 211, an arcuate wrist portion 40b located next to the wrist portion 40a and located furthest from the operation knob 211, and an arcuate wrist portion 40b located at a position closest to the operation knob 211. It has an arcuate wrist portion 40c.
  • the screen shown on the (A) side of the dashed line in FIG. 22 shows the list 40 when the operation knob 211 is flexed by the largest first gripping amount and is rotated. Also, the screen shown on the (B) side of the dashed line shows the list 40 when the operation knob 211 is flexed by the second gripping amount smaller than the first gripping amount and is rotated. Further, the screen shown on the (C) side of the dashed line shows the list 40 when the operation knob 211 is flexed by the third gripping amount smaller than the second gripping amount and is rotated.
  • the function execution unit 5 retrieves the menu information from the list unit 40a according to the amount of rotation R1 of the operation knob 211. select.
  • the display processing section 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list section 40a.
  • the function execution unit 5 retrieves the menu information from the list unit 40a according to the amount of rotation R2 of the operation knob 211. select.
  • the display processing section 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list section 40a.
  • the function execution unit 5 retrieves the menu information from the list unit 40b in accordance with the amount of rotation R1 of the operation knob 211. select.
  • the display processing section 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list section 40b.
  • the function execution unit 5 retrieves the menu information from the list unit 40b in accordance with the amount of rotation R2 of the operation knob 211. select.
  • the display processing section 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list section 40b.
  • the function execution unit 5 retrieves the menu information from the list unit 40c according to the amount of rotation R1 of the operation knob 211. select.
  • the display processing unit 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list portion 40c.
  • the function execution unit 5 retrieves the menu information from the list unit 40c according to the amount of rotation R2 of the operation knob 211. select.
  • the display processing unit 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list portion 40c.
  • the operation input device 2A can select target menu information from the list 40 by a natural operation of changing the gripping amount of the rotating operation knob 211 .
  • the audio playback screen is composed of the list 40
  • a large category such as input source switching is assigned to the list section 40a.
  • Switching songs (tracks) is assigned to the list portion 40b.
  • the list portion 40c is assigned bar movement of the playback position.
  • the number of list parts may be three, two, or four or more.
  • a list expressed not only in two dimensions but also in three dimensions may be used. For example, by sliding and rotating the operating knob 211 and bending the operating knob 211, the adjustment amounts set for the XYZ axes are changed.
  • menu information is arranged.
  • complicated menu information that can be operated while the vehicle is stopped may be arranged in the list section on the passenger seat side.
  • Complicated menu information may include, for example, destination setting, switching processing between a camera imaging screen and a navigation screen, and the like.
  • Simple menu information that can be operated while the vehicle is running may be arranged in the list section on the driver's seat side. For example, menu information such as volume control, air conditioner temperature control, or screen brightness change can be considered.
  • the vibration section 213 vibrates the operation knob 211 according to the adjustment amount of the adjustment function executed by the function execution section 5. Since vibration corresponding to the adjustment amount of the adjustment function is applied to the operation knob 211, it is possible to feed back to the user how much the adjustment amount has been changed by the operation using the manipulator 21A.
  • the operation information generation unit 22 generates operation information for switching the operation target according to the grip amount of gripping and bending the operation knob 211 .
  • the operation input device 2A can perform an operation corresponding to a desired function regardless of the number of fingers holding the operation element 21.
  • the display processing unit 23 changes the display position of the operation target on the screen of the LCD 4 according to the gripping amount of gripping and bending the operation knob 211 .
  • the operation input device 2A can change the display position of the operation target by a natural operation of changing the gripping amount of the operation knob 211 .
  • the operation input device can be used, for example, in a navigation device mounted on a vehicle.
  • 1 Information processing device 1A Information processing device, 2, 2A Operation input device, 3 Touch panel, 4 LCD, 5 Function execution part, 7 Arm, 7A, 7B Spring, 8A, 35A First list, 8B, 35B Second list, 21, 21A operator, 22 operation information generator, 23 display processor, 30, 36 menu selection screen, 31 CD playback screen, 32 slide bar image, 33 map screen, 33A image, 33B route, 34A audio source list , 34B audio playback screen, 40 list, 40a to 40c list part, 41 cursor, 100 input interface, 101 output interface, 102 processing circuit, 103 processor, 104 memory, 211 operation knob, 211A outer frame part, 211B inner frame part, 212 detection unit, 212a to 212c switch, 213 vibration unit, 213a to 213c contact unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

This operation input device (2) comprises: an operator (21) including an operation knob (211) rotatably provided to a touch panel (3) and a detection unit (212) for detecting the gripping amount with which the operation knob (211) is gripped and bent; and an operation information generation unit (22) that generates operation information indicating an operation using the operator (21) and that outputs the operation information to a function execution unit (5) which executes a function corresponding to the operation. The operation information generation unit (22) generates operation information according to the gripping amount with which the operation knob (211) is bent, said gripping amount having been detected by the detection unit (212).

Description

操作入力装置、情報処理装置および操作入力方法Operation input device, information processing device and operation input method
　本開示は、操作入力装置、情報処理装置および操作入力方法に関する。 The present disclosure relates to an operation input device, an information processing device, and an operation input method.
　一つの操作子を用いた複数種類の操作によって情報処理装置に対して様々な機能を実行させる技術が提案されている。例えば、特許文献１には、ダイヤルスイッチまたはロータリースイッチである操作子と、操作子を把持する指の数を検出する指センサを備えた操作入力装置が記載されている。当該操作入力装置は、指センサの検出結果に基づいて、操作子を把持する指の数を特定し、操作入力に対する操作指令を、操作子を把持する指の数に応じて切り替える。 Techniques have been proposed that allow an information processing device to perform various functions through a plurality of types of operations using a single operator. For example, Patent Literature 1 describes an operation input device that includes an operator, which is a dial switch or a rotary switch, and a finger sensor that detects the number of fingers holding the operator. The operation input device identifies the number of fingers gripping the operator based on the detection result of the finger sensor, and switches the operation command for the operation input according to the number of fingers gripping the operator.
特開２０１８－５７６３号公報JP 2018-5763 A
　特許文献１に記載された操作入力装置は、別の操作に切り替える際に操作子を把持する指の数を変える必要があり、操作性が悪いという課題があった。例えば、指の数が多い方が回転させやすい操作子であっても、実行対象の機能によっては少ない指の数で不自然に操作子を回転させる必要がある。また、操作子を回転させる際にさらに指が操作子に触れると、実行対象の機能とは別の機能が誤って実行される可能性がある。 The operation input device described in Patent Document 1 has the problem of poor operability because it is necessary to change the number of fingers that hold the operator when switching to another operation. For example, even if the manipulator is easier to rotate with a larger number of fingers, it may be necessary to unnaturally rotate the manipulator with a smaller number of fingers depending on the function to be executed. Further, if the finger touches the manipulator while rotating the manipulator, a function different from the function to be executed may be erroneously executed.
　本開示は上記課題を解決するものであり、操作子を把持する指の数によらずに、目的の機能に対応する操作を行うことができる操作入力装置、情報処理装置および操作入力方法を得ることを目的とする。 The present disclosure is intended to solve the above problems, and provides an operation input device, an information processing device, and an operation input method that enable an operation corresponding to a desired function to be performed regardless of the number of fingers that hold the operator. for the purpose.
　本開示に係る操作入力装置は、タッチパネルに回転可能に設けられた操作ノブおよび操作ノブを把持して撓ませる把持量を検出する検出部を有した操作子と、操作子を用いた操作を示す操作情報を生成し、操作に対応する機能を実行する機能実行部に操作情報を出力する操作情報生成部とを備え、操作情報生成部は、検出部によって検出された操作ノブを撓ませる把持量に応じた操作情報を生成する。 An operation input device according to the present disclosure includes an operation knob provided rotatably on a touch panel, an operation element having a detection unit that detects the amount of gripping and bending the operation knob, and an operation using the operation element. an operation information generation unit that generates operation information and outputs the operation information to a function execution unit that executes a function corresponding to the operation; Generate operation information according to
　本開示によれば、操作ノブおよび検出部を有した操作子と、操作子を用いた操作を示す操作情報を生成し、機能実行部に操作情報を出力する操作情報生成部とを備え、操作情報生成部は、検出部によって検出された操作ノブを撓ませる把持量に応じた操作情報を生成する。操作ノブを把持する力を変えて撓ませる自然な操作によって実行対象の機能を指定できるため、本開示に係る操作入力装置は、操作子を把持する指の数によらずに、目的の機能に対応する操作を行うことができる。 According to the present disclosure, an operator having an operation knob and a detection unit, an operation information generator that generates operation information indicating an operation using the operator, and outputs the operation information to a function execution unit, The information generation unit generates operation information according to the amount of grip of the operation knob that is detected by the detection unit. Since the function to be executed can be specified by a natural operation of bending the operation knob by changing the gripping force, the operation input device according to the present disclosure can perform the desired function regardless of the number of fingers gripping the operation element. Corresponding operations can be performed.
実施の形態１に係る情報処理装置の構成例を示すブロック図である。1 is a block diagram showing a configuration example of an information processing apparatus according to Embodiment 1; FIG. 図２Ａは、操作子を示す斜視図であり、図２Ｂは、操作子の内部の構成を示す構成図である。FIG. 2A is a perspective view showing the manipulator, and FIG. 2B is a configuration diagram showing the internal configuration of the manipulator. 図３Ａは、操作ノブを把持により撓ませる操作を行う前の操作子の内部の構成を示す構成図であり、図３Ｂは、操作ノブを把持により撓ませる操作が行われている操作子の内部の構成を示す構成図である。FIG. 3A is a configuration diagram showing the internal configuration of the manipulator before an operation to bend the operation knob by holding it, and FIG. 1 is a configuration diagram showing the configuration of . 実施の形態１に係る操作入力方法を示すフローチャートである。4 is a flowchart showing an operation input method according to Embodiment 1; 図５Ａは、操作ノブを撓ませずに回転させたときの調整量の変化分を示す概要図であり、図５Ｂは、操作ノブを小さい把持量で撓ませて回転させたときの調整量の変化分を示す概要図であり、図５Ｃは、操作ノブを大きい把持量で撓ませて回転させたときの調整量の変化分を示す概要図である。FIG. 5A is a schematic diagram showing the change in the adjustment amount when the operation knob is rotated without being bent, and FIG. 5B is a schematic diagram showing the adjustment amount when the operation knob is bent with a small holding amount and rotated. FIG. 5C is a schematic diagram showing the amount of change, and FIG. 5C is a schematic diagram showing the amount of change in the adjustment amount when the operation knob is flexed and rotated by a large grasp amount. 図６Ａは、操作ノブを撓ませずに回転させたときのメニュー選択画面を示す概要図であり、図６Ｂは、操作ノブを小さい把持量で撓ませながら回転させたときのメニュー選択画面を示す概要図であり、図６Ｃは、操作ノブを大きい把持量で撓ませながら回転させたときのメニュー選択画面を示す概要図である。FIG. 6A is a schematic diagram showing the menu selection screen when the operation knob is rotated without being bent, and FIG. 6B is a schematic diagram showing the menu selection screen when the operation knob is rotated while being bent with a small gripping amount. FIG. 6C is a schematic diagram showing a menu selection screen when the operation knob is rotated while being flexed by a large grip amount. 図７Ａは、実施の形態１に係る操作入力装置の機能を実現するハードウェア構成を示すブロック図であり、図７Ｂは、実施の形態１に係る操作入力装置の機能を実現するソフトウェアを実行するハードウェア構成を示すブロック図である。7A is a block diagram showing a hardware configuration that implements the functions of the operation input device according to Embodiment 1, and FIG. 7B shows a hardware configuration that implements the functions of the operation input device according to Embodiment 1. FIG. 3 is a block diagram showing a hardware configuration; FIG. 実施の形態２に係る情報処理装置の構成例を示すブロック図である。FIG. 11 is a block diagram showing a configuration example of an information processing apparatus according to Embodiment 2; 実施の形態２に係る操作入力装置の構成例を示す正面図である。FIG. 9 is a front view showing a configuration example of an operation input device according to Embodiment 2; 操作ノブのスライド操作と、操作ノブを撓ませる操作および操作ノブの把持量とを組み合わせた操作によって、ＣＤ再生処理を行ったときの表示例を示す画面図である。FIG. 10 is a screen diagram showing a display example when CD playback processing is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and an amount of gripping the operation knob; 操作ノブのスライド操作と、操作ノブを撓ませる操作および操作ノブの把持量とを組み合わせた操作によって、車両周辺の地図を回転させる処理を行ったときの表示例を示す画面図である。FIG. 10 is a screen diagram showing a display example when a process of rotating a map around the vehicle is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob. 操作ノブのスライド操作と、操作ノブを撓ませる操作および操作ノブの把持量とを組み合わせた操作によって、車両の経路上の位置を変更する処理を行ったときの表示例を示す画面図である。FIG. 10 is a screen diagram showing a display example when a process of changing the position of the vehicle on the route is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob. 操作ノブの把持量に応じた調整量の変化と、調整量に応じた振動の強さおよび回数の変化との関係を示すグラフである。7 is a graph showing the relationship between changes in the adjustment amount according to the gripping amount of the operation knob, and changes in vibration intensity and frequency according to the adjustment amount. 操作ノブの把持量に応じた調整量の変化と、調整量に応じた振動の強さの変化との関係を示すグラフである。7 is a graph showing the relationship between changes in the adjustment amount according to the grip amount of the operation knob and changes in vibration strength according to the adjustment amount. 操作ノブの把持量に応じた調整量の変化と、調整量に応じた振動の回数の変化との関係を示すグラフである。7 is a graph showing the relationship between changes in the amount of adjustment according to the amount of gripping the operation knob and changes in the number of vibrations according to the amount of adjustment. 操作ノブの把持量に応じた調整量の変化と、調整量に応じた振動の周波数の変化との関係を示すグラフである。7 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob and the change in the frequency of vibration according to the adjustment amount. 操作ノブの把持量に応じた調整量の変化と、調整量に応じた振動の印加時間の変化との関係を示すグラフである。7 is a graph showing the relationship between changes in adjustment amount according to the gripping amount of the operation knob and changes in vibration application time according to the adjustment amount. オーディオ再生画面における操作ノブの把持量に応じた操作対象の切り替えを示す画面図である。FIG. 11 is a screen diagram showing switching of an operation target according to the gripping amount of the operation knob on the audio playback screen; 操作ノブのスライド操作と操作ノブを撓ませる操作および操作ノブの把持量とを組み合わせた操作によって項目選択画面から項目情報を選択する処理を行ったときの表示例（１）を示す画面図である。FIG. 10 is a screen diagram showing a display example (1) when a process of selecting item information from the item selection screen is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob; . 操作ノブのスライド操作と操作ノブを撓ませる操作および操作ノブの把持量とを組み合わせた操作によって項目選択画面から項目情報を選択する処理を行ったときの表示例（２）を示す画面図である。FIG. 10 is a screen diagram showing a display example (2) when a process of selecting item information from the item selection screen is performed by an operation combining a sliding operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob; . 操作ノブのスライド操作と操作ノブを撓ませる操作および操作ノブの把持量とを組み合わせた操作によって項目選択画面から項目情報を選択する処理を行ったときの表示例（３）を示す画面図である。FIG. 11 is a screen diagram showing a display example (3) when a process of selecting item information from the item selection screen is performed by an operation combining the operation of sliding the operation knob, the operation of bending the operation knob, and the gripping amount of the operation knob; . 操作ノブの回転操作と操作ノブを撓ませる操作および操作ノブの把持量とを組み合わせた操作によって項目選択画面から項目情報を選択する処理を行ったときの表示例を示す画面図である。FIG. 10 is a screen diagram showing a display example when a process of selecting item information from the item selection screen is performed by an operation combining a rotation operation of the operation knob, an operation of bending the operation knob, and a gripping amount of the operation knob.
実施の形態１．
　図１は、実施の形態１に係る情報処理装置１の構成例を示すブロック図である。図１において、情報処理装置１は、操作入力装置２によって受け付けられた操作入力に対応する機能を実行している。例えば、情報処理装置１は、ナビゲーション装置、空調装置またはオーディオ機器である。情報処理装置１は、図１に示すように、操作入力装置２、タッチパネル３、液晶ディスプレイ（以下、ＬＣＤと記載する。）４および機能実行部５を備える。 Embodiment 1.
FIG. 1 is a block diagram showing a configuration example of an information processing apparatus 1 according to Embodiment 1. As shown in FIG. In FIG. 1 , an information processing device 1 executes a function corresponding to an operation input received by an operation input device 2 . For example, the information processing device 1 is a navigation device, an air conditioner, or an audio device. The information processing device 1 includes an operation input device 2, a touch panel 3, a liquid crystal display (hereinafter referred to as LCD) 4, and a function execution unit 5, as shown in FIG.
　タッチパネル３は、パネル面における静電容量の変化を検出する静電容量方式のタッチパネルであり、パネル面で静電容量の変化が検出された部分の位置情報およびパネル面に対する押圧情報を操作情報生成部２２に出力する。ＬＣＤ４は、タッチパネル３が設けられた表示部である。例えば、ＬＣＤ４は、操作入力装置２から出力された映像情報を表示する。情報処理装置１がＬＣＤ４を有したナビゲーション装置である場合、ＬＣＤ４は、例えば、車室内の前席中央に取り付けられる。機能実行部５は、操作情報が示す操作に対応する機能を実行する。 The touch panel 3 is a capacitive touch panel that detects a change in capacitance on the panel surface, and generates operation information from the position information of the portion where the change in capacitance is detected on the panel surface and the pressing information on the panel surface. Output to the unit 22 . The LCD 4 is a display section provided with the touch panel 3 . For example, the LCD 4 displays video information output from the operation input device 2 . If the information processing device 1 is a navigation device having an LCD 4, the LCD 4 is installed, for example, in the center of the front seat in the vehicle. The function execution unit 5 executes a function corresponding to the operation indicated by the operation information.
　操作入力装置２は、タッチパネル３のタッチ面上に設けられた操作子２１を用いた操作入力を受け付ける装置であり、操作子２１、操作情報生成部２２および表示処理部２３を備える。操作子２１は、操作ノブ２１１および検出部２１２を備える。図２Ａは、操作子２１を示す斜視図である。操作ノブ２１１は、図２Ａに示すように、ダイヤル形状の部材である。操作ノブ２１１は、タッチパネル３のタッチ面上に回転可能に設けられ、ユーザの手で把持されて操作される。また、操作ノブ２１１は、導電性材料で構成されている。 The operation input device 2 is a device that receives an operation input using an operator 21 provided on the touch surface of the touch panel 3, and includes an operator 21, an operation information generator 22, and a display processor 23. The operator 21 includes an operation knob 211 and a detector 212 . FIG. 2A is a perspective view showing the manipulator 21. FIG. The operation knob 211 is a dial-shaped member, as shown in FIG. 2A. The operation knob 211 is rotatably provided on the touch surface of the touch panel 3, and is gripped and operated by the user's hand. Further, the operation knob 211 is made of a conductive material.
　図２Ｂは、操作子２１の内部の構成を示す構成図である。操作ノブ２１１は、図２Ｂに示すように、外枠部２１１Ａと、外枠部２１１Ａの内側に配置される内枠部２１１Ｂとを備える。外枠部２１１Ａは、ユーザが把持する力に応じて撓む可撓性を有した導電部材によって構成される。スイッチ２１２ａ、２１２ｂおよび２１２ｃは、操作ノブ２１１を把持して撓ませる把持量を押圧力として検出する検出部２１２である。スイッチ２１２ａ、２１２ｂおよび２１２ｃには、押圧力を検出するための圧力センサが内蔵されている。 FIG. 2B is a configuration diagram showing the internal configuration of the manipulator 21. FIG. As shown in FIG. 2B, the operation knob 211 includes an outer frame portion 211A and an inner frame portion 211B arranged inside the outer frame portion 211A. The outer frame portion 211A is configured by a conductive member having flexibility that bends according to the gripping force of the user. The switches 212a, 212b, and 212c are the detection unit 212 that detects the grip amount of gripping and bending the operation knob 211 as a pressing force. The switches 212a, 212b and 212c incorporate pressure sensors for detecting pressing forces.
　スイッチ２１２ａ、２１２ｂおよび２１２ｃは、外枠部２１１Ａの内壁面と内枠部２１１Ｂの外壁面との間に設けられる。例えば、スイッチ２１２ａ、２１２ｂおよび２１２ｃは、内枠部２１１Ｂの外径方向に均等に配置され、ボタン部が外枠部２１１Ａ側に向いており、スイッチ本体部が内枠部２１１Ｂ側に向いている。これにより、操作ノブ２１１の外枠部２１１Ａのどの部分を押圧しても、スイッチ２１２ａ、２１２ｂおよび２１２ｃのいずれかが、外枠部２１１Ａを撓ませる把持量を検出することができる。スイッチ２１２ａ、２１２ｂおよび２１２ｃのうち、把持量を検出した操作ノブ２１１が、把持量の検出信号を操作情報生成部２２に出力する。 The switches 212a, 212b and 212c are provided between the inner wall surface of the outer frame portion 211A and the outer wall surface of the inner frame portion 211B. For example, the switches 212a, 212b, and 212c are evenly arranged in the outer diameter direction of the inner frame portion 211B, with the button portion facing the outer frame portion 211A side and the switch body portion facing the inner frame portion 211B side. . Accordingly, no matter which portion of the outer frame portion 211A of the operation knob 211 is pressed, any one of the switches 212a, 212b, and 212c can detect the gripping amount for bending the outer frame portion 211A. Of the switches 212 a , 212 b and 212 c , the operation knob 211 that has detected the amount of grip outputs a detection signal of the amount of grip to the operation information generator 22 .
　操作ノブ２１１は、タッチパネル３のタッチ面に配置される。外枠部２１１Ａの底面には、図２Ｂに示すように、接触部２１３ａ、２１３ｂおよび２１３ｃが設けられている。接触部２１３ａ、２１３ｂおよび２１３ｃは、導電性材料によって構成されており、操作ノブ２１１と導通した状態で、タッチパネル３のタッチ面に接触している。例えば、手で把持して操作ノブ２１１が回転されると、接触部２１３ａ、２１３ｂおよび２１３ｃは、タッチパネル３のタッチ面に接触した状態でタッチ面上を移動する。 The operation knob 211 is arranged on the touch surface of the touch panel 3 . As shown in FIG. 2B, contact portions 213a, 213b and 213c are provided on the bottom surface of the outer frame portion 211A. The contact portions 213 a , 213 b and 213 c are made of a conductive material, and are in contact with the touch surface of the touch panel 3 while conducting with the operation knob 211 . For example, when the operation knob 211 is rotated while being held by hand, the contact portions 213a, 213b, and 213c move on the touch surface of the touch panel 3 while being in contact with the touch surface.
　タッチパネル３は、操作ノブ２１１の回転による接触部２１３ａ、２１３ｂおよび２１３ｃの回転軌跡を検出し、検出した回転軌跡を回転方向の回転操作量として操作情報生成部２２に出力する。操作情報生成部２２が回転操作量を示す信号を入力することにより、操作入力装置２は、操作ノブ２１１の回転操作を受け付ける。 The touch panel 3 detects the rotational trajectory of the contact portions 213a, 213b, and 213c due to the rotation of the operation knob 211, and outputs the detected rotational trajectory to the operation information generating section 22 as a rotational operation amount in the rotational direction. The operation input device 2 receives a rotation operation of the operation knob 211 when the operation information generation unit 22 inputs a signal indicating the amount of rotation operation.
　なお、図２Ａおよび図２Ｂに示した操作ノブ２１１は、中央に穴の開いた円環状であるが、ユーザが把持して操作することができる形状であれば、操作ノブ２１１は、どのような形状であってもよい。また、３つの接触部２１３ａ、２１３ｂおよび２１３ｃが底面に設けられた外枠部２１１Ａを示したが、外枠部２１１Ａに接触部を設ける個数は２個以上であればよく、外枠部２１１Ａに接触部を設ける位置は、任意であってもよい。さらに、操作ノブ２１１が、ユーザの手と操作ノブ２１１と接触部２１３ａ、２１３ｂおよび２１３ｃとの間を導通させる構造を有していれば、外枠部２１１Ａは、導電性部材以外の部材で構成されてもよい。 The operation knob 211 shown in FIGS. 2A and 2B has an annular shape with a hole in the center. It may be in shape. Also, although the outer frame portion 211A has three contact portions 213a, 213b, and 213c provided on the bottom surface, the number of contact portions provided on the outer frame portion 211A may be two or more. The position at which the contact portion is provided may be arbitrary. Furthermore, if the operation knob 211 has a structure that allows conduction between the user's hand, the operation knob 211, and the contact portions 213a, 213b, and 213c, the outer frame portion 211A is made of a member other than a conductive member. may be
　図３Ａは、操作ノブ２１１を把持により撓ませる操作を行う前の操作子２１の内部の構成を示す構成図である。図３Ｂは、操作ノブ２１１を把持により撓ませる操作が行われている操作子２１の内部の構成を示す構成図である。図３Ａに示すように、外枠部２１１Ａが撓んでいなければ、スイッチ２１２ａ、２１２ｂおよび２１２ｃは、いずれも把持量を検出しない。この状態において、接触部２１３ａ、接触部２１３ｂおよび接触部２１３ｃを順に破線の仮想線で結んだ三角形Ｔ１は、例えば正三角形である。 FIG. 3A is a configuration diagram showing the internal configuration of the manipulator 21 before the operation of bending the manipulation knob 211 by gripping it. FIG. 3B is a configuration diagram showing the internal configuration of the manipulator 21 in which the manipulation knob 211 is bent by being gripped. As shown in FIG. 3A, none of the switches 212a, 212b, and 212c detect the grip amount unless the outer frame portion 211A is bent. In this state, a triangle T1 formed by connecting the contact portion 213a, the contact portion 213b, and the contact portion 213c in order with a dashed imaginary line is, for example, an equilateral triangle.
　矢印Ａ１方向および矢印Ａ２方向に操作ノブ２１１を把持する力が閾値を超えた場合、図３Ｂに示すように、外枠部２１１Ａは、矢印Ａ１方向および矢印Ａ２方向に撓む。外枠部２１１Ａが把持により撓むと、接触部２１３ａ、接触部２１３ｂおよび接触部２１３ｃを順に破線の仮想線で結んだ三角形Ｔ２は、正三角形以外の三角形に変形する。この状態で、スイッチ２１２ａ、２１２ｂおよび２１２ｃのうちの少なくとも一つが把持量を検出する。例えば、図３Ｂに示すように、矢印Ａ１方向に押し込められた外枠部２１１Ａの内壁がスイッチ２１２ｃを押圧することにより、スイッチ２１２ｃが把持量を検出する。 When the force for gripping the operation knob 211 in the arrow A1 direction and the arrow A2 direction exceeds the threshold, the outer frame portion 211A bends in the arrow A1 direction and the arrow A2 direction, as shown in FIG. 3B. When the outer frame portion 211A is flexed by gripping, the triangle T2 formed by connecting the contact portion 213a, the contact portion 213b and the contact portion 213c in order with a dashed virtual line deforms into a triangle other than an equilateral triangle. In this state, at least one of switches 212a, 212b and 212c detects the grip amount. For example, as shown in FIG. 3B, the inner wall of the outer frame portion 211A pushed in the arrow A1 direction presses the switch 212c, whereby the switch 212c detects the amount of grip.
　操作入力装置２は、検出部２１２から出力された把持量の検出信号を取得することによって、操作ノブ２１１を撓ませる把持量を示す情報を受け付ける。操作情報生成部２２は、操作子２１を用いた操作を示す操作情報を生成する。例えば、操作情報生成部２２は、スイッチ２１２ａ、２１２ｂおよび２１２ｃのいずれかによって検出された操作ノブ２１１の把持量に応じた操作情報を生成し、生成した操作情報を機能実行部５に出力する。 The operation input device 2 receives information indicating the gripping amount for bending the operation knob 211 by acquiring the gripping amount detection signal output from the detection unit 212 . The operation information generator 22 generates operation information indicating an operation using the manipulator 21 . For example, the operation information generation unit 22 generates operation information according to the grip amount of the operation knob 211 detected by any one of the switches 212 a , 212 b and 212 c and outputs the generated operation information to the function execution unit 5 .
　機能実行部５は、操作情報生成部２２によって生成された操作情報を入力し、入力した操作情報が示す操作に対応する機能を実行する。機能実行部５が実行する機能に関連した表示情報は、表示処理部２３に出力される。表示処理部２３は、タッチパネル３が設けられたＬＣＤ４に対し、機能実行部５が実行する機能に対応する画面を表示する。例えば、機能実行部５がＣＤ再生機能を実行する場合、表示処理部２３は、ＣＤ再生画面をＬＣＤ４に表示する。 The function execution unit 5 receives the operation information generated by the operation information generation unit 22 and executes the function corresponding to the operation indicated by the input operation information. Display information related to the functions executed by the function execution unit 5 is output to the display processing unit 23 . The display processing unit 23 displays a screen corresponding to the function executed by the function executing unit 5 on the LCD 4 provided with the touch panel 3 . For example, when the function executing section 5 executes the CD playing function, the display processing section 23 displays the CD playing screen on the LCD 4 .
　なお、スイッチ２１２ａ、２１２ｂおよび２１２ｃの代わりに、タッチパネル３を把持量の検出に用いてもよい。図３Ａおよび図３Ｂに示すように、操作ノブ２１１の撓みにより、接触部２１３ａ、接触部２１３ｂおよび接触部２１３ｃを順に仮想線で結んだ三角形Ｔ１が、三角形Ｔ２に変形する。タッチパネル３は、三角形Ｔ１の変形を、タッチ面上の接触部の位置変化として検出できる。すなわち、タッチパネル３は、タッチ面上での接触部の位置の変化量に基づいて、操作ノブ２１１の把持量を検出することができる。この場合、タッチパネル３は、操作ノブ２１１を把持して撓ませる把持量を検出する検出部として機能する。 Instead of the switches 212a, 212b, and 212c, the touch panel 3 may be used to detect the grip amount. As shown in FIGS. 3A and 3B, due to the bending of the operation knob 211, a triangle T1 formed by connecting the contact portions 213a, 213b, and 213c in order with a virtual line is transformed into a triangle T2. The touch panel 3 can detect the deformation of the triangle T1 as a change in the position of the contact portion on the touch surface. That is, the touch panel 3 can detect the grip amount of the operation knob 211 based on the amount of change in the position of the contact portion on the touch surface. In this case, the touch panel 3 functions as a detection unit that detects the grip amount of gripping and bending the operation knob 211 .
　図４は実施の形態１に係る操作入力方法を示すフローチャートであり、操作入力装置２の動作を示している。操作情報生成部２２は、操作子２１を用いた操作が行われたか否かを判定する（ステップＳＴ１）。例えば、操作情報生成部２２は、タッチパネル３および検出部２１２のうち少なくとも一方から操作子２１を用いた操作の検出情報が取得され、取得した検出情報が有効であると判定した場合に、操作子２１を用いた操作が行われたと判定する。 FIG. 4 is a flowchart showing the operation input method according to Embodiment 1, showing the operation of the operation input device 2. FIG. The operation information generator 22 determines whether or not an operation using the operator 21 has been performed (step ST1). For example, when the operation information generation unit 22 acquires detection information of an operation using the operation element 21 from at least one of the touch panel 3 and the detection unit 212 and determines that the acquired detection information is valid, the operation information generation unit 22 21 has been performed.
　例えば、操作情報生成部２２は、タッチパネル３のタッチ面における操作ノブ２１１の接触部の回転操作量が閾値以上である場合、操作ノブ２１１の回転操作の検出情報が有効であると判定し、回転操作量が閾値未満である場合、検出情報が無効であると判定する。また、操作情報生成部２２は、スイッチ２１２ａ、２１２ｂおよび２１２ｃのいずれかが検出している把持量が閾値以上である場合、操作ノブ２１１を撓ませる操作の検出情報が有効であると判定し、把持量が閾値未満である場合、検出情報が無効であると判定する。 For example, when the amount of rotation operation of the contact portion of the operation knob 211 on the touch surface of the touch panel 3 is equal to or greater than a threshold value, the operation information generation unit 22 determines that the detection information of the rotation operation of the operation knob 211 is valid, and determines that the rotation operation amount is valid. If the manipulated variable is less than the threshold, it is determined that the detection information is invalid. Further, when the grip amount detected by any of the switches 212a, 212b, and 212c is equal to or greater than the threshold value, the operation information generation unit 22 determines that the detection information of the operation to bend the operation knob 211 is valid, If the grip amount is less than the threshold, it is determined that the detection information is invalid.
　操作子２１を用いた操作が行われていないと判定した場合（ステップＳＴ１；ＮＯ）、操作情報生成部２２は、操作子２１を用いた操作が行われるまで、ステップＳＴ１の判定を繰り返す。操作子２１を用いた操作が行われたと判定すると（ステップＳＴ１；ＹＥＳ）、操作情報生成部２２は、操作子２１を用いた操作が、操作ノブ２１１を撓ませる操作であるか否かを判定する（ステップＳＴ２）。 When determining that an operation using the manipulator 21 has not been performed (step ST1; NO), the operation information generation unit 22 repeats the determination of step ST1 until an operation using the manipulator 21 is performed. When it is determined that an operation using the manipulator 21 has been performed (step ST1; YES), the operation information generation unit 22 determines whether or not the manipulation using the manipulator 21 is an operation to bend the manipulation knob 211. (step ST2).
　例えば、操作情報生成部２２は、有効な検出情報が検出部２１２から取得したものである場合、操作子２１を用いた操作が、操作ノブ２１１を撓ませる操作であると判定する。また、操作情報生成部２２は、有効な検出情報がタッチパネル３から取得したものである場合に、操作ノブ２１１を撓ませる操作ではないと判定し、操作子２１を用いた操作が、操作ノブ２１１の回転操作であると判定する。 For example, when valid detection information is acquired from the detection unit 212, the operation information generation unit 22 determines that the operation using the operation element 21 is an operation to bend the operation knob 211. Further, when the valid detection information is acquired from the touch panel 3, the operation information generation unit 22 determines that the operation using the operation knob 21 is not the operation to bend the operation knob 211, and the operation using the operation element 21 It is determined that it is a rotation operation of
　操作情報生成部２２は、操作子２１を用いた操作が、操作ノブ２１１を撓ませる操作であると判定した場合（ステップＳＴ２；ＹＥＳ）、操作ノブ２１１を把持により撓ませた把持量を含む操作情報を生成する（ステップＳＴ３）。また、操作子２１を用いた操作が操作ノブ２１１を撓ませる操作ではないと判定した場合（ステップＳＴ２；ＮＯ）、操作情報生成部２２は、操作ノブ２１１を撓ませせずに用いた操作を含む操作情報を生成する（ステップＳＴ４）。操作情報には、例えば、タッチ面における操作ノブ２１１の接触部２１３ａ～２１３ｃの各位置座標に基づいて算出された操作ノブ２１１のＸＹ座標、操作ノブ２１１の回転方向および回転操作量、スイッチ２１２ａ～２１２ｃにより検出された把持量を示す情報が含まれる。 When the operation information generating unit 22 determines that the operation using the manipulator 21 is an operation to bend the operation knob 211 (step ST2; YES), the operation information including the grip amount by which the operation knob 211 is bent by gripping. Information is generated (step ST3). Further, when it is determined that the operation using the manipulator 21 is not the operation of bending the operation knob 211 (step ST2; NO), the operation information generation unit 22 performs the operation using the operation knob 211 without bending it. Operation information is generated (step ST4). The operation information includes, for example, the XY coordinates of the operation knob 211 calculated based on the position coordinates of the contact portions 213a to 213c of the operation knob 211 on the touch surface, the rotation direction and amount of rotation of the operation knob 211, and the switches 212a to 213c. 212c includes information indicating the grip amount detected.
　例えば、操作情報生成部２２は、有効な検出情報が最初に取得された時点から１つの操作と判断する基準時間が経過するまでに取得された有効な検出情報を用いて、操作情報を生成する。例えば、操作情報生成部２２は、上記基準時間内に取得された検出情報が、操作ノブ２１１を撓ませる操作の検出情報であった場合、マウスのクリック操作と同様に、操作ノブ２１１を１回撓ませることにより目的の情報を選択する操作を示す操作情報を生成する。 For example, the operation information generation unit 22 generates operation information using valid detection information acquired from the time when valid detection information is first acquired until the reference time for determining one operation has passed. . For example, if the detection information acquired within the reference time is the detection information of an operation of bending the operation knob 211, the operation information generation unit 22 moves the operation knob 211 once, similar to a mouse click operation. Operation information indicating an operation of selecting target information by bending is generated.
　また、操作情報生成部２２は、上記基準時間内に取得された検出情報が、操作ノブ２１１を短い間隔で２回撓ませる操作の検出情報であった場合、マウスのダブルクリック操作と同様に、操作ノブ２１１を短い間隔で２回撓ませることにより目的の情報を選択する操作を示す操作情報を生成する。上記基準時間内に取得された検出情報が、操作ノブ２１１を短い間隔で３回撓ませる操作の検出情報であった場合、操作情報生成部２２は、マウスのトリプルクリック操作と同様に、操作ノブ２１１を短い間隔で３回撓ませることにより目的の情報を選択する操作を示す操作情報を生成する。 Further, when the detection information acquired within the reference time is the detection information of an operation of bending the operation knob 211 twice at short intervals, the operation information generation unit 22 performs By bending the operation knob 211 twice at short intervals, operation information indicating an operation of selecting target information is generated. If the detection information acquired within the reference time is the detection information of an operation of bending the operation knob 211 three times at short intervals, the operation information generation unit 22 generates the operation knob in the same manner as the triple-click operation of the mouse. By bending 211 three times at short intervals, operation information indicating an operation for selecting target information is generated.
　操作情報生成部２２は、上記基準時間内に取得された検出情報が、操作ノブ２１１を短い間隔で４回以上撓ませる操作の検出情報であった場合、マウスのロングクリック操作と同様に、操作ノブ２１１を短い間隔で４回以上撓ませることにより目的の情報を選択する操作を示す操作情報を生成する。また、操作情報生成部２２は、上記基準時間内に取得された検出情報が、撓んだ状態の操作ノブ２１１の回転操作であった場合、例えば、マウスを用いたドラッグアンドドロップ操作と同様に、表示画面上で目的の情報を移動させる操作を示す操作情報を生成する。 If the detection information acquired within the reference time is the detection information of an operation of bending the operation knob 211 four times or more at short intervals, the operation information generation unit 22 generates an operation similar to a long-click operation of the mouse. By flexing the knob 211 four times or more at short intervals, operation information indicating an operation for selecting target information is generated. Further, when the detection information acquired within the reference time is a rotation operation of the operation knob 211 in a flexed state, the operation information generation unit 22 generates an operation similar to a drag-and-drop operation using a mouse, for example. , generates operation information indicating an operation to move the target information on the display screen.
　操作情報生成部２２は、生成した操作情報を機能実行部５へ出力する（ステップＳＴ５）。機能実行部５は、操作情報生成部２２から操作情報を取得し、取得した操作情報が示す操作に対応した機能を実行し、実行している機能に対応した表示情報を、表示処理部２３に出力する。表示処理部２３は、表示情報をＬＣＤ４に表示する。例えば、ＬＣＤ４には、地図画面、カメラ画面、メニュー画面あるいはオーディオ再生画面が表示される。機能実行部５は、操作情報に含まれる操作ノブ２１１のＸＹ座標、操作ノブ２１１の回転方向および回転操作量といった操作内容を示す表示情報を、表示処理部２３に出力する。表示処理部２３は、操作情報が示す操作に対応した機能の画面表示において、表示情報に基づいて操作の内容を反映させる。 The operation information generation unit 22 outputs the generated operation information to the function execution unit 5 (step ST5). The function execution unit 5 acquires operation information from the operation information generation unit 22, executes a function corresponding to the operation indicated by the acquired operation information, and transmits display information corresponding to the function being executed to the display processing unit 23. Output. The display processing unit 23 displays display information on the LCD 4 . For example, the LCD 4 displays a map screen, a camera screen, a menu screen, or an audio playback screen. Function execution unit 5 outputs display information indicating operation details such as the XY coordinates of operation knob 211 , the rotation direction and amount of rotation of operation knob 211 included in the operation information to display processing unit 23 . The display processing unit 23 reflects the content of the operation based on the display information in the screen display of the function corresponding to the operation indicated by the operation information.
　操作情報生成部２２は、操作ノブ２１１の把持量が変更されたか否かを判定する（ステップＳＴ６）。検出部２１２によって検出された把持量が、前のステップで生成した操作情報に含まれる把持量から変化した場合、操作情報生成部２２は、操作ノブ２１１の把持量が変更されたと判定する。操作ノブ２１１の把持量が変更された場合（ステップＳＴ６；ＹＥＳ）、操作情報生成部２２は、ステップＳＴ３の処理に戻り、変更後の把持量を含む操作情報を生成する。操作ノブ２１１の把持量が変更されなかった場合（ステップＳＴ６；ＮＯ）、図４の処理を終了する。 The operation information generation unit 22 determines whether or not the gripping amount of the operation knob 211 has been changed (step ST6). When the amount of grip detected by the detection unit 212 changes from the amount of grip included in the operation information generated in the previous step, the operation information generation unit 22 determines that the amount of grip of the operation knob 211 has changed. If the gripping amount of the operation knob 211 is changed (step ST6; YES), the operation information generator 22 returns to the process of step ST3 and generates the operation information including the gripping amount after the change. If the gripping amount of the operation knob 211 has not been changed (step ST6; NO), the process of FIG. 4 ends.
　図５Ａは、操作ノブ２１１を撓ませずに回転させたときの調整量の変化分を示す概要図である。図５Ｂは、操作ノブ２１１を小さい把持量で撓ませて回転させたときの調整量の変化分を示す概要図である。図５Ｃは、操作ノブ２１１を大きい把持量で撓ませて回転させたときの調整量の変化分を示す概要図である。図５Ａ、図５Ｂおよび図５Ｃにおいて、操作ノブ２１１の回転量に応じた調整量が目盛りで表現されている。操作入力装置２は、操作ノブ２１１の把持量の増加に応じて、操作ノブ２１１を撓ませる操作に対応する調整機能の調整量を増加させる操作情報を生成する。 FIG. 5A is a schematic diagram showing the amount of change in the adjustment amount when the operation knob 211 is rotated without bending. FIG. 5B is a schematic diagram showing the amount of change in the adjustment amount when the operation knob 211 is flexed with a small grasp amount and rotated. FIG. 5C is a schematic diagram showing a change in the amount of adjustment when the operation knob 211 is flexed by a large amount of grip and rotated. 5A, 5B, and 5C, the adjustment amount corresponding to the amount of rotation of the operation knob 211 is represented by scales. The operation input device 2 generates operation information for increasing the adjustment amount of the adjustment function corresponding to the operation of bending the operation knob 211 in accordance with an increase in the gripping amount of the operation knob 211 .
　例えば、図５Ａに示すように、撓ませずに操作ノブ２１１を矢印方向に回転量Ｒ１だけ回転させた場合、矢印Ｂ１で示すように、調整量は、初期値から１目盛りだけ増加する。また、第１の把持量で撓ませた操作ノブ２１１を、図５Ａと同様に回転量Ｒ１だけ回転させた場合、矢印Ｂ２で示すように、調整量は、初期値から２目盛り増加する。さらに、第１の把持量よりも大きい第２の把持量で撓ませた操作ノブ２１１を、図５Ａと同様に回転量Ｒ１だけ回転させた場合には、矢印Ｂ３で示すように、調整量は、初期値から４目盛り増加する。このように、操作入力装置２は、操作ノブ２１１を撓ませるという自然な操作によって、機能実行部５が実行する調整機能における調整量を変化させることが可能である。 For example, as shown in FIG. 5A, when the operation knob 211 is rotated in the direction of the arrow by a rotation amount R1 without bending, the adjustment amount increases by one scale from the initial value, as indicated by an arrow B1. Further, when the operation knob 211 bent by the first grip amount is rotated by the rotation amount R1 as in FIG. 5A, the adjustment amount increases by two scales from the initial value as indicated by the arrow B2. Furthermore, when the operation knob 211 bent by the second gripping amount larger than the first gripping amount is rotated by the rotation amount R1 as in FIG. 5A, the adjustment amount is , is increased by 4 scales from the initial value. In this way, the operation input device 2 can change the adjustment amount in the adjustment function executed by the function execution unit 5 by a natural operation of bending the operation knob 211 .
　図６Ａは、操作ノブ２１１を撓ませずに回転させたときのメニュー選択画面を示す概要図である。図６Ｂは、操作ノブ２１１を小さい把持量で撓ませながら回転させたときのメニュー選択画面を示す概要図である。図６Ｃは、操作ノブ２１１を大きい把持量で撓ませながら回転させたときのメニュー選択画面を示す概要図である。図６Ａ、図６Ｂおよび図６Ｃにおいて、メニュー選択画面３０は、複数の項目情報（メニュー情報）が登録されたリストから目的のメニュー情報を選択させる画面であり、タッチパネル３が設けられたＬＣＤ４に表示される。操作入力装置２は、操作ノブ２１１の把持量の増加に応じて、メニュー選択画面３０からメニュー情報を選択するためのカーソルの移動量を増加させる操作情報を生成する。 FIG. 6A is a schematic diagram showing the menu selection screen when the operation knob 211 is rotated without bending. FIG. 6B is a schematic diagram showing a menu selection screen when the operation knob 211 is rotated while being flexed by a small gripping amount. FIG. 6C is a schematic diagram showing a menu selection screen when the operation knob 211 is bent while being rotated by a large grasp amount. 6A, 6B and 6C, menu selection screen 30 is a screen for selecting target menu information from a list in which a plurality of item information (menu information) are registered, and is displayed on LCD 4 provided with touch panel 3. be done. The operation input device 2 generates operation information for increasing the amount of movement of the cursor for selecting menu information from the menu selection screen 30 in accordance with an increase in the grip amount of the operation knob 211 .
　例えば、操作ノブ２１１が把持される前のメニュー選択画面３０は、図６Ａに示すように、メニュー情報Ｃの位置にカーソルがあり、メニュー情報Ｃが選択候補になっていたとする。この状態から、第１の把持量で撓ませた操作ノブ２１１を回転量Ｒ１で回転させた場合、図６Ｂにおいて矢印Ｃ１で示すように、メニュー情報Ｃに隣接したメニュー情報Ｄの位置にカーソルが移動し、メニュー選択画面３０において、メニュー情報Ｃとメニュー情報Ｄとの間で表示順が入れ替わる。 For example, assume that the menu selection screen 30 before the operation knob 211 is gripped has the cursor at the position of the menu information C and the menu information C is a selection candidate, as shown in FIG. 6A. From this state, when the operation knob 211 bent by the first holding amount is rotated by the rotation amount R1, the cursor is positioned at the position of the menu information D adjacent to the menu information C, as indicated by the arrow C1 in FIG. 6B. The display order of menu information C and menu information D is changed on the menu selection screen 30 .
　また、図６Ａの状態から、第１の把持量よりも大きい第２の把持量で撓ませた操作ノブ２１１を回転量Ｒ１で回転させた場合は、図６Ｃにおいて矢印Ｃ２で示すように、メニュー情報Ｄよりもメニュー情報Ｃから離れたメニュー情報Ｅの位置にカーソルが移動して、メニュー選択画面３０において、メニュー情報Ｃとメニュー情報Ｅとの間で表示順が入れ替わる。このように、操作入力装置２は、操作ノブ２１１を撓ませるという自然な操作によって、メニュー選択画面３０におけるメニュー情報の表示順の変更という複雑な処理を行うことが可能である。 Further, when the operation knob 211 bent by the second grip amount larger than the first grip amount is rotated by the rotation amount R1 from the state of FIG. 6A, as indicated by the arrow C2 in FIG. 6C, the menu The cursor moves to the position of the menu information E that is farther from the menu information C than the information D, and the display order of the menu information C and the menu information E is switched on the menu selection screen 30 . In this way, the operation input device 2 can perform complicated processing such as changing the display order of menu information on the menu selection screen 30 by a natural operation of bending the operation knob 211 .
　操作入力装置２における操作情報生成部２２および表示処理部２３の機能は、処理回路により実現される。すなわち、操作入力装置２は、図４に示したステップＳＴ１からステップＳＴ６の処理を実行するための処理回路を備える。処理回路は、専用のハードウェアであってもよいが、メモリに記憶されたプログラムを実行するＣＰＵであってもよい。 The functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 are realized by processing circuits. That is, the operation input device 2 includes a processing circuit for executing the processing from step ST1 to step ST6 shown in FIG. The processing circuit may be dedicated hardware, or may be a CPU that executes a program stored in memory.
　図７Ａは、操作入力装置２の機能を実現するハードウェア構成を示すブロック図である。図７Ｂは、操作入力装置２の機能を実現するソフトウェアを実行するハードウェア構成を示すブロック図である。図７Ａおよび図７Ｂにおいて、入力インタフェース１００は、タッチパネル３または操作子２１が備える検出部２１２から操作情報生成部２２へ出力される検出情報、または、機能実行部５から表示処理部２３へ出力される表示情報を中継するインタフェースである。出力インタフェース１０１は、操作情報生成部２２から機能実行部５へ出力される操作情報を中継するインタフェースである。 FIG. 7A is a block diagram showing the hardware configuration that implements the functions of the operation input device 2. FIG. FIG. 7B is a block diagram showing a hardware configuration for executing software realizing the functions of the operation input device 2. As shown in FIG. 7A and 7B, the input interface 100 includes detection information output from the detection unit 212 included in the touch panel 3 or the operator 21 to the operation information generation unit 22, or output from the function execution unit 5 to the display processing unit 23. It is an interface that relays display information. The output interface 101 is an interface that relays operation information output from the operation information generation unit 22 to the function execution unit 5 .
　処理回路が図５Ａに示す専用のハードウェアの処理回路１０２である場合、処理回路１０２は、例えば、単一回路、複合回路、プログラム化したプロセッサ、並列プログラム化したプロセッサ、ＡＳＩＣ、ＦＰＧＡ、またはこれらを組み合わせたものが該当する。操作入力装置２における操作情報生成部２２および表示処理部２３の機能を別々の処理回路で実現してもよく、これらの機能をまとめて一つの処理回路で実現してもよい。 If the processing circuit is the dedicated hardware processing circuit 102 shown in FIG. 5A, the processing circuit 102 may be, for example, a single circuit, multiple circuits, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or any of these. A combination of is applicable. The functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 may be realized by separate processing circuits, or these functions may be collectively realized by one processing circuit.
　処理回路が図５Ｂに示すプロセッサ１０３である場合、操作入力装置２における操作情報生成部２２および表示処理部２３の機能は、ソフトウェア、ファームウェアまたはソフトウェアとファームウェアとの組み合わせによって実現される。なお、ソフトウェアまたはファームウェアは、プログラムとして記述されてメモリ１０４に記憶される。 When the processing circuit is the processor 103 shown in FIG. 5B, the functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 are realized by software, firmware, or a combination of software and firmware. Note that software or firmware is written as a program and stored in the memory 104 .
　プロセッサ１０３は、メモリ１０４に記憶されたプログラムを読み出して実行することにより、操作入力装置２における操作情報生成部２２および表示処理部２３の機能を実現する。例えば、操作入力装置２は、プロセッサ１０３によって実行されるときに、図４に示したステップＳＴ１からステップＳＴ６の処理が結果的に実行されるプログラムを記憶するためのメモリ１０４を備える。これらのプログラムは、操作情報生成部２２および表示処理部２３が行う処理の手順または方法を、コンピュータに実行させる。 The processor 103 implements the functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 by reading and executing the programs stored in the memory 104 . For example, the operation input device 2 includes a memory 104 for storing a program that, when executed by the processor 103, results in the processing of steps ST1 to ST6 shown in FIG. These programs cause the computer to execute the procedures or methods of the processing performed by the operation information generating section 22 and the display processing section 23 .
　メモリ１０４は、コンピュータを、操作情報生成部２２および表示処理部２３として機能させるためのプログラムが記憶されたコンピュータ可読記憶媒体であってもよい。メモリ１０４は、例えば、ＲＡＭ、ＲＯＭ、フラッシュメモリ、ＥＰＲＯＭ、ＥＥＰＲＯＭなどの不揮発性または揮発性の半導体メモリ、磁気ディスク、フレキシブルディスク、光ディスク、コンパクトディスク、ミニディスク、ＤＶＤなどが該当する。 The memory 104 may be a computer-readable storage medium storing a program for causing a computer to function as the operation information generating section 22 and the display processing section 23. The memory 104 corresponds to, for example, nonvolatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, EEPROM, magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD, and the like.
　操作入力装置２における操作情報生成部２２および表示処理部２３の機能の一部を専用のハードウェアで実現し、一部をソフトウェアまたはファームウェアで実現してもよい。例えば、操作情報生成部２２は、専用のハードウェアである処理回路１０２によってその機能を実現し、表示処理部２３は、プロセッサ１０３がメモリ１０４に記憶されたプログラムを読み出して実行することによりその機能を実現してもよい。このように、処理回路は、ハードウェア、ソフトウェア、ファームウェアまたはこれらの組み合わせにより上記機能を実現することができる。 A part of the functions of the operation information generation unit 22 and the display processing unit 23 in the operation input device 2 may be realized by dedicated hardware, and a part may be realized by software or firmware. For example, the operation information generation unit 22 realizes its functions by the processing circuit 102, which is dedicated hardware, and the display processing unit 23 implements its functions by the processor 103 reading and executing a program stored in the memory 104. may be realized. As such, the processing circuitry may implement the above functions in hardware, software, firmware, or a combination thereof.
　以上のように、実施の形態１に係る操作入力装置２は、タッチパネルに回転可能に設けられた操作ノブおよび操作ノブを把持して撓ませる把持量を検出する検出部を有した操作子と、操作子を用いた操作を示す操作情報を生成し、操作に対応する機能を実行する機能実行部に操作情報を出力する操作情報生成部とを備え、操作情報生成部は、検出部によって検出された操作ノブを撓ませる把持量に応じた操作情報を生成する。操作ノブ２１１を把持する力を変えて撓ませる自然な操作によって実行対象の機能を指定できる。これにより、操作入力装置２は、操作子を把持する指の数によらずに、目的の機能に対応する操作を行うことができる。さらに、自然な操作によって実行対象の機能が指定されるため、操作入力装置２を備える情報処理装置１では、目的の機能とは異なる機能が誤って実行される可能性が低減される。 As described above, the operation input device 2 according to Embodiment 1 includes an operation knob provided rotatably on the touch panel and an operation element having a detection unit that detects the amount of gripping and bending the operation knob, an operation information generation unit that generates operation information indicating an operation using the operator and outputs the operation information to a function execution unit that executes a function corresponding to the operation, wherein the operation information generation unit is detected by the detection unit; Operation information is generated according to the amount of gripping that bends the operation knob. A function to be executed can be designated by a natural operation of bending the operation knob 211 by changing the gripping force. As a result, the operation input device 2 can perform an operation corresponding to a desired function regardless of the number of fingers holding the operator. Furthermore, since a function to be executed is designated by a natural operation, the information processing apparatus 1 including the operation input device 2 reduces the possibility of erroneously executing a function different from the intended function.
　実施の形態１に係る操作入力装置２において、操作情報生成部２２は、操作ノブ２１１を把持して撓ませる把持量に応じて機能実行部５が実行する調整機能の調整量を変化させる操作情報を生成する。これにより、操作入力装置２は、操作ノブ２１１を撓ませるという自然な操作によって、機能実行部５が実行する調整機能における調整量を変化させることが可能である。 In the operation input device 2 according to the first embodiment, the operation information generation unit 22 generates operation information for changing the adjustment amount of the adjustment function executed by the function execution unit 5 according to the amount of gripping and bending the operation knob 211. to generate Thereby, the operation input device 2 can change the adjustment amount in the adjustment function executed by the function execution unit 5 by a natural operation of bending the operation knob 211 .
実施の形態２．
　図８は、実施の形態２に係る情報処理装置１Ａの構成例を示すブロック図である。図８において、図１と同一の構成要素には同一の符号を付して説明を省略する。情報処理装置１Ａは、操作入力装置２Ａによって受け付けられた操作入力に対応する機能を実行している。例えば、情報処理装置１Ａは、ナビゲーション装置、空調装置またはオーディオ機器である。情報処理装置１Ａは、図８に示すように、操作入力装置２Ａ、タッチパネル３、ＬＣＤ４および機能実行部５を備える。 Embodiment 2.
FIG. 8 is a block diagram showing a configuration example of an information processing device 1A according to the second embodiment. In FIG. 8, the same components as those in FIG. 1 are assigned the same reference numerals, and descriptions thereof are omitted. The information processing device 1A executes a function corresponding to the operation input received by the operation input device 2A. For example, the information processing device 1A is a navigation device, an air conditioner, or an audio device. The information processing apparatus 1A includes an operation input device 2A, a touch panel 3, an LCD 4, and a function execution section 5, as shown in FIG.
　操作入力装置２Ａは、タッチパネル３のタッチ面上に設けられた操作子２１Ａを用いた操作入力を受け付ける装置であり、操作子２１Ａ、操作情報生成部２２および表示処理部２３を備える。操作子２１Ａは、操作ノブ２１１、検出部２１２および振動部２１３を備える。振動部２１３は、操作ノブ２１１に振動を与える振動子である。振動部２１３は、機能実行部５が実行する調整機能の調整量に応じて操作ノブ２１１に振動を与える。機能実行部５が実行する調整機能の調整量は、検出部２１２によって検出された把持量に応じて変化する。このため、振動部２１３は、検出部２１２によって検出された把持量に応じて振動する。例えば、振動部２１３は、操作ノブ２１１の把持量に応じて、振動の回数、振動の強さ、振動の周波数および振動の印加時間のうちの少なくとも一つを変更する。 The operation input device 2A is a device that receives an operation input using the operator 21A provided on the touch surface of the touch panel 3, and includes the operator 21A, an operation information generator 22, and a display processor 23. 21 A of manipulators are provided with the operation knob 211, the detection part 212, and the vibration part 213. FIG. The vibrating section 213 is a vibrator that vibrates the operation knob 211 . The vibration section 213 vibrates the operation knob 211 according to the adjustment amount of the adjustment function executed by the function execution section 5 . The adjustment amount of the adjustment function executed by the function execution unit 5 changes according to the gripping amount detected by the detection unit 212 . Therefore, the vibrating section 213 vibrates according to the gripping amount detected by the detecting section 212 . For example, the vibrating section 213 changes at least one of the number of times of vibration, the strength of vibration, the frequency of vibration, and the application time of vibration according to the grip amount of the operation knob 211 .
　図９は、操作入力装置２Ａの構成例を示す正面図である。操作入力装置２Ａが備える操作ノブ２１１は、図９に示すように、タッチパネル３のタッチ面上で振り子状にスライド操作可能に設けられている。ＬＣＤ４には、アーム７が設けられる。アーム７は、一方の端部がＬＣＤ４の背面側に回転自在に支持されており、他方の端部がＬＣＤ４の前面側に屈曲している。アーム７におけるＬＣＤ４の前面側に屈曲した端部には、操作ノブ２１１が連結されている。 FIG. 9 is a front view showing a configuration example of the operation input device 2A. As shown in FIG. 9, the operation knob 211 included in the operation input device 2A is provided so as to be slidably operated in a pendulum shape on the touch surface of the touch panel 3 . The LCD 4 is provided with an arm 7 . One end of the arm 7 is rotatably supported on the back side of the LCD 4 , and the other end is bent toward the front side of the LCD 4 . An operation knob 211 is connected to the end portion of the arm 7 bent toward the front side of the LCD 4 .
　操作ノブ２１１は、アーム７の一方の端部を回転中心として、タッチパネル３のタッチ面上で矢印Ｂ方向にスライド可能である。また、ユーザは、把持している操作ノブ２１１を矢印Ｂ方向へスライド移動させながら、操作ノブ２１１を回転操作することが可能である。操作ノブ２１１のスライド操作は、タッチパネル３によって検出される。図９に示すように、ＬＣＤ４の背面側において、アーム７には、バネ７Ａとバネ７Ｂが取り付けられている。ユーザが操作ノブ２１１から手を離すと、バネ７Ａの荷重とバネ７Ｂの荷重とが釣り合う位置にアーム７が戻り、操作ノブ２１１は、スライド移動軌跡の中央位置に復帰する。 The operation knob 211 is slidable in the direction of arrow B on the touch surface of the touch panel 3 with one end of the arm 7 as the center of rotation. Further, the user can rotate the operating knob 211 while sliding the gripped operating knob 211 in the arrow B direction. A slide operation of the operation knob 211 is detected by the touch panel 3 . As shown in FIG. 9, a spring 7A and a spring 7B are attached to the arm 7 on the rear side of the LCD 4. As shown in FIG. When the user releases the operation knob 211, the arm 7 returns to a position where the load of the spring 7A and the load of the spring 7B are balanced, and the operation knob 211 returns to the central position of the slide movement locus.
　なお、操作ノブ２１１を中央位置に戻す機構は、バネ７Ａおよびバネ７Ｂに限定されるものではなく、磁石またはダンパ等が用いられてもよい。アーム７および操作ノブ２１１の自重によって、操作ノブ２１１が中央位置に戻る構成であってもよい。 The mechanism for returning the operation knob 211 to the central position is not limited to the springs 7A and 7B, and magnets, dampers, or the like may be used. The operation knob 211 may return to the central position by the weight of the arm 7 and the operation knob 211 .
　図１０は、操作ノブ２１１のスライド操作と、操作ノブ２１１を撓ませる操作および操作ノブ２１１の把持量とを組み合わせた操作によって、ＣＤ再生処理を行ったときの表示例を示す画面図である。ＣＤ再生画面３１は、トラック（Ｔ）、音量調整（Ｖ）および再生速度調整（Ｓ）を選択させる画面であり、ＬＣＤ４に表示される。機能実行部５は、操作ノブ２１１の回転操作に応じてＣＤ再生画面３１における調整項目の調整量を変更し、操作ノブ２１１のスライド操作に応じてＣＤ再生画面３１における調整項目を選択する。表示処理部２３は、調整項目の調整量の変更および調整項目の選択が行われるＣＤ再生画面３１をＬＣＤ４に表示する。ＣＤ再生画面３１におけるスライドバー画像３２は、現在の音量を示す画像である。 FIG. 10 is a screen diagram showing a display example when CD playback processing is performed by a combination of the operation of sliding the operation knob 211, the operation of bending the operation knob 211, and the amount of gripping the operation knob 211. FIG. A CD playback screen 31 is a screen for selecting a track (T), volume adjustment (V) and playback speed adjustment (S), and is displayed on the LCD 4 . The function execution unit 5 changes the adjustment amount of the adjustment item on the CD playback screen 31 according to the rotation operation of the operation knob 211 , and selects the adjustment item on the CD playback screen 31 according to the slide operation of the operation knob 211 . The display processing unit 23 displays on the LCD 4 a CD playback screen 31 on which adjustment amounts of adjustment items are changed and adjustment items are selected. A slide bar image 32 on the CD playback screen 31 is an image indicating the current sound volume.
　図１０において破線を境として（Ａ）側に記載した画面は、操作ノブ２１１を把持して撓ませる把持量に応じて、音量調整（Ｖ）における音量調整量を変更させたときのＣＤ再生画面３１を示している。また、破線を境として（Ｂ）側に記載した画面は、（Ａ）側に記載したＣＤ再生画面３１がＬＣＤ４に表示されているときに、操作ノブ２１１から手を離し、操作ノブ２１１がスライド移動軌跡の中央位置に復帰したときのＣＤ再生画面３１を示している。 The screen shown on the side (A) of FIG. 10 with the dashed line as the boundary is the CD playback screen when the volume adjustment amount in the volume adjustment (V) is changed according to the amount of gripping and bending the operation knob 211. 31 is shown. Also, the screen shown on the (B) side of the dashed line is displayed when the CD playback screen 31 shown on the (A) side is displayed on the LCD 4, the operation knob 211 is released, and the operation knob 211 is slid. It shows the CD playback screen 31 when returning to the center position of the movement locus.
　（Ａ）側の中央に記載したＣＤ再生画面３１は、スライド移動軌跡の中央位置にある操作ノブ２１１を回転操作していないときの画面を示している。この状態から、第１の把持量で撓ませた操作ノブ２１１を回転方向Ｄ１で第１の回転量で回転させた場合、矢印Ｅ１方向にスライドバー画像３２が第１の移動量でスライドし、音量は最小値に設定される。なお、振動部２１３は、音量が最小値または最大値に設定されたときに、操作ノブ２１１を振動させてもよい。 The CD playback screen 31 shown in the center of side (A) shows the screen when the operation knob 211 at the center position of the slide movement trajectory is not being rotated. From this state, when the operation knob 211 bent by the first grip amount is rotated by the first amount in the rotation direction D1, the slide bar image 32 slides in the direction of the arrow E1 by the first amount of movement, Volume is set to minimum. Note that the vibrating section 213 may vibrate the operation knob 211 when the volume is set to the minimum value or the maximum value.
　（Ａ）側の中央に記載したＣＤ再生画面３１において、第１の把持量よりも大きい第２の把持量で撓ませた操作ノブ２１１を、回転方向Ｄ２で第１の回転量で回転させた場合、矢印Ｅ２方向にスライドバー画像３２が、第１の移動量より多い第２の移動量でスライドし、音量が増加される。このように、操作入力装置２Ａは、操作ノブ２１１を撓ませる把持量に応じて、機能実行部５が実行する調整機能における調整量を変化させることが可能である。 In the CD playback screen 31 shown in the center of side (A), the operation knob 211 bent by the second gripping amount larger than the first gripping amount is rotated by the first rotation amount in the rotation direction D2. In this case, the slide bar image 32 slides in the direction of the arrow E2 by a second amount of movement larger than the first amount of movement, and the volume is increased. In this way, the operation input device 2A can change the adjustment amount in the adjustment function executed by the function executing section 5 according to the gripping amount by which the operation knob 211 is bent.
　撓みから復帰させた操作ノブ２１１がスライド移動軌跡の中央位置から矢印Ｆ１方向にスライド操作された場合、表示処理部２３は、ＣＤ再生画面３１において、音量調整（Ｖ）が選択された状態からトラック（Ｔ）が選択された状態に切り替える。また、撓みから復帰させた操作ノブ２１１がスライド移動軌跡の中央位置から矢印Ｆ２方向にスライド操作されると、表示処理部２３は、ＣＤ再生画面３１において、音量調整（Ｖ）が選択された状態から再生速度調整（Ｓ）が選択された状態に切り替える。操作入力装置２Ａは、操作ノブ２１１をスライドさせる自然な操作によって調整項目を変更することが可能である。 When the operation knob 211 restored from bending is slid in the direction of the arrow F1 from the center position of the slide movement trajectory, the display processing unit 23 changes the track from the state in which the volume adjustment (V) is selected on the CD playback screen 31. (T) is selected. Further, when the operation knob 211 restored from the bending is slid in the direction of the arrow F2 from the center position of the slide movement locus, the display processing unit 23 displays the CD playback screen 31 in the state where the volume adjustment (V) is selected. to the state where the reproduction speed adjustment (S) is selected. The operation input device 2A can change the adjustment item by a natural operation of sliding the operation knob 211 .
　図１１は、操作ノブ２１１のスライド操作と、操作ノブ２１１を撓ませる操作および操作ノブ２１１の把持量とを組み合わせた操作によって、車両周辺の地図を回転させる処理を行ったときの表示例を示す画面図である。図１１において、表示処理部２３は、地図画面３３をＬＣＤ４に表示している。地図画面３３には、車両の現在位置を示す画像３３Ａとルート３３Ｂが表示されている。表示処理部２３は、操作ノブ２１１を撓ませる把持量と操作ノブ２１１の回転操作とに応じて、地図画面３３を回転させる。 FIG. 11 shows a display example when a process of rotating the map around the vehicle is performed by an operation combining the operation of sliding the operation knob 211, the operation of bending the operation knob 211, and the gripping amount of the operation knob 211. FIG. It is a screen figure. In FIG. 11 , the display processing unit 23 displays the map screen 33 on the LCD 4 . The map screen 33 displays an image 33A showing the current position of the vehicle and a route 33B. The display processing unit 23 rotates the map screen 33 in accordance with the gripping amount for bending the operation knob 211 and the rotation operation of the operation knob 211 .
　図１１において破線を境として（Ａ）側に記載した各画面は、操作ノブ２１１を第１の把持量で把持して撓ませながら回転操作したときの地図画面３３を示している。また、破線を境として（Ｂ）側に記載した画面は、第１の把持量よりも大きい第２の把持量で把持して撓ませながら回転操作したときの地図画面３３を示している。 Each screen shown on the (A) side of the dashed line in FIG. 11 shows the map screen 33 when the operation knob 211 is gripped by the first gripping amount and rotated while being deflected. The screen drawn on the (B) side of the dashed line shows the map screen 33 when the map screen 33 is gripped with a second gripping amount larger than the first gripping amount and rotated while being bent.
　第１の把持量で撓ませた操作ノブ２１１が矢印Ｇ１方向に回転されると、図１１に示すように、表示処理部２３は、地図画面３３を回転量Ｈ１で回転させる。また、第１の把持量で撓ませた操作ノブ２１１が矢印Ｇ２方向に回転されると、表示処理部２３は、地図画面３３を回転量Ｈ２で回転させる。例えば、回転量Ｈ１と回転量Ｈ２とは同じ値である。
　このように、操作入力装置２Ａは、操作ノブ２１１を撓ませながら回転させるという自然な操作によって地図の向きを変更することができる。 When the operation knob 211 bent by the first grip amount is rotated in the direction of the arrow G1, the display processing unit 23 rotates the map screen 33 by the rotation amount H1, as shown in FIG. Further, when the operation knob 211 bent by the first grip amount is rotated in the direction of the arrow G2, the display processing unit 23 rotates the map screen 33 by the rotation amount H2. For example, the amount of rotation H1 and the amount of rotation H2 are the same value.
Thus, the operation input device 2A can change the orientation of the map by a natural operation of bending and rotating the operation knob 211 .
　第２の把持量で撓ませた操作ノブ２１１が矢印Ｇ１方向に回転されると、図１１に示すように、表示処理部２３は、地図画面３３を、回転量Ｈ１よりも大きい回転量Ｉ１で回転させる。また、第２の把持量で撓ませた操作ノブ２１１が矢印Ｇ２方向に回転されると、表示処理部２３は、地図画面３３を、回転量Ｈ２よりも大きい回転量Ｉ２で回転させる。このように、操作入力装置２Ａは、操作ノブ２１１の把持量に応じて地図の向きの変更量を変えることができる。 When the operation knob 211 bent by the second gripping amount is rotated in the direction of the arrow G1, the display processing unit 23 causes the map screen 33 to be rotated by the amount of rotation I1 larger than the amount of rotation H1, as shown in FIG. rotate. Further, when the operation knob 211 bent by the second gripping amount is rotated in the direction of the arrow G2, the display processing unit 23 rotates the map screen 33 by the amount of rotation I2 larger than the amount of rotation H2. In this manner, the operation input device 2A can change the amount of change in the orientation of the map according to the amount by which the operation knob 211 is gripped.
　図１２は、操作ノブ２１１のスライド操作と、操作ノブ２１１を撓ませる操作および操作ノブ２１１の把持量とを組み合わせた操作によって、車両の経路上の位置を変更する処理を行ったときの表示例を示す画面図である。図１２において、表示処理部２３は、地図画面３３をＬＣＤ４に表示している。地図画面３３には、車両の現在位置を示す画像３３Ａとルート３３Ｂが表示されている。表示処理部２３は、操作ノブ２１１を撓ませる把持量と操作ノブ２１１のスライド操作とに応じて、地図画面３３をスライド移動させる。 FIG. 12 shows an example of a display when a process of changing the position of the vehicle on the route is performed by an operation combining the operation of sliding the operation knob 211, the operation of bending the operation knob 211, and the amount of gripping the operation knob 211. It is a screen diagram showing . In FIG. 12 , the display processing unit 23 displays the map screen 33 on the LCD 4 . The map screen 33 displays an image 33A showing the current position of the vehicle and a route 33B. The display processing unit 23 slides the map screen 33 in accordance with the gripping amount for bending the operation knob 211 and the sliding operation of the operation knob 211 .
　図１２において破線を境として（Ａ）側に記載した各画面は、操作ノブ２１１を第１の把持量で把持して撓ませながらスライド操作したときの地図画面３３を示している。破線を境として（Ｂ）側に記載した画面は、第１の把持量よりも大きい第２の把持量で把持して撓ませながらスライド操作したときの地図画面３３を示している。 Each screen shown on the (A) side of the dashed line in FIG. 12 shows the map screen 33 when the operation knob 211 is gripped by the first gripping amount and slid while being bent. The screen drawn on the (B) side of the dashed line shows the map screen 33 when the slide operation is performed while holding and bending with a second holding amount larger than the first holding amount.
　第１の把持量で撓ませた操作ノブ２１１が矢印Ｊ１方向にスライド操作されると、図１２に示すように、表示処理部２３は、地図画面３３を移動量Ｋ１でスライド移動させる。また、第１の把持量で撓ませた操作ノブ２１１が矢印Ｊ２方向にスライド操作されると、表示処理部２３は、地図画面３３を移動量Ｋ２でスライド移動させる。例えば、移動量Ｋ１と移動量Ｋ２とは同じ値である。このように、操作入力装置２Ａは、操作ノブ２１１を撓ませながらスライドさせるという自然な操作によって地図画面をスライドさせることができる。 When the operation knob 211 bent by the first grip amount is slid in the direction of arrow J1, the display processing unit 23 slides the map screen 33 by the movement amount K1, as shown in FIG. Further, when the operation knob 211 bent by the first grip amount is slid in the direction of arrow J2, the display processing unit 23 slides the map screen 33 by the movement amount K2. For example, the movement amount K1 and the movement amount K2 are the same value. Thus, the operation input device 2A can slide the map screen by a natural operation of bending and sliding the operation knob 211 .
　第２の把持量で撓ませた操作ノブ２１１が矢印Ｊ１方向にスライド操作されると、図１２に示すように、表示処理部２３は、地図画面３３を、移動量Ｋ１よりも大きい移動量Ｌ１でスライド移動させる。また、第２の把持量で撓ませた操作ノブ２１１が矢印Ｊ２方向にスライド操作されると、表示処理部２３は、地図画面３３を、移動量Ｋ２よりも大きい移動量Ｌ２でスライド移動させる。このように、操作入力装置２Ａは、操作ノブ２１１の把持量に応じて地図画面のスライド移動量を変えることができる。 When the operation knob 211 bent by the second grip amount is slid in the direction of the arrow J1, the display processing unit 23 moves the map screen 33 to the position of the movement amount L1 larger than the movement amount K1, as shown in FIG. to slide. Further, when the operation knob 211 bent by the second grip amount is slid in the direction of arrow J2, the display processing unit 23 slides the map screen 33 by a movement amount L2 larger than the movement amount K2. In this manner, the operation input device 2A can change the amount of slide movement of the map screen according to the grip amount of the operation knob 211 .
　図１３は、操作ノブ２１１の把持量に応じた調整量の変化と、調整量に応じた振動の強さおよび回数の変化との関係を示すグラフである。図１３における上側のグラフは、操作ノブ２１１の把持量に応じた調整量の変化を示している。例えば、機能実行部５が実行する機能がＣＤ再生機能である場合、調整量は、音量または再生速度である。また、調整量は、選択画面におけるカーソルの移動量であってもよい。上記グラフにおいて、直線Ｍ１は、直線的に増加させた操作ノブ２１１の把持量を示している。また、直線Ｍ２は、直線的に減少させた操作ノブ２１１の把持量を示している。 FIG. 13 is a graph showing the relationship between changes in the amount of adjustment according to the amount of gripping of the operation knob 211 and changes in the strength and frequency of vibration according to the amount of adjustment. The upper graph in FIG. 13 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 . For example, when the function executed by the function execution unit 5 is the CD playback function, the adjustment amount is volume or playback speed. Also, the adjustment amount may be the movement amount of the cursor on the selection screen. In the above graph, the straight line M1 indicates the gripping amount of the operation knob 211 that is linearly increased. A straight line M2 indicates the grip amount of the operation knob 211 that is linearly decreased.
　図１３における下側のグラフは、操作ノブ２１１の把持量に応じた振動の強さの変化を示している。振動の強さは、振動部２１３が操作ノブ２１１に与える振動の強さである。振動部２１３は、調整量の変化に応じた強さの振動を操作ノブ２１１に与える。調整量の変化は、段階的であってもよいし、線形変化であってもよいし、非線形な変化であってもよい。振動部２１３は、変化後の調整量に応じた振動の強さを操作ノブ２１１に与えてもよいし、調整量の変化方向（減少または増加の方向）に対応した振動パターンで操作ノブ２１１に振動を与えてもよい。振動パターンは、例えば、振動の回数、周波数および印加時間を組み合わせたものでもよいし、これらのいずれか１つのパターンであってもよい。 The lower graph in FIG. 13 shows changes in the intensity of vibration according to the gripping amount of the operation knob 211 . The strength of vibration is the strength of vibration applied to the operation knob 211 by the vibrating section 213 . The vibrating section 213 applies vibration to the operation knob 211 with a strength corresponding to the change in the adjustment amount. A change in the adjustment amount may be a stepwise change, a linear change, or a non-linear change. The vibrating section 213 may apply vibration intensity to the operation knob 211 according to the changed adjustment amount, or may vibrate the operation knob 211 in a vibration pattern corresponding to the change direction (decrease or increase direction) of the adjustment amount. Vibration may be given. The vibration pattern may be, for example, a combination of the number of vibrations, frequency and application time, or any one of these patterns.
　図１３において、操作ノブ２１１が把持されていない場合、振動部２１３は、操作ノブ２１１に振動を与えない。直線Ｍ１における調整量「１」に対応する把持量で操作ノブ２１１が把持された場合、振動部２１３は、振動印加条件（１）に対応した強さで操作ノブ２１１に振動を与える。振動印加条件（１）は、例えば、図１３における下側のグラフに示すように、増加傾向の調整量が「１」である場合、振動部２１３が、短い時間で強さ「１」の振動を２回、操作ノブ２１１に印加する条件である。 In FIG. 13, the vibrating section 213 does not vibrate the operation knob 211 when the operation knob 211 is not gripped. When the operation knob 211 is gripped by a grip amount corresponding to the adjustment amount "1" on the straight line M1, the vibrating section 213 vibrates the operation knob 211 with a strength corresponding to the vibration application condition (1). Vibration application condition (1) is, for example, as shown in the lower graph in FIG. is applied to the operation knob 211 twice.
　直線Ｍ１における調整量「２」に対応する把持量で操作ノブ２１１が把持された場合、振動部２１３は、振動印加条件（２）に対応した強さで操作ノブ２１１に振動を与える。振動印加条件（２）は、例えば、図１３における下側のグラフに示すように、増加傾向の調整量が「２」である場合、振動部２１３が、短い時間で強さ「２」の振動を２回、操作ノブ２１１に印加する条件である。 When the operation knob 211 is gripped with a grip amount corresponding to the adjustment amount "2" on the straight line M1, the vibrating section 213 vibrates the operation knob 211 with a strength corresponding to the vibration application condition (2). Vibration applying condition (2) is, for example, as shown in the lower graph in FIG. is applied to the operation knob 211 twice.
　直線Ｍ１における調整量「３」に対応する把持量で操作ノブ２１１が把持された場合、振動部２１３は、振動印加条件（３）に対応した強さで操作ノブ２１１に振動を与える。振動印加条件（３）は、例えば、図１３における下側のグラフに示すように、増加傾向の調整量が「３」である場合、振動部２１３が、短い時間で強さ「３」の振動を２回、操作ノブ２１１に印加する条件である。 When the operation knob 211 is gripped with a grip amount corresponding to the adjustment amount "3" on the straight line M1, the vibrating section 213 vibrates the operation knob 211 with a strength corresponding to the vibration application condition (3). Vibration applying condition (3) is, for example, as shown in the lower graph in FIG. is applied to the operation knob 211 twice.
　直線Ｍ１における調整量「４」に対応する把持量で操作ノブ２１１が把持された場合、振動部２１３は、振動印加条件（４）に対応した強さで操作ノブ２１１に振動を与える。振動印加条件（４）は、例えば、図１３における下側のグラフに示すように、増加傾向の調整量が「４」である場合、振動部２１３が、短い時間で強さ「４」の振動を２回、操作ノブ２１１に印加する条件である。 When the operation knob 211 is gripped with a grip amount corresponding to the adjustment amount "4" on the straight line M1, the vibrating section 213 vibrates the operation knob 211 with a strength corresponding to the vibration application condition (4). Vibration applying condition (4) is, for example, as shown in the lower graph in FIG. is applied to the operation knob 211 twice.
　また、直線Ｍ２における調整量「３」に対応する把持量で操作ノブ２１１が把持された場合、振動部２１３は、振動印加条件（５）に対応した強さで操作ノブ２１１に振動を与える。振動印加条件（５）は、例えば、図１３における下側のグラフに示すように、減少傾向の調整量が「３」である場合に、振動部２１３が、短い時間で強さ「３」の振動を１回、操作ノブ２１１に印加する条件である。 Also, when the operation knob 211 is gripped with a grip amount corresponding to the adjustment amount "3" on the straight line M2, the vibrating section 213 vibrates the operation knob 211 with strength corresponding to the vibration application condition (5). Vibration application condition (5) is, for example, as shown in the lower graph in FIG. This is a condition for applying vibration to the operation knob 211 once.
　直線Ｍ２における調整量「２」に対応する把持量で操作ノブ２１１が把持された場合、振動部２１３は、振動印加条件（６）に対応した強さで操作ノブ２１１に振動を与える。振動印加条件（６）は、例えば、図１３における下側のグラフに示すように、減少傾向の調整量が「２」である場合に、振動部２１３が、短い時間で強さ「２」の振動を１回、操作ノブ２１１に印加する条件である。 When the operation knob 211 is gripped with a grip amount corresponding to the adjustment amount "2" on the straight line M2, the vibrating section 213 vibrates the operation knob 211 with strength corresponding to the vibration application condition (6). Vibration applying condition (6) is, for example, as shown in the lower graph in FIG. This is a condition for applying vibration to the operation knob 211 once.
　直線Ｍ２における調整量「１」に対応する把持量で操作ノブ２１１が把持された場合、振動部２１３は、振動印加条件（７）に対応した強さで操作ノブ２１１に振動を与える。振動印加条件（７）は、例えば、図１３における下側のグラフに示すように、減少傾向の調整量が「１」である場合に、振動部２１３が、短い時間で強さ「１」の振動を１回、操作ノブ２１１に印加する条件である。 When the operation knob 211 is gripped with a grip amount corresponding to the adjustment amount "1" on the straight line M2, the vibrating section 213 vibrates the operation knob 211 with a strength corresponding to the vibration application condition (7). Vibration application condition (7) is, for example, as shown in the lower graph in FIG. This is a condition for applying vibration to the operation knob 211 once.
　調整量「０」である場合、操作ノブ２１１は把持されていない。このため、振動部２１３は、振動印加条件（８）に従い、操作ノブ２１１に振動を与えない。振動印加条件（８）では、振動部２１３が、操作ノブ２１１に振動を印加しない。 When the adjustment amount is "0", the operation knob 211 is not gripped. Therefore, the vibrating section 213 does not vibrate the operation knob 211 according to the vibration application condition (8). Under the vibration applying condition (8), the vibrating section 213 does not apply vibration to the operation knob 211 .
　図１４は、操作ノブ２１１の把持量に応じた調整量の変化と、調整量に応じた振動の強さの変化との関係を示すグラフである。図１４における上側のグラフは、操作ノブ２１１の把持量に応じた調整量の変化を示している。当該グラフにおいて、直線Ｎは、直線的に増加させた操作ノブ２１１の把持量を示している。図１４における下側のグラフは、操作ノブ２１１の把持量に応じた振動の強さの変化を示している。 FIG. 14 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob 211 and the change in the strength of vibration according to the adjustment amount. The upper graph in FIG. 14 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 . In the graph, a straight line N indicates the grip amount of the operation knob 211 that is linearly increased. The lower graph in FIG. 14 shows changes in the intensity of vibration according to the gripping amount of the operation knob 211 .
　図１４において、調整量が閾値Ｔｈ１未満の場合、振動部２１３は、操作ノブ２１１に対して振動を与えない。また、調整量が閾値Ｔｈ１と同値である場合、振動部２１３は、操作ノブ２１１に対して閾値Ｔｈ以上の弱い振動を与える。調整量が、閾値Ｔｈ１よりも大きい閾値Ｔｈ２と同値である場合、振動部２１３は、操作ノブ２１１に対して中程度の強さの振動を与える。調整量が、閾値Ｔｈ２よりも大きい閾値Ｔｈ３と同値である場合、振動部２１３は、操作ノブ２１１に対して中程度の強さよりも強い振動（強）を与える。 In FIG. 14, the vibrating section 213 does not vibrate the operation knob 211 when the adjustment amount is less than the threshold Th1. Further, when the adjustment amount is equal to the threshold value Th1, the vibrating section 213 applies weak vibration equal to or greater than the threshold value Th to the operation knob 211 . When the adjustment amount is equal to the threshold Th2, which is larger than the threshold Th1, the vibrating section 213 vibrates the operation knob 211 with moderate strength. When the adjustment amount is equal to the threshold Th3, which is larger than the threshold Th2, the vibrating section 213 vibrates the operation knob 211 with a stronger vibration (strong) than medium strength.
　図１５は、操作ノブ２１１の把持量に応じた調整量の変化と、調整量に応じた振動の回数の変化との関係を示すグラフである。図１５における上側のグラフは、操作ノブ２１１の把持量に応じた調整量の変化を示している。当該グラフにおいて、直線Ｎは、直線的に増加させた操作ノブ２１１の把持量を示している。図１５における下側のグラフは、操作ノブ２１１の把持量に応じた振動の強さの変化を示している。 FIG. 15 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob 211 and the change in the number of vibrations according to the adjustment amount. The upper graph in FIG. 15 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 . In the graph, a straight line N indicates the grip amount of the operation knob 211 that is linearly increased. The lower graph in FIG. 15 shows changes in the intensity of vibration according to the gripping amount of the operation knob 211 .
　図１５において、調整量が閾値Ｔｈ１未満の場合、振動部２１３は、操作ノブ２１１に対して振動を与えない。また、調整量が閾値Ｔｈ１と同値である場合、振動部２１３は、操作ノブ２１１に対して閾値Ｔｈ以上の強さの振動を１回与える。調整量が、閾値Ｔｈ１よりも大きい閾値Ｔｈ２と同値である場合、振動部２１３は、操作ノブ２１１に対して、閾値Ｔｈ以上の強さの振動を２回与える。調整量が、閾値Ｔｈ２よりも大きい閾値Ｔｈ３と同値である場合、振動部２１３は、操作ノブ２１１に対して閾値Ｔｈ以上の強さの振動を３回与える。 In FIG. 15, the vibrating section 213 does not vibrate the operation knob 211 when the adjustment amount is less than the threshold Th1. Further, when the adjustment amount is equal to the threshold value Th1, the vibrating section 213 vibrates the operation knob 211 once with a strength equal to or greater than the threshold value Th. When the adjustment amount is equal to the threshold Th2, which is larger than the threshold Th1, the vibrating section 213 vibrates the operation knob 211 twice with an intensity equal to or greater than the threshold Th. When the adjustment amount is equal to the threshold Th3, which is larger than the threshold Th2, the vibrating section 213 vibrates the operation knob 211 three times with an intensity equal to or greater than the threshold Th.
　図１６は、操作ノブ２１１の把持量に応じた調整量の変化と、調整量に応じた振動の周波数の変化との関係を示すグラフである。図１６における上側のグラフは、操作ノブ２１１の把持量に応じた調整量の変化を示している。当該グラフにおいて、直線Ｎは、直線的に増加させた操作ノブ２１１の把持量を示している。図１６における下側のグラフは、操作ノブ２１１の把持量に応じた振動の強さの変化を示している。 FIG. 16 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob 211 and the change in the vibration frequency according to the adjustment amount. The upper graph in FIG. 16 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 . In the graph, a straight line N indicates the grip amount of the operation knob 211 that is linearly increased. The lower graph in FIG. 16 shows changes in the intensity of vibration according to the grip amount of the operation knob 211 .
　図１６において、調整量が閾値Ｔｈ１未満の場合、振動部２１３は、操作ノブ２１１に対して振動を与えない。また、調整量が閾値Ｔｈ１と同値である場合、振動部２１３は、操作ノブ２１１に対して閾値Ｔｈ以上の強さでかつ周波数が１００Ｈｚの振動を与える。調整量が閾値Ｔｈ１よりも大きい閾値Ｔｈ２と同値である場合、振動部２１３は、操作ノブ２１１に対して閾値Ｔｈ以上の強さでかつ周波数が２００Ｈｚの振動を与える。調整量が閾値Ｔｈ２よりも大きい閾値Ｔｈ３と同値である場合、振動部２１３は、操作ノブ２１１に対して閾値Ｔｈ以上の強さでかつ周波数が３００Ｈｚの振動を与える。 In FIG. 16, the vibrating section 213 does not vibrate the operation knob 211 when the adjustment amount is less than the threshold Th1. Further, when the adjustment amount is equal to the threshold value Th1, the vibrating section 213 vibrates the operation knob 211 with a strength equal to or greater than the threshold value Th and a frequency of 100 Hz. When the adjustment amount is equal to the threshold Th2, which is larger than the threshold Th1, the vibrating section 213 vibrates the operation knob 211 with an intensity equal to or greater than the threshold Th and a frequency of 200 Hz. When the adjustment amount is equal to the threshold Th3, which is larger than the threshold Th2, the vibrating section 213 vibrates the operation knob 211 with an intensity equal to or greater than the threshold Th and a frequency of 300 Hz.
　図１７は、操作ノブ２１１の把持量に応じた調整量の変化と、調整量に応じた振動の印加時間の変化との関係を示すグラフである。図１７における上側のグラフは、操作ノブ２１１の把持量に応じた調整量の変化を示している。当該グラフにおいて、直線Ｎは、直線的に増加させた操作ノブ２１１の把持量を示している。図１７における下側のグラフは、操作ノブ２１１の把持量に応じた振動の強さの変化を示している。 FIG. 17 is a graph showing the relationship between the change in the adjustment amount according to the gripping amount of the operation knob 211 and the change in the vibration application time according to the adjustment amount. The upper graph in FIG. 17 shows changes in the adjustment amount according to the gripping amount of the operation knob 211 . In the graph, a straight line N indicates the grip amount of the operation knob 211 that is linearly increased. The lower graph in FIG. 17 shows changes in the intensity of vibration according to the grip amount of the operation knob 211 .
　図１７において、調整量が閾値Ｔｈ１未満の場合、振動部２１３は、操作ノブ２１１に対して振動を与えない。また、調整量が閾値Ｔｈ１と同値である場合、振動部２１３は、操作ノブ２１１に対して閾値Ｔｈ以上の強さの振動を、２００ミリ秒（ｍｓ）印加する。調整量が閾値Ｔｈ１よりも大きい閾値Ｔｈ２と同値である場合は、振動部２１３は、操作ノブ２１１に対して閾値Ｔｈ以上の強さの振動を、４００ミリ秒（ｍｓ）印加する。調整量が閾値Ｔｈ２よりも大きい閾値Ｔｈ３と同値である場合は、振動部２１３は、操作ノブ２１１に対して閾値Ｔｈ以上の強さの振動を、６００ミリ秒（ｍｓ）印加する。 In FIG. 17, the vibrating section 213 does not vibrate the operation knob 211 when the adjustment amount is less than the threshold Th1. Further, when the adjustment amount is equal to the threshold value Th1, the vibration unit 213 applies vibration having a strength equal to or greater than the threshold value Th to the operation knob 211 for 200 milliseconds (ms). When the adjustment amount is equal to the threshold Th2, which is larger than the threshold Th1, the vibrating section 213 applies vibration having a strength equal to or greater than the threshold Th to the operation knob 211 for 400 milliseconds (ms). When the adjustment amount is equal to the threshold Th3, which is larger than the threshold Th2, the vibrating section 213 applies vibration having a strength equal to or greater than the threshold Th to the operation knob 211 for 600 milliseconds (ms).
　図１８は、オーディオ再生画面における、操作ノブ２１１の把持量に応じた操作対象の切り替えを示す画面図である。図１８に示す各画面は、オーディオソースリスト３４Ａとオーディオ再生画面３４Ｂとを含んでいる。オーディオソースリスト３４Ａには、複数のオーディオソースが選択可能なリストであり、ＣＤ、ラジオ（ＦＭまたはＡＭ）、テレビ（ＴＶ）などが設定されている。オーディオ再生画面３４Ｂは、オーディオソースリスト３４Ａから選択されたオーディオソースの再生用の画面である。 FIG. 18 is a screen diagram showing switching of the operation target according to the grip amount of the operation knob 211 on the audio playback screen. Each screen shown in FIG. 18 includes an audio source list 34A and an audio playback screen 34B. The audio source list 34A is a list from which a plurality of audio sources can be selected, and CD, radio (FM or AM), television (TV), etc. are set. The audio playback screen 34B is a screen for playback of the audio source selected from the audio source list 34A.
　撓ませずに把持された操作ノブ２１１が回転量Ｋ１で回転操作された場合、機能実行部５は、操作ノブ２１１の回転量に応じてオーディオ再生画面３４Ｂに表示された音量調整を行う。表示処理部２３は、音量調整（Ｖ）がアクティブなオーディオ再生画面３４ＢをＬＣＤ４に表示する。また、把持量「小」で撓ませた操作ノブ２１１が回転量Ｋ１で回転操作された場合、機能実行部５は、操作ノブ２１１の回転量に応じてオーディオ再生画面３４Ｂに表示された再生速度調整（Ｓ）を行う。表示処理部２３は、図１８において右側に示すように、再生速度調整（Ｓ）がアクティブなオーディオ再生画面３４ＢをＬＣＤ４に表示する。 When the operation knob 211 gripped without bending is rotated by the amount of rotation K1, the function execution unit 5 adjusts the volume displayed on the audio playback screen 34B according to the amount of rotation of the operation knob 211. The display processing unit 23 displays on the LCD 4 an audio playback screen 34B in which the volume adjustment (V) is active. Further, when the operation knob 211 flexed with the grip amount “small” is rotated by the rotation amount K1, the function execution unit 5 adjusts the playback speed displayed on the audio playback screen 34B according to the rotation amount of the operation knob 211. Adjust (S). The display processing unit 23 displays on the LCD 4 an audio playback screen 34B in which playback speed adjustment (S) is active, as shown on the right side of FIG.
　把持量「中」で撓ませた操作ノブ２１１が回転量Ｋ１で回転操作された場合、機能実行部５は、操作ノブ２１１の回転量に応じてオーディオ再生画面３４Ｂに表示されたトラック（Ｔ）の選択（曲の選択）を行う。表示処理部２３は、図１８において中央に示すように、トラック（Ｔ）がアクティブなオーディオ再生画面３４ＢをＬＣＤ４に表示する。
　把持量「大」で撓ませた操作ノブ２１１が回転量Ｋ１で回転操作された場合、機能実行部５は、操作ノブ２１１の回転量に応じてオーディオソースリスト３４Ａからオーディオソースの選択を行う。表示処理部２３は、図１８において左側に示すように、オーディオソースの選択がアクティブなオーディオソースリスト３４ＡをＬＣＤ４に表示する。
　回転操作する操作ノブ２１１の把持量を変える自然な操作によって、操作入力装置２Ａは、オーディオ再生を行うことができる。 When the operation knob 211 flexed with the grip amount “medium” is rotated by the rotation amount K1, the function execution unit 5 reproduces the track (T) displayed on the audio playback screen 34B according to the rotation amount of the operation knob 211. selection (song selection). The display processing unit 23 displays on the LCD 4 an audio playback screen 34B in which the track (T) is active, as shown in the center of FIG.
When the operation knob 211 flexed with the grip amount “large” is rotated by the rotation amount K1, the function execution unit 5 selects an audio source from the audio source list 34A according to the rotation amount of the operation knob 211 . The display processing unit 23 displays an audio source list 34A in which audio source selection is active on the LCD 4, as shown on the left side of FIG.
The operation input device 2A can perform audio reproduction by a natural operation of changing the grip amount of the operation knob 211 that rotates.
　図１９は、操作ノブ２１１のスライド操作と操作ノブ２１１を撓ませる操作および操作ノブ２１１の把持量を組み合わせた操作によって項目選択画面から項目情報を選択する処理を行ったときの表示例（１）を示す画面図である。図１９に示すメニュー選択画面は、複数のメニュー情報から目的のメニュー情報を選択させる項目選択画面であり、タッチパネル３が設けられたＬＣＤ４に表示される。メニュー選択画面には、第１のリスト３５Ａおよび第２のリスト３５Ｂが表示される。第１のリスト３５Ａは、選択候補の複数のメニュー情報が横並びに表示されたリストである。第２のリスト３５Ｂは、第１のリスト３５Ａにおける複数のメニュー情報が縦並びに表示されたリストである。 FIG. 19 shows a display example (1) when a process of selecting item information from the item selection screen is performed by an operation combining the operation of sliding the operation knob 211, the operation of bending the operation knob 211, and the amount of grip of the operation knob 211. It is a screen diagram showing . The menu selection screen shown in FIG. 19 is an item selection screen for selecting target menu information from a plurality of menu information, and is displayed on LCD 4 provided with touch panel 3 . A first list 35A and a second list 35B are displayed on the menu selection screen. The first list 35A is a list in which a plurality of selection candidates of menu information are displayed side by side. The second list 35B is a list in which a plurality of pieces of menu information in the first list 35A are displayed vertically.
　図１９において破線を境として（Ａ）側に記載したメニュー選択画面は、第１の把持量で撓ませた操作ノブ２１１をスライド操作したときのメニュー選択画面を示している。破線を境として（Ｂ）側に記載したメニュー選択画面は、第１の把持量よりも大きい第２の把持量で撓ませた操作ノブ２１１をスライド操作したときのメニュー選択画面を示している。 The menu selection screen shown on the (A) side of FIG. 19 with the dashed line as the boundary shows the menu selection screen when the operation knob 211 bent by the first gripping amount is slid. The menu selection screen shown on the (B) side of the dashed line shows the menu selection screen when the operation knob 211 is slid while being bent by the second gripping amount larger than the first gripping amount.
　機能実行部５は、撓ませる操作が行われている操作ノブ２１１のスライド操作に応じて第１のリスト８Ａおよび第２のリスト８Ｂにおけるメニュー情報を選択する。例えば、（Ａ）側および（Ｂ）側の中央に記載したメニュー選択画面では、第１のリスト３５Ａおよび第２のリスト３５Ｂにおいてメニュー情報Ｄが選択されている。メニュー情報Ｄは、第１のリスト３５Ａおよび第２のリスト３５Ｂにおける中央位置に表示されたメニュー情報である。 The function execution unit 5 selects menu information in the first list 8A and the second list 8B according to the slide operation of the operation knob 211 that is being bent. For example, in the menu selection screen shown in the center of (A) side and (B) side, menu information D is selected in the first list 35A and the second list 35B. Menu information D is menu information displayed at the central position in the first list 35A and the second list 35B.
　第１の把持量で撓ませた操作ノブ２１１が矢印Ｌ１方向に限界までスライド操作されると、機能実行部５は、操作ノブ２１１のスライド移動量に応じて、第１のリスト３５Ａと第２のリスト３５Ｂにおけるメニュー情報Ａを選択する。表示処理部２３は、メニュー情報Ａが選択された第１のリスト３５Ａおよび第２のリスト３５ＢをＬＣＤ４に表示する。
　第１の把持量で撓ませた操作ノブ２１１が矢印Ｌ２方向に限界までスライド操作されると、機能実行部５は、操作ノブ２１１のスライド移動量に応じて、第１のリスト３５Ａにおけるメニュー情報Ｆを選択し、これに応じて第２のリスト３５Ｂにおけるメニュー情報Ｆを選択する。表示処理部２３は、メニュー情報Ｆが選択された第１のリスト３５Ａおよび第２のリスト３５ＢをＬＣＤ４に表示する。 When the operation knob 211 flexed by the first gripping amount is slid to the limit in the direction of the arrow L1, the function execution unit 5 moves the first list 35A and the second list 35A according to the slide movement amount of the operation knob 211. menu information A in the list 35B of . The display processing unit 23 displays on the LCD 4 the first list 35A and the second list 35B in which the menu information A is selected.
When the operation knob 211 flexed by the first gripping amount is slid to the limit in the direction of the arrow L2, the function executing unit 5 retrieves the menu information in the first list 35A according to the slide movement amount of the operation knob 211. Select F and select menu information F in the second list 35B accordingly. The display processing unit 23 displays on the LCD 4 the first list 35A and the second list 35B in which the menu information F is selected.
　第２の把持量で撓ませた操作ノブ２１１が矢印Ｌ１方向に限界までスライド操作されると、表示処理部２３は、操作ノブ２１１のスライド移動量に応じて、従前に選択されていたメニュー情報Ｄの表示位置を、第１のリスト３５Ａのトップ（最も左側）に移動し、第２のリスト３５Ｂのトップ（最も上側）に移動する。
　第２の把持量で撓ませた操作ノブ２１１が矢印Ｌ２方向に限界までスライド操作されると、表示処理部２３は、操作ノブ２１１のスライド移動量に応じて、従前に選択されていたメニュー情報Ｄの表示位置を、第１のリスト３５Ａのエンド（最も右側）に移動し、第２のリスト３５Ｂのエンド（最も下側）に移動する。 When the operation knob 211 flexed by the second gripping amount is slid to the limit in the direction of the arrow L1, the display processing unit 23 displays the previously selected menu information according to the slide movement amount of the operation knob 211. The display position of D is moved to the top (leftmost) of the first list 35A and moved to the top (uppermost) of the second list 35B.
When the operation knob 211 bent by the second grip amount is slid to the limit in the direction of the arrow L2, the display processing unit 23 displays the previously selected menu information according to the slide movement amount of the operation knob 211. The display position of D is moved to the end (rightmost side) of the first list 35A and to the end (lowermost side) of the second list 35B.
　このように、操作入力装置２Ａは、操作ノブ２１１を撓ませる把持量を変化させる自然な操作によって、操作ノブ２１１のスライド操作で選択したメニュー情報をリストの中央位置に表示する。これにより、ユーザは、操作ノブ２１１のスライド操作によって選択されたメニュー情報を正確に視認することができる。 In this way, the operation input device 2A displays the menu information selected by the slide operation of the operation knob 211 at the center position of the list by the natural operation of changing the gripping amount of bending the operation knob 211 . Thereby, the user can accurately visually recognize the menu information selected by the slide operation of the operation knob 211 .
　図２０は、操作ノブ２１１のスライド操作と操作ノブ２１１を撓ませる操作および操作ノブ２１１の把持量とを組み合わせた操作によって項目選択画面から項目情報を選択する処理を行ったときの表示例（２）を示す画面図である。図２０に示すメニュー選択画面３６は、複数の項目情報（メニュー情報）から目的のメニュー情報を選択させる項目選択画面であり、タッチパネル３が設けられたＬＣＤ４に表示される。メニュー選択画面３６には、メニュー情報Ａ～Ｌが縦横３×４の行列的に配置されている。操作ノブ２１１には、メニュー情報Ｉ～Ｌの行が最も近く、その次にメニュー情報Ｅ～Ｈの行が近く、メニュー情報Ａ～Ｄの行は最も遠い。 FIG. 20 shows a display example (2 ) is a screen view showing. A menu selection screen 36 shown in FIG. 20 is an item selection screen for selecting target menu information from a plurality of item information (menu information), and is displayed on the LCD 4 provided with the touch panel 3 . On the menu selection screen 36, menu information items A to L are arranged in a 3×4 matrix. The rows of menu information I to L are closest to the operation knob 211, the rows of menu information E to H are next closest, and the rows of menu information A to D are the furthest.
　図２０において破線を境として（Ａ）側に記載したメニュー選択画面３６は、第１の把持量で撓ませた操作ノブ２１１をスライド操作したときの画面を示している。破線を境として（Ｂ）側に記載したメニュー選択画面３６は、第１の把持量よりも大きい第２の把持量で撓ませた操作ノブ２１１をスライド操作したときの画面を示している。 The menu selection screen 36 shown on the (A) side of the dashed line in FIG. 20 shows the screen when the operation knob 211 bent by the first gripping amount is slid. A menu selection screen 36 shown on the (B) side of the dashed line shows a screen when the operation knob 211 is slid while being bent by a second gripping amount larger than the first gripping amount.
　第１の把持量で撓ませた操作ノブ２１１が矢印方向に移動量Ｐ１でスライド操作されると、機能実行部５は、操作ノブ２１１のスライド移動量Ｐ１に応じて、操作ノブ２１１に最も近い位置にあるメニュー情報Ｉ～Ｌの行から、メニュー情報Ｊを選択する。表示処理部２３は、メニュー情報Ｊがアクティブ、すなわち操作対象の表示箇所として選択されたメニュー選択画面３６をＬＣＤ４に表示する。
　第１の把持量で撓ませた操作ノブ２１１が矢印方向に移動量Ｐ２でスライド操作されると、機能実行部５は、操作ノブ２１１のスライド移動量Ｐ２に応じて、操作ノブ２１１に最も近い位置にあるメニュー情報Ｉ～Ｌの行から、メニュー情報Ｉを選択する。表示処理部２３は、メニュー情報Ｉがアクティブ、すなわち操作対象の表示箇所として選択されたメニュー選択画面３６をＬＣＤ４に表示する。 When the operation knob 211 bent by the first grip amount is slid in the direction of the arrow by the amount of movement P1, the function execution unit 5 moves the operation knob 211 closest to the operation knob 211 according to the amount of slide movement P1 of the operation knob 211. Menu information J is selected from the rows of menu information I to L at the position. The display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information J is active, that is, the menu selection screen 36 selected as the display location to be operated.
When the operation knob 211 bent by the first gripping amount is slid in the direction of the arrow by the amount of movement P2, the function execution unit 5 moves the operation knob 211 closest to the operation knob 211 according to the amount of slide movement P2 of the operation knob 211. Menu information I is selected from the row of menu information I to L at the position. The display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information I is active, that is, the menu selection screen 36 selected as the display location to be operated.
　第２の把持量で撓ませた操作ノブ２１１が矢印方向に移動量Ｐ１でスライド操作されると、機能実行部５は、操作ノブ２１１のスライド移動量Ｐ１に応じて、操作ノブ２１１から最も遠い位置にあるメニュー情報Ａ～Ｄの行からメニュー情報Ｂを選択する。表示処理部２３は、メニュー情報Ｂがアクティブ、すなわち操作対象の表示箇所として選択されたメニュー選択画面３６をＬＣＤ４に表示する。
　第２の把持量で撓ませた操作ノブ２１１が矢印方向に移動量Ｐ２でスライド操作されると、機能実行部５は、操作ノブ２１１のスライド移動量Ｐ２に応じて、操作ノブ２１１から最も遠い位置にあるメニュー情報Ａ～Ｄの行からメニュー情報Ｄを選択する。表示処理部２３は、メニュー情報Ｄがアクティブ、すなわち操作対象の表示箇所として選択されたメニュー選択画面３６をＬＣＤ４に表示する。
　スライド操作する操作ノブ２１１の把持量を変える自然な操作によって、操作入力装置２Ａは、メニュー選択画面３６から目的のメニュー情報を選択することができる。 When the operation knob 211 flexed by the second gripping amount is slid in the direction of the arrow by the amount of movement P1, the function execution unit 5 moves to the farthest position from the operation knob 211 according to the amount of slide movement P1 of the operation knob 211. Menu information B is selected from the rows of menu information A to D in the position. The display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information B is active, that is, the menu selection screen 36 selected as the display location to be operated.
When the operation knob 211 flexed by the second gripping amount is slid in the direction of the arrow by the amount of movement P2, the function execution unit 5 moves to the farthest position from the operation knob 211 according to the amount of slide movement P2 of the operation knob 211. Menu information D is selected from the rows of menu information A to D in the position. The display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information D is active, that is, the menu selection screen 36 selected as the display location to be operated.
The operation input device 2A can select target menu information from the menu selection screen 36 by a natural operation of changing the gripping amount of the operation knob 211 for sliding operation.
　図２１は、操作ノブ２１１のスライド操作と操作ノブ２１１を撓ませる操作および操作ノブ２１１の把持量とを組み合わせた操作によって項目選択画面から項目情報を選択する処理を行ったときの表示例（３）を示す画面図である。なお、図２１に示すメニュー選択画面３６は、複数の項目情報（メニュー情報）から目的のメニュー情報を選択させる項目選択画面であり、タッチパネル３が設けられたＬＣＤ４に表示される。メニュー選択画面３６には、メニュー情報Ａ～Ｌが縦横３×４の行列的に配置されている。操作ノブ２１１には、メニュー情報Ｉ～Ｌの行が最も近く、その次にメニュー情報Ｅ～Ｈの行が近く、メニュー情報Ａ～Ｄの行は最も遠い。 FIG. 21 shows a display example (3 ) is a screen view showing. A menu selection screen 36 shown in FIG. 21 is an item selection screen for selecting target menu information from a plurality of item information (menu information), and is displayed on the LCD 4 provided with the touch panel 3 . On the menu selection screen 36, menu information items A to L are arranged in a 3×4 matrix. The rows of menu information I to L are closest to the operation knob 211, the rows of menu information E to H are next closest, and the rows of menu information A to D are the furthest.
　図２１において破線を境として（Ａ）側に記載したメニュー選択画面３６は、第１の把持量で撓ませた操作ノブ２１１をスライド操作したときの画面を示している。破線を境として（Ｂ）側に記載したメニュー選択画面３６は、第１の把持量よりも大きい第２の把持量で撓ませた操作ノブ２１１をスライド操作したときの画面を示している。図２１は、操作ノブ２１１をスライドさせる方向と、メニュー選択画面３６からメニュー情報を選択するためのカーソルを移動させる方向とを、図２０に示した場合と逆にしたものである。 The menu selection screen 36 shown on the (A) side of the dashed line in FIG. 21 shows the screen when the operation knob 211 is bent by the first gripping amount and is slid. A menu selection screen 36 shown on the (B) side of the dashed line shows a screen when the operation knob 211 is slid while being bent by a second gripping amount larger than the first gripping amount. In FIG. 21, the direction of sliding the operation knob 211 and the direction of moving the cursor for selecting menu information from the menu selection screen 36 are reversed from those shown in FIG.
　第１の把持量で撓ませた操作ノブ２１１が矢印方向（左方向）に移動量Ｐ１でスライド操作されると、機能実行部５は、操作ノブ２１１のスライド移動量Ｐ１に応じて、操作ノブ２１１に最も近い位置にあるメニュー情報Ｉ～Ｌの行のうち、矢印方向とは逆側（右側）からカーソルが移動してメニュー情報Ｋを選択する。表示処理部２３は、メニュー情報Ｋがアクティブ、すなわち操作対象の表示箇所として選択されたメニュー選択画面３６を、ＬＣＤ４に表示する。
　第１の把持量で撓ませた操作ノブ２１１が矢印方向に移動量Ｐ２でスライド操作されると、機能実行部５は、操作ノブ２１１のスライド移動量Ｐ２に応じて、操作ノブ２１１に最も近い位置にあるメニュー情報Ｉ～Ｌの行のうち、矢印方向とは逆側（右側）からカーソルが移動してメニュー情報Ｌを選択する。表示処理部２３は、メニュー情報Ｌがアクティブ、すなわち操作対象の表示箇所として選択されたメニュー選択画面３６を、ＬＣＤ４に表示する。 When the operation knob 211 bent by the first gripping amount is slid in the direction of the arrow (leftward) by the movement amount P1, the function execution unit 5 moves the operation knob 211 according to the slide movement amount P1. Among the rows of menu information I to L closest to 211, the cursor is moved from the opposite side (right side) to the direction of the arrow to select menu information K. FIG. The display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information K is active, that is, the menu selection screen 36 selected as the display location to be operated.
When the operation knob 211 bent by the first gripping amount is slid in the direction of the arrow by the amount of movement P2, the function execution unit 5 moves the operation knob 211 closest to the operation knob 211 according to the amount of slide movement P2 of the operation knob 211. Among the rows of menu information I to L at the position, the cursor is moved from the opposite side (right side) to the direction of the arrow to select menu information L. The display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information L is active, that is, the menu selection screen 36 selected as the display location to be operated.
　第２の把持量で撓ませた操作ノブ２１１が矢印方向（左方向）に移動量Ｐ１でスライド操作されると、機能実行部５は、操作ノブ２１１のスライド移動量Ｐ１に応じて、操作ノブ２１１から最も遠い位置にあるメニュー情報Ａ～Ｄの行のうち、矢印方向とは逆側（右側）からカーソルが移動してメニュー情報Ｃを選択する。表示処理部２３は、メニュー情報Ｃがアクティブ、すなわち操作対象の表示箇所として選択されたメニュー選択画面３６を、ＬＣＤ４に表示する。
　第２の把持量で撓ませた操作ノブ２１１が矢印方向（右方向）に移動量Ｐ３でスライド操作されると、機能実行部５は、操作ノブ２１１のスライド移動量Ｐ３に応じて、操作ノブ２１１から最も遠い位置にあるメニュー情報Ａ～Ｄの行のうち、矢印方向とは逆側（左側）からカーソルが移動してメニュー情報Ａを選択する。表示処理部２３は、メニュー情報Ａがアクティブ、すなわち操作対象の表示箇所として選択されたメニュー選択画面３６を、ＬＣＤ４に表示する。
　このようにスライド操作する操作ノブ２１１の把持量を変える自然な操作によって、操作入力装置２Ａは、メニュー選択画面３６から目的のメニュー情報を選択できる。 When the operation knob 211 bent by the second gripping amount is slid in the direction of the arrow (leftward) by the movement amount P1, the function execution unit 5 moves the operation knob 211 according to the slide movement amount P1. Among the rows of menu information A to D farthest from 211, the cursor is moved from the opposite side (right side) of the arrow direction to select menu information C. FIG. The display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information C is active, that is, the menu selection screen 36 selected as the display location to be operated.
When the operation knob 211 bent by the second gripping amount is slid in the direction of the arrow (rightward) by the movement amount P3, the function execution unit 5 moves the operation knob 211 according to the slide movement amount P3. Among the rows of menu information A to D located farthest from 211, the cursor is moved from the opposite side (left side) of the arrow direction to select menu information A. FIG. The display processing unit 23 displays on the LCD 4 the menu selection screen 36 in which the menu information A is active, that is, the menu selection screen 36 selected as the display location to be operated.
The operation input device 2A can select desired menu information from the menu selection screen 36 by such a natural operation of changing the grip amount of the operation knob 211 that slides.
　図２２は、操作ノブ２１１の回転操作と操作ノブ２１１を撓ませる操作および操作ノブ２１１の把持量とを組み合わせた操作によって項目選択画面から項目情報を選択する処理を行ったときの表示例を示す画面図である。図２１に示すメニュー選択画面は、複数の項目情報（メニュー情報）から目的のメニュー情報を選択させる項目選択画面であり、タッチパネル３が設けられたＬＣＤ４に表示される。このメニュー選択画面には、操作ノブ２１１を要部とした扇形状のリスト４０が表示されている。リスト４０は、操作ノブ２１１から最も遠い位置にある円弧状のリスト部４０ａ、リスト部４０ａの次に操作ノブ２１１から最も遠い位置にある円弧状のリスト部４０ｂおよび操作ノブ２１１に最も近い位置にある円弧状のリスト部４０ｃを備える。 FIG. 22 shows a display example when a process of selecting item information from the item selection screen is performed by an operation combining the operation of rotating the operation knob 211, the operation of bending the operation knob 211, and the gripping amount of the operation knob 211. FIG. It is a screen figure. The menu selection screen shown in FIG. 21 is an item selection screen for selecting target menu information from a plurality of item information (menu information), and is displayed on the LCD 4 provided with the touch panel 3 . A fan-shaped list 40 having the operation knob 211 as a main part is displayed on the menu selection screen. The wrist 40 has an arcuate wrist portion 40a located farthest from the operation knob 211, an arcuate wrist portion 40b located next to the wrist portion 40a and located furthest from the operation knob 211, and an arcuate wrist portion 40b located at a position closest to the operation knob 211. It has an arcuate wrist portion 40c.
　図２２において破線を境として（Ａ）側に記載した画面は、最も大きい第１の把持量で撓ませた操作ノブ２１１を回転操作したときのリスト４０を示している。また、破線を境として（Ｂ）側に記載した画面は、第１の把持量よりも小さい第２の把持量で撓ませた操作ノブ２１１を回転操作したときのリスト４０を示している。さらに、破線を境として（Ｃ）側に記載した画面は、第２の把持量よりも小さい第３の把持量で撓ませた操作ノブ２１１を回転操作したときのリスト４０を示している。 The screen shown on the (A) side of the dashed line in FIG. 22 shows the list 40 when the operation knob 211 is flexed by the largest first gripping amount and is rotated. Also, the screen shown on the (B) side of the dashed line shows the list 40 when the operation knob 211 is flexed by the second gripping amount smaller than the first gripping amount and is rotated. Further, the screen shown on the (C) side of the dashed line shows the list 40 when the operation knob 211 is flexed by the third gripping amount smaller than the second gripping amount and is rotated.
　第１の把持量で撓ませた操作ノブ２１１が矢印方向に回転量Ｒ１で回転操作されると、機能実行部５は、操作ノブ２１１の回転量Ｒ１に応じて、リスト部４０ａからメニュー情報を選択する。表示処理部２３は、メニュー情報を選択するためのカーソル４１をリスト部４０ａに移動させたリスト４０を、ＬＣＤ４に表示する。
　第１の把持量で撓ませた操作ノブ２１１が矢印方向に回転量Ｒ２で回転操作されると、機能実行部５は、操作ノブ２１１の回転量Ｒ２に応じて、リスト部４０ａからメニュー情報を選択する。表示処理部２３は、メニュー情報を選択するためのカーソル４１をリスト部４０ａに移動させたリスト４０を、ＬＣＤ４に表示する。 When the operation knob 211 bent by the first gripping amount is rotated in the direction of the arrow by the amount of rotation R1, the function execution unit 5 retrieves the menu information from the list unit 40a according to the amount of rotation R1 of the operation knob 211. select. The display processing section 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list section 40a.
When the operation knob 211 bent by the first gripping amount is rotated in the direction of the arrow by the amount of rotation R2, the function execution unit 5 retrieves the menu information from the list unit 40a according to the amount of rotation R2 of the operation knob 211. select. The display processing section 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list section 40a.
　第２の把持量で撓ませた操作ノブ２１１が矢印方向に回転量Ｒ１で回転操作されると、機能実行部５は、操作ノブ２１１の回転量Ｒ１に応じて、リスト部４０ｂからメニュー情報を選択する。表示処理部２３は、メニュー情報を選択するためのカーソル４１をリスト部４０ｂに移動させたリスト４０を、ＬＣＤ４に表示する。
　第２の把持量で撓ませた操作ノブ２１１が矢印方向に回転量Ｒ２で回転操作されると、機能実行部５は、操作ノブ２１１の回転量Ｒ２に応じて、リスト部４０ｂからメニュー情報を選択する。表示処理部２３は、メニュー情報を選択するためのカーソル４１をリスト部４０ｂに移動させたリスト４０を、ＬＣＤ４に表示する。 When the operation knob 211 flexed by the second grip amount is rotated by the amount of rotation R1 in the direction of the arrow, the function execution unit 5 retrieves the menu information from the list unit 40b in accordance with the amount of rotation R1 of the operation knob 211. select. The display processing section 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list section 40b.
When the operation knob 211 flexed by the second holding amount is rotated by the amount of rotation R2 in the direction of the arrow, the function execution unit 5 retrieves the menu information from the list unit 40b in accordance with the amount of rotation R2 of the operation knob 211. select. The display processing section 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list section 40b.
　第３の把持量で撓ませた操作ノブ２１１が矢印方向に回転量Ｒ１で回転操作されると、機能実行部５は、操作ノブ２１１の回転量Ｒ１に応じて、リスト部４０ｃからメニュー情報を選択する。表示処理部２３は、メニュー情報を選択するためのカーソル４１をリスト部４０ｃに移動させたリスト４０を、ＬＣＤ４に表示する。
　第３の把持量で撓ませた操作ノブ２１１が矢印方向に回転量Ｒ２で回転操作されると、機能実行部５は、操作ノブ２１１の回転量Ｒ２に応じて、リスト部４０ｃからメニュー情報を選択する。表示処理部２３は、メニュー情報を選択するためのカーソル４１をリスト部４０ｃに移動させたリスト４０を、ＬＣＤ４に表示する。
　回転操作する操作ノブ２１１の把持量を変える自然な操作によって、操作入力装置２Ａは、リスト４０から目的のメニュー情報を選択することができる。 When the operation knob 211 flexed by the third holding amount is rotated by the amount of rotation R1 in the direction of the arrow, the function execution unit 5 retrieves the menu information from the list unit 40c according to the amount of rotation R1 of the operation knob 211. select. The display processing unit 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list portion 40c.
When the operation knob 211 flexed by the third holding amount is rotated by the amount of rotation R2 in the direction of the arrow, the function execution unit 5 retrieves the menu information from the list unit 40c according to the amount of rotation R2 of the operation knob 211. select. The display processing unit 23 displays on the LCD 4 the list 40 in which the cursor 41 for selecting menu information is moved to the list portion 40c.
The operation input device 2A can select target menu information from the list 40 by a natural operation of changing the gripping amount of the rotating operation knob 211 .
　例えば、オーディオ再生画面をリスト４０で構成する場合、リスト部４０ａには、入力ソースの切り替えといった大きいカテゴリを割り当てる。リスト部４０ｂには、曲の切り替え（トラック）を割り当てる。リスト部４０ｃには再生位置のバー移動を割り当てる。また、リスト部の数は３つでもよいし、２つでも４つ以上であってもよい。２次元で表現されたリストだけではなく、３次元で表現されたリストでもよい。例えば、操作ノブ２１１のスライド操作、回転操作および操作ノブ２１１を撓ませる操作によって、ＸＹＺ軸にそれぞれ設定された調整量を変更する。 For example, when the audio playback screen is composed of the list 40, a large category such as input source switching is assigned to the list section 40a. Switching songs (tracks) is assigned to the list portion 40b. The list portion 40c is assigned bar movement of the playback position. Also, the number of list parts may be three, two, or four or more. A list expressed not only in two dimensions but also in three dimensions may be used. For example, by sliding and rotating the operating knob 211 and bending the operating knob 211, the adjustment amounts set for the XYZ axes are changed.
　車内前方にＬＣＤ４が配置される場合、ＬＣＤ４に表示するメニュー選択画面の運転席側のリスト部には、頻繁に使用するメニュー情報が配置され、助手席側のリスト部には、使用頻度の低いメニュー情報が配置される。
　また、助手席側のリスト部には、停車中に操作可能な複雑なメニュー情報を配置してもよい。複雑なメニュー情報としては、例えば、目的地設定、あるいは、カメラの撮像画面とナビゲーション画面との切り替え処理などが考えられる。運転席側のリスト部には、車両の走行中に操作可能なシンプルなメニュー情報を配置してもよい。例えば、音量調節、エアコン温度調節または画面輝度の変更といったメニュー情報が考えられる。 When the LCD 4 is arranged in front of the vehicle, frequently used menu information is arranged in the driver's side list section of the menu selection screen displayed on the LCD 4, and infrequently used menu information is arranged in the passenger side list section. Menu information is arranged.
Further, complicated menu information that can be operated while the vehicle is stopped may be arranged in the list section on the passenger seat side. Complicated menu information may include, for example, destination setting, switching processing between a camera imaging screen and a navigation screen, and the like. Simple menu information that can be operated while the vehicle is running may be arranged in the list section on the driver's seat side. For example, menu information such as volume control, air conditioner temperature control, or screen brightness change can be considered.
　以上のように、実施の形態２に係る操作入力装置２Ａにおいて、振動部２１３が、機能実行部５が実行する調整機能の調整量に応じて操作ノブ２１１に振動を与える。調整機能の調整量に応じた振動が操作ノブ２１１に与えられるので、操作子２１Ａを用いた操作によって調整量をどれくらい変化させたかをユーザにフィードバックすることができる。 As described above, in the operation input device 2A according to the second embodiment, the vibration section 213 vibrates the operation knob 211 according to the adjustment amount of the adjustment function executed by the function execution section 5. Since vibration corresponding to the adjustment amount of the adjustment function is applied to the operation knob 211, it is possible to feed back to the user how much the adjustment amount has been changed by the operation using the manipulator 21A.
　実施の形態２に係る操作入力装置２Ａにおいて、操作情報生成部２２が、操作ノブ２１１を把持して撓ませる把持量に応じて、操作対象を切り替える操作情報を生成する。操作ノブ２１１を撓ませるという自然な操作によって、操作入力装置２Ａは、操作子２１を把持する指の数によらず、目的の機能に対応する操作を行うことができる。 In the operation input device 2A according to the second embodiment, the operation information generation unit 22 generates operation information for switching the operation target according to the grip amount of gripping and bending the operation knob 211 . With the natural operation of bending the operation knob 211, the operation input device 2A can perform an operation corresponding to a desired function regardless of the number of fingers holding the operation element 21. FIG.
　実施の形態２に係る操作入力装置２Ａにおいて、表示処理部２３が、操作ノブ２１１を把持して撓ませる把持量に応じて、ＬＣＤ４の画面における操作対象の表示箇所を変更する。操作ノブ２１１の把持量を変える自然な操作によって、操作入力装置２Ａは、操作対象の表示箇所を変更できる。 In the operation input device 2A according to the second embodiment, the display processing unit 23 changes the display position of the operation target on the screen of the LCD 4 according to the gripping amount of gripping and bending the operation knob 211 . The operation input device 2A can change the display position of the operation target by a natural operation of changing the gripping amount of the operation knob 211 .
　なお、各実施の形態の組み合わせまたは実施の形態のそれぞれの任意の構成要素の変形もしくは実施の形態のそれぞれにおいて任意の構成要素の省略が可能である。 It should be noted that it is possible to omit any component in each of the combinations of the embodiments, the modification of the components of each of the embodiments, or the configuration of each of the embodiments.
　本開示に係る操作入力装置は、例えば、車両に搭載されたナビゲーション装置に利用可能である。 The operation input device according to the present disclosure can be used, for example, in a navigation device mounted on a vehicle.
　１　情報処理装置、１Ａ　情報処理装置、２，２Ａ　操作入力装置、３　タッチパネル、４　ＬＣＤ、５　機能実行部、７　アーム、７Ａ，７Ｂ　バネ、８Ａ，３５Ａ　第１のリスト、８Ｂ，３５Ｂ　第２のリスト、２１，２１Ａ　操作子、２２　操作情報生成部、２３　表示処理部、３０，３６　メニュー選択画面、３１　ＣＤ再生画面、３２　スライドバー画像、３３　地図画面、３３Ａ　画像、３３Ｂ　ルート、３４Ａ　オーディオソースリスト、３４Ｂ　オーディオ再生画面、４０　リスト、４０ａ～４０ｃ　リスト部、４１　カーソル、１００　入力インタフェース、１０１　出力インタフェース、１０２　処理回路、１０３　プロセッサ、１０４　メモリ、２１１　操作ノブ、２１１Ａ　外枠部、２１１Ｂ　内枠部、２１２　検出部、２１２ａ～２１２ｃ　スイッチ、２１３　振動部、２１３ａ～２１３ｃ　接触部。 1 Information processing device, 1A Information processing device, 2, 2A Operation input device, 3 Touch panel, 4 LCD, 5 Function execution part, 7 Arm, 7A, 7B Spring, 8A, 35A First list, 8B, 35B Second list, 21, 21A operator, 22 operation information generator, 23 display processor, 30, 36 menu selection screen, 31 CD playback screen, 32 slide bar image, 33 map screen, 33A image, 33B route, 34A audio source list , 34B audio playback screen, 40 list, 40a to 40c list part, 41 cursor, 100 input interface, 101 output interface, 102 processing circuit, 103 processor, 104 memory, 211 operation knob, 211A outer frame part, 211B inner frame part, 212 detection unit, 212a to 212c switch, 213 vibration unit, 213a to 213c contact unit.

Claims (7)

  1. 　タッチパネルのタッチ面上に回転可能に設けられた操作ノブおよび前記操作ノブを把持して撓ませる把持量を検出する検出部を有した操作子と、
    　前記操作子を用いた操作を示す操作情報を生成し、操作に対応する機能を実行する機能実行部に前記操作情報を出力する操作情報生成部と、
    　を備え、
    　前記操作情報生成部は、前記検出部によって検出された前記操作ノブを撓ませる把持量に応じた前記操作情報を生成すること、
    　を特徴とする操作入力装置。     an operation element having an operation knob rotatably provided on a touch surface of a touch panel and a detection unit for detecting a gripping amount of gripping and bending the operation knob;
    an operation information generation unit that generates operation information indicating an operation using the operator and outputs the operation information to a function execution unit that executes a function corresponding to the operation;
    with
    The operation information generation unit generates the operation information according to the gripping amount for bending the operation knob detected by the detection unit;
    An operation input device characterized by:
  2. 　前記操作情報生成部は、前記操作ノブを把持して撓ませる把持量に応じて前記機能実行部が実行する調整機能の調整量を変化させる前記操作情報を生成すること、
    　を特徴とする請求項１に記載の操作入力装置。     The operation information generation unit generates the operation information for changing the adjustment amount of the adjustment function executed by the function execution unit according to the amount of gripping and bending the operation knob;
    The operation input device according to claim 1, characterized by:
  3. 　前記操作ノブに振動を与える振動部を備え、
    　前記振動部は、前記機能実行部が実行する調整機能の調整量に応じて前記操作ノブに振動を与えること、
    　を特徴とする請求項２に記載の操作入力装置。     a vibrating unit that vibrates the operation knob;
    The vibrating section vibrates the operation knob according to the adjustment amount of the adjusting function executed by the function executing section;
    The operation input device according to claim 2, characterized by:
  4. 　前記操作情報生成部は、前記操作ノブを把持して撓ませる把持量に応じて、操作対象を切り替える前記操作情報を生成すること、
    　を特徴とする請求項１に記載の操作入力装置。     The operation information generating unit generates the operation information for switching the operation target according to the grip amount of gripping and bending the operation knob;
    The operation input device according to claim 1, characterized by:
  5. 　前記タッチパネルが設けられた表示部に対して、前記機能実行部が実行する機能に対応する画面を表示する表示処理部を備え、
    　前記表示処理部は、前記操作ノブを把持して撓ませる把持量に応じて、前記表示部の画面における操作対象の表示箇所を変更すること、
    　を特徴とする請求項１に記載の操作入力装置。     A display processing unit that displays a screen corresponding to the function executed by the function execution unit on the display unit provided with the touch panel,
    The display processing unit changes the display position of the operation target on the screen of the display unit according to the amount of gripping and bending the operation knob,
    The operation input device according to claim 1, characterized by:
  6. 　前記タッチパネルと、
    　前記タッチパネルが設けられた表示部と、
    　請求項１から請求項５のいずれか１項に記載の操作入力装置と、
    　前記操作子を用いた操作に対応する機能を実行する前記機能実行部と、
    　を備えたことを特徴とする情報処理装置。     the touch panel;
    a display unit provided with the touch panel;
    an operation input device according to any one of claims 1 to 5;
    the function execution unit that executes a function corresponding to the operation using the operator;
    An information processing device comprising:
  7. 　タッチパネルのタッチ面上に回転可能に設けられた操作ノブおよび前記操作ノブを把持して撓ませる把持量を検出する検出部を有した操作子を用いた操作入力方法であって、
    　操作情報生成部が、前記操作子を用いた操作を示す操作情報を生成し、操作に対応する機能を実行する機能実行部に前記操作情報を出力するステップと、
    　を備え、
    　前記操作情報生成部は、前記検出部によって検出された前記操作ノブを撓ませる把持量に応じた前記操作情報を生成すること、
    　を特徴とする操作入力方法。     An operation input method using an operator having an operation knob rotatably provided on a touch surface of a touch panel and an operator having a detection unit for detecting an amount of grip of the operation knob by gripping and bending the operation knob,
    an operation information generation unit generating operation information indicating an operation using the operator, and outputting the operation information to a function execution unit that executes a function corresponding to the operation;
    with
    The operation information generation unit generates the operation information according to the gripping amount for bending the operation knob detected by the detection unit;
    An operation input method characterized by:
PCT/JP2021/015937 2021-04-20 2021-04-20 Operation input device, information processing device and operation input method WO2022224327A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2021/015937 WO2022224327A1 (en) 2021-04-20 2021-04-20 Operation input device, information processing device and operation input method
JP2023515910A JPWO2022224327A1 (en) 2021-04-20 2021-04-20

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/015937 WO2022224327A1 (en) 2021-04-20 2021-04-20 Operation input device, information processing device and operation input method

Publications (1)

Publication Number Publication Date
WO2022224327A1 true WO2022224327A1 (en) 2022-10-27

Family

ID=83722015

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/015937 WO2022224327A1 (en) 2021-04-20 2021-04-20 Operation input device, information processing device and operation input method

Country Status (2)

Country Link
JP (1) JPWO2022224327A1 (en)
WO (1) WO2022224327A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160294387A1 (en) * 2013-12-18 2016-10-06 Diehl Ako Stiftung & Co. Kg Operating device and appliance having the device
WO2019073538A1 (en) * 2017-10-11 2019-04-18 三菱電機株式会社 Touch panel type display device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5489922A (en) * 1993-12-08 1996-02-06 Hewlett-Packard Company Hand worn remote computer mouse
JP2011003074A (en) * 2009-06-19 2011-01-06 Sharp Corp Input method, input device and electric apparatus
DE102013008567A1 (en) * 2013-05-17 2014-11-20 Diehl Ako Stiftung & Co. Kg actuator
US9766705B2 (en) * 2015-06-15 2017-09-19 Motorola Solutions, Inc. Stationary interface control and method for using the same
JP2017138738A (en) * 2016-02-02 2017-08-10 富士通テン株式会社 Input device, display device, and method for controlling input device
DE112017007918B4 (en) * 2017-10-11 2022-02-10 Mitsubishi Electric Corporation Display control device, display control method, display control program and electronic device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160294387A1 (en) * 2013-12-18 2016-10-06 Diehl Ako Stiftung & Co. Kg Operating device and appliance having the device
WO2019073538A1 (en) * 2017-10-11 2019-04-18 三菱電機株式会社 Touch panel type display device

Also Published As

Publication number Publication date
JPWO2022224327A1 (en) 2022-10-27

Similar Documents

Publication Publication Date Title
JP5295328B2 (en) User interface device capable of input by screen pad, input processing method and program
US20190064996A1 (en) Method and apparatus for generating a haptic effect in response to flex gesturing
JP5784061B2 (en) Input device, input method, and input program
US8581859B2 (en) Display device
US7196688B2 (en) Haptic devices using electroactive polymers
JP4447823B2 (en) Portable information equipment
US20040221243A1 (en) Radial menu interface for handheld computing device
EP3385824A1 (en) Mobile device and operation method control available for using touch and drag
WO2011088218A1 (en) Multi-touchpad multi-touch user interface
US20100194693A1 (en) Electronic apparatus, method and computer program with adaptable user interface environment
US20110227947A1 (en) Multi-Touch User Interface Interaction
US10596908B1 (en) Input apparatus for vehicle
WO2003104967A1 (en) Information processing method for specifying an arbitrary point in 3-dimensional space
US9280265B2 (en) Input control device, input control method, and input control program for controlling display target upon receiving input on display screen of display device
JP2018063700A (en) Contextual pressure sensing haptic responses
CN102129312A (en) Virtual touchpad for a touch device
JP5667002B2 (en) Computer input device and portable computer
JP2013097513A (en) Input device for vehicle
JP2009536385A (en) Multi-function key with scroll
JP2015170282A (en) Operation device for vehicle
JP2017045330A (en) Input device and on-vehicle device
JP5470350B2 (en) INPUT CONTROL DEVICE, INPUT CONTROL METHOD, AND INPUT CONTROL PROGRAM
WO2022224327A1 (en) Operation input device, information processing device and operation input method
JP6390657B2 (en) Vehicle display device
JP2020510254A (en) Smart device with display allowing simultaneous multifunctional operation of displayed information and / or data

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21937825

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2023515910

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21937825

Country of ref document: EP

Kind code of ref document: A1