JP2014052983A - Information processor, projection system and operation program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate operations using a pointing device.SOLUTION: An information processor receives operation information on an indication image indicating an operation position on a projection image projected by a projector. The information processor sets either a first mode including a movement function for moving an indication image to an operation object included in the projection image or a second mode not including the movement function according to the operation information including information for switching the mode of the operation performed by the indication image. The information processor executes an operation of the indication image according to the operation information including information for moving the indication image. The information processor moves, when the position of the moved indication image is included in an object range determined according to each operation object in the first mode, the indication image to the operation object corresponding to the object range.

Description

  The present invention relates to an information processing apparatus, a projection system, and an operation program.

  2. Description of the Related Art Conventionally, in a presentation at a conference or the like, a projection device such as a projector and a PC (Personal Computer) connected to each other may be used. Specifically, the projection device projects the screen of the connected PC onto a projection surface such as a screen. In addition, a pointer for pointing to an operation target object is displayed on the PC screen. With regard to the operation of the pointer, a technique for remotely operating the pointer with a pen-type pointing device or the like is known in order to smoothly advance the presentation.

  For example, Patent Document 1 discloses a technique that enables an input operation and a marking operation on a device such as a PC using a pointing device equipped with an angular velocity sensor or an acceleration sensor.

  However, the above-described conventional technique has a problem that an operation using a pointing device may not be easily performed. Specifically, in the prior art, the pointer on the screen cannot be fixed at one point because the user's hand holding the pointing device shakes unintentionally. For example, if there is an operation that can press a button on the screen by pressing a button mounted on the pointing device, the pointer will be shifted when the button is pressed, and the operation intended by the user can be performed. There is no possibility. As a result, in the prior art, there are cases where an operation using a pointing device cannot be easily performed.

  The present invention has been made in view of the above, and an object thereof is to provide an information processing apparatus, a projection system, and an operation program capable of easily performing an operation using a pointing device.

  In order to solve the above-described problems and achieve the object, an information processing apparatus according to the present invention is an information processing apparatus that generates a projection image to be projected on a projection apparatus, and is an instruction image that indicates an operation position in the projection image A first mode including a receiving unit that receives operation information relating to the operation information, and a movement function that moves the instruction image to an operation target included in the projection image according to the operation information including information for switching an operation mode using the instruction image And an execution of the operation of the instruction image according to the operation information including the setting unit for setting any one of the second mode not including the movement function and the operation for moving the instruction image And the operation execution unit is a pair in which the position of the moved instruction image is determined for each operation target in the state set in the first mode. If included in the scope, move the instruction image to the operation target corresponding to the target range.

  The projection system according to the present invention is a projection system having a projection device and an information processing device that generates a projection image to be projected on the projection device, wherein the information processing device is an operation position in the projection image. And a movement function for moving the instruction image to an operation target included in the projection image according to the operation information including information for switching an operation mode using the instruction image. The operation of the instruction image is performed according to the setting information for setting one of the first mode including and the second mode not including the movement function, and the operation information including information for the operation of moving the instruction image. An operation execution unit to be executed, and the operation execution unit controls the position of the moved instruction image in the state set in the first mode. Projection for projecting the projection image generated by the information processing apparatus when the instruction image is moved to an operation target corresponding to the target range when included in the target range determined for each target Part.

  In addition, an operation program according to the present invention includes a reception unit that receives operation information related to an instruction image that indicates an operation position in a projection image that is projected by a projection apparatus on a computer, and information for switching an operation mode using the instruction image. A setting unit configured to set one of a first mode including a movement function for moving the instruction image to an operation target included in the projection image and a second mode not including the movement function according to the operation information included; In accordance with the operation information including information for moving the instruction image, the operation execution unit is configured to execute an operation of the instruction image, and the operation execution unit is set in the first mode. When the position of the moved instruction image is included in the target range determined for each operation target, the operation target corresponding to the target range To move the instruction image.

  According to one aspect of the present invention, there is an effect that an operation using a pointing device can be easily performed.

FIG. 1 is a diagram illustrating a configuration example of a projection system according to the first embodiment. FIG. 2 is a functional block diagram illustrating a configuration example of the information processing apparatus according to the first embodiment. FIG. 3 is a diagram illustrating a screen configuration example of a projection image projected by the projection apparatus. FIG. 4 is a diagram illustrating determination of a target range by a target range determination unit. FIG. 5 is a diagram illustrating a calculation example of the coordinate value of the target range by the target range determination unit. FIG. 6 is a diagram illustrating a screen configuration example of a projection image to which the target range is applied. FIG. 7 is a diagram illustrating an example in which a plurality of target ranges are set as one target range. FIG. 8 is a flowchart illustrating an example of a flow of operation processing according to the first embodiment. FIG. 9 is a diagram for explaining directions in which the pointer can be operated in each operation target. FIG. 10 is a flowchart illustrating an example of a flow of operation processing according to the second embodiment. FIG. 11 is a diagram for explaining switching of the operation target. FIG. 12 is a diagram for explaining priorities of a plurality of operation targets included in the target range group. FIG. 13 is a diagram illustrating an example of operation targets grouped for each target range group. FIG. 14 is a diagram illustrating an example of group priorities. FIG. 15 is a diagram for explaining the movement of the pointer when target ranges that do not belong to the same target range group overlap. FIG. 16 is a diagram illustrating an example in which an operation target is highlighted.

  Embodiments of an information processing apparatus, a projection system, and an operation program according to the present invention will be described below with reference to the accompanying drawings. In addition, this invention is not limited by the following embodiment. Moreover, each embodiment can be combined suitably as long as the content is not contradicted.

(Embodiment 1)
[System configuration]
The configuration of the projection system according to the first embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating a configuration example of a projection system according to the first embodiment. As shown in FIG. 1, in the projection system 1, a pointing device 10, a projection device 20, and an information processing device 30 are connected to a network.

  The pointing device 10 is a device that recognizes an operation by a user. More specifically, the pointing device 10 is used for moving a pointer indicating an operation position in a projection image projected by the projection device 20, recognizing an operation using a mounted button, and switching an operation mode using the pointer. Operation information including information and the like is output to the projection device 20. The pointing device 10 is equipped with, for example, an angular velocity sensor or an acceleration sensor for recognizing the movement of the pointer, and is provided in the form of a pen type or the like for the purpose of improving the operability for the user. The details of the operation mode using the pointer will be described later. The pointer is an example of an instruction image.

  The projection device 20 projects the projection image onto a projection surface such as a screen. More specifically, the projection device 20 projects the projection image generated by the information processing device 30 onto the screen. In the projected image, the operation result of the operation by the user using the pointing device 10 is reflected. In addition, the projection device 20 receives the operation information output by the pointing device 10 and outputs the received operation information to the information processing device 30.

  The information processing device 30 generates a projection image to be projected on the projection device 20. More specifically, the information processing device 30 generates a projection image to be projected on the projection device 20 based on the operation information output by the projection device 20, and outputs the generated projection image to the projection device 20. To do. Details of the generation of the projection image based on the operation information will be described later.

[Device Configuration According to Embodiment 1]
Next, the configuration of the information processing apparatus 30 according to the first embodiment will be described with reference to FIG. FIG. 2 is a functional block diagram illustrating a configuration example of the information processing apparatus 30 according to the first embodiment. 2 shows the pointing device 10 and the projection device 20 in addition to the information processing device 30.

  As illustrated in FIG. 2, the projection device 20 includes an operation instruction unit 21 and a projection unit 22. The operation instruction unit 21 relays the operation information output by the pointing device 10 and outputs the operation information to the information processing device 30. That is, in the projection system 1, a projection image is generated by the information processing apparatus 30 with the output of operation information from the operation instruction unit 21 as a trigger. The projection unit 22 projects the projection image generated by the information processing device 30 onto the screen.

  The information processing apparatus 30 includes a reception unit 31, a setting unit 32, a target range determination unit 33, an operation execution unit 34, and a generation unit 35. The accepting unit 31 accepts the operation information output by the operation instruction unit 21 of the projection device 20. More specifically, the reception unit 31 receives operation information related to a pointer that indicates an operation position in the projection image. Then, the reception unit 31 outputs the received operation information to the setting unit 32 and the operation execution unit 34.

  Such operation information includes information related to the operation of the pointer and information related to the mode of operation using the pointer. For example, the information related to the operation of the pointer is an operation of the operation target in the projection image by moving the pointer in the projection image or pressing a button mounted on the pointing device 10. The operation of the operation target by pressing the button includes pressing a button on the projection image, selecting an item with a radio button / select box, or the like. Further, for example, the information regarding the mode of operation by the pointer is set to one of the first mode including the moving function for moving the pointer to the operation target included in the projection image and the second mode not including the moving function. Information.

  The setting unit 32 sets either the first mode or the second mode according to the operation information output by the receiving unit 31. More specifically, the setting unit 32 determines whether the operation mode using the pointer is the first mode or the second mode according to the operation information that is output by the reception unit 31 and includes information for switching the operation mode using the pointer. Set to either. Then, the setting unit 32 notifies the target mode determination unit 33 and the operation execution unit 34 of the set mode.

  The target range determination unit 33 determines a target range for each operation target included in the screen configuration of the projection image based on the screen configuration of the projection image projected on the projection device 20. Here, the operation target refers to objects such as buttons, radio buttons, select boxes, and scroll bars in the screen configuration of the projected image. In addition, the target range refers to a specific range represented by coordinate values in the projection image that are determined for each object.

  FIG. 3 is a diagram illustrating a screen configuration example of a projection image projected by the projection device 20. As shown in FIG. 3, the screen of the projected image includes a scroll bar 201 for scrolling a text area, a radio button 202, and a button (OK) for determining an item selected by the radio button 202. ) 204, a select box 203, a button (OK) 205 for determining an item selected in the select box 203, and a button (Save) 206 for saving text, the determined item, etc. 200 is included in the configuration. The window 200 also includes a pointer 207 that indicates the operation position. The pointer 207 can be remotely operated by the user operating the pointing device 10. The numerical values shown at the upper left and lower right of the window 200 represent the coordinates “(x, y) = (width, height)” in the window 200. Based on such a screen configuration, the target range determination unit 33 determines a target range for each operation target.

  FIG. 4 is a diagram for explaining the determination of the target range by the target range determination unit 33. The target range determination unit 33 calculates the coordinate value of the target range of each operation target based on the default target range and the shape of the target range determined for each operation target shown in FIG. For example, the target range determination unit 33 sets the coordinate value of the target range as “(x, y) = (4, 4)” with respect to the operation target of the button 204, the button 205, and the button 206. calculate. The shape of the target range can be changed according to the operation target. That is, in the case of an operation target such as a scroll bar, the shape is adapted to the operating range including the entire scroll bar. Further, when the operation target is at the end of the window 200 and the width and height of the target range shown in FIG. 4 cannot be maintained, the position serving as the reference of the target range can be shifted.

  FIG. 5 is a diagram illustrating a calculation example of the coordinate value of the target range by the target range determination unit 33. As shown in FIG. 5, the target range determination unit 33 calculates the start point coordinates and the end point coordinates of the target range for each of the scroll bar 201, radio button 202, select box 203, button 204, button 205, and button 206. . For example, for the scroll bar 201, the start point of the target range is calculated as “(x, y) = (19, 5)” and the end point of the target range is calculated as “(x, y) = (20, 28)”. At this time, the target range determination unit 33 calculates the start position of the operation of the operation target corresponding to the target range, and also calculates the position of the pointer moved by the operation execution unit 34 described later. The position of the pointer is determined as a position where each object can be operated. For example, the “position” of the scroll bar 201 is a position “(x, y) = (19, 5)” at which the scroll operation can be performed. With respect to the target range and the operation start position of the operation target determined in this way, the target range determination unit 33 instructs the operation execution unit 34 when the mode output by the setting unit 32 is the first mode. Output.

  FIG. 6 is a diagram illustrating a screen configuration example of a projection image to which the target range is applied. As illustrated in FIG. 6, the target range is a range represented by a broken line with respect to the scroll bar 201, the radio button 202, the select box 203, the button 204, the button 205, and the button 206 that are the operation targets. In the example illustrated in FIG. 6, the shape of the target range is changed according to the operation target. For the radio button 202, a plurality of target ranges are set as one target range.

FIG. 7 is a diagram illustrating an example in which a plurality of target ranges are set as one target range. As shown in FIG. 7, the target range of the radio button 202 shown in FIG. 6 is actually the target range of each of the radio button 202 _A , radio button 202 _B , and radio button 202 _C merged. The reason for merging the target ranges of radio buttons is that they have a characteristic of determining items by selecting one of a plurality of radio buttons. For example, as shown in the upper part of FIG. 7, the target ranges of the radio button 202 _A , the radio button 202 _B , and the radio button 202 _C may overlap with each other due to the arrangement of the radio buttons. Therefore, as shown in the lower part of FIG. 7, a plurality of target ranges of the radio button 202 _A , the radio button 202 _B , and the radio button 202 _C are set as one target range. Hereinafter, a plurality of target ranges as one target range may be referred to as a “target range group”.

  The operation execution unit 34 executes the operation of the pointer according to the operation information output by the receiving unit 31 and including information related to the operation for moving the pointer. The operation for moving the pointer differs depending on the mode set by the setting unit 32. More specifically, the operation execution unit 34 sets the position of the pointer moved according to the operation information to the target range determined by the target range determination unit 33 in the state set to the first mode by the setting by the setting unit 32. If included, the pointer is moved to the operation target corresponding to the target range. On the other hand, when the operation mode is set to the second mode by the setting by the setting unit 32, the operation execution unit 34 moves the pointer in the instructed direction according to the operation information.

  For example, the operation execution unit 34 moves the pointer to a position included in the target range of the button 204 that is one of the operation targets in the window 200 shown in FIG. 6 in the state set in the first mode. In this case, the pointer is moved to the operation start position “(x, y) = (34, 10)” of the button 204. The operation execution unit 34 restricts the movement of the pointer when the pointer is moved to the operation start position of the button 204. Here, the limitation on the movement of the pointer with respect to the button 204 is that the pointer is fixed at the position “(x, y) = (34, 10)”. Thereby, when the button 204 is pressed, it is possible to prevent the position from being shifted due to shaking of the hand.

  Similarly, the operation execution unit 34 moves the pointer to the operation target corresponding to the target range group even when the pointer is moved to a position included in the target range group. For example, when the operation execution unit 34 moves the pointer to a position included in the target range group of the radio button 202 that is one of the operation targets in the window 200 shown in FIG. The pointer is moved to the operation start position “(x, y) = (24, 8)”.

  The generation unit 35 generates a projection image that reflects the operation result of the pointer executed by the operation execution unit 34. Then, the generation unit 35 outputs the generated projection image to the projection unit 22 of the projection device 20.

[Operation processing flow according to Embodiment 1]
Next, the flow of operation processing according to the first embodiment will be described with reference to FIG. FIG. 8 is a flowchart illustrating an example of a flow of operation processing according to the first embodiment. The operation process mainly refers to a process related to a pointer operation.

  As illustrated in FIG. 8, the reception unit 31 receives operation information from the pointing device 10 via the projection device 20 (step S <b> 101). Then, the reception unit 31 outputs the received operation information to the setting unit 32 and the operation execution unit 34. Thereby, the setting unit 32 sets either the first mode or the second mode according to the operation information including information for switching the operation mode by the pointer.

  Further, when the operation information output by the accepting unit 31 is an operation for moving the pointer (step S102: Yes), the operation executing unit 34 determines whether or not the mode set by the setting unit 32 is the first mode. Is determined (step S103). At this time, when the second mode is set (step S103: No), the operation execution unit 34 moves the pointer in the direction instructed according to the operation information (step S104). On the other hand, when the first mode is set (step S103: Yes), the operation execution unit 34 determines whether or not the pointer is at the position to be operated (step S105).

  Here, when the pointer is at the position to be operated in the state set to the first mode (step S105: Yes), the operation executing unit 34 is executing a function that restricts the movement of the pointer. Therefore, the process ends without moving the pointer. Further, when the pointer is not at the position to be operated in the state set in the first mode (step S105: No), the operation execution unit 34 moves the pointer in the instructed direction according to the operation information (step S106). ).

  In addition, when the position of the pointer after moving the pointer is included in the target range determined by the target range determination unit 33 (step S107: Yes), the operation execution unit 34 moves the pointer to the target range. The corresponding operation target is moved to the operation start position (step S108). Note that the operation execution unit 34 ends the process when the position of the pointer after the pointer is moved is not included in the target range determined by the target range determination unit 33 (step S107: No).

  In step S102, if the operation information output by the receiving unit 31 is not an operation for moving the pointer (step S102: No), the operation execution unit 34 determines whether the operation is a button press operation. (Step S109). At this time, when the operation information output by the receiving unit 31 is an operation for pressing a button (step S109: Yes), the operation execution unit 34 executes the button pressing (step S110). On the other hand, the operation execution part 34 complete | finishes a process, when the operation information output by the reception part 31 is not operation which presses a button (step S109: No). Note that the processing of step S109 and step S110 is a process that can be executed regardless of the mode of operation by the pointer.

[Effects of Embodiment 1]
As described above, when the pointer is moved to the target range set for each operation target, the information processing apparatus 30 moves the pointer to the operation target corresponding to the target range. As a result, the user can easily perform an operation using the pointing device.

(Embodiment 2)
In the first embodiment, the case where the pointer is moved to the operation start position of the operation target corresponding to the target range is described if the moved pointer is included in the target range. However, the operation in which the pointer is moved is described. The pointer can be further operated according to the characteristics of the object. Therefore, in the second embodiment, a case will be described in which the pointer is further operated according to the characteristics of the operation target to which the pointer is moved.

  FIG. 9 is a diagram for explaining directions in which the pointer can be operated in each operation target. As shown in FIG. 9, in the scroll bar 201, the direction in which the pointer can be operated is “up, down”. In addition, the radio button 202 has “up, down” directions in which the pointer can be operated. In the select box 203, the direction in which the pointer can be operated is “up, down”. Further, the button 204, the button 205, and the button 206 do not have directions in which the pointer can be operated.

  The direction in which the pointer can be operated in each operation target is mainly the operation start operation of the operation target corresponding to the target range when the position after the pointer movement is included in the target range in the state of the first mode. It refers to the movable direction when moving to a position and further operating the pointer. That is, the scroll bar 201 for scrolling the text area, the radio button 202 for selecting an item, and the select box 203 can move the pointer in the vertical direction within each area. In addition, since the operation of the button 204, the button 205, and the button 206 is limited to pressing, the positions are fixed and there is no movable direction as described in the first embodiment. In this way, the pointer is moved in a specific direction according to the characteristics of each operation target that has moved the pointer.

As for the movement of the pointer in a specific direction, it is only necessary to move the pointer when a certain amount of pointer movement operation is performed. For example, when the moving operation direction above a certain pointer radio button 202 _B from the radio buttons 202 _A is performed to move the position of the pointer on the radio button 202 _B. At this time, the pointer may not be moved to an operation target other than the operation target included in the target range group corresponding to the radio button 202. Further, the operable directions shown in FIG. 9 are examples. For example, when the scroll bar or radio button is configured in the width direction, the operable direction is “left, right”.

[Operation processing flow according to Embodiment 2]
Next, the flow of operation processing according to the second embodiment will be described with reference to FIG. FIG. 10 is a flowchart illustrating an example of a flow of operation processing according to the second embodiment.

  As illustrated in FIG. 10, the reception unit 31 receives operation information from the pointing device 10 via the projection device 20 (step S201). Then, the reception unit 31 outputs the received operation information to the setting unit 32 and the operation execution unit 34. Thereby, the setting unit 32 sets either the first mode or the second mode according to the operation information including information for switching the operation mode by the pointer.

  Further, when the operation information output by the accepting unit 31 is an operation for moving the pointer (step S202: Yes), the operation executing unit 34 determines whether the mode set by the setting unit 32 is the first mode. Is determined (step S203). At this time, when the second mode is set (step S203: No), the operation execution unit 34 moves the pointer in the designated direction according to the operation information (step S204). On the other hand, when the first mode is set (step S203: Yes), the operation execution unit 34 determines whether or not the pointer is at the position to be operated (step S205).

  Here, when the pointer is not at the position to be operated in the state set to the first mode (step S205: No), the operation execution unit 34 moves the pointer in the designated direction according to the operation information (step S205). S206). In addition, when the position of the pointer after moving the pointer is included in the target range determined by the target range determination unit 33 (step S207: Yes), the operation execution unit 34 moves the pointer to the target range. The corresponding operation target is moved to the operation start position (step S208). Note that the operation execution unit 34 ends the process when the position of the pointer after the pointer is moved is not included in the target range determined by the target range determination unit 33 (step S207: No).

  In step S205, when the pointer is at the position of the operation target in the state set to the first mode (step S205: Yes), the operation execution unit 34 can move with respect to the movement of the pointer on the operation target. It is determined whether the direction is correct (step S209). At this time, if the direction is a movable direction (step S209: Yes), the operation execution unit 34 moves the pointer in the instructed direction according to the operation information (step S210). On the other hand, when the direction is not movable (step S209: No), the operation execution unit 34 ends the process without moving the pointer.

  In step S202, if the operation information output by the receiving unit 31 is not an operation for moving the pointer (step S202: No), the operation execution unit 34 determines whether the operation is a button press operation. (Step S211). At this time, when the operation information output by the receiving unit 31 is an operation of pressing a button (step S211: Yes), the operation execution unit 34 executes the button pressing (step S212). On the other hand, the operation execution part 34 complete | finishes a process, when the operation information output by the reception part 31 is not operation which presses a button (step S211: No). Note that the processing in step S211 and step S212 is processing that can be executed regardless of the mode of operation by the pointer.

[Effects of Embodiment 2]
As described above, after the information processing apparatus 30 moves the pointer within the target range to the operation target, the information processing apparatus 30 restricts the direction in which the pointer can be moved according to the characteristics of the operation target. As a result, the user can more easily perform an operation using the pointing device.

(Embodiment 3)
The embodiment of the projection system 1 having the projection apparatus 20 and the information processing apparatus 30 according to the present invention has been described so far, but may be implemented in various different forms other than the above-described embodiment. is there. Therefore, (1) switching the operation target, (2) priority in the target range group, (3) priority in the target range group, (4) change in display, (5) operation target larger than the target range, ( Different embodiments of 6) cancellation of movement restriction, (7) configuration, and (8) program will be described.

(1) Switching the operation target In the second embodiment, if the moved pointer is included in the target range, the pointer is moved to the operation start position of the operation target corresponding to the target range, and the characteristics of the operation target are set. A case has been described in which the pointer is further moved accordingly. In the present invention, after the pointer is moved to the operation start position of the operation target, when there is an operation for moving the pointer by a predetermined amount or more in the direction of another operation target different from the operation target, You may make it move a pointer to.

  FIG. 11 is a diagram for explaining switching of the operation target. FIG. 11 shows an example in which the pointer is moved to the scroll bar 201, select box 203, or button 204, which is another operation target, in a state where the pointer is moved to the radio button 202 that is one operation target.

  As shown in FIG. 11, the operation execution unit 34 moves the pointer in the direction of the scroll bar 201 (left direction in FIG. 11) in a state where the pointer is moved to the radio button 202, and information for an operation for moving the pointer by a predetermined amount or more. The pointer is moved to the scroll bar 201 according to the operation information including. Similarly, in a state where the pointer is moved to the radio button 202, the operation execution unit 34 operates according to operation information including information for an operation for moving the pointer by a predetermined amount or more in the direction of the select box 203 (downward in FIG. 11). Then, the pointer is moved to the select box 203. Similarly, in a state where the pointer is moved to the radio button 202, the operation execution unit 34 operates according to operation information including information for an operation for moving the pointer by a predetermined amount or more in the direction of the button 204 (right direction in FIG. 11). The pointer is moved to the button 204. Each of the above processes is executed in the state set in the first mode. Further, the predetermined amount may be the same length as the target range, that is, an amount that is out of the target range due to the movement of the pointer, or may be a separately set amount. As a result, the information processing apparatus 30 can further improve the operability of the pointer using the pointing device 10.

(2) Priority in target range group In the first embodiment, the radio button is taken as an example, and when a plurality of target ranges overlap, the target range group having a plurality of target ranges as one target range has been described. . In the second embodiment, when the selection of each radio button corresponding to the target range group is switched, the pointer is moved when a certain pointer movement operation is performed on another radio button included in the target range group. The case of moving and switching has been described. In the present invention, priority may be set for a plurality of operation targets included in the target range group, and the pointer may be moved according to the priority.

FIG. 12 is a diagram for explaining priorities of a plurality of operation targets included in the target range group. As shown in FIG. 12, the radio button 202 _A has a priority “1”, and “radio button 202 _B ” is selected as an operation target to be switched when the pointer is moved from the radio button 202 _A. The direction is “down”. The radio button 202 _B has a priority “2”, and “radio button 202 _A ” and “radio button 202 _C ” are set as the operation targets to be switched when the pointer is moved from the radio button 202 _B. The operable directions are “up” and “down”. The radio button 202 _C has a priority “3”, “radio button 202 _B ” as a switching destination operation target when the pointer is moved from the radio button 202 _C , and the operable direction is “up”. It is said. It is assumed that “1” is the highest priority.

Thus, the operation execution unit 34 of the radio buttons 202 _A ~ radio button 202 _C is a plurality of operation target included in the scope group of radio buttons 202, priority radio button 202 _A is "1" Move the pointer. The operation execution unit 34, after moving the pointer to the radio buttons 202 _A, the switching of the operation target by the moving operation of the pointer, specifying the switching destination as shown in FIG. 12. Accordingly, it is possible to specify an operation target for moving the pointer and to prevent unintended switching of the operation target.

(3) Priority in target range group In the first embodiment, when a plurality of target ranges corresponding to a plurality of operation targets overlap, taking a radio button as an example, a plurality of target ranges are set as one target range. The target range group is described. In the present invention, when a plurality of target ranges corresponding to a plurality of operation targets that are not preferably set as a target range group overlap, the pointer may be moved to the operation target corresponding to the specific target range. For example, each target range is grouped, and the pointer is moved according to the priority of each group.

  FIG. 13 is a diagram illustrating an example of operation targets grouped for each target range group. FIG. 14 is a diagram illustrating an example of group priorities. FIG. 15 is a diagram for explaining the movement of the pointer when target ranges that do not belong to the same target range group overlap.

  As shown in FIG. 13, the radio button 301, the radio button 302, and the radio button 303 are divided into the same group as the target range group, and the group ID is “1”. The buttons 401 and 402 are divided into the same group as the target range group, and the group ID is “2”. Note that the priority, switching destination, and operable direction in the target range group are the same as those described in FIG.

  As shown in FIG. 14, the group ID “1” has a priority “1”, and the group ID “2” has a priority “2”. That is, the target range group with the group ID “1” has a higher priority than the target range group with the group ID “2”. Here, as shown in FIG. 15, a case where a part of the target range group with the group ID “1” and the target range group with the group ID “2” overlap each other will be described. For example, when the pointer is moved to a position where the target range group with the group ID “1” and the target range group with the group ID “2” overlap, the operation execution unit 34 has a higher priority of the group ID. The pointer is moved to the radio button 301 included in the target range group of the group ID “1” and having a higher priority of the operation target. In addition, although the case where the target range group was grouped and the priority was set for each group was described, when the pointer was moved to the position where the target range group overlaps without setting the priority for each group The pointer may not be moved, that is, the function in the first mode may not be executed.

(4) Change of display In the first embodiment, the case where the pointer is moved to a specific operation target when the pointer is moved to the target range in the state of the first mode has been described. The display of the operation target and the pointer may be changed when the function is executed.

  FIG. 16 is a diagram illustrating an example in which an operation target is highlighted. As illustrated in FIG. 16, the operation execution unit 34 has a frame of the button 204 when the pointer 207 is moved to the button 204 due to the pointer 207 being moved to the target range of the button 204 in the state of the first mode. The display of the operation target is changed by emphasizing. At this time, the frame of the pointer may be emphasized or blinked instead of the operation target.

(5) Operation target larger than the target range In the first embodiment, the case where the shape of the target range is changed in accordance with the operation target has been described. However, the target range is the operation target as shown in FIG. Since the range is determined for each, the operation target may be larger than the target range. Even in such a case, the operation execution unit 34 moves the pointer to the operation target corresponding to the target range only when the pointer is moved to the target range. More specifically, even when the size of the operation target is smaller than the target range corresponding to the operation target, the operation execution unit 34 may include the position of the moved pointer within the target range. The pointer is moved to the operation target corresponding to the target range. In other words, since the target range for each operation target illustrated in FIG. 4 is set so that the pointer operation can be easily performed even if the user's hand shakes, the size of the operation target is sufficiently larger than the target range. If the value is larger, the function of the first mode may not be executed.

(6) Release of movement restriction In the first and second embodiments, the case where the pointer is moved to the operation target included in the target range and the movement of the pointer is restricted for each operation target has been described. Can also be canceled. For example, the operation execution unit 34 performs the operation of the pointer according to the operation information including information for releasing the restriction on the movement of the pointer moved to the operation target. That is, after the selection items such as radio buttons and select boxes are determined, the restriction on the pointer movement set for each operation target can be released.

(7) Configuration In addition, information including processing procedures, control procedures, specific names, various data, parameters, and the like shown in the document and drawings can be arbitrarily changed unless otherwise specified. For example, the size of the target range for each operation target is not limited to the above example, and can be changed as appropriate.

  Further, each component of each illustrated apparatus is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution or integration of each device is not limited to the one shown in the figure, and all or a part thereof is functionally or physically distributed in arbitrary units according to various burdens or usage conditions. Or they can be integrated. For example, the target range determination unit 33 does not have to be included in the information processing device 30, and is executed by a server device on the network that holds the target range for each operation target determined based on the screen configuration. Also good. In such a case, the target range of each operation target is acquired from the server device.

(8) Program The operation program executed by the information processing apparatus 30 is a file in an installable format or an executable format in one form, such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD. (Digital Versatile Disk) provided by being recorded on a computer-readable recording medium. Further, the operation program executed by the information processing apparatus 30 may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. The operation program executed by the information processing apparatus 30 may be provided or distributed via a network such as the Internet. Further, the operation program may be provided by being incorporated in advance in a ROM or the like.

  The operation program executed by the information processing apparatus 30 has a module configuration including the above-described units (reception unit 31, setting unit 32, operation execution unit 34), and a CPU (processor) is stored as actual hardware. By reading the operation program from the medium and executing it, the above-described units are loaded onto the main storage device, and the reception unit 31, the setting unit 32, and the operation execution unit 34 are generated on the main storage device.

DESCRIPTION OF SYMBOLS 1 Projection system 10 Pointing device 20 Projection apparatus 21 Operation instruction part 22 Projection part 30 Information processing apparatus 31 Reception part 32 Setting part 33 Target range determination part 34 Operation execution part 35 Generation part

JP 2009-238004 A

Claims (15)

An information processing apparatus for generating a projection image to be projected on a projection apparatus,
A reception unit that receives operation information related to an instruction image indicating an operation position in the projection image;
A first mode including a moving function for moving the instruction image to an operation target included in the projection image according to the operation information including information for switching an operation mode using the instruction image, and a first mode not including the moving function. A setting unit for setting one of two modes;
An operation execution unit that executes an operation of the instruction image according to the operation information including information for an operation for moving the instruction image;
When the position of the moved instruction image is included in a target range determined for each operation target in the state set in the first mode, the operation execution unit sets an operation target corresponding to the target range. An information processing apparatus that moves the instruction image.   The information processing apparatus according to claim 1, wherein the operation execution unit restricts movement of the instruction image for each operation object when the instruction image is moved to the operation object.   The information processing apparatus according to claim 2, wherein the operation execution unit moves the instruction image in a specific direction according to a characteristic of each operation target.   Even when the size of the operation target is smaller than the target range corresponding to the operation target, the operation execution unit, when the position of the moved instruction image is included in the target range, The information processing apparatus according to claim 1, wherein the instruction image is moved to an operation target.   The operation execution unit includes information for an operation of moving the instruction image by a predetermined amount or more in a direction of another operation object different from the operation object in a state where the instruction image is moved to the operation object. The information processing apparatus according to claim 1, wherein the instruction image is moved to another operation target according to operation information.   The operation execution unit executes the operation of the instruction image according to the operation information including information for releasing the restriction on the movement of the instruction image moved to the operation target. The information processing apparatus described.   The operation execution unit moves the instruction image to an operation target corresponding to the target range group when the target execution range includes a plurality of the target ranges as a single target range. The information processing apparatus according to 1.   The operation execution unit moves the instruction image to one of a plurality of operation objects included in the target range group according to the operation information including information for an operation for moving the instruction image. The information processing apparatus according to claim 7.   The information processing apparatus according to claim 7, wherein the operation execution unit moves the instruction image according to a priority of a plurality of operation targets corresponding to the target range group.   When the position of the moved instruction image is included in the plurality of target ranges, the operation execution unit moves the instruction image to an operation target corresponding to a specific target range among the plurality of target ranges. The information processing apparatus according to claim 1.   The information processing apparatus according to claim 10, wherein the operation execution unit moves the instruction image to an operation target corresponding to a specific target range according to a priority of a plurality of the target ranges.   The information processing apparatus according to claim 1, wherein the operation execution unit changes the display of the operation target when the instruction image is moved to the operation target.   The information processing apparatus according to claim 1, wherein the operation execution unit changes a display of the instruction image when the instruction image is moved to the operation target. A projection system comprising: a projection device; and an information processing device that generates a projection image to be projected onto the projection device,
The information processing apparatus includes:
A reception unit that receives operation information related to an instruction image indicating an operation position in the projection image;
A first mode including a moving function for moving the instruction image to an operation target included in the projection image according to the operation information including information for switching an operation mode using the instruction image, and a first mode not including the moving function. A setting unit for setting one of two modes;
An operation execution unit that executes an operation of the instruction image according to the operation information including information for an operation for moving the instruction image;
When the position of the moved instruction image is included in a target range determined for each operation target in the state set in the first mode, the operation execution unit sets an operation target corresponding to the target range. Moving the instruction image,
The projector is
A projection system comprising: a projection unit that projects the projection image generated by the information processing apparatus. Computer
A reception unit that receives operation information related to an instruction image indicating an operation position in a projection image to be projected on the projection device;
A first mode including a moving function for moving the instruction image to an operation target included in the projection image according to the operation information including information for switching an operation mode using the instruction image, and a first mode not including the moving function. A setting unit for setting one of two modes;
According to the operation information including information for operation to move the instruction image, function as an operation execution unit that executes the operation of the instruction image,
When the position of the moved instruction image is included in a target range determined for each operation target in the state set in the first mode, the operation execution unit sets an operation target corresponding to the target range. An operation program for moving the instruction image.

Images