JP2005301668A - Information processor and information processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve the operability of a graphical user interface. <P>SOLUTION: In the information processor 1, the distance (depth) to a pointer taken by an imaging device 20 is conformed to GUI of each application, and GUI of each application can be switchingly displayed by longitudinally moving the pointer in front of the imaging device 10 by a user. Accordingly, GUI never displaying a number of buttons on a display 60 of the information processor 1 can be configured. Namely, even if an area for displaying a button cannot be sufficiently ensured within a display screen, the operability of the graphical user interface can be improved. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information processing apparatus having a graphical user interface and an information processing program for realizing the information processing apparatus.

Currently, a graphical user interface (GUI) is used as a user interface in an information processing apparatus such as a PC (Personal Computer), a personal digital assistant, or a mobile phone.
The GUI is a user interface that inputs and outputs information between the apparatus and the user using a lot of graphics. The user can perform input operations on the screen with a mouse or the like, and is highly convenient.

By the way, it is practically difficult to use an input device such as a keyboard, a mouse, or a trackball in a portable device such as a mobile phone among information processing apparatuses. In addition, portable devices are small in size, and it is difficult to provide a large number of hardware buttons and the like on the main body.
For this reason, in a portable device, it is conceivable to use a touch panel that can be input by an operation on a display screen.

However, in recent years, portable devices have been reduced in size, and when such a device is equipped with a GUI, a large number of buttons must be displayed in a limited-size display screen, resulting in a decrease in operability. Resulting in. In addition, the display screen is directly touched or pressed, which may cause the display screen to become dirty or cause equipment failure.
Therefore, as a GUI applicable to a portable device, a technique has been proposed in which a user's body, for example, a hand or the like is photographed by an imaging device and an input operation is performed according to the movement.

  For example, in the Interaction 2001 Proceedings, "Handwritten character input system in the air-Input interface in wearable computer environment", Tomoya Sonoda, Yoichi Muraoka (see Non-Patent Document 1), the head worn by the user There has been disclosed a technology related to an interface in which a touch panel is displayed on a mount display and a user's hand motion is image-analyzed so that the button can be virtually pressed with a fingertip.

According to the technique described in Non-Patent Document 1, an input operation can be performed by virtually pressing a button displayed on the display screen, so there is no need to provide an input device such as a mouse. Since the touch panel is not actually touched, a GUI that does not cause the above-described problem can be realized.
Tomoya Sonoda and Yoichi Muraoka, “Handwritten Character Input System in the Air -Input Interface in Wearable Computer Environment-”, Interaction 2001 Proceedings, Information Processing Society of Japan, 2001, pp. 197 3-10

However, since the technique described in Non-Patent Document 1 assumes a head-mounted display, it is difficult to immediately apply to a display screen of a limited size in a portable device. That is, in the case of a display screen in a portable device, there is a problem that a sufficient area for displaying buttons cannot be secured, and operability is lowered.
An object of the present invention is to improve the operability of a graphical user interface.

In order to solve the above problems, the present invention provides:
An information processing apparatus including an imaging unit (for example, the imaging device 10 in FIGS. 1 and 2) that captures an image of a subject, and when an image of a preset object is captured by the imaging unit A predetermined parameter related to the object (for example, a parameter based on a positional relationship with the object such as a distance to the object, a parameter indicating the size of the object or the shape of the object itself, or a photograph of the object) Parameter acquisition means (for example, the imaging shown in FIGS. 1 and 2) for acquiring a positional relationship with the object such as the size of the image of the object in the obtained image or a parameter that indirectly indicates the form of the object itself. In order to perform an input operation on the apparatus 10 in accordance with the apparatus 10 or a measuring apparatus that directly measures the distance to the object, the size of the object, and the like) and the predetermined parameter Interface display means (for example, the control unit 30 in FIG. 2) that switches and displays a plurality of operation screens (for example, a graphical user interface corresponding to a plurality of applications or a plurality of buttons in a graphical user interface of one application). And a display control unit 50 and a display 60).

As a result, when a preset object is photographed, the operation screen is switched and displayed according to the predetermined parameter acquired for the object.
Therefore, the user can switch the operation screen by changing the predetermined parameter in the object, and the operability of the graphical user interface can be improved even when a sufficient area for displaying the button cannot be secured in the display screen. It becomes possible to improve.

Further, the parameter acquisition unit acquires the size of the image of the object (for example, the cumulative number of pixels in the image of the object) as the predetermined parameter in the image captured by the imaging unit. Yes.
Thereby, since a predetermined parameter can be acquired from the image imaged by the imaging means, a simple device configuration can be achieved.

Further, the interface display means switches and displays a graphical user interface corresponding to a plurality of applications that can be executed by the device according to the predetermined parameter.
Accordingly, when a plurality of applications are provided, it is possible to easily select these.

Further, the interface display means performs a display (for example, an indicator in FIG. 8) suggesting a correspondence relationship between the predetermined parameter and the displayed operation screen.
Thereby, it becomes possible to assist the operation when the user changes the predetermined parameter.

In addition, when the interface display unit switches and displays the plurality of operation screens, another operation screen that is newly displayed when the predetermined parameter changes with respect to the displayed operation screen. (For example, the control software of the imaging apparatus 10 in FIG. 7B) is superimposed and displayed.
Thereby, since the operation screen can be gradually switched, it is possible to prevent the operability from being deteriorated due to the sudden switching of the operation screen.

Further, the interface display means displays information related to an operation screen that is scheduled to be displayed when the predetermined parameter is changed in the operation screen that is currently displayed.
Thereby, it becomes possible to assist the operation when the user changes the predetermined parameter.

Further, the image of the object is recognized as a pointer for input operation, and an input operation on the operation screen is possible by the image of the object moved in the displayed operation screen. .
As a result, the object used for switching the operation screen can be used for the input operation as it is, so that the operability can be improved.

Further, the interface display means displays an input button on the operation screen, and changes an operation content for the input button according to a time when the image of the object is superimposed on the input button. .
Thereby, it becomes possible to input with respect to an operation screen by simple operation using a target object.

  Further, the image processing apparatus further includes detection means (for example, the imaging device 10 and the control unit 30 in FIGS. 1 and 2) that detects a change in form in the image of the object photographed by the imaging means, and the form in the image of the object. It is characterized in that an input operation on the operation screen can be performed by a change (for example, a color change, a size change, or a shape change of an object).

Thereby, it is possible to perform relatively various input operations with a simple operation using the object.
In addition, the correspondence relationship between the predetermined parameter and each of the plurality of operation screens (for example, the order in which the operation screens are arranged with respect to the predetermined parameters, the size of the range of the predetermined parameter assigned to each operation screen, etc.) is changed. It is characterized by being possible.

Thereby, it becomes possible to perform flexible setting according to a user's request | requirement, and it becomes possible to aim at the further improvement of operativity.
Further, the apparatus further includes a usage frequency measuring unit (for example, the control unit 30 in FIG. 1) that measures the usage frequency of each of the plurality of operation screens, and the predetermined parameter is determined according to the usage frequency measured by the usage frequency measuring unit. And a correspondence relationship between each of the plurality of operation screens is set.

Thus, operation screens that are frequently used can be automatically arranged in an easy-to-operate order, and operability can be further improved.
The operation screen fixing means for displaying the operation screen displayed by the interface display means regardless of the change of the predetermined parameter (for example, the GUI provided as hardware in the best mode for carrying out the invention) A fixing button and a GUI fixing button displayed on the GUI).

Thereby, since it can fix to the operation screen which a user wants to perform input operation, it can prevent that the operation screen switches unexpectedly by the state of a target object changing.
The present invention also provides:
An information processing program for controlling an information processing apparatus including an imaging unit that captures an image of a subject, wherein an image of a preset object is captured by the imaging unit. A parameter acquisition function for acquiring a predetermined parameter and an interface display function for switching and displaying a plurality of operation screens for performing an input operation on the device according to the predetermined parameter are realized.
According to the present invention, the predetermined parameter related to the object is associated with the plurality of operation screens, and the operation screen can be switched and displayed by the user changing the predetermined parameter.

  Therefore, the operability of the graphical user interface can be improved even when a sufficient area for displaying buttons or the like cannot be secured in the display screen.

Embodiments of an information processing apparatus according to the present invention will be described below with reference to the drawings.
First, the configuration will be described.
FIG. 1 is a schematic diagram showing an external configuration of an information processing apparatus 1 to which the present invention is applied. FIG. 1A is a front view and FIG. 1B is a rear view. FIG. 2 is a block diagram illustrating a functional configuration of the information processing apparatus 1. In addition, in FIG. 1, the indicator 2 used at the time of the instruction | indication input with respect to the information processing apparatus 1 is shown collectively.

1 and 2, the information processing apparatus 1 includes an imaging device 10, a captured image processing unit 20, a control unit 30, a storage unit 40, a display control unit 50, and a display 60. .
The imaging apparatus 10 converts an image formed by a lens into an electrical signal by a photoelectrically convertible device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor) sensor. Then, the imaging device 10 outputs image data (hereinafter referred to as “captured image data”) indicated by the electrical signal to the captured image processing unit 20.

  In the present embodiment, it is assumed that the imaging device 10 is used as a parameter acquisition unit in the claims, and the distance from the captured object 2 or the like as a predetermined parameter is acquired from a captured image as a predetermined parameter. However, in addition to this, a measuring device for directly measuring the distance to the indicator 2 or the like as the object or the size or shape of the indicator 2 is provided, and the measured distance, size, or shape is set to the predetermined parameter. It is also good to get as.

The captured image processing unit 20 further includes an image processing unit 21 and an image processing memory 22.
The image processing unit 21 performs processing for converting the captured image data input by the imaging device 10 into image data of a predetermined format such as color interpolation or size change, and stores the processing result in the image processing memory 22. Let

The image processing memory 22 is configured by a semiconductor memory such as SRAM (Static Random Access Memory), and stores captured image data input by the imaging device 10 and image data of a predetermined format that is a processing result of the image processing unit 21. To do.
The control unit 30 further includes a processor 31 and a memory 32.
The processor 31 controls the entire information processing apparatus 1 and performs various processes stored in the storage unit 40 in accordance with various instruction signals input by a power button (not shown) or a graphical user interface (GUI) described later. Read and execute the program related to. For example, when the power button is pressed and the information processing apparatus 1 is turned on, the processor 31 reads the GUI construction processing program stored in the storage unit 40 and implements the GUI for realizing the GUI according to the present invention. Run the build process. Then, the processor 31 stores various processing results in predetermined areas of the memory 32 and the storage unit 40 or outputs them to the display control unit 50.

The memory 32 is composed of a semiconductor memory such as a DRAM (Dynamic Random Access Memory), and has a work area for temporarily storing various data generated in various processes executed by the processor 31.
The storage unit 40 is configured by a nonvolatile storage device such as a flash ROM, and stores data held in a nonvolatile manner such as an operating system program, an application program, a system data file, or a GUI construction processing program of the information processing device 1. Yes. In addition, the storage unit 40 stores various parameters set by the user and various data acquired during operation of the information processing apparatus 1, for example, usage frequency of applications.

Note that the usage frequency of the application can be displayed according to the user's request, and the user can set the arrangement order of the GUIs according to the displayed usage frequency.
The display control unit 50 includes a display controller and a display driver, and generates a control signal for causing the display 60 to display the image data input by the processor 31.

The display 60 is a display device such as an LCD (Liquid Crystal Display), and displays various images according to control signals generated by the display control unit 50.
Subsequently, the indicator 2 used in the present embodiment will be described.
The indicator 2 shown in FIG. 1 is composed of a rod-shaped holding portion 2a that is a portion held by a user, and a spherical recognition portion 2b attached to the tip of the holding portion 2a.

The recognized portion 2b is colored red, and the information processing apparatus 1 identifies the recognized portion 2b from the shape and color in the captured image. The image of the recognized portion 2b is used as a pointer (cursor) in the GUI, and the user can input various instructions by moving the pointing tool 2 in each direction with the holding portion 2a. .
The specific form (shape, color, etc.) of the pointing tool 2 can be determined according to the design. For example, the holding portion 2a is a cylindrical shape having a diameter of 5 millimeters and a length of 10 centimeters. The recognition unit 2b can be a sphere having a diameter of 2 centimeters.

Next, the operation will be described.
The information processing apparatus 1 starts the GUI construction process when the power is turned on, and subsequent input operations are performed via the GUI constructed by the GUI construction process.
The GUI construction process is a process of photographing the pointing tool 2 preset as a GUI pointer by the information processing apparatus 1 and switching the GUIs of a plurality of applications depending on the distance to the photographed pointing tool 2.

  When the GUI construction process is executed, in the initialization process, each application installed in the information processing apparatus 1 is associated with the distance range to the captured indicator 2. That is, the GUI of each application is virtually arranged in a predetermined arrangement order in the depth direction in the captured image. In addition, a buffer portion (hereinafter referred to as “play width” as appropriate) that is not associated with the GUI of any application is provided between the distance ranges associated with each application.

FIG. 3 is a conceptual diagram showing a state in which each application is associated with a distance (depth) to the pointing tool 2.
In FIG. 3, GUIs of each application are arranged one by one in a certain range in the depth direction of the captured image space.
The arrangement order of each application can be in various forms according to user requirements or design specifications. For example, the order in which the applications are frequently used is set according to the user setting or automatically as described above. It is conceivable to arrange GUI of each application.

The GUI construction process is executed under such initial settings.
FIG. 4 is a flowchart showing a GUI construction process executed by the processor 31 of the information processing apparatus 1.
When the GUI construction process is started, the processor 31 acquires image data in a predetermined format by the imaging device 10 and the captured image processing unit 20 (step S1), and the instruction set as the GUI pointer in the acquired image data A process for deriving the distance to the tool 2 (hereinafter referred to as “distance deriving process”) is executed (step S2).

Next, the processor 31 executes a process of displaying the GUI of the application corresponding to the distance to the pointing tool 2 (hereinafter referred to as “GUI display process”) derived in step S2 (step S3), and thereafter. , Steps S1 to S3 are repeated.
Next, the distance derivation process executed in step S2 of the GUI construction process will be described.

FIG. 5 is a flowchart showing the distance derivation process executed in the GUI construction process.
When the distance derivation process is started, the processor 31 extracts a red area (hereinafter referred to as “target area”) from the image data acquired in step S1 of the GUI construction process (step S101).

Here, the reason why the red region is extracted is that the recognized portion 2b of the pointing tool 2 is colored red. Next, the processor 31 converts the extracted red region (target region) into black and red. The area other than is converted to white, and the image data is binarized (step S102).
Next, the processor 31 performs image reduction processing by thinning out pixels included in the image data (step S103).

By performing the reduction process, an area that can be regarded as noise, such as a target area consisting of one pixel, can be erased.
Then, the processor 31 returns the image reduced in step S103 to the original size again (step S104), and assigns (labels) an identification number to each of the regions remaining as target regions at this time (step S105). .

Furthermore, the processor 31 derives the circularity for each target region to which the identification number is assigned in step S105 (step S106).
Note that the circularity of each target region is derived by matching the contour with a circle.
Then, the processor 31 derives the area X (the cumulative number of pixels in this case) on the image with respect to the target area having the identification number derived as having the highest circularity (step S107), and returns to the GUI construction process.

Next, the GUI display process executed in step S3 of the GUI construction process will be described.
FIG. 6 is a flowchart showing a GUI display process executed in the GUI construction process.
In the information processing apparatus 1, X1, X2, X3, and X4 are preset in ascending order as the threshold value of the area X, and when the GUI display process is started, the processor 31 determines that the area X is greater than or equal to X1 and less than X2. It is determined whether or not there is (step S201).

If it is determined in step S201 that the area X is greater than or equal to X1 and less than X2, the processor 31 displays the GUI of the first application (for example, the GUI of the control software of the imaging device 10) (step S202).
On the other hand, when it is determined in step S201 that the area X is not less than X1 and less than X2, the processor 31 determines whether or not the area X is not less than X2 and less than X3 (step S203).

If it is determined in step S203 that the area X is greater than or equal to X2 and less than X3, the processor 31 displays the GUI of the second application (for example, the GUI of music play software) (step S204).
On the other hand, if it is determined in step S203 that the area X is not less than X2 and less than X3, the processor 31 determines whether or not the area X is not less than X3 and less than X4 (step S205).

If it is determined in step S205 that the area X is not less than X3 and less than X4, the processor 31 displays the GUI of the third application (step S206).
On the other hand, if it is determined in step S205 that the area X is not less than X3 and less than X4, the processor 31 proceeds to step S1 of the GUI construction process.
If the processor 31 determines that an input operation has been performed by pressing the displayed button in the GUI displayed by the GUI display process, the processor 31 proceeds to various processes corresponding to the input operation.

If it is determined that no input operation is performed on the GUI displayed in the GUI construction process, the processor 31 repeats the GUI construction process until the input operation is performed.
As a result of executing such GUI construction processing, the GUI of the first to third applications is sequentially switched and displayed on the display 60 when the user moves the pointing tool 2 close to or away from the imaging apparatus 10. The For this reason, the user fixes the position of the pointing tool 2 when the GUI of the desired application is displayed while moving the pointing tool 2 in front of or in front of the imaging apparatus 10, and the in-plane ( It is possible to move the pointing tool 2 within the GUI displayed on the display 60 and press a necessary button.
As a specific form of the operation of pressing the button, the image of the recognized portion 2b of the pointing tool 2 is overlapped with the position of the displayed button, and the touched state is pressed according to the passage of time. It is possible to change with the state.

At this time, the display form of the buttons may be sequentially changed according to the state of the buttons.
For example, it is possible to change the button color or change the alpha value (transparency) according to the elapsed time.
Thus, by changing the display form of the button, it is possible to inform the user of the state of the button (the touched state or the pressed state).

In addition, the length of the elapsed time when changing the display form of the button can be set according to the user's request.
As another form of pressing the button, the color or shape of the object set as the pointer can be changed (for example, the table is red in the recognized portion 2b of the pointing tool 2 described above, When the button is pressed, the color or shape of the target object with the pointer over the button It is also possible to determine that the button has been pressed by changing (reversing the recognized part 2b and switching the front and back, or switching the color or brightness of the light by operating a switch such as a penlight) good.

  In addition, when the user moves the pointing tool 2 close to or away from the imaging apparatus 10, it may be somewhat difficult for the user to move the pointing tool 2 while maintaining an in-plane position at a certain depth. Therefore, when the GUI of a desired application is displayed, the displayed GUI can be fixed to improve operability. In this case, the processor 31 is displayed in response to pressing of a GUI fixing button provided as hardware in the information processing apparatus 1 or a GUI fixing button displayed on the GUI. It is possible to control to fix the GUI.

In addition to setting the above-described pointing tool 2 as a GUI pointer, it is possible to set any pointer such as an index finger as a pointer. In this case, the object to be set as a pointer is photographed by the imaging device 10 and can be used as a pointer thereafter by recognizing its shape and color.
In addition, when the user moves an object set as a pointer close to or away from the imaging apparatus 10, the GUI display processing sequentially switches the applications on which the GUI is displayed. The GUI is being switched from the state in which the currently selected GUI (the GUI corresponding to the position of the object set as the pointer) is displayed instead of selectively switching the GUI of It is good also as performing the display which suggests.

For example, the currently selected GUI can be displayed in a watermarked state, and a new GUI being switched can be superimposed and displayed.
FIG. 7 shows a state in which only the GUI of the music play software is displayed in the GUI construction processing (see FIG. 7A) and a state in which the GUI of the control software of the imaging device 10 is superimposed (see FIG. 7B). ).

Note that FIG. 7 shows a case where the index finger is set as a pointer instead of the pointing tool 2.
In FIG. 7, when the index finger set as a pointer is gradually brought closer to the information processing apparatus 1 from the state where only the music play software GUI is displayed (the state of FIG. 7A), from a predetermined position, Next, the GUI of the control software of the imaging apparatus 10 to be displayed is displayed in a superimposed state (the state shown in FIG. 7B).

By performing such a display, when the user moves the pointer (index finger), it is possible to prevent sudden switching to a GUI of a different application, resulting in a sense of incongruity in the operation, thus improving operability. It becomes possible to make it.
Such display can be performed in the above-described play width portion.
As described above, in the information processing apparatus 1 according to the present embodiment, the distance (depth) to the pointing tool 2 captured by the imaging apparatus 10 is associated with the GUI of each application, and the user captures images. The GUI of each application can be switched and displayed by moving the pointing tool 2 back and forth in front of the device 10.

Therefore, it is possible to construct a GUI that does not display many buttons on the display 60 of the information processing apparatus 1. That is, even when a sufficient area for displaying buttons on the display screen cannot be secured, a graphical user interface with high operability can be realized.
In order to clarify the correspondence between the distance to the object set as the pointer and the displayed GUI, an indicator showing the correspondence between the distance range to the object and the application is displayed on the display 60. It's also good.

FIG. 8 is a diagram showing a display screen in the case where an indicator showing the correspondence between the distance range to the object set as the pointer and the application is displayed on the display 60.
In FIG. 8, an indicator in which a distance range to which an application is assigned and a position of a pointer (forefinger) are associated with each other on a meter indicating the depth in the image.

The user can perform an operation while accurately grasping the state where the GUI is switched by moving the pointer back and forth while referring to the indicator.
In FIG. 8, the application name is displayed at the top and bottom of the image, respectively, in order to suggest to the user the GUI application located at the back and in front of the current pointer position.

By performing such display, the user can easily grasp in which direction the pointer should be moved.
Here, if the play width between the distance ranges (depth ranges) to which the application is assigned is excessively narrow, the GUI is frequently switched. On the other hand, if the play width is excessively wide, the GUI is switched. Since the distance to move the object in the depth direction becomes longer, the user can set an appropriate assignment according to the request. In addition, the length of the distance range itself to which the application is assigned can be set by the user upon request.

Note that such assignment reflects the setting when each application installed in the information processing apparatus 1 is associated with the distance range to the photographed object in the initialization process of the GUI construction process. This is possible.
Further, in the present embodiment, it has been described that the GUI is displayed on the image captured by the imaging device 10, but at this time, the pointer image is displayed on the foreground, and the captured image is displayed on the back surface, Only the image of the pointer can be displayed on the GUI.

FIG. 9 is a diagram illustrating a state in which only the pointer image is displayed on the GUI.
In FIG. 9, since the captured image, the GUI, and the pointer image are displayed in this order, the user can easily operate the GUI, and the operability can be further improved. It is also possible to display the pointer image on the back of the GUI by moving the object (forefinger) set as the pointer from the state shown in FIG.

Further, in the present embodiment, the case has been described as an example where the GUIs of a plurality of applications are switched according to the distance (depth) to the target set as the pointer, but the present invention is applied. The object is not limited to this, and can be applied to various input operations. For example, when selecting one of many buttons in the GUI of one application, it is possible to sequentially switch and display different buttons according to the distance of the pointer.
In the present embodiment, as shown in FIG. 3, the GUI of each application has been described as being arranged in the depth direction of the image space. However, when a large number of applications are provided, The selection process can be hierarchical. That is, by dividing a large number of applications into groups and setting each GUI shown in FIG. 3 as a selection screen for each group, first, a GUI that is a selection screen of any group is selected, and then It is possible to select a specific application on the selection screen.

It is the schematic which shows the external appearance structure of the information processing apparatus 1 to which this invention is applied. 2 is a block diagram illustrating a functional configuration of the information processing apparatus 1. FIG. It is a conceptual diagram which shows the state with which each application is matched with the distance to the indicator 2. 4 is a flowchart illustrating a GUI construction process executed by a processor 31 of the information processing apparatus 1. It is a flowchart which shows the distance derivation process performed in a GUI construction | assembly process. It is a flowchart which shows the GUI display process performed in a GUI construction | assembly process. In the GUI construction process, it is a diagram showing a state in which only the GUI of the music play software is displayed, and a state in which the GUI of the control software of the imaging device 10 is superimposed. It is a figure which shows the display screen in the case of displaying on the display 60 the indicator which shows the correspondence of the distance range of a pointer, and an application. It is a figure which shows the state in which only the image of a pointer is displayed on GUI.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Information processing apparatus, 2 Indicator, 2a Holding part, 2b Recognized part, 10 Imaging apparatus, 20 Captured image processing unit, 21 Image processing part, 22 Image processing memory, 30 Control part, 31 Processor, 32 Memory, 40 Storage unit, 50 display control unit, 60 display

Claims (13)

An information processing apparatus including an imaging unit that captures an image of a subject,
Parameter acquisition means for acquiring a predetermined parameter related to the object when an image of the object set in advance is taken by the imaging means;
Interface display means for switching and displaying a plurality of operation screens for performing an input operation on the device according to the predetermined parameter;
An information processing apparatus comprising:   The information processing apparatus according to claim 1, wherein the parameter acquisition unit acquires, as the predetermined parameter, a size of an image of the object in an image captured by the imaging unit.   The information processing apparatus according to claim 1, wherein the interface display unit switches and displays a graphical user interface corresponding to a plurality of applications that can be executed by the apparatus according to the predetermined parameter.   4. The information processing apparatus according to claim 1, wherein the interface display unit performs a display that suggests a correspondence relationship between the predetermined parameter and the displayed operation screen. 5.   The interface display means suggests another operation screen to be newly displayed by changing the predetermined parameter with respect to the displayed operation screen when the plurality of operation screens are switched and displayed. The information processing apparatus according to claim 1, wherein a screen to be displayed is superimposed and displayed.   6. The interface display unit according to claim 1, wherein information related to an operation screen that is scheduled to be displayed when the predetermined parameter is changed is displayed within the currently displayed operation screen. The information processing apparatus according to item.   The image of the object is recognized as a pointer for an input operation, and an input operation on the operation screen is possible by the image of the object moved in the displayed operation screen. The information processing apparatus according to any one of 1 to 6. The interface display means displays an input button on the operation screen,
The information processing apparatus according to any one of claims 1 to 7, wherein an operation content for the input button is changed in accordance with a time when the image of the object is superimposed on the input button. A detection unit for detecting a change in form in the image of the object imaged by the imaging unit;
The information processing apparatus according to claim 1, wherein an input operation on the operation screen is possible by a change in form of the image of the object.   The information processing apparatus according to claim 1, wherein a correspondence relationship between the predetermined parameter and each of the plurality of operation screens can be changed.   A usage frequency measuring unit that measures the usage frequency of each of the plurality of operation screens is further provided, and the correspondence between the predetermined parameter and each of the plurality of operation screens is determined according to the usage frequency measured by the usage frequency measuring unit. The information processing apparatus according to claim 1, wherein the information processing apparatus is set.   The information processing according to any one of claims 1 to 11, further comprising an operation screen fixing unit that displays an operation screen displayed by the interface display unit regardless of a change in the predetermined parameter. apparatus. An information processing program for controlling an information processing apparatus including an imaging unit that captures an image of a subject,
A parameter acquisition function for acquiring a predetermined parameter related to the object when an image of the object set in advance is captured by the imaging unit;
An interface display function for switching and displaying a plurality of operation screens for performing an input operation on the device according to the predetermined parameter;
An information processing program characterized by realizing the above.