JPH1011608A - Experience system for three-dimensional virtual space - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an experience having the degree of freedom approximated to reality as much as possible through an intuitive natural operation. SOLUTION: Three-dimensional (3D) image data concerning respective elements consisting of a 3D virtual space are prepared inside a 3D orthogonal coordinate system, and the experience of exploration inside this space is presented for a user. Manipulated variables ±X, ±Y and ±Z in the respective axial directions of an XYZ coordinate system are inputted while using 3D manipulated variable sensors, the setting of (1) moving mode/(2) rotating mode is inputted by a setting switch 30, and the setting of (1) normal mode/(2) inverse mode is inputted by an auxiliary setting switch 80. Based on these inputs, moving processing concerning front, rear, left and right positions P of user in the virtual space, rotating processing for turning the line-of-sight direction of user up, down, left or right and processing for changing a zoom rate in order to display articles existent in the line-of-sight direction are executed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional virtual space experience apparatus, and more particularly to a three-dimensional virtual space experience in which various objects can be freely observed while moving in the three-dimensional virtual space. Related to the device.

[0002]

2. Description of the Related Art In recent years, with the spread of personal computers, a three-dimensional virtual space is projected on a display screen.
It has become possible to provide an experience of freely moving within this virtual space. For example, in the field of game software, genres in which a player explores a three-dimensional virtual space constructed by a computer have become widespread. Also, with the spread of personal computer communication, the so-called online shopping sales method is becoming commonplace. In particular, when providing product information via the Internet, a method of introducing products while experiencing a three-dimensional virtual space has attracted attention. ing. For example, proposals have been made to introduce various products by using the Internet to provide customers with an experience of walking around a pseudo department store constructed in a three-dimensional virtual space. While staying at home, the customer can look around various products as if walking around in a department store, and can also fully observe the products of interest from a desired angle. Will be possible.

In order to move freely in a virtual space, it is necessary to instruct a computer in a desired moving direction. As an input device for a personal computer, a keyboard, a mouse, a trackball, a trackpad, a joystick, a graphic tablet, and the like are generally used. However, as an input device for instructing a moving direction in a three-dimensional virtual space, it is usually used. For example, a mouse or a joystick that is convenient for intuitively inputting a direction is used.
For example, if you use a joystick, you can instruct forward by leaning the stick forward, instruct backward by leaning backward, instruct rightward by leaning right, and lean left. , An input form such as instructing a left turn can be adopted. The user can freely move in the three-dimensional space by combining these instructions.

[0004]

The performance of a CPU mounted on a computer and the capacity of a memory have been remarkably improved year by year, and in the future, a delicate image closer to reality will be displayed on a display screen with very smooth movement. It will be possible to present it. However, even if the image data processing function inside the computer is remarkably improved, if the interface for transmitting the intention of the user to the computer is insufficient, it is not possible to expect the improvement of the function of the entire apparatus for experiencing the three-dimensional virtual space. In other words, in order to provide a more realistic experience, an environment in which the user can freely move in the three-dimensional space as he or she wants and can observe an object in a desired manner. Need to be prepared. However, as described above, the conventional instruction input method using a mouse or a joystick as a general input device in a personal computer can only provide an environment for instructing movement to the front, rear, left, and right. The degree of freedom was extremely limited. Of course, if the command input is given in the form of a command using a keyboard, in principle, an infinite number of types of command inputs are possible, but since this is not an intuitive operation, a command input that is natural for humans The disadvantage is that it does not occur.

Accordingly, an object of the present invention is to provide a three-dimensional virtual space experience apparatus that can present an experience having a degree of freedom as close to reality as possible by intuitive natural operation.

[0006]

[Means for Solving the Problems]

(1) In a first aspect of the present invention, in a UVW three-dimensional orthogonal coordinate system, a three-dimensional image is formed for each element constituting a three-dimensional virtual space in which a UV plane is a horizontal plane and a W axis is a vertical axis. Three-dimensional image data storage means for storing image data, and a position P on a UV plane in a UVW coordinate system
(U, v), and a line-of-sight vector E defined with this position P or a position P ′ vertically above it as a starting point
Is stored with respect to the UV plane and the angle φ with respect to the UW plane, and a magnification value M indicating the projection magnification of the three-dimensional virtual space component in the direction indicated by the line-of-sight vector E. Means and a line-of-sight vector E from the position P or a position P 'vertically above the position P based on the three-dimensional image data and the posture state data described above.
A view image data generating means for generating view image data indicating a two-dimensional view image obtained by projecting a state when viewing the direction based on the magnification value M, and displaying the two-dimensional view image based on the view image data. Display means, and positive and negative operation amounts + X, X in the X-axis direction in the XYZ three-dimensional rectangular coordinate system.
-X, positive and negative manipulated variables + Y and -Y in the Y-axis direction,
A three-dimensional operation amount sensor that detects positive and negative operation amounts + Z and −Z in the Z-axis direction and outputs each detected operation amount, and selects one of a first state and a second state A setting switch that can be set dynamically, and a posture state data updating unit that updates the posture state data in the posture state data storage unit based on the output of the three-dimensional operation amount sensor and the setting of the setting switch. The experience device is configured, and the posture state data updating means is set to the first setting switch.
, The position P on the UV plane is orthogonal to the projection vector F based on the manipulated variables + X and -X in consideration of the projection vector F obtained by projecting the line-of-sight vector E on the UV plane. The coordinate value (u, v) is updated so as to move in the direction, and the coordinate value is moved so that the position P on the UV plane is moved in the direction indicated by the projection vector F or in the opposite direction based on the operation amounts + Y and -Y When (u, v) is updated and the setting switch is in the second state, the angle φ is increased or decreased based on the operation amounts + X and −X, and the angle θ is increased or decreased based on the operation amounts + Y and −Y. Regardless of the setting of the setting switch, or when the setting switch is in one of the states, a function of increasing or decreasing the magnification value M based on the operation amounts + Z and -Z is provided.

(2) The second aspect of the present invention is the above-mentioned first aspect.
In the experience device according to the aspect, an auxiliary setting switch that can selectively set any one of the two states is further provided, and as the three-dimensional operation amount sensor, regarding the operation amount in the Z-axis direction, the positive operation amount + Z and Using a sensor capable of detecting at least one operation amount of the negative operation amount -Z, the posture state data updating means performs the operation of reversing the sign of the operation amount in the Z-axis direction based on the state of the auxiliary setting switch. It is configured to do so.

(3) A third aspect of the present invention is the above-described first aspect.
Alternatively, in the experience apparatus according to the second aspect, the keyboard is provided with a three-dimensional operation amount sensor provided on a keyboard, and an operation amount can be input by operating an operation rod set up in a gap between keys. The horizontal direction substantially along the main surface is defined as the X axis, the vertical direction is defined as the Y axis, and the direction substantially perpendicular to the keyboard main surface is defined as the Z axis, and the operation rod is operated in each coordinate axis direction to input each operation amount. It is something that can be done.

(4) The fourth aspect of the present invention is the above-described third aspect.
In the experience device according to the aspect, a specific key on a keyboard is used as a setting switch or an auxiliary setting switch.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below based on an embodiment shown in the drawings. FIG. 1 is a block diagram showing a basic configuration of a three-dimensional virtual space experience apparatus according to the present invention. Here, the three-dimensional image data storage unit 10 performs three-dimensional image processing on each element constituting a three-dimensional virtual space defined by a UV plane as a horizontal plane and a W axis as a vertical axis in a UVW three-dimensional orthogonal coordinate system. It has a function of storing image data a. In other words, a UVW three-dimensional orthogonal coordinate system as shown in FIG. 2 is defined, and a virtual space having a UV plane as a floor is formed. For example, if a virtual department store space is to be constructed, three-dimensional image data of elements such as display shelves and show windows arranged in the three-dimensional coordinate space and various products placed in the space are prepared. Will be done.

The posture state data storage means 20 has a function of storing posture state data b indicating the position and posture of the user moving in the three-dimensional virtual space. The posture state data b includes coordinate values (u, v) indicating the current position of the user in the UVW coordinate space, angles (θ, φ) defining the direction of a line-of-sight vector E indicating the line-of-sight direction of the user,
And a magnification value M indicating the display magnification of the object to be watched by the user. The coordinate value (u, v) is a parameter indicating the position P on the UV plane in the UVW coordinate system, as shown in FIG. 2, and under the assumption that the user is standing at the position P in the virtual space. Then, the following processing is performed.

The line of sight vector E is a parameter indicating where the user at the position P is looking. If the height of the user is ignored (that is, if the user himself is represented by one point P), the line-of-sight vector E becomes a vector starting from the position P. However, in this embodiment, as shown in FIG. 2, the height of the user (strictly speaking, the height to the eyeball) is h, and the position P ′ (u, v, v) is vertically above the position P (u, v).
h), and the line-of-sight vector E starting from the position P 'is defined. In performing the processing described later, a projection vector F is defined by projecting the line-of-sight vector E on a UV plane (floor surface).

In the present invention, since the line-of-sight vector E is used as a parameter indicating the direction of the line of sight, its directional component is important, but information on the magnitude (length) of the vector is not required. Therefore, only the direction of the line-of-sight vector E is defined by a pair of angles (θ, φ). That is, the angle of the line-of-sight vector E with respect to the UV plane is defined as an angle θ (in this embodiment, the angle θ is defined in a range of −90 ° ≦ θ ≦ + 90 °, with the upper part being positive and the lower part being negative) , The angle of the line-of-sight vector E with respect to the UW plane is defined as an angle φ (in this embodiment, the angle increases in a counterclockwise direction when viewed from above with respect to the UW plane in which the value of U is positive. Is defined as 0 ° ≦ φ <360 °). FIG. 3 shows the starting point of the line-of-sight vector E shown in FIG.
FIG. 6 is a diagram showing a state where the object has been translated to the origin O of the coordinate system, and a method of defining the angles θ and φ is visually shown. After all, the angle θ is the line-of-sight vector E (vector OQ)
Is defined as an angle between a projection vector F (vector OQ ′) obtained by projecting this on the UV plane, and the angle φ is defined as an angle between the U axis and the projection vector F.

On the other hand, the magnification value M indicates the projection magnification of the three-dimensional virtual space component in the direction indicated by the line-of-sight vector E, ie, a parameter indicating the zoom magnification of the object in the direction of the line-of-sight vector E. It is. Even if the position P is exactly the same, if the magnification value M is increased, an image is displayed as if the object is closer to the object, and if the magnification value M is smaller, an image is displayed as if the object is farther from the object. Will be.

The view image data generating means 30 generates a position P 'based on the three-dimensional image data a and the posture state data b.
Generates view image data c indicating a two-dimensional view image obtained by projecting a state when viewing the direction of the line-of-sight vector E from the position (in a case where the handling is performed ignoring the height of the user) based on the magnification value M. Has functions. In other words, a process of defining a projection area having a predetermined size on a plane orthogonal to the line-of-sight vector E, and two-dimensionally projecting the three-dimensional image defined by the three-dimensional image data a onto the projection area is performed. Will be The two-dimensional image obtained on the projection area corresponds to the view image, and view image data c indicating the view image is generated. The display means 40 is a so-called display device, and has a function of displaying a two-dimensional view image based on the view image data c. The magnification value M is a parameter for determining the size of the projection area. As the magnification value M is larger, a smaller projection area is defined, and the two-dimensional view image projected in the projection area is greatly enlarged on the screen of the display means. Will be displayed.

As described above, even if the three-dimensional image data a prepared beforehand in the three-dimensional image data storage means 10 is the same, the posture state data b in the posture state data storage means 20 makes the display means 40 The content displayed on the screen will be different. In this way, even when observing the same three-dimensional space, it is possible to experience different view images depending on the observation position and the viewing direction.

The apparatus according to the present invention is further provided with a three-dimensional operation amount sensor 50, a setting switch 60, and a posture state data updating means 70. The user can use the three-dimensional operation amount sensor 50 and the setting switch 60 to give an instruction input for updating the content of the posture state data b. The posture state data updating means 70 executes a process of updating the contents of the posture state data b based on the instruction input. When the posture state data b in the posture state data storage unit 20 is updated in this way, each time the view image data generation unit 30 generates new view image data c, and the view image displayed on the display device 40 is It is updated in real time.

A feature of the present invention is that an instruction input having a relatively high degree of freedom can be realized by an intuitive natural operation by a user.
An experience with a degree of freedom close to reality can be presented. Such an instruction input is performed by the three-dimensional operation amount sensor 50 and the setting switch 60. The three-dimensional operation amount sensor 50 includes an XYZ three-dimensional rectangular coordinate system (here, for convenience of explanation, in order to distinguish it from a three-dimensional space in which the three-dimensional image data a is defined, a three-dimensional rectangular coordinate system is used. X in another coordinate system)
Detects positive and negative manipulated variables + X and -X in the axial direction, positive and negative manipulated variables + Y and -Y in the Y-axis direction, and positive and negative manipulated variables + Z and -Z in the Z-axis direction. And a function of outputting each detected operation amount. On the other hand, the setting switch 60
It has a function of setting whether the mode is the movement mode or the rotation mode.

The three-dimensional operation amount sensor 50 is capable of inputting information as to which coordinate axis of the three-dimensional coordinate system has been operated in which direction (positive direction or negative direction). If possible, any sensor may be used, but in the embodiment described here, a capacitance type three-dimensional force sensor is used as the three-dimensional operation amount sensor 50. FIG. 4 is a side sectional view of the capacitance type three-dimensional force sensor 50. Details of such a capacitance type sensor are disclosed in, for example, Japanese Patent Application Laid-Open No. 8-6711, and therefore, only a brief description of the structure and operation will be given here.

The sensor shown in FIG. 4 includes a substrate 51, a cover member 52, and an operating rod 53.
On the upper surface of one, five electrodes E1 to E5 are formed.
FIG. 5 is a top view showing a state in which the lid member 52 and the operating rod 53 are removed from the sensor, and clearly shows the shapes and arrangements of the five electrodes E1 to E5 formed on the substrate 51. (The broken line indicates the attachment position of the lid member 52).

Now, an XYZ three-dimensional orthogonal coordinate system is defined so that the upper surface of the substrate 51 is included in the XY plane. The operating rod 53 is a columnar member extending in the Z-axis direction, and is fixed to the center of the upper surface of the lid member 52. Lid member 52
Functions as a cover that covers the entire five electrodes E1 to E5 formed on the substrate 51 and functions as one common electrode as a whole. That is, in this sensor, the substrate 51 and the operating rod 53 are made of an insulating material, but the five electrodes E1 to E5 and the lid member 5
Reference numeral 2 is made of a conductive material, and a portion constituting the upper surface of the lid member 52 serves as a common electrode facing all of the five electrodes E1 to E5. Therefore, 5
The five electrodes E1 to E5 and the common electrode opposed thereto form five sets of capacitive elements C1 to C5.

The cover member 52 is made of a conductive material having flexibility (in this example, metal). When a force is applied to the operation rod 53, the cover member 52 bends based on the force. Having. For example, X in the figure is
When a force in the positive axial direction is applied, the entire lid member 52 is bent such that a part of the lid member 52 facing the electrode E1 is lowered and a part of the lid member 52 facing the electrode E3 is raised. become. As a result, the electrode interval of the capacitance element C1 becomes shorter and the capacitance value increases, and the electrode interval of the capacitance element C3 becomes longer and the capacitance value decreases. When a force is applied in the negative direction of the X axis, the opposite phenomenon occurs. Therefore, when the capacitance values of the capacitance elements C1 and C3 arranged on the X axis are electrically measured, the direction of the force applied to the upper part of the operating rod 53 in the X axis direction (X axis positive direction) Or negative direction) and its magnitude.
Similarly, if the capacitance values of the capacitance elements C2 and C4 arranged on the Y axis are measured, the direction of the force applied to the upper part of the operating rod 53 in the Y axis direction (Y axis positive direction or negative direction). Direction?),
It is possible to detect its size.

On the other hand, when a force (a force in the positive direction of the Z-axis) is applied to the operating rod 53 to pull it upward in FIG. 4, the entire lid member 52 is raised so that the central portion facing the electrode E5 is raised. Of the capacitor C5, the distance between the electrodes of the capacitor C5 increases, and the capacitance value decreases. Conversely, when a force (a force in the negative direction of the Z-axis) that pushes the operating rod 53 downward is applied to the operating rod 53, the entire lid member 52 bends so that the central portion facing the electrode E5 is lowered. As a result, the distance between the electrodes of the capacitance element C5 becomes shorter, and the capacitance value increases. Therefore, if the capacitance value of the capacitive element C5 is electrically measured, the direction of the force (Z
Axis positive direction or negative direction) and its magnitude.

Thus, the capacitance type force sensor shown in FIGS. 4 and 5 is a three-dimensional operation amount sensor 50 according to the present invention.
, And the operation amount ± X, ± along each XYZ coordinate axis.
A function of detecting Y and ± Z and providing the detected operation amount to the posture state data updating means 70 can be achieved. In addition,
According to the sensor shown in FIGS. 4 and 5, for which coordinate axis of the three-dimensional coordinate system, in what direction (positive direction or negative direction), how much operation has been performed (that is, , The amount of force applied to the upper part of the operating rod 53), the function of detecting up to the amount of force applied to the operating rod 53 is not applicable to the present invention. You don't have to. For example, X
With respect to the manipulated variable ± X along the axis, if the above-described sensor is used, the value of +3.
Although it is possible to specify a specific scalar value such as 2 or -8.4, the present invention does not necessarily require a function to specify such a scalar value. Regarding the amount, a force in the + X direction is detected (for example, operation amount +1), a force in the −X direction is detected (for example, operation amount −1), and there is no significant level of force detection in the X-axis direction. (For example, 0 operation amount)
It is enough to have a function to recognize only one state.

On the other hand, if the setting switch 60 is a switch capable of selectively setting one of the first state (moving mode) and the second state (rotating mode),
Any switch may be used. A so-called “switch” that can switch between two state settings may be used, or a so-called “switch” that normally stays in the first state and enters the second state only while the finger is kept pressed. A “push-button switch” may be used.
Alternatively, a so-called “toggle switch” may be used in which the two states are alternately switched each time the button is pressed.

A feature of the present invention is that a three-dimensional operation amount sensor 50 is provided.
An instruction input to the posture state data updating means 70 is performed by a combination of the setting switch 60 and the setting switch 60. When the “movement mode” is set by the setting switch 60, the three-dimensional operation amount sensor 50
When the setting switch 60 has set the “rotation mode”, the three-dimensional operation amount sensor 50 can input an instruction related to rotation (line-of-sight change). These instruction inputs correspond to the operation amount ± in the three-dimensional operation amount sensor 50.
In addition, in the present invention, an instruction input for updating the magnification value M for the display target is performed by using the operation amount ± Z of the three-dimensional operation amount sensor 50 in the present invention. ing. Since any of the instruction inputs uses the three-dimensional operation amount sensor 50, very intuitive input becomes possible.

The posture state data updating means 70 includes operation amounts ± X, ± Y, ± Z given from the three-dimensional operation amount sensor 50.
The following update process is performed on the posture state data b in the posture state data storage unit 20 based on the signal indicating the state and the signal indicating the state / given from the setting switch 60.

First, when the setting switch 60 is set to the "movement mode", the operation amounts + X and -X are set in consideration of the projection vector F obtained by projecting the line-of-sight vector E on the UV plane. The coordinate value (u, v) is updated so as to move the position P on the UV plane in a direction orthogonal to the projection vector F based on the operation amount + Y and -Y. The coordinate values (u, u) move in the direction indicated by F or in the opposite direction.
v) is updated. By such an update process, in the “movement mode”, the XY plane defined on the three-dimensional operation amount sensor 50 corresponds to the UV plane defined on the three-dimensional image data a, and the user can In the direction intuitively indicated by the three-dimensional operation amount sensor 50,
It can move in a three-dimensional virtual space.

More specifically, when the operation amount + X is given, the coordinate values (u, u) are set so that the position P moves rightward along the line orthogonal to the projection vector F on the UV plane. v) is updated, and when the manipulated variable -X is given, the coordinate values (u, u) are moved so that the position P moves leftward along a line orthogonal to the projection vector F on the UV plane.
v) is updated. Therefore, the user can experience a state in which the user moves rightward or leftward while keeping the line of sight fixed.

When the manipulated variable + Y is given,
The coordinate value (u, v) is updated so that the position P moves along the direction indicated by the projection vector F, and when the operation amount -Y is given, the direction is opposite to the direction indicated by the projection vector F. (U, v) is updated so that the position P moves along. Therefore, the user can experience a state of moving forward or backward while keeping the direction of the line of sight fixed.

On the other hand, when the setting switch 60 is set to the "rotation mode", the angle φ is increased or decreased based on the operation amounts + X and -X, and the operation amounts + Y and -Y
Is performed to increase or decrease the angle θ based on By such an update process, in the “rotation mode”, the XY plane defined on the three-dimensional operation amount sensor 50 corresponds to the UW plane defined on the three-dimensional image data a. The gaze vector E can be directed in a direction intuitively indicated by the three-dimensional operation amount sensor 50. In other words, the operation of increasing or decreasing the angle φ is intuitively equivalent to the operation of changing the body direction to the left or right at the position P, and the operation of increasing or decreasing the angle θ is intuitively equivalent to the operation of changing the position P
In this case, the operation corresponds to an operation of changing the vertical direction of the face (for example, an operation of moving the line of sight from the floor to the ceiling).

More specifically, when the operation amount + X is given, an operation is performed in which the angle φ is reduced and the line-of-sight vector E is rotated clockwise (clockwise) when viewed from above. When the operation amount −X is given, an operation of increasing the angle φ and rotating the line of sight vector E counterclockwise (counterclockwise) when viewed from above is performed. Since the angle φ is defined in the range of 0 ° ≦ φ <360 °, if 0 ° <φ by this increase / decrease processing, the value obtained by adding 360 ° is set as a new value of φ. , 36
When 0 ° ≦ φ, a correction is made such that a value obtained by subtracting 360 ° is a new value of φ.

When the manipulated variable + Y is given,
An operation of decreasing the angle θ and rotating the line of sight vector E downward is performed. When an operation amount −Y is given, an operation of increasing the angle θ and rotating the line of sight vector E upward is performed. Note that, since the angle θ is defined in the range of −90 ° ≦ θ ≦ 90 °, the angle θ>
In the case of 90 °, θ = 90 ° is maintained, and θ <
In the case where −90 ° is obtained, a saturation process for maintaining θ = −90 ° is performed.

Further, a process of increasing or decreasing the magnification value M based on the manipulated variables + Z and -Z is performed. That is, the operation amount +
When Z is given, a process of decreasing the magnification value M is performed. When Z is given, a process of increasing the magnification value M is performed. By such an update process, the Z axis defined on the three-dimensional operation amount sensor 50 corresponds to the display magnification of the object to be watched in the three-dimensional virtual space. By 50, as if operating the zoom lever of the camera,
The display magnification can be changed.

The updating process of the magnification value M based on the operation amount ± Z may be always executed irrespective of the setting state of the setting switch 60, or the setting switch 60 may be set to one of the setting states. It may be executed only at a certain time. In the embodiment shown here, the updating process of the magnification value M is performed only when the setting switch 60 is set to the “movement mode” in order to avoid confusion in the operation of the user. .

FIG. 6 is a chart showing the contents of the updating process performed by the posture state data updating means 70 for the combination of the setting state of the setting switch 60 and the operation amount given from the three-dimensional operation amount sensor 50. As mentioned above,
In the “movement mode”, a process of updating the coordinate value (u, v) of the position P based on the operation amounts ± X and ± Y is performed, and a process of updating the magnification value M based on the operation amounts ± Z. Is performed, and in the “rotation mode”, the operation amount ±
A process of updating the angle value (θ, φ) indicating the direction of the line-of-sight vector E based on X, ± Y is performed.

When a three-dimensional operation amount sensor 50 capable of specifying even the scalar value is used as each operation amount, the update processing can be performed with an update width corresponding to the scalar value. For example, in the “movement mode”, even when the operation amount + Y is input, when the operation amount Y = + 10 is input, the position P is input when the operation amount Y = + 10 is input. If the movement amount is set to be twice, more intuitive movement processing can be performed. However, the three-dimensional operation amount sensor 50 applied to the present invention does not necessarily need to be able to specify even such a scalar value. For example, with respect to the Y-axis direction, a force in the + Y direction is detected. It is sufficient to have a function of recognizing only three states, that is, no force detection at a significant level in the Y-axis direction, in which the force is detected, and in this case, the same detection state continues. The update width is determined by the time. For example, when the detection state of “the force in the + Y direction is detected” continues for one second, and when the detection state continues for two seconds, the movement amount of the position P may be doubled.

When operating the three-dimensional operation amount sensor 50 as shown in FIGS. 4 and 5, ± X, ± Y,-
The operation of inputting the five types of operation amounts of Z is relatively easy and can be executed as a natural operation, but the input operation of the operation amount of + Z is somewhat unnatural and difficult to handle. That is, the operation of inputting the operation amounts ± X and ± Y is an operation of touching the upper part of the operation rod 53 and tilting the operation rod 53 in a predetermined direction, and the operation of inputting the operation amount −Z is performed. This is an operation in which a finger is put on the upper surface of the operating rod 53 and pushed downward, and both operations are natural. However, the operation amount + Z
Is an operation of pinching the operation rod 53 with a finger and pulling it upward, which is an unnatural and difficult operation.

In order to avoid such adverse effects, the configuration shown in FIG. 7 may be employed instead of the configuration shown in FIG. In the configuration shown in FIG. 7, the three-dimensional operation amount sensor 50 has a function of inputting five types of operation amounts of ± X, ± Y, and -Z (+ Z depending on how the coordinate system is defined). The function of inputting the operation amount + Z (−Z depending on how the coordinate system is defined) is not necessarily required. Instead, it is necessary to newly provide an auxiliary setting switch 80. As with the setting switch 60, the auxiliary setting switch 80 may be any switch as long as it can selectively set one of the two states.

In the experience apparatus having such a configuration, the posture state data updating means 70 determines the sign of the operation amount Z based on the setting state of the auxiliary setting switch 80. In this embodiment, “normal mode” or “reversal mode” can be set by the auxiliary setting switch 80.
When the “normal mode” is set, the posture state data updating unit 70 handles the operation amount −Z given from the three-dimensional operation amount sensor 50 as it is, but the “reversal mode” is not set. If so,
The sign is inverted so that the operation amount + Z is given even though the operation amount -Z is given.

In the experience apparatus provided with such an auxiliary setting switch 80, the input operation to the three-dimensional operation amount sensor 50 as shown in FIGS. 4 and 5 is performed by five kinds of operation of ± X, ± Y, -Z. Only input operation of quantity is enough, operation quantity + Z
Unnecessary input operation for inputting is unnecessary. That is, when the user wants to increase the display magnification of the target, the user may perform an operation of pressing the upper surface of the operating rod 53 with a finger while the auxiliary setting switch 80 is maintained in the “normal mode”, Conversely, when it is desired to reduce the display magnification, the operation of pressing the upper surface of the operation rod 53 with a finger may be performed in the same manner while the auxiliary setting switch 80 is maintained in the “reversal mode”. Although an operation of switching the auxiliary setting switch 80 is added,
For example, if is constituted by a simple push button switch (a switch that normally switches to the “reverse mode” while being pressed in the “normal mode”), the operation becomes very natural.

[0042]

Next, more specific embodiments of the apparatus for experiencing a three-dimensional virtual space according to the present invention will be described with reference to examples. Here, as an example of a three-dimensional virtual space, an example in which a simulated department store is assumed, and the user can observe the displayed products while walking around the simulated department store, in other words, An embodiment in which the present invention is applied to an experience apparatus for realizing so-called online shopping will be described.

FIG. 8 is a plan view showing the concept of three-dimensional image data a showing the inside of a simulated department store, showing the UV plane viewed vertically from above. In the example shown here, show windows S1 and S2 are arranged, and goods G are arranged in each show window. The show window and the product are each defined as three-dimensional image data (for example, data indicating the pixel values of a large number of pixels defined on the surface).

As described above, in this three-dimensional virtual space, the position P (u,
v) and a gaze vector E indicating the gaze direction of the user
(Θ, φ) is defined. In the illustrated example, the line-of-sight vector E points in the direction of the product G displayed in the show window S1. When the height of the user is considered, as shown in the side view of FIG. 9, the line-of-sight vector E is a vector starting from a point P ′ (u, v, h) vertically above the point P (u, v). become.

When the operation amount ± X is input with the setting switch 60 set to the “movement mode”, “+
As indicated by the arrow marked "X" or "-X", the position P of the user moves left and right. Also, when the operation amount ± Y is input in the state where the “movement mode” is set, the user's position P moves forward and backward as indicated by the arrow “+ Y” or “−Y” in FIG. Will be. Thus, in the “movement mode”, the user can freely move on the UV plane.

On the other hand, when the operation amount ± X is input while the setting switch 60 is set to the “rotation mode”,
, The user rotates right and left at the position P, and the direction of the line-of-sight vector E changes. That is, the user has turned left and right at the position P. Further, when the operation amount ± Y is input in the state where the “rotation mode” is also set, as shown by the arrow “+ Y” or “−Y” in FIG. Will be inclined. That is, the user has changed the face direction up and down. Thus, in the “rotation mode”, the user can see an arbitrary direction.

In this embodiment, the setting switch 60
Irrespective of the setting state, the magnification value M for displaying the object in the direction of the line-of-sight vector E can be increased or decreased by inputting the operation amount ± Z. FIG. 10 is a diagram illustrating an example of the view image actually displayed on the display screen of the display device 40. In both the case where the setting switch 60 is in the “movement mode” and the case where the setting switch 60 is in the “rotation mode”, the magnification value M is increased by inputting the operation amount −Z.
Is enlarged, the magnification value M is reduced by input of the operation amount + Z, and the visibility image is reduced as shown on the right of FIG. In this embodiment, the capacitance type force sensor shown in FIGS. 4 and 5 is used as the three-dimensional operation amount sensor 50, and the sign of the operation amount Z is determined by the auxiliary setting switch 80 as shown in FIG. Since the configuration is adopted, when the auxiliary setting switch 80 is set to the “normal mode” and the operating rod 53 is pushed in, the visual field image is enlarged and displayed (zoom-up), and the auxiliary setting switch 80 is set to the “reversal mode” and the operating rod 53 is set. When pressed, the view image is reduced (zoomed down).

FIG. 11 is a table showing the contents of the updating process performed by the posture state data updating means 70 for the combination of the setting state of each switch and the operation amount in the experience apparatus according to the above-described embodiment. As can be seen from this chart, in this embodiment, the setting state of the auxiliary setting switch 80 is irrelevant to the operation amounts ± X and ± Y, and the setting state of the setting switch 60 is irrelevant to the operation amount -Z. Therefore, an embodiment in which both the setting switch 60 and the auxiliary setting switch 80 are used is also possible. FIG. 12 is a chart showing the content of the update process in such an embodiment.
However, in order to prevent confusion of the operation by the user, it is preferable to provide the setting switch 60 and the auxiliary setting switch 80 separately.

FIG. 13 shows a state in which the capacitance type force sensor 50 shown in FIGS.
FIG. 5 is a perspective view of an embodiment in which an operation rod 53 is erected in a gap 1; Here, the lateral direction (longitudinal direction of the keyboard) substantially along the main surface of the keyboard 90 is X.
It is embedded in the keyboard 90 so that the axis and the vertical direction (the short direction of the keyboard) are the Y axis, and the direction substantially perpendicular to the keyboard main surface is the Z axis. The user can input each operation amount by operating the operation rod 53 provided in the gap between the keys 53. The structure of the keyboard incorporating the sensor 50 is disclosed in, for example, Japanese Patent Application Laid-Open No. 8-6711.

As described above, the sensor 50 is attached to the keyboard 90.
When adopting the configuration with built-in, on this keyboard,
Although the setting switch 60 and the auxiliary setting switch 80 can be provided independently, a specific key (for example, a space bar, a control key, etc.)
The function as 0 and the auxiliary setting switch 80 can also be assigned. In this case, there is no need to provide a separate and independent setting switch. For example, if the space bar is used as the setting switch 60, simply operating only the operation rod 53 will result in an input of the operation amount in the “movement mode”.
Is operated, an operation amount input in the “rotation mode” is possible.

[0051]

As described above, according to the apparatus for experiencing a three-dimensional virtual space according to the present invention, the operation amount input using the combination of the three-dimensional operation amount sensor and the setting switch is performed, so that it is intuitive and natural. The operation makes it possible to present an experience with a degree of freedom as close to reality as possible.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a basic configuration of a three-dimensional virtual space experience apparatus according to the present invention.

FIG. 2 is a coordinate diagram for explaining the contents of three-dimensional image data a and posture state data b in the apparatus shown in FIG.

FIG. 3 is a coordinate diagram showing a method for defining the direction of a line-of-sight vector E shown in FIG. 2 by angles (θ, φ).

FIG. 4 is a side sectional view of a conventionally proposed capacitance type three-dimensional force sensor.

5 shows electrodes E1 to E on a substrate 51 of the sensor shown in FIG.
It is a top view which shows arrangement | positioning of No.5.

FIG. 6 is a diagram illustrating a combination of a setting state of a setting switch and an operation amount given from a three-dimensional operation amount sensor in an apparatus for experiencing a three-dimensional virtual space shown in FIG. 9 is a chart showing the contents of an update process.

FIG. 7 is a block diagram showing another basic configuration of the three-dimensional virtual space experience device according to the present invention.

FIG. 8 is a plan view showing the concept of three-dimensional image data a showing the inside of a simulated department store.

FIG. 9 is a side view of the inside of the department store shown in FIG. 8;

FIG. 10 is a diagram showing an example of a field-of-view image actually displayed on a display screen of a display device 40.

11 is a table showing the contents of an update process performed by a posture state data updating unit 70 for a combination of a setting state and an operation amount of each switch in the experience apparatus shown in FIG. 7;

FIG. 12 is a table showing the contents of an update process in an embodiment in which the setting switch 60 and the auxiliary setting switch 80 are both used in the experience apparatus shown in FIG. 7;

13 is a perspective view of an embodiment in which the capacitance-type force sensor 50 shown in FIGS. 4 and 5 is provided on a keyboard 90, and an operation rod 53 is erected in a gap between keys 91. FIG.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 ... Three-dimensional image data storage means 20 ... Attitude state data storage means 30 ... View image data generation means 40 ... Display means (display) 50 ... Three-dimensional operation amount sensor 51 ... Substrate 52 ... Lid member 53 ... Operation rod 60 ... Setting Switch 70: Posture state data updating means 80 ... Auxiliary setting switch 90 ... Keyboard 91 ... Key a ... Three-dimensional image data b ... Posture state data c ... View image data E ... View vector E1 to E5 ... Electrode F ... Projection vector G ... Product M: Display magnification value of the object P: User's position on UV plane P ': User's eyeball position in UVW three-dimensional space Q: Point of eye vector E Q': Point of projection vector E S1, S2: show window θ, φ: angle indicating the direction of the line-of-sight vector

Claims (4)

[Claims] 1. In a UVW three-dimensional rectangular coordinate system, U
A three-dimensional image data storage unit that stores three-dimensional image data of each element constituting a three-dimensional virtual space defined by a V plane as a horizontal plane and a W axis as a vertical axis; and a UV plane in the UVW coordinate system. The coordinate value (u, v) indicating the upper position P and the UV of the line-of-sight vector E defined with the position P or the position P ′ vertically above the position P as the starting point
An angle θ with respect to the plane and an angle φ with respect to the UW plane;
Posture state data storage means for storing posture state data consisting of a magnification value M indicating a projection magnification of a three-dimensional virtual space component in a direction indicated by the line of sight vector E; the three-dimensional image data and the posture state data Based on the above, view image data for generating view image data representing a two-dimensional view image obtained by projecting a state when viewing the direction of the line-of-sight vector E from the position P or a position P ′ vertically above the position P based on the magnification value M. Generating means; display means for displaying a two-dimensional view image based on the view image data; positive and negative operation amounts + X, -X in the X-axis direction in the XYZ three-dimensional orthogonal coordinate system; And negative manipulated variables + Y, -Y and positive and negative manipulated variables + Z, -Z in the Z-axis direction.
Z, a three-dimensional operation amount sensor that outputs each detected operation amount, a setting switch that can selectively set one of a first state and a second state, and the three-dimensional operation amount A posture state data updating unit that updates posture state data in the posture state data storage unit based on an output of a sensor and a setting of the setting switch, wherein the posture state data updating unit is configured such that: In the state 1, the position P on the UV plane is changed to the projection vector F based on the operation amounts + X and -X, taking into account the projection vector F obtained by projecting the line-of-sight vector E on the UV plane. The coordinate values (u, v) are updated so as to move in the orthogonal direction, and the position P on the UV plane is determined based on the manipulated variables + Y and -Y in the direction indicated by the projection vector F or in the direction indicated by the projection vector F. The coordinate value (u, v) is updated so as to move in the opposite direction. When the setting switch is in the second state, the angle φ is increased or decreased based on the operation amounts + X and −X, and the operation amount + Y
The angle θ is increased or decreased based on the operation amounts + Z and −Z, regardless of the setting of the setting switch, or when the setting switch is in one of the states. A three-dimensional virtual space experience device having a function of increasing and decreasing. 2. The experience device according to claim 1, further comprising: an auxiliary setting switch for selectively setting one of two states, wherein the three-dimensional operation amount sensor is configured to control an operation amount in the Z-axis direction. , Using a sensor capable of detecting at least one of the positive operation amount + Z and the negative operation amount -Z, and the posture state data updating means based on the state of the auxiliary setting switch. An apparatus for experiencing a three-dimensional virtual space, wherein the operation amount is inverted in sign. 3. The experience device according to claim 1, wherein a three-dimensional operation amount sensor is provided on a keyboard, and an operation amount can be input by operating an operation rod standing upright in a gap between the keys. The horizontal direction substantially along the keyboard main surface is defined as the X axis, the vertical direction is defined as the Y axis, and the direction substantially perpendicular to the keyboard main surface is defined as the Z axis, and the operating rod is operated in each coordinate axis direction. An apparatus for experiencing a three-dimensional virtual space, wherein each operation amount can be input by the user. 4. The experience apparatus according to claim 3, wherein a specific key on a keyboard is used as a setting switch or an auxiliary setting switch.