JPH0773338A - Virtual reality apparaus mainly based on vision - Google Patents

Abstract

PURPOSE:To provide a virtual reality apparatus mainly based on vision so as to facilitate operability by intuitively providing layout materials. CONSTITUTION:A user wears a stereoscopic viewing means 11 to both the eyes by using any holder or belt. A storage means stores the materials required for generating the plural environments which is the target for visually experiencing virtual reality after they are inputted before the simulation. An in-view menu generating means generates a menu inside the view of the stereoscopic viewing device so that the user can select desired virtual reality. The menu selecting means can select any menu intended by the user out of the menus generated inside the view corresponding to the operation of one hand of the user. Based on the materials stored by the memory, a stereoscopic environment generating means generates the stereoscopic environment selected by the menu selecting means inside the stereoscopic viewing means 11. The simulating person can perform the input operation only by one hand.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a simulated experience device,
In particular, the present invention relates to a simulated experience device for predicting and confirming various living environments mainly by sight and auditorily when designing a house.

[0002]

2. Description of the Related Art In recent years, the demands of consumers for houses have become diverse. On the other hand, in the case of homes, high-performance and high-performance home-related facilities and equipment such as air conditioners are remarkable. Especially in recent years, housing-type air conditioners (air conditioners integrated with a house) have been increasing, and in such cases, it is generally necessary to simultaneously select housing-related equipment when designing a house. . Furthermore, it is becoming more and more necessary to consider the indoor light environment from the time of designing, not only in terms of the positions of TV receivers, study desks, etc., as well as windows and lighting equipment.

On the other hand, amenities (amenity, place, air conditioning,
(Comfort such as visual sense) is still high, and therefore, in addition to the habitability only from the physical side, the aesthetics of the indoor space is excellent while effectively utilizing the narrow space, and from the mental and mood aspects There is also a demand for a housing design that can promptly provide a living environment that is sufficiently satisfied with. Moreover, these things are important not only for new construction but also for renovation.

[0004] In addition to housing, such things are becoming important not only in shops and offices where many people work and use. However, when designing a house, in order to optimize it while satisfying various specifications of users and residents for each individual property, the conventional experimental method using a reduced model requires a high labor cost. Costs are particularly high in Europe, the United States and Japan, and it is difficult to respond quickly as a real problem. Therefore, by adopting a computer technology which has been remarkably developed in recent years, the three-dimensional living environment evaluation is carried out after the housing environment is virtually constructed. This makes it possible to evaluate air conditioning, lighting, sound, etc. in a short time and at low cost. This is a kind of computer simulation. Moreover, it is becoming easier to form the simulation result as a virtual space called virtual reality and then make it possible to experience it in a state close to reality by using a simulated experience device. For this reason, it is possible to efficiently grasp a large amount of analysis data required in the design stage, and also to simulate the residential environment of the building before the actual construction of the residential environment for the final user such as a resident or sales person (salesman) who is a customer. It is about to be adopted in proposal-based sales, such as for people to experience it. And this is a large amount of production of houses of the same standard,
It is important for condominiums, houses for sale, office buildings, etc. that will be sold. By the way, conventionally, it is general that the simulation result of the living environment is two-dimensionally displayed on a CRT or a dome-shaped display, or three-dimensionally by stereoscopic parallax using stereoscopic glasses, and then completed. It was often used to evaluate the performance of existing houses. In this case, the cost performance of the simulated experience device is improved by the progress of the hardware, and, for example, as shown in FIG. 1, the goggle type stereoscopic display device 11, the arithmetic and control unit 13, and the three-dimensional input unit 12 are installed, By changing the virtual and three-dimensional interior of the goggles type stereoscopic display device according to the viewing angle and viewing position, it is possible to see what the room looks like by changing them. It has become possible to observe artificially. Here,
The goggle type stereoscopic display device 11 has a small image forming device for each of the left and right eyes, and an image formed for the left and right eyes is simply displayed in a small size according to the distance in a distant device or the like. Not only is it displayed, but by giving a predetermined parallax on the left and right sides, it is possible to obtain a stereoscopic and perspective distance as if an actual object is viewed with the naked eye in an actual environment. In addition, menus and the like can be displayed if necessary. Further, since the three-dimensional input device 12 has both eyes closed by the goggle type stereoscopic display device 11, generally, what is called a data glove as shown in FIG. 1 is used. Here, the data glove 12 is a glove in which a large number of expandable and contractible corrugated or spiral metal thin wires are embedded, and when various switch operations or similar operations are performed with a hand, especially a finger, the metal thin wires are By expanding or contracting, the operation content can be detected.
Then, the instructions to be input to the simulated experience device are set in advance corresponding to the movements of the hands and fingers.
Various instructions can be input by the movement of a finger, and it is possible to experience a virtual experience in a virtually constructed space. In addition, the magnetic detection end 15 is placed on the head of the simulated person in three directions of up, down, left and right, and front and back.
By detecting the change in the strength of the magnetic field in the three directions by the magnetic field generator 14 separately provided for the direction, the tilt of the head is also detected, and this tilt is also a goggle type solid. It can be reflected in the visual field of the virtual space formed on the display device. Here, the magnetic detection is taken into consideration that the detection by light is easily affected by the indoor lighting, and the detection by sound is easily affected by noise from the outside.

As means necessary for three-dimensional display, the position and shape of each device, house, its wall, window, etc. are defined with X coordinate in the east-west direction, Y coordinate in the north-south direction, and Z coordinate in the vertical direction. A method is used in which parallax, a visible shape, and a visible size are calculated after the eye height h based on the three-dimensional coordinates is set as z = h. The shape etc. input into 1300 of FIG. 1 are shown notionally.

[0006] Further, it is possible to experience, to some extent, how the sight and hearing change when a person moves while wearing it. In this case, the movement of the person is the same as the required number of detectors or the number of detectors is small, and the magnetic detector 15 is independent of sound and light.
Is performed by detecting the magnetic field generated by the magnetic generator 14. Based on the above, not only the equipment in the room is stereoscopically displayed, but also the thermal environment and the light environment due to the illumination are stereoscopically displayed as shown in FIG. Display 2 of the air flow blown out from the air conditioner 21 in A of FIG.
2 and the contour line 23 of the temperature distribution analytic index are shown. B of FIG.
A contour line 25 of the illuminance distribution due to the illumination from the chandelier 24 is shown in FIG. FIG. 2C shows how the stereo headphones 26 experience an auditory environment.

The laws and facts necessary for these calculations are as follows, for example. (1) The solid angle in the visual field of the device is inversely proportional to the square of the distance from the eye. (2) Binocular parallax is inversely proportional to distance. (3) The amount of light received from the light source and the volume from the sound source are inversely proportional to the square of the distance.

(4) Illumination equipment, contents such as directivity and frequency of light and sound emitted from a sound source, change in reflectance due to incident angle on a reflecting surface, absorption of light and sound by each equipment, and air, Attenuation rate and the like in glass are fixed if conditions are given. (5) Similarly, the specific heat and viscosity of air, the amount of heat released from the heat source,
The thermal properties of each device, etc. are also determined if conditions are given.

(6) Various analysis formulas such as the EULER formula and the continuous formula. However, these are not the gist of the present invention per se, and have been published in school mathematics, graphic arts, and physics textbooks. In addition, general examples of programming technology such as application examples that reflect sound in three-dimensional visual display and displaying menus for program selection instead of physical objects such as houses are described in Hattori Katsura K. K. It is a so-called well-known technology introduced in "World of Artificial Reality" published by Engineering Research Society. In addition, various formulas and analysis methods such as interpolation method, numerical differentiation and numerical integration, difference method, transition matrix method, and finite element method are widely known. Therefore, the description thereof will be omitted.

[0010]

However, in the three-dimensional input device 12 using the above-mentioned conventional data globe, in order to select the target building, room, or environmental element to be evaluated from the menu, the three-dimensional input device 12 is used. The data globe 12 must be moved to a position where the menu selected by the data globe 12 drawn in the space can be grabbed. Therefore, the goggles-type stereoscopic display device 1 for both eyes
It is necessary to move the upper arm while keeping the center of gravity of the body while wearing 1.

In addition, it is necessary to remember a rule for inputting by finger movement, which is not usually adopted. Therefore, the operability is very low. And, this is important not only for a design engineer in the beginning but also for sales engineering when the customer wants a simulated experience. In addition, furniture in the room (fixed equipment such as walls and windows),
Alternatively, in order to select an equipment device (a lighting device, an air conditioner, a washing machine, or the like that can be moved or replaced) and the like to be changed, it is necessary to move in the virtual space. Consequently, it is necessary to actually walk while wearing the goggles type stereoscopic display device 11 for that purpose. However, the range of the magnetic field that detects the position of the goggle type stereoscopic display device 11 is at most about 2 m, and when it is necessary to move a distance more than that, a movement command by the data glove 12 is decided in advance to walk. You must adopt a method such as specifying the action. For example, the user must move in the direction indicated by the displayed finger.
And in order to increase the target of various simulated experiences,
There are many rules that need to be remembered, and it cannot be said that it is the optimum man-machine interface.

Further, since the data globe 12 is also rarely used, it is complicated and expensive. In addition, in order to evaluate the simulation result of the living environment as a design material, the experiencer can virtually move to the evaluation position in the virtual space by the above-mentioned method, or It is necessary to take measures such as observing by displaying physical quantities such as illuminance in contour lines on the virtual cross section. However, it is not preferable to walk with both eyes blocked by the goggle type stereoscopic display device 11, even in a room. Even if this is not the case, the operation to rotate or move the field of view up or down needs to be kept as close as possible. For this reason, it is unavoidable to pay attention to them, and observation of the liver and kidney tends to be insufficient.

[0013] In particular, it is impossible for a home construction company or a home sales company to allow a prospective resident or a purchaser who is the final consumer to fully simulate the housing environment to be constructed or sold. If not, it will be very difficult. In addition, it is difficult to observe the sensation of temperature, wind, etc. that a person may feel with the movement, which is indispensable for the placement and selection of air conditioners and the like. However, this is absolutely necessary not only in ordinary housing for residents but also in shops for business.

Although information about the wind, heat, light, sound, etc. can be obtained in the room as a whole or in sections, it is difficult to obtain the local information that is indispensable for designing a comfortable living space. In addition, many people are often present not only in stores but also in homes, but simulating this situation and mutual influences is not considered. In particular, it is completely impossible to obtain design data and experiences regarding mutual movements, their effects, and effects not only during normal times but also during emergencies. However, this is very important in houses, stores, etc.

Further, the influence of light on the house and the internal equipment is not accurately displayed, and the display of the brightness is not effective, so that it is difficult to evaluate the feeling of shading. Further, when viewing the room from the outside or vice versa, only the outer wall or the inner wall can be seen, and it is difficult to evaluate the house or the whole room in relation to the outside or the outside. And this is a very important drawback in houses with gardens, restaurants with gardens for viewing, etc.

The influence of external noise caused by opening and closing windows is also important in urban areas, but intuitive evaluation is difficult. In addition, since beginners move around in the boundaries created by the program, they often go out of the room by mistake, but it is very difficult to grasp the positional relationship in the space created by the program. Yes, it is difficult to return to the room.

Further, it is difficult for a house design engineer to intuitively understand the changes in various house environments due to changes in design conditions, even though he or she may know them. In particular, this is important for novice design engineers. Even if not, it is inconvenient to obtain intuitive design data. Also, in sales engineering, it is difficult to quickly and intuitively experience various customer requests, such as changes in environmental conditions such as the brightness of the room due to blinking lights and opening / closing windows. Is.

Further, in a store, it is indispensable to evaluate the arrangement of mirrors, the color of the glass of the show window, and the color of the lighting, but it is difficult to have a quick and intuitive experience. Therefore, it is desired to realize a three-dimensional input device and a goggle type stereoscopic display device capable of evaluating the living environment with sufficient man-machine interface specifications. The present invention has been made for the purpose of solving the problems in these conventional examples.

[0019]

In order to achieve the above-mentioned object, in the invention of claim 1, a pseudo that enables a user to visually experience different environmental conditions in which the user will exist according to the operation of the user. In the experience device, a CRT to be worn on both eyes of the user and a stereoscopic means having a liquid crystal display unit, and materials necessary for generating a plurality of environments to be visually simulated are input prior to the simulated experience. In addition, the storage means consisting of a disk and a high-speed semiconductor memory to be stored and the menu of the environment to be simulated are stereoscopically displayed so that the user can select the one that he / she wants to simulate. In-field menu generation means generated in the field of view of the device, and from the menus generated in the field of view, the one intended for the simulated experience of the user is converted into the motion of only one hand of the user. And menu selection means for enabling selection storage means is characterized by having a three-dimensional environment generation means for generating in the stereoscopic means selected environment by the menu selection means based on the material to be stored. In the invention of claim 2, the menu selecting means is designated by a beam light from a menu, and a beam light generating portion for generating a beam light whose direction can be changed only by one hand movement within the stereoscopic field of view. It is characterized in that it has a menu selection designating section that enables the user to select and designate what is intended.

According to the third aspect of the present invention, the user operation input for allowing the user who virtually exists in the environment generated by the stereoscopic means to input the data relating to the operation in the environment. Based on the operation means and the data about the virtual operation in the environment of the user, the data inputted from the user operation input operation means, and the environment-related data currently stored in the stereoscopic means stored in the storage means. In addition, the stereoscopic environment user motion reflecting means for making necessary corrections of the visual field and the like according to the motion of the user with respect to the environment virtually created in the stereoscopic vision means There is.

In the invention of claim 4, the user operation input operation means includes an operation for causing a magnetic change and an acceleration (including an acceleration, in order to enable an input operation relating to the user exercising only by exercising one hand of the user. It is characterized by having a detection unit that detects at least one of an operation that causes a tilt), a push button operation, and a switch operation, and an input operation conversion unit that converts the detection result of the detection unit into the content of the input operation. There is.

According to the fifth aspect of the invention, the input operation conversion unit reduces the walking and head swing of the user who is supposed to have the detection result of the detection unit within the environmental conditions generated in the stereoscopic means. Also, the three-dimensional environment user action reflection means receives the conversion result of the first conversion portion, and performs a necessary correction as the user's walking,
It is characterized by having a walking and swing correction unit that corrects a change in the visual field associated with at least one swing.

According to the sixth aspect of the invention, the input operation conversion section receives the detection result of the detection section and divides windows, light sources such as electric lights, walls, curtains and the like existing in the environment created in the stereoscopic means. A second conversion unit for converting the input to an operation that will change the light environment condition for at least one of the devices such as a surface, a reflective surface, a transmissive surface, and a television receiver, or at least one of the scenes in the field of view. The three-dimensional environment user action reflection means has a light for correcting at least one of illuminance, color, equipment arrangement, equipment display, and partition surface in the visual field associated with the operation that changes the light environment condition of the user. It is characterized by having an operation input correction unit.

In the seventh aspect of the invention, the input operation converting section receives the detection result of the detecting section, the sound environment existing in the environment generated in the stereoscopic means, the thermal environment such as the panel heater, the fan, A third conversion unit for converting the input / output of the operation of at least one of the changes in the existence state of the partition surface such as the start / stop of the device in the field of view and the opening / closing of the door that affects at least one of the air flow environment such as the duct. The stereoscopic environment user action reflection means receives the conversion result of the third conversion unit, and the illuminance in the visual field according to the user's operation, the color, the arrangement of the device, the display of the device, the start / stop of the device, and the partition surface. It is characterized by having a sound, temperature, and airflow input correction unit that corrects at least one of the existing states.

In the invention of claim 8, the user operation input means is a voice input section capable of accepting a user's voice input, and a voice input for converting the input accepted by the voice input section into the content of the user's operation instruction. And a converter. According to a ninth aspect of the invention, in a simulated experience device that simulates a different environment in which the user will exist in accordance with a user's operation, the user can visually experience the experience with stereoscopic means worn on both eyes of the user. It includes a storage means for storing the material required to generate the target environment prior to the simulated experience, and a CPU for generating the environment in the stereoscopic means based on the material stored in the storage means. In the environment of the three-dimensional environment generating means, the soft robot generating means for generating the soft robot in the environment generated in the three-dimensional viewing means under the action of the three-dimensional environment generating means, and the soft robot environment generated by the soft robot generating means The physical location of the robot such as the temperature and illuminance in the environment to be stored in the storage means, and the soft robot location position instructing means that allows the user to specify and change the location. A physical material storage means, such as a high-speed semiconductor memory, which stores the materials required to determine the conditions, and at least the materials required to determine the physical conditions stored by the physical material storage means. A part is used to calculate and store the physical environmental conditions of the position instructed by the soft robot location position instructing means in the environment and the physical condition calculation storage means and the environment in the soft robot's location. Soft robot display rule storage means for storing and storing a rule defining the relationship between the value of the physical condition and the display mode of the soft robot in accordance with this value, and storing the rule, prior to the generation of the soft robot. Soft robot display for determining the display mode of the soft robot based on the calculation result stored in the storage means and the rule stored in the soft robot display rule storage means When the soft robot generated by the soft robot generating means is combined with the environment generated in the stereoscopic means and generated and displayed, the soft robot display is displayed in the mode determined by the soft robot display mode determining means. It has a mode control means.

According to the tenth aspect of the present invention, among the materials necessary for determining the physical conditions stored in the physical material storage means, the calculation of the physical conditions of the environment at the location of the soft robot is performed. A physical material change operation means that enables at least a part of the used material to be changed to other material or at least one newly input material,
When the material is changed by the physical material change operation means, the physical condition calculation storage means, the soft robot display mode determination means and the soft robot display mode control means are required to make necessary corrections such as recalculation according to the change. It is characterized by having a physical condition changing operation execution means for effecting the action.

According to the eleventh aspect of the present invention, the soft robot location position indicating means detects at least one of an operation that causes a magnetic change due to the movement of one hand of the user, an operation that causes an acceleration, a push button operation, and a switch operation. And a conversion unit that converts the detection result of the detection unit into the content of the user's instruction. Claim 12
In the invention described above, the soft robot location-instructing means has a voice input section including a microphone or the like capable of accepting a voice input of the user, and a voice instruction conversion including an MCPU or the like for converting the input accepted by the voice input section into an instruction. It is characterized by having a part.

According to the thirteenth aspect of the present invention, the physical material storage means has an air flow material storage portion for receiving and storing material for defining conditions relating to the air flow, and the physical condition calculation storage means is the environment. It has a wind direction and wind speed distribution calculation storage unit for calculating the wind direction and wind speed distribution inside, and the soft robot display mode determining means is a string attached to at least one place of the soft robot (including long hair of the head) It has a string rule storage unit for inputting the relationship between the fluttering direction and the fluttering condition according to the wind direction and the wind speed of the It is characterized in that it has a string display mode deciding unit for displaying the fluttering condition as a wind direction and a wind speed of the unit.

In the fourteenth aspect of the present invention, the physical material storage means has an illuminance material storage section for receiving and storing materials for defining conditions related to the illuminance in the environment such as the output and position of the light, and the physical material storage means. The dynamic condition calculation storage means has an illuminance calculation storage section for calculating and storing the illuminance in the environment, and the soft robot display rule storage means displays the face of the soft robot according to the illuminance on the face part of the soft robot, the face. A face display rule storage unit for storing and storing a rule about at least one of the shadows attached to the soft robot display mode determining unit displays the face of the soft robot according to the illuminance of the unit. In addition, it has a face display mode determination unit that determines at least one of which is not shaded according to the illuminance of the part.

In the fifteenth aspect of the present invention, the physical material storage means has an acoustic condition storage portion for inputting and storing the material concerning the condition related to the sound in the environment, and the physical condition calculation storage means is The soft robot display mode determining means has a sound intensity calculation storage unit for calculating and storing the sound intensity from a predetermined sound source, and the soft robot display mode determining means is responsive to the sound intensity from the predetermined sound source in the ear part of the soft robot. A volume display surface storage unit for inputting and storing a rule regarding the content of the volume display surface portion attached to the soft robot, and the soft robot display mode determining means determines the volume according to the volume of the ear portion of the soft robot. It is characterized in that it has a volume display surface section determining section for changing and displaying the volume display surface section.

According to the sixteenth aspect of the present invention, the physical material storage means has a temperature condition storage unit for inputting and storing a material for determining a condition relating to the temperature in the environment such as the output of the fan or the output of the air conditioner. The physical condition calculation storage means has a temperature calculation storage portion for calculating and storing the temperature in the environment or the sensible temperature, and the soft robot display rule storage means is provided in at least one part of the soft robot which is defined. The soft robot display mode determining means includes a color display rule storage unit that stores and stores a rule regarding the content of the color attached to the part according to the temperature of the part or the sensible temperature and any of the temperatures. Characterized by having a color display determination unit for displaying at least one predetermined part of the robot with a color according to any temperature of the part That.

According to a seventeenth aspect of the present invention, in a simulated experience device that simulates a different environment in which the user will exist in accordance with the user's operation, the stereoscopic viewing means worn on both eyes of the user and the A storage means for storing the material necessary for generating the environment to be simulated to be input prior to the simulated experience, and an environment is generated in the stereoscopic means based on the material input by the storage means. A symbol for visually displaying the value of the physical condition in the environment in the environment generated in the stereoscopic means under the effect of the stereoscopic environment generating means and the stereoscopic environment generating means (with a symbol or coloring A symbol generating means for generating a predetermined shape or a symbol having a predetermined shape, and a symbol for enabling the user to specify and change the location of the symbol in the environment that the symbol generating means can generate. The physical location input means, the physical material storage means for storing the material necessary for determining the physical conditions in the environment stored by the storage means, and the physical material input by the physical material storage means Physical condition calculation memory for calculating and storing the physical environmental condition of the position instructed by the symbol location instructing means in the environment by using at least a part of the material required to determine the physical condition Means and
A symbol display rule storage means for storing and storing a rule defining the relationship between the value of the physical condition of the environment and the display mode of the symbol at the location of the symbol prior to the generation of the symbol, and the physical condition calculation storage means. Symbol display mode determining means for determining the display mode of the symbol based on the calculation result stored in the symbol display rule storage means and the rule stored in the symbol display rule storage means, and the symbol generated by the symbol generating means is generated in the stereoscopic viewing means. It is characterized in that it has a symbol display mode control means for displaying in the mode determined by the symbol display mode determining means when it is combined with the environment and generated and displayed.

According to the eighteenth aspect of the present invention, among the materials necessary for defining the physical conditions already input and stored in the physical material storage means, the physical environment of the environment at the location of the symbol is defined. Physical material change operation means for changing at least a part of the materials used for calculation of various conditions to other materials or at least one newly input material, and materials by physical material change operation means If there is any change in the physical condition, the physical condition calculation means, the symbol display mode determination means and the symbol display mode control means perform the necessary correction action such as recalculation and redisplay according to the change. It is characterized by having an operation execution means.

In the nineteenth aspect of the present invention, the symbol location position indicating means is capable of exerting its function only by the movement of one hand of the user, so that an operation for causing a magnetic change, an operation for causing acceleration, a push button operation, It has an accelerometer that detects at least one switch operation and a detection unit that consists of magnetic detection ends in three directions in a magnetic field, and a conversion unit that converts the detection result of the detection unit into the content of the user's instruction. It is characterized by being.

In the twentieth aspect of the present invention, the symbol location instructing means is a voice input section including a microphone or the like for receiving a voice input of the user, and a voice instruction for converting the voice received by the voice input section into the content of the instruction. And a converter. In the invention of claim 21,
The symbol display rule storage means is characterized by having a numerical value display rule storage section for storing the inputted rule for displaying the physical value itself such as 15 ° C., 50 phones, etc. as a numerical value.

According to a twenty-second aspect of the invention, in the simulated experience device for visually simulating different environmental conditions in which the user is to exist in accordance with the user's operation, stereoscopic means to be mounted on both eyes of the user. Specifying and changing the storage means for storing the materials necessary to generate the environment in which the user will visually experience the simulated experience, and the location of the user in the environment. The user position input operation means that enables the user position and the environment for a simulated experience in the stereoscopic viewing means based on the material stored in the storage means according to the user's position input by the user position input operation means. A three-dimensional environment generating means for generating, a boundary wall recognizing means for recognizing a boundary wall of an environment to be simulated by the user based on the material stored in the storage means, and a user It recognizes the position of the user in the environment created as the target of the simulated experience in the stereoscopic means based on the input operation to the position input operation means under the action of the stereoscopic environment generation means. Further, when the position of the user based on the boundary wall recognized by the boundary wall recognition means is outside the environment that is the target of the simulated experience due to an erroneous operation, etc., this is detected, The user recognition means outside the boundary wall, which finds the correlation between the current position of the user (outside the environment) and the position in the environment where the user had just had a simulated experience, and the position of the user outside the boundary wall In this case, the user recognizing means outside the boundary wall receives a notification of the mutual relationship between the current user position and the position within the boundary where the user had a pseudo-experience immediately before, and refers to the material stored in the storing means to see the three-dimensional shape. The interrelationship of both positions in the visual means It is characterized by having a user environment in a feedback enhancing means for generating information about the order of the user.

According to the twenty-third aspect of the present invention, the user position input operation means includes an operation that causes a magnetic change, an operation that causes acceleration, a push button operation, and a switch operation so that the input operation can be performed only by the movement of one hand of the user. It is characterized in that it has a detection unit that detects at least one and an operation content conversion unit that converts the detection result of the detection unit into the content of the input operation.

[0038] In the twenty-fourth aspect of the present invention, the return-in-promotion means within the user's environmental condition is a position in the environment that the user has experienced from the position outside the environmental wall where the current user is, immediately before the user leaves the environmental wall. It is characterized by having an in-environmental landscape perspective display part that displays a landscape in which the boundary wall existing between both positions (including the visual environment of the inner surface) is transparent. .

In a twenty-fifth aspect of the present invention, in a simulated experience device that simulates a different environment in which the user will exist in accordance with the user's operation, the stereoscopic vision means worn by both eyes of the user and the A storage means for storing the material required to generate the environment to be simulated to be input prior to the simulated experience, and an environment is generated in the stereoscopic means based on the material stored in the storage means. The three-dimensional environment generating means, the physical material storage means for storing the material necessary for determining the physical conditions in the environment stored by the storage means, and the material stored by the physical material storage means. A physical condition distribution calculation storage means for calculating and storing the distribution of physical conditions in the environment based on the virtual condition, and at least one virtual condition in the environment generated in the stereoscopic means under the instruction of the user. Set a flat plane An environment based on the virtual plane setting operation means and the distribution of physical conditions in the environment calculated by the physical condition distribution calculation storage means on the virtual plane set by the virtual plane setting operation means It is characterized in that it has a contour map creating means for drawing a contour map of the physical conditions inside and displaying this together with the stereoscopic environment in the stereoscopic means.

In the twenty-sixth aspect of the invention, at least one of the position and direction (including inclination) of the virtual plane set by the virtual plane setting operation means can be changed only by the movement of one hand of the user. It is characterized in that it has a virtual plane moving means for causing it. In the invention of claim 27, the virtual plane setting means has a plurality of virtual plane setting parts capable of setting a plurality of virtual planes, and the contour map creating means sets under the action of the plurality of virtual plane setting parts. When drawing and displaying a contour map on each of a plurality of virtual planes that have been displayed, the contour map color-coded display unit that divides each contour map by three-dimensionally by changing the color for each virtual plane is displayed. It is characterized by having.

In the twenty-eighth aspect of the present invention, the physical material storage means has an illuminance condition storage part for storing the material for determining the condition regarding the illuminance, and the physical condition distribution calculation storage means is provided in the environment. An illuminance distribution calculation storage unit for calculating and storing the illuminance distribution is provided, and the contour map creating means is provided with an illuminance contour map creating unit for creating an illuminance contour map.

In the twenty-ninth aspect of the present invention, the physical material storage means has a temperature condition input section for storing the material necessary for determining the conditions relating to temperature, and the physical condition distribution calculation storage means is It is characterized in that it has a temperature distribution calculation storage section for calculating and storing the temperature distribution, and the contour map creating means has a temperature contour map creating section for creating a temperature contour map.

According to the thirtieth aspect of the present invention, the physical material storage means stores the material necessary for determining a condition related to at least one of external noise, sound having a predetermined property such as stereo, other equipment or sound from the sound source. The physical condition distribution calculation storage means has a sound condition storage unit for inputting and storing, and the physical condition distribution calculation storage unit calculates and stores a volume distribution of at least one sound of a sound having a predetermined property or a sound from a sound source Has a section,
The contour map creating means is characterized by including a volume contour map creating unit for creating a volume contour map.

According to the thirty-first aspect of the invention, in the simulated experience device for making the user experience a different environment in which the user exists in accordance with the operation of the user, the stereoscopic vision means to be worn on both eyes of the user and the A storage means for storing the material required to generate the environment to be simulated to be input prior to the simulated experience, and a user illuminating the room to evaluate the light environment condition in the environment stored by the storage means. Of each primary color, the transmittance of each primary color of the glass surface, and the reflectance of the mirror surface of at least one of the selectable numerical data for inputting and storing the selectable numerical data, and the selectable light. The selection operation means that allows the user to select, from the numerical materials stored in the material storage means, the one used for the evaluation of the optical environment conditions, the material stored in the storage means, and the selectable light condition storage means are stored. A three-dimensional environment generating means for generating a light environment condition to be generated in the environment on the basis of the numerical material selected by the selecting operation means among the selectable numerical materials, and displaying it in the stereoscopic means. It is characterized by doing.

According to a thirty-second aspect of the invention, the soft robot generating means for generating the soft robot in the environment generated in the stereoscopic vision means, and the environment of the soft robot generated by the action of the soft robot generating means. The environment determined by the three-dimensional environment generation means when displaying the soft robot location position indicating means for allowing the user to specify and change the location position in the inside and the soft robot at the position designated and operated by the soft robot location position indicating means. It is characterized by having a soft robot display control means for light environment condition evaluation that reflects the light environment conditions therein.

According to a thirty-third aspect of the present invention, the soft robot location position instructing and operating means is an operation for causing a magnetic change due to a one-handed motion of the user, an operation for causing an acceleration,
It is characterized in that it has a detection unit that detects at least one of push button operation and switch operation, and an instruction conversion unit that converts the detection result of the detection unit into the content of the instruction. Claim 3
In the invention of 4, the soft robot color designation operation means for storing and storing the color of at least a part of the soft robot under white light (sunlight) on the user.
When the soft robot display control means for light environment evaluation displays at least a part of the soft robot specified by the soft robot color specification operation means, the color to be displayed by reflecting the light environment conditions in the environment at the position where it is located. It is characterized by having designated software robot display control means.

According to the thirty-fifth aspect of the invention, in the simulated experience device that allows a plurality of users to simultaneously and independently experience different environments in which the users will exist in accordance with the operation, each user uses both eyes. Equipped with a stereoscopic viewing means, a storage means for storing the materials necessary to generate the environment to be visually simulated to be input prior to the simulated experience, and a simulated experience for each user. A location position indicating means for each user that allows the user to specify and change his / her location within the environmental conditions, and an environment stored in the storage means in the stereoscopic means equipped to each user. Each user's environment generation means for generating an environment defined by the material and the position input by the location position designating means, and each user based on the input from the location position designating means for each user A user position recognition means for recognizing a location position during similar experience, and the user at the location position of another user based on the recognition result of the user position recognition means in the environment generated in the stereoscopic viewing means for each user. The virtual experience device is characterized by having a soft robot generating means for generating and displaying a soft robot corresponding to the other user.

In the thirty-sixth aspect of the present invention, the position input means for each user detects at least one of an operation that causes a magnetic change due to the movement of one hand, an operation that causes an acceleration, a push button operation, and a switch operation. And a conversion unit that converts the detection result of the detection unit into the content of the input operation.

[0049]

With the above structure, in the invention of claim 1,
In a simulated experience device that allows a user to visually experience a different environment in which a user exists in accordance with a user's operation, the user wears stereoscopic means on both eyes with a holder, a belt, or the like. The storage means stores the material necessary for generating a plurality of environments to be visually simulated as input prior to the simulated experience. The in-field-of-view menu generating means generates a menu in the visual field of the stereoscopic device so that the user can select the one he / she wants to have a simulated experience from a plurality of environments stored in the storage means. The menu selection means allows the user to select a menu intended by the user from the menus generated in the field of view by the exercise of the user's one hand. The three-dimensional environment generating means generates the environment selected by the menu selecting means in the three-dimensional viewing means based on the material stored in the memory.

In the second aspect of the invention, the beam light generator of the menu selection means generates a beam light whose direction can be changed only by one-handed movement within the stereoscopic field of view. Similarly, the menu selection designation beam light generation unit allows the user to select and designate a menu item designated by the beam light from the menu of each environment in which the menu item is designated by a user's switch operation.

According to the third aspect of the present invention, the data relating to the user operating in the environment in which the user operation input operation means is virtually present in the environment generated by the stereoscopic means is provided. Allow input. The stereoscopic environment user action reflection means is currently generated in the stereoscopic vision means based on the data input from the user action input operation means regarding the movement in the user's environment and the material stored in the storage means. The environment is modified as necessary according to the user's action such as changing the field of view.

In the invention of claim 4, the detection unit in the user operation input operation means is at least one of an operation that causes a magnetic change due to the movement of one hand of the user, an operation that causes acceleration, a push button operation, and a switch operation. To detect. Similarly, the input operation conversion unit converts the detection result of the detection unit into the content of the input operation according to a predetermined program procedure. According to the invention of claim 5, the first conversion unit in the input operation conversion unit is a user's walking or swinging movement, in which the detection result of the detection unit exists within the environmental condition generated in the stereoscopic means. Convert to at least one input operation. In the three-dimensional environment user movement reflection means, the walking and head swing correction unit is the first
Upon receiving the conversion result of the conversion unit, the change of the visual field due to at least one of the walking and the head swing of the user is corrected as a necessary correction.

In the sixth aspect of the present invention, the second conversion section in the input operation conversion means includes a light source, a partition surface, a reflection surface existing in the environment in which the detection result of the detection section is generated in the stereoscopic viewing means, It is converted into an input for a transparent surface, a light environment condition for at least one of the devices, or an operation for changing at least one of the scenes in the visual field. The light operation input correction unit in the three-dimensional environment user action reflection unit receives the conversion result of the second conversion unit and changes the light environment condition of the user. , Display of equipment, at least one of the partitions is corrected.

According to the invention of claim 7, the third conversion section in the input operation conversion means has a sound environment, a thermal environment and an air flow existing in the environment in which the detection result of the detection section is generated in the stereoscopic means. Start and stop of devices in the field of view that affect at least one of the environment
It is converted into an input about an operation about at least one of the change of the existence state of the partition surface. The sound, temperature, and airflow input correction unit in the three-dimensional environment user action reflection unit receives the conversion result of the third conversion unit, and receives the illuminance, color, and
Arrangement of equipment, display of equipment, start / stop of equipment, and correction of at least one of the existence states of partition surfaces.

In the eighth aspect of the present invention, the voice input section in the user action input means can accept the user's voice input such as "stop" or "move". Similarly, the voice input conversion unit converts the input received by the voice input unit into the content of the operation instruction of the user. In the invention of claim 9,
In a simulated experience device that enables a simulated experience of an environment in which a person is located according to a user's operation, stereoscopic means is attached to both eyes of the user with belts or the like. The storage means stores, in advance, the material necessary for generating an environment as a target to be visually simulated by inputting it with a keyboard or the like prior to the simulated experience. The stereoscopic environment generating means generates an environment for a pseudo experience in the stereoscopic viewing means based on the material stored in the storage means. The soft robot generating means generates a soft robot in the environment generated in the stereoscopic viewing means under the action of the stereoscopic environment generating means. The soft robot location position instructing means allows the user to designate and change the location of the soft robot in the environment generated by the soft robot generating means. The physical material storage means inputs and stores the material necessary for defining the physical condition in the environment to be stored in the storage means. The physical condition calculation storage means uses at least a part of the material necessary for defining the physical condition stored in the physical material storage means, and uses the soft robot location position indicating means in the environment. The physical environmental conditions at the position designated by are calculated by a predetermined procedure and then stored. The soft robot display rule storage means stores a rule that defines the relationship between the value of the physical condition of the environment at the location of the soft robot and the display mode of the soft robot, which is input prior to the generation of the soft robot. The soft robot display mode determination means determines the display mode of the soft robot based on the calculation result stored in the physical condition calculation storage means and the rule input by the soft robot display rule storage means. When the soft robot display mode control means causes the soft robot generated by the soft robot generation means to be generated and displayed in the environment generated in the stereoscopic means, the soft robot display mode control means causes the soft robot display mode determination means to display the soft robot.

According to the tenth aspect of the invention, among the materials necessary for the physical material change operation means to determine the physical conditions stored in the physical material storage means, the environment at the location of the soft robot is set. Change at least part of what is used to calculate the physical conditions of to other materials or at least one of the newly entered materials (including,
Output change). When the physical material change operation execution means changes the material by the physical material change operation means, the physical condition calculation storage means, the soft robot display mode determination means and the soft robot display mode control means are changed. Corrective actions such as necessary recalculation, re-memorization, and redisplay are performed.

In the eleventh aspect of the present invention, the detecting section in the soft robot location position indicating means is at least one of an operation that causes a magnetic change due to the movement of one hand of the user, an operation that causes acceleration, a push button operation, and a switch operation. To detect. Similarly, the conversion unit converts the detection result of the detection unit into the content of the instruction. According to the twelfth aspect of the invention, the voice input unit in the soft robot location-instructing means can accept the voice input of the user. Similarly, the voice instruction conversion unit converts the input accepted by the voice input unit into the content of the instruction.

In the thirteenth aspect of the present invention, the air flow material storage unit in the physical material storage means receives and stores the material that defines the conditions related to the air flow. A wind direction and wind speed distribution calculation storage unit in the physical condition calculation storage unit calculates and stores the wind direction and wind speed distribution in the environment. A string rule input unit in the soft robot display rule storage means inputs the relationship between the fluttering direction and the fluttering condition according to the wind direction and the wind speed of the string attached to at least one place of the soft robot.
The string display mode determining unit in the soft robot display mode determining means displays the fluttering direction and the fluttering condition of the string attached to at least one position of the soft robot as a wind direction and a wind speed of the part.

In the fourteenth aspect of the present invention, the illuminance material storage unit in the physical material storage means receives and stores a material that defines a condition related to the illuminance in the environment. The illuminance calculation storage unit in the physical condition calculation storage unit calculates and stores the illuminance in the environment. The face display rule storage unit in the soft robot display rule storage means inputs a rule for displaying the face of the soft robot according to the illuminance on the face part of the soft robot and at least one content of the shadow attached to the face. I remembered it. The face display mode determination unit in the soft robot display mode determination means determines at least one of displaying the face of the soft robot according to the illuminance of the portion and shading the face according to the illuminance of the portion. To do.

According to the fifteenth aspect of the present invention, the acoustic condition storage unit in the physical material storage means stores the material concerning the condition related to the sound in the environment after being input. The sound intensity calculation storage unit in the physical condition calculation storage unit calculates and stores the intensity of the sound from the determined sound source. The volume display surface portion display rule storage unit in the soft robot display rule storage means is related to the contents of the volume display surface portion attached to the soft robot according to the intensity of sound from a predetermined sound source in the ear portion of the soft robot. The rules of are input and stored. The volume display surface section determination unit in the soft robot display mode determination means determines to change and display the volume display surface section according to the volume of the ear portion of the soft robot.

In the sixteenth aspect of the present invention, the temperature condition storage unit in the physical material storage means receives and stores the material for defining the condition related to the temperature in the environment. The temperature calculation storage unit in the physical condition calculation storage means calculates and stores the temperature in the environment or the sensible temperature. The color display rule storage unit in the soft robot display rule storage unit is attached to at least one predetermined portion of the soft robot according to the temperature or the sensible temperature of the portion and the temperature or the sensible temperature. The rule about the contents of color is input and stored. The color display determination unit in the soft robot display mode determination means determines to display at least one determined portion of the soft robot with a color according to the temperature of the portion.

According to the seventeenth aspect of the present invention, in the simulated experience device for simulated experience of another environment where the user is located according to the user's operation, the stereoscopic means is attached to both eyes of the user with a band or the like. . The storage means stores the material necessary for generating the environment that is the target of the simulated experience, which is input and stored prior to the simulated experience. The stereoscopic environment generation means generates an environment in the stereoscopic vision means based on the material stored in the storage means. The symbol generation means
A symbol for visually displaying the value of a physical condition in the environment is generated in the environment generated in the stereoscopic means under the action of the stereoscopic environment generating means. The symbol location position designating means allows the user to designate and change the location of the symbol generated by the symbol generating means in the environment. The physical material storage means inputs and stores the material necessary for defining the physical condition in the environment to be stored in the storage means. The physical condition calculation storage means uses at least a part of the material necessary for determining the physical condition stored in the physical material storage means, and determines the symbol location in the environment. The physical environmental conditions at the position designated by the designating means are calculated and stored. The symbol display rule storage means stores a rule that defines the relationship between the value of the physical condition of the environment at the location of the symbol and the display mode of the symbol, which is input prior to the generation of the symbol. The symbol display mode determination means determines the symbol display mode based on the calculation result stored in the physical condition calculation storage means and the rule stored in the symbol display rule storage means. When the symbol display mode control means synthesizes the symbol generated by the symbol generating means with the environment generated in the stereoscopic vision means and generates and displays the symbol, the symbol display mode determining means causes the symbol display mode determining means to display the symbol.

According to the eighteenth aspect of the present invention, the physical material change operation means is a symbol among the materials necessary for determining the physical condition already stored in the physical material storage means and stored. At least part of what is used to calculate the physical conditions of the environment at the location of the can be changed to at least one other material or newly entered material. If the physical material change operation implementation means changes the material by the physical material change operation means, it responds to the physical condition calculation storage means, the symbol display mode determination means and the symbol display mode control means according to the change. To make the necessary corrections.

According to the nineteenth aspect of the present invention, the detection unit in the symbol location position indicating means can perform its function only by the movement of one hand of the user, so that an operation that causes a magnetic change and an operation that causes acceleration, Detects at least one of push button operation and switch operation. Similarly, the conversion unit converts the detection result of the detection unit into the content of the instruction. In the twentieth aspect of the invention, the voice input unit in the symbol location instructing means receives the voice input of the user. Similarly, the voice instruction conversion unit converts the voice received by the voice input unit into the content of the instruction.

According to the twenty-first aspect of the invention, the numerical value display rule storage unit in the symbol display rule storage means stores the inputted rule for displaying the physical value itself as a numerical value. According to the twenty-second aspect of the present invention, in the simulated experience device that allows the user to visually experience the environmental conditions in which the person is located in accordance with the user's operation, the stereoscopic means is attached to both eyes of the user with a stopper or the like. The storage means stores the material necessary for generating the environment in which the user will experience the simulated experience, which is input and stored prior to the simulated experience. The user position input operation means makes it possible to specify and change the position of the user in the environment. The three-dimensional environment generating means generates an environment for a simulated experience in the three-dimensional viewing means based on the material stored in the storage means according to the user's location input by the user position input operation means. The boundary wall recognition means recognizes the boundary wall (in the case of a house, the position of the wall) of the environment that the user is to make a simulated experience based on the material input to the storage means. In the environment where the user recognition means located outside the boundary wall is generated as a simulated experience target under the action of the stereoscopic environment generation means in the stereoscopic means based on the input operation to the user position input operation means. The location of the user is recognized, and the location of the user based on the boundary wall recognized by the boundary wall recognition means is outside the environment where the user experiences a simulated experience due to an erroneous operation. If this happens, it will detect this and
The relationship between the current position of the user and the position in the environment where the user had a simulated experience immediately before is sought. When the user's location is outside the boundary wall, the in-user environment return facilitating means recognizes the current position of the user from the user recognizing means outside the boundary wall and the boundary within the boundary that the user was experiencing immediately before. In response to the notification of the mutual relationship with the position, the information about the mutual relationship between the two positions is visually generated in the stereoscopic means in consideration of the stored content of the storage means. Promote return.

According to the twenty-third aspect of the present invention, the detection unit in the user position input operation means can perform an input operation only by the movement of one hand of the user, so that an operation that causes a magnetic change due to the movement of the one hand of the user, Detects at least one of acceleration, push button operation, and switch operation. Similarly, the input operation conversion unit converts the detection result of the detection unit into the content of the input operation.

In the twenty-fourth aspect of the present invention, the in-environmental landscape perspective display section in the user environmental condition return promotion means is
From the current location outside the environment wall where the user is located, we saw the location in the environment that was simulated just before the user left the environment wall as a transparent boundary wall between both locations. Display the landscape. In the invention of claim 25,
In a simulated experience device that enables a simulated experience of an environment in which a person is located according to a user's operation, stereoscopic vision means is attached to both eyes of the user. The storage means stores the material necessary for generating the environment that is the target of the simulated experience, which is input and stored prior to the simulated experience. 3D environment generation means
An environment is created in the stereoscopic means based on the material stored in the storage means. The physical material storage means stores the material necessary for determining the physical condition in the environment stored by the storage means after the input. The physical condition distribution calculation storage means calculates and stores the distribution of the physical condition in the environment based on the material about the physical environment condition stored in the physical material storage means. The virtual plane setting operation means sets at least one virtual plane in the environment generated in the stereoscopic means under the instruction of the user. Based on the distribution of the physical conditions in the environment that the contour map creating means calculates and stores in the physical condition distribution calculation storage means on the virtual plane set by the virtual plane setting operation means. , A contour map of physical conditions in the environment is drawn and displayed in the stereoscopic means together with the stereoscopic environment.

In the twenty-sixth aspect of the present invention, the virtual plane moving means uses at least one of the position and direction of the virtual plane set by the virtual plane setting operation means by the movement of one hand of the user. It can be changed. In the twenty-seventh aspect of the invention, the plurality of virtual plane portions in the virtual plane setting means set a plurality of virtual planes. When the contour map color-coded display unit in the contour map creating means draws and displays the contour map on each virtual plane, the contour map is divided into three-dimensional shapes by changing the color for each virtual plane. Display it.

In the twenty-eighth aspect of the present invention, the illuminance condition storage section in the physical material storage means receives and stores the material related to the illuminance. The illuminance distribution calculation storage unit in the physical condition distribution calculation storage unit calculates and stores the distribution of illuminance in the environment. The illuminance contour line creation unit in the contour map creation means
Create a contour map of illuminance on a virtual plane. Claim 2
In the ninth aspect of the invention, the temperature condition storage unit in the physical material storage means stores the material related to the temperature after being input.
A temperature distribution calculation storage unit in the physical condition distribution calculation storage means calculates and stores the temperature distribution. A temperature contour line creating unit in the contour line drawing means draws and displays a temperature contour map on a virtual plane.

In the thirtieth aspect of the invention, the sound condition storage unit in the physical material storage means stores the sound of a predetermined characteristic or the sound from the sound source related to at least one of the input sounds. The sound condition storage unit in the physical condition distribution calculation storage means calculates and stores at least one volume distribution of sounds of a predetermined characteristic or sounds from a sound source. The volume contour map creation unit in the contour map creation means displays the volume contour map on a virtual plane.

According to the thirty-first aspect of the invention, in the simulated experience device that enables the simulated experience of the environment where the person is located according to the user's operation, the stereoscopic means is attached to both eyes of the user. The storage means stores the material necessary for generating the environment that is the target of the simulated experience, which is input and stored prior to the simulated experience. A selectable optical material storage means for evaluating the light environmental conditions in the environment stored by the storage means,
The user inputs and stores selectable numerical data for at least one of the intensity of each primary color of the room lighting, the transmittance of each primary color of the glass surface, and the reflectance of the mirror surface. The selection operation means enables the user to select, from the numerical data input by the selectable optical data storage means, the one used for the evaluation of the optical environment condition. Optical environment to be generated in the environment by the three-dimensional environment generation means based on the numerical material selected by the selection operation means from the material stored in the storage means and the selectable numerical material stored in the selectable optical material storage means The condition is generated and displayed in the stereoscopic means.

In the thirty-second aspect of the invention, the soft robot generating means causes the soft robot to generate in the environment generated in the stereoscopic means. The soft robot location position instructing means allows the user to specify and change the location of the soft robot generated in the environment under the action of the soft robot generating means. The light environment condition evaluation soft robot display control means reflects the light environment condition in the environment obtained by the three-dimensional environment generation means on the display of the soft robot at the position designated and operated by the soft robot location position designating means.

In a thirty-third aspect of the present invention, the detecting unit in the soft robot location-position instructing and operating means is at least one of operations for causing a magnetic change, acceleration, push button operation, and switch operation by a user's one-handed movement. To detect. In the invention of claim 34, the soft robot color designation operation means allows the user to designate and change the color of at least a part of the soft robot under white light and stores the color. When the soft robot display control means in the soft robot display control means for light environment evaluation displays at least part of the soft robot designated by the soft robot color designation operation means, The light environment conditions are reflected and displayed.

According to a thirty-fifth aspect of the present invention, in a simulated experience device that allows a plurality of users to simultaneously and independently experience the environment in which a person is located in accordance with the operation, each user has stereoscopic vision means for both eyes. Equip. The storage means stores the material necessary for generating the environment that is the target of the simulated experience, which is input and stored prior to the simulated experience. The location indicating means for each user allows each user to specify and change the location of the user in the environmental condition during the simulated experience, in principle, independently of other users. Each user's environment generation means generates, in the stereoscopic means equipped to each user, a material for generating the environment stored in the storage means and an environment determined by the position input by the location position instructing means. . The user position recognizing unit recognizes the position of each user during the simulated experience based on the input from the position locating unit for each user.
Based on the recognition result of the user position recognizing means in the environment generated in the stereoscopic means for each user, the soft robot generating means corresponding to the other user corresponds to the user's location. Is generated and displayed.

In the thirty-sixth aspect of the present invention, the detection unit in the position input means of each user detects at least one of the operation that causes a magnetic change due to the movement of one hand, the operation that causes acceleration, the push button operation, and the switch operation. To do. Similarly, the conversion unit converts the detection result of the detection unit into the content of the dormitory operation.

[0076]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 3 is a schematic configuration diagram of the first embodiment of the simulated experience device of the present invention. In this figure, the data globe 12 is 3D.
(3 dimentions) Three-dimensional input device 30 called a mouse
It is basically the same as that of FIG. 1 except that it is changed. In the figure, a signal input from the three-dimensional input device 30 while the simulated user visually recognizes the goggle type stereoscopic display device 11 is output to the goggle type stereoscopic display device 11 again via the arithmetic control unit 13.

FIG. 4 is an enlarged view of the appearance of the three-dimensional input device 30 in order to explain the operation and operation of the three-dimensional input device 30. This device has a shape similar to the grip of a pistol (handgun), and the trigger switch 31
However, a right button 32, a center button 33, and a left button 34 are provided on the upper part. These switches, buttons, etc. are used properly according to the purpose of operation, but the contents will be described later. Further, a magnetic detecting end 35 and an accelerometer 36 for each of the three-dimensional directions of up and down, left and right, and front and back are built in,
By comparing the differences in the strengths of the magnetic fields in the three directions detected by the magnetic detection end 35 and detecting the direction of gravity and the direction of acceleration by the accelerometer 36, etc. It is possible to detect a change in the rotation angle and movement of the input device 30. Further, the three-dimensional input device 30 itself is properly used by switching a switch or the like according to the contents to be simulated. Then, this will be described in a later embodiment.

FIG. 5 shows the internal structure of the arithmetic and control unit 13. A signal input from the three-dimensional input device 30 by the user using the goggles type stereoscopic display device 11 enters the input control unit 130. Then, the analog signal regarding the rotation angle and the like is converted into a digital signal. Of course,
Signals from switches and buttons are input as they are. Further, it is sent to each arithmetic unit and processed according to its contents. That is, the information is an operation for selecting a menu about buildings, rooms, environmental elements and start / stop of devices drawn on the goggle type stereoscopic display device 11, and a semi-infinite length three-dimensional beam used for that operation. If it is related to the operation of, the data is sent to the three-dimensional menu / three-dimensional beam coordinate calculation unit 131, the three-dimensional menu / three-dimensional beam display data calculation unit 132. Further, in the case of walking through the room, it is sent to the three-dimensional space movement velocity vector calculation unit 133 and the three-dimensional space display data calculation unit 134. Further goggles type stereoscopic display device 1
In the case of operating after drawing and forming the soft robot in the visual field of 1, the soft robot moving speed vector calculation unit 1
35, and is sent to the soft robot display data calculation unit 136.

In addition to the above, various operations are sent to a processing section and an arithmetic section therefor, which will be described later as needed each time. Then, all of these signals are finally sent to the display control unit 137. Then, it is converted into an electric signal necessary for generating and displaying a predetermined image on the goggle type stereoscopic display device 11 according to each operation content, and the goggle type stereoscopic display device 1 again.
Sent to 1.

In addition to the above, the input part and the storage part of the geometrical shape and arrangement of the house, the indoor equipment, the lighting equipment, the physical properties such as the reflectance of each part, which are objects of the simulated experience and the selection thereof, It has a storage unit of a program for performing mesh division and calculation necessary for analysis, an input operation unit by a user, and the like. Then, these will be sequentially described as needed in later embodiments. In addition, certain environmental conditions are stored after performing precise or rough calculations and analyzes in advance to enable swift response, and also have a storage unit necessary for this purpose. The embodiments will be sequentially described as needed.

Specific operations and effects will be described below with reference to the drawings. First, menu selection will be described with reference to FIG. This figure shows a three-dimensional menu drawn in the space created by the goggle type stereoscopic display device 11. In the figure, candidate homes are displayed on the screen in order to select a target home when the indoor environment is simulated. The user uses the three-dimensional input device 30 to select a house that he / she wants to experience as a simulated experience from the six houses displayed as icons. On the screen, three-dimensional beams 61 and 62 having semi-infinite length are drawn on the screen separately from the house to be selected for use in this selection. The directions of the three-dimensional beams 61 and 62 change according to the movement, rotation, and tilting operation of the three-dimensional input device 30, and by irradiating this on any of the houses visible on the screen, the pseudo beam is simulated. It is possible to select the house that you want to experience.

Specifically, prior to the walk-through in the room, after pressing the center button 33 of the three-dimensional beam device 30 to display a three-dimensional menu, a simulated experience of the drawn three-dimensional beam 61 is desired. The three-dimensional icon of the house to be illuminated is irradiated, and in this state, the trigger switch 31 issues a confirmation instruction. As a result, the selected housing environment is virtually displayed. This eliminates the need for the user to move by himself or operate the data globe 12.

Next, the calculation contents of the three-dimensional menu / three-dimensional beam coordinate calculation unit 131 and the three-dimensional menu / three-dimensional beam display data calculation unit 132 at this time will be described. In the present embodiment, the three-dimensional beams 61 and 62 are displayed as semi-infinitely long bars starting from the three-dimensional input device 30. Further, when displaying or the like, the center coordinates of the cross section are determined by three-dimensional polar coordinates. Therefore, the intersection with the icon displayed in the three-dimensional virtual space represented by the three-dimensional orthogonal coordinates is adjusted to the angle with respect to the magnetic field of the three-dimensional input device 30 after the origins of both coordinates are aligned and the coordinate axes are adjusted. Can be easily obtained from a simple calculation. Then, when the confirmation instruction is given, the icon corresponding to the angle of the three-dimensional input device 30 with respect to the magnetic field in that state, in the case of FIG. 6, the house is selected.

Therefore, it is possible to select a menu with the same feeling as if the user points a specific product lined up in a store with a stick (tact) or a finger. In the present embodiment, it is also possible for the three-dimensional beam to start from the center of both eyes of the user by the selection operation of the three-dimensional input device 30 that the user has separately. As a result, it is possible to make a menu selection in the same manner as when a user or the like swings his or her head to the left or right while selecting (instructing) a product or the like that is noticeable for purchase.

These operations are performed only by the rotation operation of the wrist or head of the user having the three-dimensional input device 30 and the operation of the push button or the like by the finger. For this reason, it is not only necessary to learn complicated operations, but also it is close to daily operations. As a result, it is easy to learn. Further, it becomes unnecessary to adjust the center of gravity of the body when both eyes are covered with the goggle type stereoscopic display device 11.

It is needless to say that the selection by the three-dimensional beam can be used not only for the building but also for the selection of the model of the air conditioning equipment in the room and the selection of other environmental elements to be evaluated such as the start and stop of the air conditioning equipment. . Also, depending on the user's wishes, it can be used to move or change equipment that is noticeable while walking through the room, select start / stop, open / close windows, or select or change some environmental conditions themselves. Of course. (Second Embodiment) Another embodiment of the present invention will be described with reference to the drawings.

The present embodiment relates to a pseudo experience method or a pseudo experience method called a walkthrough under the residential environment selected in the first embodiment. Therefore, the basic configuration and the like are the same as those of the first embodiment. Therefore, description of common components will be omitted, and only the configuration and operation unique to this embodiment will be described. Here, the walk-through means that the user looks around each part of the virtually formed room, and also starts and stops the installed equipment, so that the same room and lighting as the actual living , To experience the environment such as sound. The processing for that will be described below.

FIG. 7 is a diagram showing three-dimensional visual information processing in this embodiment. In the figure, 13 is an arithmetic and control unit, and 11 is a goggle type stereoscopic display unit. 7
As shown in FIG. 1, the housing environment is input in advance in the main storage unit for displaying the virtual environment in three-dimensional coordinates. Then, as shown by 72, the human eye is input in the same direction and three-dimensional coordinates of the scale in the sub-storage unit with the left eye, which is the dominant eye, as a reference. The position, line-of-sight direction, etc. are operated by the three-dimensional input device 30. That is, simply by inclining the three-dimensional beam device 30 called this three-dimensional mouse in each direction as shown in FIG. 4, the rotation angle information is transferred to the three-dimensional space moving speed via the input control unit 130 in the arithmetic and control unit 13. It is input to the vector calculation unit 133, and the moving speed and direction of the walkthrough are calculated according to the magnitude and direction of the rotation angle, and the position of both eyes from the starting point is calculated.

Next, the position adjustment 73 is performed by matching the origins of the coordinates of both the storage units and the coordinate axis lines to generate a housing environment viewed from the left eye. The distance calculation 74 is to calculate the distance of each part of the room from the left eye. On this,
A solid angle calculation 75 of each device in the house is performed. Further, the parallax calculation 76 of each part in the room is performed based on the result of the distance calculation between the left and right eyes and the device. Field of view adjustment 77
Is performed by generating a visual field viewed from the right eye based on the results of solid angle calculation and parallax calculation. On this, the solid angle calculation result is output as it is for the left visual field 78, and the visual field adjustment result is output for the right visual field 79.
Is sent to the RCRT 112, and a three-dimensional display is made by the movement of the person.

Each of these processes is mainly performed by the three-dimensional space display data operation unit 134 and the three-dimensional space movement velocity vector operation unit 133. At this time, the illuminance and the like of each part of the room, whether or not there is a user, unless there are many people in the first place,
Almost irrelevant to position coordinates. Therefore, in this embodiment, it is calculated in advance and used for display according to the visual field of the user.

Next, a change in the field of view when the user walks through the virtual house with the above configuration will be described. FIG. 8 shows this. A of the figure is the appearance of the house selected as the target of the simulated experience by the menu drawn on the goggle type stereoscopic display device 11. You can see the door in the foreground. In FIG. 8B, a state in which the door is approached by tilting the three-dimensional input device 30 forward is displayed. In FIG. 8C, the state of entering the room through the door is further displayed, and the window on the opposite wall is visible. After that, in FIG. 8D, the three-dimensional input device 30 is rotated to the right by twisting the wrist to the right, so that the door entered in the room is easily turned to the right hand and the window to the left hand. It is displayed.

Of course, by moving the three-dimensional input device 30 up and down, it is possible to display the ceiling and the vicinity of the floor in a close-up manner. Further, in the present embodiment, instead of the input operation by the rotation angle to the three-dimensional input device 30 which is held in hand, the input operation can be performed from the magnetic detection end 15 attached to the head. In order to distinguish from the selection mode of the above-mentioned three-dimensional menu, the three-dimensional input device 30 is operated while pressing the trigger switch 31 thereof.

For these reasons, it can be operated with a natural feeling just like a joystick of a TV game or a control stick of a helicopter. In addition to the above, in the present embodiment, the moving speed of the person is variable according to the absolute value and the size of the rotation angle due to the inclination or rotation of the three-dimensional input device 30.
Since the principle of these is simple, the description is omitted.

Next, through a microphone provided integrally with the goggle type stereoscopic display device and the three-dimensional input device,
The soft robot may be moved by voice.
In this case, the word used in the instruction is “advance”,
Simple and limited types such as "stop" and "to the right" make it easy for the user to memorize and facilitate voice recognition. Therefore, the operability is further improved. However, since the voice recognition technology itself is not the gist of the present invention, its description is omitted. (Third Embodiment) Another embodiment of the present invention will be described with reference to the drawings. Like the second embodiment, this embodiment is based on the configuration of the first embodiment. Therefore, the description of the parts common to the first embodiment will be omitted.

In sales engineering targeted at general users, particularly customers such as house residents and home buyers, it is considered that the confirmation of the indoor atmosphere by lighting and the view of the room by walk-through are the most important. However, when an architect or equipment designer uses this simulated experience device, it becomes necessary to visualize and display even more detailed physical phenomena. Furthermore, in commercial buildings such as coffee shops, movie theaters, and dance halls, how the owners of this coffee shop feel the indoor equipment and lighting equipment installed in the room, etc. Or what kind of effect it has is of great concern. Therefore, as a means for concretely showing a huge amount of three-dimensional data obtained as a result of the numerical simulation, for example, as shown in FIG. 2A, a virtual cross section is drawn and then the temperature distribution is displayed by contour lines. As shown in B of No. 2, a method of visualizing the wind speed by displaying a particle path in which small particles are blown in the room (displaying loci of small particles by variously working) is adopted. Further, as a means for locally obtaining a detailed evaluated value, the three-dimensional input device 30 is regarded as a virtual sensor and actually moved to that position,
There is also a method of calculating and displaying the temperature at that position, or displaying a value calculated in advance as a virtually measured value. However, with these methods, it is not possible to intuitively understand and understand how a person actually feels their temperature, etc., and what value they have in relation to the position of the person. Have difficulty.

In this embodiment, a soft robot 90 as shown in FIG. 9 is used as a solution. The soft robot 90 is a virtual person who is displayed as the alter ego of the user who is the observer or as a third party, and is capable of visually expressing the temperature felt by the person. In the present embodiment, this problem is solved by generating this in an indoor space and allowing a designer or the like to visually observe the state of the environment felt by the virtual person. Specifically, the soft robot 90 walks through the entire room on behalf of the user, and responds to physical values of environmental conditions and changes in the physical conditions according to the position in the room and the start / stop of devices. I try to change the color of each part. This allows not only to display physical values such as the indoor temperature and wind speed of the place where it is located, but also to display the distribution of the sensible temperature, which is a temperature that also considers humidity depending on the wind speed and circumstances, and By displaying the amount of wind, the direction of wind, etc. by changing the shaking condition and facial expression, it is possible to evaluate efficiently, objectively and visually in relation to a person. Furthermore, in this case, the perceived temperature of each part of the robot, not only the temperature but also the wind speed, the humidity,
By displaying the sensible temperature, the air volume, etc. in consideration of the body part as well, it becomes effective as well as the actual one. This is important when considering the arrangement of tables and air conditioning equipment in coffee shops.

The indoor movement of the soft robot 90, which is the basis of this embodiment, will be briefly described below. 9A and 9B show how the soft robot 90 moves indoors. The operation is basically the same as the above-mentioned user's own walk-through, and therefore is performed by the three-dimensional input device 30. Further, the moving direction of the soft robot 90 is determined by the user's selection based on the direction of the line of sight of the user or the soft robot. In addition, the soft robot movement speed vector calculation unit 135 and the soft robot display data calculation unit 136 also perform processing necessary for various displays as the soft robot moves.

The contents will be specifically described below. Figure 1
0 indicates a state of processing of visual information accompanying the walk-through of the soft robot 90 in the present embodiment.
In the figure, 13 is an arithmetic and control unit, and 11 is a goggle type stereoscopic display unit. As shown at 71, the housing environment is formed in advance in the main storage unit for displaying the virtual environment in three-dimensional coordinates. With regard to the visual environment, this stored content is generated as it is as the visual field 751 for the left eye, and after parallax adjustment for the right eye. On the other hand, the position from the base point of the soft robot 90 is formed in the sub storage unit in three-dimensional coordinates with the left eye as the center, as shown at 72. Then, after passing through the display processing 771, the visual signal of the soft robot 90 is used as it is as the visual field 78 for the left eye, and the parallax adjustment processing 76 as the visual field 79 for the right eye.
It is used after 1, 762. After that, the left and right visual signals are sent to the left and right CRTs 111 and 112, respectively, to form a stereoscopic environment.

In the present embodiment, the movement of the soft robot and the movement movement of the user are distinguished by switching the button press of the three-dimensional input device 30 of FIG. 4, but a separate dedicated three-dimensional input device is used. Other means such as replacement with the above may be adopted. Further, if only the visual environment in the room is to be simulated by walking through the soft robot 90, the soft robot 90 may be displayed with only its outline being black and thick.

Next, the structure and operation necessary for displaying the physical conditions of the indoor environment in which the robot is located due to facial expressions, color changes, etc. of the soft robot will be described with reference to the drawings. FIG. 11 shows data input and processing for this purpose.
In the figure, as the environmental data 1101, the size and geometrical shape of the room, the installation position of the air conditioner, the blowing direction, the size and position of the furniture, the position and illuminance of the lighting equipment, the size and position of the window, etc. in the room. Various environmental data is entered.

As the environmental analysis 1102, indoor environmental conditions are calculated based on these environmental data. As the symbol data 1103, data about the contents of the symbol itself such as the soft robot and its various facial expressions and data about how the symbol changes according to the physical environment of the room are input. Specifically, how to change the color and brightness according to the sensible temperature in the room, how to shelve hair or strings in place of hair according to wind speed, and how external noise makes it look Is how to change.

As the symbol instruction 1104, designation of a position where a symbol such as a soft robot exists, a position of a living environment to be displayed, a physical value or the like is input by a keyboard, a mouse or the like. The symbol calculation 1105 is a calculation necessary for displaying the designated environment as a symbol based on the environmental analysis result calculated based on the input environmental data and the data regarding the symbol, for example, the feeling of the soft robot. This is a calculation necessary for displaying the temperature distribution and also for determining and forming a soft robot facial expression according to external noise.

The pre-storing 1106 is to preliminarily calculate various thermal, optical and acoustic conditions of each part of the room based on the inputted living environment data and the like and store them in a separate storage part. This makes it possible to promptly respond to various display requests by the user. Furthermore, in this case, for lighting, air conditioning, etc., for each unit output of each device, for example, the output of the air conditioning device is every 500 W, 1 kW, 1.5 kW, and the outside temperature is 10 ° C., 5 ° C., 0 ° C., The temperature of each part of the room is calculated every -5 ° C and stored in advance. Also,
When the number of soft robots is small, this has little influence on the environmental conditions (100 w / h person), and therefore the movement thereof is not reflected in the environmental conditions.

The symbol calculation display 1107 is formed so that the contents of the corresponding symbol can be visually recognized on the screen according to the result of the symbol calculation. Specifically, C
The sensation volume is displayed by numerically displaying the calculation result of the sound intensity in dB units on the RT screen, or by displaying the facial expression of the soft robot in a comfortable or unpleasant manner. These will be described in detail later.

Next, the display processing of the calculation result using the soft robot will be described with reference to FIG. As shown in the figure, in the present embodiment, the results of the environmental analysis and pre-storing process (1201), the soft robot creating process for creating the soft robot (1202), and the environmental analysis result of the position of the soft robot are taken into consideration based on these both steps. Calculation result for display by soft robot-soft robot synthesis processing (1203) and soft robot display (1204) for displaying the result.

Of these, the environmental analysis pre-storage 12
01 is the environment analysis 1102 and the pre-storage 1106 of FIG.
Similarly, the calculation result—soft robot synthesis processing 1203 corresponds to the symbol calculation 1105, and the soft robot display 1204 also corresponds to the symbol display 1107. In the environment analysis, for example, the following simulation calculation is performed using a general-purpose workstation.

Indoor temperature distribution (steady state and unsteady state). The locus of the flow of warm air and cold air generated from air conditioners.
Calculation of PMV distribution, which is a human comfort index. Evaluate the indoor landscape regarding the light environment, and calculate the illuminance distribution and brightness distribution in the room by lighting equipment.

Calculation of reverberation characteristics for evaluating the degree of sound reverberation in a room regarding sound environment, evaluation of sound insulation characteristics for external noise, and the like. Since these analysis and calculation procedures are not the main purpose of the present invention, detailed description thereof will be omitted. Next, the soft robot creation, calculation result-soft robot synthesis, and soft robot display necessary for displaying various calculation results by the soft robot, which are calculations unique to this embodiment, will be described in detail with reference to FIG.

In this figure, the solid line indicates the flow of calculation processing,
The dotted line shows the flow of data. In addition, step (s
1) to (s4) are processes belonging to soft robot creation, and include steps (s5), (s61), (s62), and (s).
63) and (s64) are processes belonging to the calculation result-soft robot composition, and (s7) is a calculation process belonging to the soft robot display.

In creating a soft robot, first, soft robot object data is input (s1). For the soft robot object data (D2), a soft robot object is created by CAD (s8), CA
D data is created (D1), converted into object data for CAD data pseudo experience (s9), and obtained.

Next, the indoor object data is input (s2). The indoor object data (D3) is created by sharing the mesh coordinate file (D4) used when performing the environmental analysis simulation (s1).
0). Next, regarding the movement of the soft robot, the moving direction of the soft robot 120 is input by the three-dimensional input device 1330 (s3), and then the soft robot is moved based on the input information of the previous period (s4).

Calculation Result-In soft robot synthesis, first, the display contents of the soft robot are selected (s
5). Here, for example, when the contents to be displayed in the color contour diagram such as the temperature distribution related to the thermal environment, the comfort evaluation index PMV distribution, the illuminance distribution related to the light environment, and the brightness distribution are selected, the color distribution of the soft robot is performed. (S
61) In addition, when evaluating the air flow from the air conditioner related to the thermal environment, the soft robot is tufted by pulling the string attached to the head of the soft robot (s2). When evaluating, the face shadow of the soft robot is added (s6
3) Further, when the facial expression of the soft robot is changed according to the acoustic environment, the facial expression of the soft robot is added (s64). These steps (s31)
To perform (s64), the mesh coordinate file D4 is shared with the environmental analysis simulation calculation step and the environmental analysis simulation data D5 is required, as in the indoor object data input processing of step (s2). In the color distribution of the soft robot in s31), the color distribution table D6 is necessary, and after reading the environmental analysis simulation data at the position of the soft robot, the color value preset from the color distribution table D6 in the previous period based on this data is read. Is taken out, and a process of coloring each part of the soft robot is performed.

In the tufting of the soft robot in step (s62), after reading the environmental analysis simulation data at the position of the soft robot, based on the direction and magnitude of the air flow vector at that position,
The process of shelving the string attached to the soft robot is performed. In addition, in the face shadow addition of the soft robot in step (s63), the color distribution table D7 is required, and after reading the environmental analysis simulation data at the position of the soft robot, based on the illuminance and the brightness at that position, A process of shading the face is performed.

Furthermore, in the facial expression addition of the soft robot in step (s64), the facial expression table D8 is necessary, and after reading the environmental analysis simulation data at the position of the soft robot, how to hear the sound at that position is read. Based on this, a preset facial expression is selected from the facial expression table D8 in the previous term and is attached to the face of the soft robot.

Finally, when displaying the soft robot,
Based on each calculation process in the previous term, the result of environmental analysis simulation is displayed by the soft robot using the simulated experience device. FIG. 14 shows a screen displaying the temperature distribution in the room by the soft robot 90. In the figure, a wall-mounted air conditioner 21 is installed on the left side wall of the room, and is in a state of being heated by blowing hot air from an air outlet below the air conditioner 21. Further, there is a window 1421 on the right side wall opposite the air conditioner 21. And the temperature due to these in the living environment,
The value of wind or the like is calculated and stored in advance as described above. Now, under the condition that the output of the air conditioner is 500 W and the outside temperature is 0 ° C., the soft robot 90 is walked through in this room by the three-dimensional input device 30 and is standing on the side of the window 1421 that is close to the air conditioner 21 and away from the center of the room. Suppose you moved it with. In the present embodiment, the temperature distribution and comfort index PMV of the portion located in the room can be known by the colors of the three parts of the soft robot 90, the head, the body, and the lower limbs. Now, when the soft robot 90 is in the center of the room, the body color of the soft robot 90 is displayed in almost the same bright color (white in the figure) based on the environmental data of the room. The result that it is comfortable is displayed. On the other hand, on the window side, the lower limbs 1422 are darker than the head and torso (hatched in the figure)
As a result, the result that the lower limbs are slightly cold is displayed. This is because the warm air blown out from the air conditioner 21 is distributed almost evenly in the center of the room.
It is because the temperature difference between high and low occurred because it could not reach the feet at 21:00. Therefore, the output of the air conditioner 21 is 1 kW.
Then, the temperature distribution is observed again, and if it is still insufficient, the output can be checked again by increasing the output again, and the minimum required output of the air conditioner can be obtained. In addition, it is possible to obtain a better sensible temperature display by reflecting the differences in how to feel the temperature, humidity, and wind depending on the body parts such as the face, the torso wearing clothes, and the legs of a woman wearing a skirt. May be.

Thus, the temperature distribution inside the room can be locally confirmed in detail and intuitively. For this reason, it becomes easy to design equipment and the like necessary for comfortably air conditioning the room. FIG. 15 shows a screen displaying the airflow by the air conditioner. In this figure, the basic conditions are the same as in FIG. 14 described above, and the wall-mounted air conditioner 21 on the left side of the room heats the room by blowing warm air from the air outlet at the bottom thereof.
Further, the window 1421 is the same on the right side wall opposite the air conditioner 21. Now, the three-dimensional input device 30 causes the soft robot 90 to walk through from the position directly below the outlet of the air conditioner 21 to the side of the window 1421. By the way, the soft robot 90 is displayed with a string 1501 resembling hair on its head, and the wind flow of the air conditioner 21 at the position of the soft robot 90 at the position of the soft robot 90 can be determined from the shelving direction and the shelving angle of the string 1501. You can know the direction and strength. In the figure, the cord of the head of the soft robot 90 is very strongly shelved in the lower part of the air conditioner 21 in the direction of the window 1421, and is almost lowered near the window 1421. For this reason, the state of the air flow by the air conditioner in the room can be associated with the soft robot 90 and locally and in detail confirmed. Furthermore, it is also possible to attach a string to each part of the body and observe the wind hitting each part. As a result, it becomes easy to design the room for comfortable air conditioning from both the temperature distribution and the air flow. Of course,
This display can be applied to the case of cooling, and in this case, a fan or the like may be separately provided.

FIG. 16 shows a screen displaying the effect of indoor lighting. In the figure, one chandelier 24 and four spotlights 16 around it are provided on the ceiling in the room.
21 is installed. FIG. 16A shows the case where the soft robot 90 is erected at the center of the room and is illuminated only by the chandelier 24. When only the chandelier 24 is used for illumination, the entire room is very bright and bright enough to be in harmony with each other, but there is a shadow on the face of the soft robot 90. On the other hand, in FIG. 16B, when the chandelier 24 and the spotlight 1621 are used for illumination, the shadow of the face of the soft robot 90 is almost eliminated. As a result, the lighting environment of only the chandelier 24 is sufficient to actually sit on the sofa 1622 in the center of the room and face each other, but by using the chandelier 24 and the spotlight 1621 together, the facial expression of the other party becomes clear. It is possible to evaluate it as a better lighting environment because it is possible to get together while watching. In this case, although not shown in FIG. 16A, since the face is actually displayed in the goggle type stereoscopic display device 11 with the shadow even, there is no simulated experience in a lighting environment that is actually close. Get Of course, it is possible to magnify and display only the face and observe it in detail by a separate operation.

Next, regarding the display of the indoor illuminance in this case, the illuminance at each unit output (1 W) in the case of the chandelier 24 alone and each spotlight 1621 alone is calculated and stored in advance. Depending on how the illumination conditions are selected, the stored illuminance of only one or both illuminances are taken out, the output value given separately is corrected as necessary, and then used for the display of the soft robot 90. . Therefore, the chandelier 24 alone can be evaluated even when the output illuminance is large. At this time, it is needless to say that the non-linearity of the light source and human vision is corrected as necessary.

FIG. 17 shows a display screen when used for acoustic analysis. In this figure, two floor-mounted speakers 1701 are installed in front of the room, and music is playing. There is a window 1421 on the right side wall of the room, and the acoustic environment condition that there is a considerable noise source outside is input in advance. In this display example, the degree of hindrance to music listening due to noise is divided into four levels, and the facial expression of the soft robot 90 is changed according to each level. This is a so-called symbol display. Then, in order to facilitate understanding of the evaluation result, the soft robot 9 at each stage
A facial expression 1702 of 0 is displayed on the upper right of the screen for reference. Now, the soft robot 90 is set up at the center of the room, and the window 1421 is closed by a soundproof sash with a sound insulation of about 60 dB, a general window with a sound insulation of about 30 dB, and an open state. The result of evaluation of the acoustic condition in listening to music is displayed by the facial expression on the street. A in the figure shows a case where the window 1421 is a soundproof sash, and almost no noise is transmitted to the room, and the user is listening to music comfortably. Similarly, B shows the case where the window 1421 is a general window, and shows the result that the noise is somewhat obstructed in listening to music. Similarly, C shows that the window 1421 is opened, and it is almost impossible to listen to music.

All conventional sound environment evaluations have been performed by a method in which the observer himself / herself actually listens to sound using headphones or the like. Therefore, you can listen to two or more sounds at the same time,
Sound insulation evaluation, such as how much one sound is disturbed by the other sound, was very difficult due to hardware problems. However, in the present embodiment, the sound environment evaluation can be performed sensuously. Of course, separate headphones may be applied to both ears so that the user can actually experience the acoustic environment. In this case, a visual evaluation can be obtained at the same time, which is a more intuitive pseudo experience. Further, in sales engineering, it is more effective if the external noise and the volume of each music sound from the speaker 1701 are numerically displayed together. (Fourth Embodiment) Another embodiment of the present invention will be described below with reference to the drawings.

Not limited to this embodiment, in order to make a simulated experience visually, it is necessary to reflect the illuminance and the like on the display of the house and the equipment inside. Furthermore, as a practical matter, in sales engineering, vision is of paramount importance. In this example,
Regarding simulated experiences of various visual environments. Hereinafter, a basic procedure of the light environment analysis, which is a prerequisite for various visual experiences, will be described with reference to the flowchart of FIG. The flowchart is a part of the environment analysis 1102 shown in FIG. As described above, the optical properties such as the geometrical shape of the solid wall, the ceiling, the floor, and the internal equipment and the reflectance are input in advance (t
1). In addition, the optical properties of its outer surface are also three primary colors (RGB).
Each value is entered and set. On this, the input geometric shape is mesh-divided as shown in FIG. 19 (t2). In addition, if necessary, FIG.
A virtual partition surface 1901 as shown in A and a virtual mirror surface 1902 as shown in B of FIG. 19 are also input. The former is used to find the brightness of the midpoint of the room where nothing exists, for example, the position of the human eye, and the latter is used to efficiently analyze a plane-symmetric room. Then, the reflectance or the like for each primary color input for each mesh is set in the computer (t3). For each primary color, the optical properties of the light source,
For example, the amount of light per unit output, the irradiation direction, and the distribution of the amount of light (information about directivity) are input (t4). The amount of received light and the amount of reflected light of each mesh are calculated for each primary color (t5). The basis of this calculation is that the light emitted from each mesh is reflected to other meshes according to a predetermined reflectance and the like as a light source this time. Then, each time each mesh repeats this reflection, the light amount given as the initial value from the original light source is attenuated. Then, it is repeated until the attenuation amount reaches a predetermined value with respect to the initial value. Then, the brightness of each mesh is obtained as the total sum of the amount of light emitted by the reflection from each mesh. The brightness of the mesh on the virtual partition surface is the amount of light passing through the mesh. In this embodiment, it is determined whether or not the total sum of the amount of reflected light is within 0.5% of the initial amount of light from the light source for each primary color and for each number of reflections (t6). If it exceeds 0.5%, the reflected light is reflected from this mesh and illuminates other meshes in each part of the room (t7). Also,
If it is 0.5% or less, the repeated calculation that the light from the original light source is repeatedly reflected by each part (each mesh) and contributes to the illumination of each part (each mesh) in the room and is attenuated is completed.

In this state, the brightness of each mesh on the outer surface of each object, which is the calculation result of the illumination simulation, is read and displayed on the display. At this time, for the purpose of cost reduction, the calculation divides the outer surface of the object into coarseness that does not impair the calculation accuracy, and the respective divided meshes have the same brightness. However, when displaying the visual environment, the goggle type stereoscopic display device 11 is used.
A predetermined correction is performed for each pixel. Further, for stereoscopic display, the parallax is adjusted in the necessary part (t8). As a result, as shown in FIG. 20, the indoor environment with a real sense of shading is overlooked.

Next, the handling of the virtual partition surface 1901 and the virtual mirror surface 1902 as an application example of this embodiment will be described.
As shown in A of FIG. 19, on the virtual partition surface 1901, the incident light passes 100% while maintaining its direction.
As shown in FIG. 19B, the virtual mirror surface 1902 reflects 100% after changing the direction according to Newton's law (Fermat's principle). In addition, glass is similar to a virtual partition surface, but the transmittance is not 100%, and there are reflection according to Newton's law and some diffuse reflection. Further, in colored glass, the transmittance, reflectance, etc. for each primary color differ depending on the color. On the mirror surface, unlike the virtual mirror surface, the reflectance is 95%. In addition, it is assumed that there is some diffuse reflection. With these, not only can the illuminance of a space on the floor surface where there is no object of a given height, specifically, the amount of light entering the human eye, etc. It is also possible to visually simulate the appearance of the original show windows using colored glass and the halls with large mirrors installed here and there. Of course, it can also be used for selecting the color of colored glass.

Next, another application example will be described. In sales engineering or a simulated experience by a beginner, the simulated experience person may inevitably jump out of the room due to an erroneous operation such as a walkthrough. In this case, particularly in sales engineering, if only the outer wall can be seen, it is difficult for the customer to grasp the positional relationship between the house and the external visual field generated in the goggle type stereoscopic display device 11, and it is difficult to return to the room. . Therefore, in the present embodiment, when the user goes outside, the outside wall of the room is regarded as a virtual partition surface and made transparent so that the position inside the room can be easily grasped and the operation for returning to the room again can be performed. It's easy to do. At this time, it is possible not only to make the display of the outer wall transparent, but also to display the landscape of the garden etc., which was created separately, so that the interior can be seen from the outside. This not only makes it easier to correct erroneous operations, but also makes it possible to evaluate the entire room more clearly.

Of course, an external environment such as a garden may be input as a target for a visual simulation experience, and then observed from inside the room with the window opened together with the room. This allows
The effect of sales engineering also increases. In this case, the necessary illuminance is corrected to compensate for the difficulty of visual recognition caused by the change in the indoor brightness due to the opening and closing of the window and the large difference between the external environment and the indoor brightness. Specifically, human vision is proportional to the logarithm of the illuminance, and it is possible to consider reducing the external illuminance as necessary.

FIG. 21 shows a state in which the indoor plants of the virtual house and the plants in the garden are displayed together when viewed from the outside. (Fifth Embodiment) Next, another embodiment of the present invention will be described. Generally, the user is most interested in the confirmation of the indoor atmosphere by lighting and the appearance of the room by the walk-through in the evaluation of the living environment. However, when the architect or equipment designer uses this simulated experience device to obtain intuitive design materials, it becomes necessary to visualize and display even more detailed physical phenomena. This is especially important in the design of the light environment in the art exhibition space, the sound environment in the music hall, and the like. In this embodiment, an intuitive design material is obtained by providing a virtual cross section in a room and displaying enormous three-dimensional data such as temperature distribution by numerical simulation as scalar information such as isotherms on the virtual cross section. It was possible. In this case, three-dimensional data,
Since the vector information and the like are displayed in a contour map which is two-dimensional data, it is easy to leave an impression on the user. Moreover, since the indoor environment is three-dimensionally displayed, it is intuitive, and it is easy to effectively reflect the display result in various designs.

Next, the basics of the data processing will be described. As described above, the temperature, the wind direction, the wind speed, and the like at each point in the room are calculated and stored in advance by environmental analysis and subsequent storage. Therefore, if the two-dimensional plane that is the target of the isotherm diagram is determined, the calculation result of each calculated point closest to this plane is taken from the storage unit, and the points of the same temperature are connected by an interpolation curve. Created. In addition, for example, for illuminance, analysis values of each part of the room per unit output of the light source are stored, and the output is corrected and displayed by a simple calculation according to the output and contents of various light sources, thereby making it possible to speed up the operation. Correspondence is also possible. On the floor of the room 1.5
The illuminance at a place where nothing is present in m is obtained by setting the virtual partition surface described in the previous embodiment.

FIG. 22 is a contour map of illuminance on the virtual partition surface and the indoor wall surface. Next, in the present embodiment, the three-dimensional input device 30 makes it possible to move and rotate the two-dimensional contour map in all directions to evaluate and observe the indoor environment. Of course, since it is a stereoscopic display, it is possible to display it in multiple layers. Specifically, the vertical partition at the position of 1 m from the user is red, the position of 2 m is yellow, the position of 3 m is blue, and the contour lines are blue, and the numerical values shown by the contour lines are numbers at predetermined intervals or For example, it is displayed at a predetermined position. However, in FIG. 22, the numbers attached to the contour lines are omitted.

In the present embodiment, the display position of the contour line can be moved also by a voice recognition device (not shown). This is a state where both eyes are covered with goggles,
Since the contour map will rotate, the movement of the body is minimized. Note that the word recognition technology itself used for the commands such as “rotate”, “right”, and “up” is not the purpose of the present invention, and therefore its description is omitted.

Next, the local and detailed evaluation will be described. The guest seats in the hall are actually moved to the position to obtain the detailed design data, and specifically, the position of the measuring object is designated by using the three-dimensional input device 30 as a virtual sensor, and It is also necessary to obtain the detailed temperature and the like of only the position. At this time, since the temperature, the flow velocity, and the like have data for each coordinate, they can be obtained by extrapolation or can be calculated in detail based on the data of the close points.

Regarding the brightness, the position of the viewpoint and the angle of the line of sight are necessary. Therefore, the angles of the three-dimensional input device 30 and the goggle type display device 11 are read, the brightness value at that position is calculated by calculation, and a numerical value is displayed at a designated position in the goggle type stereoscopic display device 11 as shown in FIG. Display. Figure 2
In FIG. 3, A indicates temperature and illuminance by numerical values, and B indicates air volume and direction by numerical values and vectors.

In this embodiment, for convenience of this case,
As shown in FIG. 3, the goggle type stereoscopic device 11 is connected to the input device 1
5 is attached, which enables selection of environmental elements and change of temporal conditions. This principle is that, as shown in FIG. 24, the goggle-type three-dimensional device 11 has a magnetic detection end or the like in each of the three-dimensional directions of up, down, left and right, front and back, and the speed of the three-dimensional input device with respect to the magnetic field and the direction of gravity. It is possible to make selection and change operations according to acceleration, acceleration, and their directions. In this case, since it is fixed to the head and both eyes, it becomes easy to specify the position precisely. (Sixth Embodiment) This embodiment relates to generation and display of a plurality of soft robots.

In a house, a shop, an office, etc., there are usually a plurality of people. For this reason, it is preferable to consider the presence of other people when visually trying to experience the situation more closely. By the way, each person may act independently and may interact with each other.
In this embodiment, not only can a simulated experience be made in any case, but it is also possible to analyze the mutual influence of each person.

Next, referring to FIG. 25, three soft robots 91, 9 are provided in one of the goggle type stereoscopic display devices 11.
The manner in which 2, 93 are displayed, the principle, and the like will be described.
The soft robots 91, 92, and 93 of FIG. 26 are the goggles-type stereoscopic display device 11 and the three-dimensional input device 3 corresponding thereto.
0, the arithmetic unit 13, the magnetic field generator 14, and the like are in a one-to-one correspondence. On this stereoscopic display device 11, not only a soft robot 91 that walks through can be displayed according to an operation from the same set of three-dimensional input devices 30, but a soft robot 92 that walks through the same room by another set. , 93 can also be displayed.

For this reason, the soft robot 91 that the user manipulates
Besides, soft robots 92, 9 imitated by other users
3 makes it possible to visually and objectively evaluate the environmental factors when walking through. At this time, it goes without saying that the soft robots 92 and 93 other than the ones operated by themselves are displayed at the positions of other users. Therefore, it is possible to use not only for the simulated experience in consideration of the existence of other users, but also for the analysis of the behavior of a person at the time of a fire or the behavior of a customer at a store. In these cases, it goes without saying that necessary programs and the like for generating smoke and displaying articles in the show window are installed. Moreover, you may use experimental data about the generation of smoke. Furthermore, it is needless to say that it has various equipments necessary for analyzing the behavior of a large number of people. FIG. 26
Indicates a configuration therefor.

In the figure, reference numerals 261, 262, ... Are equipments provided exclusively for each user or subject, which are composed of a goggle type stereoscopic display device, a three-dimensional input device, and a magnetic field generator, and are basically shown in FIG. It is the same as the configuration excluding the arithmetic and control unit 13 shown in FIG. Reference numeral 2613 denotes an arithmetic and control unit, and when compared with that shown in FIG. 3, some component parts are provided for each user in order to enable simultaneous use by a plurality of users, and the position parallax adjusting part 2611 is also provided. The provision is different. That is, the soft robot display data calculation unit 136 and the soft robot movement speed vector calculation unit 13
5. The three-dimensional space movement velocity vector calculation unit 133 is provided for each user.

In addition, it has an adjusting unit 260 for adjusting contradictory requests from each user. On the other hand, the common one is a calculation unit 134 that calculates a common indoor environment and the like. The adjustment unit 260 adjusts the conflicting requests of each user so that the plurality of soft robots 91, 92, and 93 are not displayed at the same position, and also provides information about the position of each user. The position of the set is passed to the parallax adjustment unit 2611. The position / parallax adjustment unit 2611 performs correction according to the position of each user when forming the indoor environment calculated by the three-dimensional space display data calculation unit 134 in the goggle type stereoscopic display device 11 for each user, At the same time, the material for generating a soft robot corresponding to another user in the field of view is received from the adjusting unit 260, and at the same time, information about the user in charge of the user is sent.

Next, other uses and usages of this embodiment will be described. In sales of a house, when the customer has a simulated experience of the environment of the house to be sold (purchased), the customer is unfamiliar with the contents that the simulated experience device can experience and the operation of the three-dimensional input device 30. As it is, the experience content tends to be inadequate. For this reason, separately, a salesman of a home building and a sales company also wears the goggle type stereoscopic display device 11 to experience the same virtual housing environment as the customer is actually experiencing, while operating and simulating the customer. Need to help. Alternatively, doing so is more effective not only in the simulated experience but also in the sale of the house. Therefore, the customer and the salesman can be integrated to use the simulated experience device. In this case,
Two soft robots suitable for customers and salesmen 9
1 or 92 may be displayed, or the goggle type stereoscopic display device 11 equipped with the customer is formed with a field of view of the customer who is actually waking through, in which the soft robot 92 corresponding to the salesman is displayed. On the other hand, the goggle type stereoscopic display device 11 equipped by the salesman may display a virtual space centered on the customer's vision and intention. In the latter case, the position for the salesman, the parallax adjustment unit 2611, the soft robot display data operation unit 136, etc. are deactivated, and the video signal for the customer's simulated experience is divided into two for the salesman. And supply. In addition, whichever display is used, adjustment of the operation of the three-dimensional input device 30 owned by the customer and the salesman may be switched as necessary with the understanding of the conversation between the two.

Although the present invention has been described above based on the embodiments, it goes without saying that the present invention is not limited to the above embodiments. That is, for example, (1) if the target is an indoor space, but if it is a target of a simulated experience centered on vision, the interior of an aircraft, an outdoor theater,
It may be applied not only to the jungle, the North Pole and the South Pole but also to other three-dimensional spaces such as outer space and the sea. Alternatively, the term “indoor” as used in the present invention means in a three-dimensional space,
The terms "house" and "equipment" mean the types and contents in the three-dimensional space, and various condition generating elements existing inside them. More specifically, the plains where middle-aged dinosaurs are present may be simulated as entertainment. In this case, the user may see the dinosaur or may see the middle-aged world through the eyes of the dinosaur. Further, the goggle-type stereoscopic device may generate a world viewed through the eyes of reptiles and insects instead of the eyes of humans.

(2) Physical data for evaluation is
Not only the computer simulation result but also the actual measurement result of the experiment may be reflected. In this case, the actual measurement result is, of course, input in advance. (3) The three-dimensional input device may be held in both hands instead of being operated by one hand, and rough operations and instructions may be performed with the left hand, and detailed instructions may be given with the right hand. Also, a separate operating device may be used in combination. Particularly in sales engineering, it may be convenient for the salesman to set complicated conditions with a separate operating device and to make the three-dimensional input device handled by the customer simple. Further, in sales engineering, voice input by a customer's simple words such as “stop”, “move” may be adopted. This further improves the practicality.

(4) As the three-dimensional input device, the one held in the hand and the one mounted on the head have been introduced, but both do not have to have the same function. That is, what is mainly held in the hand, and what is mounted on the head is used for changing the image of the virtual indoor space in response to turning the neck or bending the head, and of walking through. It may be dedicated to specifying the direction. This would be more practical for a simulated customer experience in sales engineering.

(5) Stereo type headphones may also be provided so that the noise and the like associated with the operation of the washing machine, the air conditioner, etc. can be simulated. (6) The three-dimensional input device may have an elongated rod at a portion corresponding to the barrel portion, not at the grip portion of the pistol, so that the sense of directivity of the three-dimensional beam by the hand can be obtained.

(7) A CRT and CPU are separately provided, and a third party refers to the CRT display on a desk so that the virtual house environment and the operation of the simulated experience person, which are formed for the visual experience of the simulated experience person, The simulated experience content may be analyzed or changed. Furthermore, the goggles-type stereoscopic display device 11 of each user is displayed with his / her own field of view through which the user walks through, as well as the soft robots and smoke corresponding to other users, and the display contents that each user runs away for safety. It is also possible to perform experimental analysis of human behavior. This is particularly effective in analysis of human behavior at the time of disaster.

(8) The change in the rotation angle of the three-dimensional input device may be detected only by gravity. Further, although it becomes expensive and complicated, other means such as ultrasonic wave and infrared ray may be used together. This enables more precise input operation. (9) Many people wear goggles-type stereoscopic display devices, and it is the same indoor environment that is formed in each of these devices, but only in the part corresponding to the line-of-sight position depending on how each person's head is swung and oriented. The image of the indoor pain may be virtually configured. As a result, it becomes possible for one salesman to give a large number of customers a visual experience of the interior of a house to be sold.

(10) When an environment such as a coffee shop or a dance hall is to be simulated, a function of generating a plurality or a plurality of soft robots not necessarily corresponding to the simulated experience may be added. In this case, the thermal condition is analyzed assuming that the heat generation amount (60 to 100 W / h person) increases in proportion to the number of soft robots, and the wind direction or the like is ignored or treated analytically depending on the condition, or Individual examinations will be adopted as appropriate. Also, the heat generation amount of the soft robot may be changed depending on the conditions. (Of course, even children and adults will be less if they are stationary.) (11) In the selection of the menu, the selection correspondence may be additionally displayed with a frame of a specific color.

(12) For a customer or a beginner, the operation guide of the three-dimensional input device may be displayed within the visual field of the goggle type stereoscopic display device. (13) The air flow, the air volume, and the wind direction may be similar to this, and the source of the air flow may be not an air conditioner but one having the same function as this, for example, a fan or the like. For this reason, a method such as calculation display of the blowing of the air flow from the air conditioner may be applied to an offensive odor from a cigarette or other offensive odor source, a flow of smoke from a fire source, or the like.

(14) The soft robot does not have to be humanoid as long as it visually displays the physical conditions in the environment, and the calculated values of the physical conditions are displayed numerically on the visual display. May be. Further, the doll soft robot may be allowed to input operations such as sitting, standing, and raising hands.

[0148]

As described above, the present invention basically focuses on the visual sense of the living environment, which is excellent in operability and the contents of the simulated experience itself, and is inexpensive, and also targets the hearing sense. In addition, we will provide a simulated experience device for acoustics. Specifically, it has the following effects.

Provided is a simulated experience device which mainly focuses on the visual sense of the living environment, which has few rules regarding the operations that must be remembered when selecting and changing the equipment and facilities in the room, and which also targets the sound. Provide a simulated experience device centered on vision for various living environments such as residences, shops, and offices.

Provided is a simulated experience device centered on the visual sense of the living environment in which a local experience can be obtained in relation to the temperature, wind, comfort level, etc. that may be felt as a person moves indoors. To do. Provided is a simulated experience device centered on the visual sense of a living environment in which a large number of human beings exist and the mutual influence of the large number of humans is taken into consideration.

Provided is a visual experience device which is visually and intuitively focused on the visual sense and the auditory sense of the living environment in consideration of the indoor and outdoor relations and influences. Not only for customers in sales engineering but also for design engineers, it is possible to obtain not only various experiences but also changes in the living environment due to changes in equipment, etc., and various design data can be obtained quickly and intuitively. Provide experience device.

It is close to normal human operation, there is no danger, proficiency, and difficulty in operation, and repair from operation mistakes is easy. Therefore, a living environment very effective for sales engineering. Provide a simulated experience device centered on the visual sense of. Provide a simulated experience device centering on the visual sense of the living environment because it is intuitive for the education of housing engineers and acquisition of technical materials.

Provided is a simulated experience device centering on the visual sense of the living environment, which is applicable not only to residential use but also to stores, offices and the like. Provide an inexpensive simulated experience device centered on the visual environment. Provide a simulated experience device that is sufficiently effective and effective for the acoustics of the living environment. Provided is a simulated experience device capable of performing a complicated operation such as rotation of a visual field only by exercising one hand and only by sound with both eyes closed.

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram of a conventional simulated experience device for a residential environment.

FIG. 2 shows the contents of experience of a conventional simulated experience device for a residential environment. In the figure, A is a display example of the analysis result of the thermal environment, B is a display example of the analysis result of the light environment, and C is a state in which the analysis result of the sound environment is output acoustically.

FIG. 3 is a schematic configuration diagram of a first embodiment of the simulated experience device of the present invention.

FIG. 4 is an external view and operation explanatory diagram of a three-dimensional input device 30 for menu selection in the above embodiment.

FIG. 5 is a diagram showing an internal configuration of an arithmetic and control unit 3 in the embodiment.

FIG. 6 is a diagram showing a state of a three-dimensional menu and a three-dimensional beam for selecting a menu in the above embodiment.

FIG. 7 is a diagram showing a state of processing when generating a three-dimensional visual environment in a room accompanying a walk-through of a simulated experiencer in the second embodiment.

FIG. 8 is an example of indoor and outdoor displayed when walking through the room in the above embodiment.

FIG. 9 shows an example in which the soft robot in the third embodiment is moved and displayed indoors.

FIG. 10 is a diagram showing how visual information is processed according to the movement of the soft robot in the above embodiment.

FIG. 11 is a diagram showing rough input and processing of unique data according to the third embodiment of the present invention.

FIG. 12 is a diagram showing the contents of calculation processing of the present embodiment.

FIG. 13 is a diagram showing a flow of processing for a display operation related to the soft robot of this embodiment.

FIG. 14 is a diagram showing a manner in which the soft robot displays the indoor temperature distribution in an easy-to-understand manner in relation to a person due to the difference in color of each part in the above-described embodiment.

FIG. 15 is a diagram showing a state of warm air blown out from an air conditioner according to a state of pulling a shelf attached to a head of a soft robot in the above embodiment.

FIG. 16 is a diagram showing a change in indoor brightness due to a change in illumination in the above-described embodiment. A in the figure shows the appearance of the shadow of the soft robot's face as it was illuminated only by the chandelier, and B shows the appearance of the soft robot's face as it was illuminated by using the chandelier and spotlights together. It is shown.

FIG. 17 shows the difference in facial expression of the soft robot depending on the sound environment in the above embodiment.
In the figure, A shows the case where the window is made a soundproof sash, B shows the case where the window is general, and C shows the case where the window is opened.

FIG. 18 is a flow chart of an analysis process for making it possible to experience simulated indoor light and lighting environment in the fourth embodiment.

FIG. 19 is a diagram showing a state in which the inner surface of the room is divided into meshes for analysis in the above example. In this figure, A is a virtual partition surface, and B is a virtual mirror surface.

FIG. 20 shows how the virtual indoor space, which is the analysis result, is stereoscopically displayed in the above embodiment.

FIG. 21 is a diagram showing a state in which a transparent outer wall and an outdoor garden plant in a virtual space are displayed together in the embodiment.

FIG. 22 is a display example of illuminance contour lines on a virtual plane or an inner surface in a virtual space in the fifth example of the present invention.

FIG. 23 is a display example of the physical value of the virtual space at the position when the virtual sensor is set in the above embodiment. In this figure, A indicates the indoor temperature and B indicates the indoor illuminance.

FIG. 24 is a diagram showing movement and rotation related to the appearance and operation of the goggle type stereoscopic display device 11 in the above embodiment.

FIG. 25 is a display example when a plurality of soft robots are walking through in the sixth embodiment of the present invention.

FIG. 26 is a diagram showing a specific configuration of the arithmetic and control unit necessary for displaying a plurality of soft robots in the above embodiment.

[Explanation of symbols]

11 goggle type stereoscopic display device 13 arithmetic control device 130 input control unit 131 3D menu / beam coordinate calculation unit 132 3D menu / beam display data calculation unit 133 3D indoor movement speed vector calculation unit 134 3D indoor display data calculation unit 135 soft robot movement Velocity vector calculation unit 136 Soft robot display data calculation unit 137 Display control unit 14 Magnetic field generator 15 Magnetic detection end 30 Three-dimensional input device 31 Trigger switch 32 Right button 33 Middle button 34 Left button 35 Magnetic detection end 36 Accelerometer 61, 62 Three-dimensional light beam 90, 91, 92, 93 Soft robot 1501 String 1901 Virtual partition surface 1902 Virtual mirror surface 2613 Multi-software robot arithmetic and control unit 260 Adjustment unit

Continuation of the front page (51) Int.Cl. ⁶ Identification number Reference number within the agency FI Technical indication location 9381-5H G10K 15/00 L (72) Inventor Hisashi Kodama 1006 Kadoma, Kadoma-shi, Osaka Matsushita Electric Industrial Co., Ltd. Within

Claims (36)

[Claims] 1. A pseudo-experience device that allows a user to visually experience a different environment in which a user will exist according to a user's operation, and stereoscopic vision means to be worn on both eyes of the user, and a visual simulation. A storage means for storing the materials necessary to generate a plurality of environments to be experienced, which are input prior to the simulated experience, and a plurality of environments stored by the storage means, and the user is given a simulated experience. In-field menu generating means for generating in the visual field of the stereoscopic device a menu of an environment that is a target of a pseudo-experience so that the user can select what he / she wants, and the user's intention from the menu generated in the visual field. The menu selection means that allows the user to select what to do with one-handed exercise of the user, and the environment selected by the menu selection means based on the material stored in the storage means. Pseudo experience apparatus characterized by having a three-dimensional environment generation means for generating within a visual means. 2. The menu selection means includes: a beam light generator that generates a beam light whose direction can be changed only by one-handed movement within a stereoscopic field; and a menu for each environment displayed, The simulated experience device according to claim 1, further comprising: a beam light use menu selection designation unit that enables selection and designation of a light beam designation as a user's intention. 3. A user operation input operation means for allowing a user, who virtually exists in the environment generated by the stereoscopic means, to input data related to operation in the environment, and a user. In the environment of the user, based on the data input from the user operation input operation means and the material stored in the storage means, the user's operation with respect to the environment currently generated in the stereoscopic viewing means. 3. The simulated experience device according to claim 2, further comprising a three-dimensional environment user action reflection means for making necessary correction according to the above. 4. The detection unit, wherein the user operation input operation unit detects at least one of an operation that causes a magnetic change due to the movement of one hand of the user, an operation that causes acceleration, a push button operation, and a switch operation. 4. The simulated experience device according to claim 3, further comprising an input operation conversion unit that converts the detection result of 1. into the content of the input operation. 5. The input operation conversion unit is based on at least one of a walking and a head swing of a user who is supposed to exist in an environmental condition generated in the stereoscopic means based on the detection result of the detection unit. The three-dimensional environment user action reflection means receives the conversion result of the first conversion portion and is accompanied by at least one of the walking and head swing of the user as a necessary correction. The simulated experience device according to claim 4, further comprising a walking and swinging correction unit that corrects a change in the visual field. 6. The input operation conversion means applies the detection result of the detection section to at least one of a light source, a partition surface, a reflection surface, a transmission surface, and a device existing in the environment generated in the stereoscopic viewing means. A second conversion unit for converting into an input of an operation that changes at least one of the light environment condition or the scene in the field of view, and the stereoscopic environment user action reflection unit is a conversion result of the second conversion unit. In response, the illuminance within the field of view, the color, the arrangement of the devices, which accompanies the operation that changes the user's light environment conditions,
5. An optical operation input correction unit for correcting the display of the device and at least one of the partition surfaces is provided.
The simulated experience device described. 7. The visual field in which the input operation conversion means influences at least one of a sound environment, a thermal environment, and an airflow environment existing in an environment generated in the stereoscopic viewing means based on the detection result of the detection section. Converting to an input for operation of at least one of the start / stop of the device in the inside and the change of the existence state of the partition surface.
The three-dimensional environment user action reflection means has a conversion unit, and the three-dimensional environment user action reflection unit receives the conversion result of the third conversion unit and the illuminance in the visual field, the color, the arrangement of the device, the display of the device, and the start / stop of the device according to the user's operation The simulated experience device according to claim 4, further comprising a sound, temperature, and airflow input correction unit that corrects at least one of the existing states of the partition surface. 8. The user action input means includes: a voice input unit capable of accepting a voice input of the user; and a voice input conversion unit for changing the input accepted by the voice input unit into the content of a user's operation instruction. The simulated experience device according to claim 3, further comprising: 9. A simulated experience device for enabling a simulated experience of a different environment in which the user will exist according to a user's operation, and a stereoscopic vision means to be worn on both eyes of the user, and an object to be simulated visually. Storage means for storing the material necessary for generating the sagging environment prior to the simulated experience, and three-dimensional environment generation for generating the environment in the stereoscopic means based on the material stored in the storage means Means, a soft robot generation means for generating a soft robot in the environment generated in the stereoscopic vision means under the action of the three-dimensional environment generation means, and an environment of the soft robot generated by the soft robot generation means And a physical location in the environment to be stored in the storage means, and a soft robot location position indicating means for allowing the user to specify and change the location position A physical material storage means for inputting and storing the necessary material for defining the conditions; and at least a part of the material necessary for defining the physical conditions stored in the physical material storage means. By using the physical condition calculation storage means for calculating and storing the physical environment condition of the position instructed by the soft robot location position instructing means in the environment, and the environment physics at the location of the soft robot. And a soft robot display rule storage means for storing a rule that defines the relationship between the value of the conditional condition and the display mode of the soft robot, which is input prior to the generation of the soft robot, and the physical condition calculation storage means. Based on the calculated result and the rule stored by the soft robot display rule storage means, the soft robot display mode determining means for determining the display mode of the soft robot. And a soft robot display which is displayed in the mode determined by the soft robot display mode determination means when the soft robot generated by the soft robot generation means is combined with the environment generated in the stereoscopic vision means and generated and displayed. A simulated experience device having a mode control means. 10. Calculation of the physical condition of the environment at the location of the soft robot, out of the materials necessary for defining the physical condition already stored in the physical material storage means. The physical material change operation means for changing at least a part of the material used for the other material or the newly input material to at least one, and the change of the material by the physical material change operation means If there is, a physical material change operation execution means for performing the necessary correction action in response to the change in the physical condition calculation storage means, the soft robot display mode determination means and the soft robot display mode control means. The simulated experience device according to claim 9, further comprising: 11. The detection unit for detecting at least one of the operations for causing a magnetic change, an acceleration, a push button operation, and a switch operation for causing the soft robot location position instructing means to move the user's one hand. 11. The simulated experience device according to claim 8 or 10, further comprising: a conversion unit that converts the detection result of the unit into the content of the instruction. 12. The soft robot location instructing means includes a voice input unit capable of accepting a voice input of a user, and a voice instruction converting unit converting an input accepted by the voice input unit into instruction content. Claim 1 characterized by the above.
The simulated experience device according to 1. 13. The physical material storage means has an airflow material storage part for storing the material for determining the conditions related to the airflow, and the physical condition calculation storage means stores the physical condition calculation storage means. There is a wind direction and wind speed distribution calculation storage unit that calculates and stores the distribution of wind direction and wind speed, and the soft robot display rule storage means is according to the wind direction and wind speed of the string attached to at least one place of the soft robot. A string rule input unit for inputting the relationship between the fluttering direction and the fluttering condition, and the soft robot display mode determining means determines the fluttering direction and the fluttering condition of the string attached to at least one location of the soft robot. The pseudo display according to claim 9, 10 or 11 or 12, further comprising: a string display mode deciding unit for displaying as a display according to a wind direction and a wind speed. Experience device. 14. The physical material storage means has an illuminance material storage section for receiving and storing a material that defines a condition related to illuminance in the environment, and the physical condition calculation storage means is in the environment. Of the soft robot display rule storage means for calculating and storing the illuminance of the soft robot, the soft robot display rule storage means displays the face of the soft robot according to the illuminance in the face part of the soft robot, and displays the shadow attached to the face. It has a face display rule storage unit for inputting and storing a rule about at least one content, wherein the soft robot display mode determining means displays the face of the soft robot according to the illuminance of the part, The face display mode determining unit that determines at least one of which is not shaded according to the illuminance of the portion, is included in claim 9.
Alternatively, the simulated experience device according to claim 12. 15. The physical material storage means has an acoustic condition storage part for storing the input material for the condition related to the sound in the environment, and the physical condition calculation storage means is defined. A sound intensity calculation storage unit for calculating and storing the intensity of the sound from the sound source, wherein the soft robot display rule storage means is in accordance with the intensity of the sound from the predetermined sound source in the ear part of the soft robot. Of the volume display surface part attached to the soft robot has a volume display surface part display rule storage unit for inputting and storing the rule, wherein the soft robot display mode determining means is a part of the ear part of the soft robot. The volume display surface section determining unit for changing and displaying the volume display surface section according to the volume is provided.
The simulated experience device according to claim 1 or 12. 16. The physical material storage means has a temperature condition storage part for storing the material for determining a condition related to the temperature in the environment, and the physical condition calculation storage means is provided in the environment. Of the soft robot display rule storage means for calculating and storing the temperature or the sensible temperature of the soft robot. The soft robot display mode determining means has a color display rule storage unit that stores and stores a rule regarding the content of the color to be applied to the part according to the temperature or the sensible temperature. 10. The color display determining section for displaying a color according to the temperature or the sensible temperature of the section at a predetermined portion of the color display determining section. The simulated experience device according to claim 10, 11 or 12. 17. A simulated experience device for simulated experience of a different environment in which a user will exist in accordance with a user's operation, and stereoscopic means attached to both eyes of the user, and an environment as a target to be visually simulated. And a storage means for storing the material necessary for generating the above, which is input prior to the simulated experience, and a stereoscopic environment generating means for generating an environment in the stereoscopic means based on the material stored in the storage means. Symbol generating means for generating a symbol for visually displaying a value of a physical condition in the environment in the environment generated in the stereoscopic means under the action of the stereoscopic environment generating means, A symbol location-position instructing unit that allows the user to specify and change the location of the symbol generated by the generation unit in the environment; A physical material storage means for storing the material required to determine the physical condition upon input, and at least a part of the material required to determine the physical condition stored by the physical material storage means Using the physical condition calculation storage means for calculating and storing the physical environment condition of the position instructed by the symbol location position instructing means in the environment, and the physical condition of the environment in the location of the symbol. Symbol display rule storage means for storing a rule for defining the relationship between the condition value and the display mode of the symbol, which is inputted prior to the generation of the symbol, and the calculation result stored in the physical condition calculation storage means, and Symbol display mode determining means for determining the display mode of the symbol based on the rule stored in the symbol display rule storing means, and the symbol generated by the symbol generating means in the stereoscopic view. A simulated experience device, comprising: symbol display mode control means for displaying in a mode determined by the symbol display mode determination means when the generated and displayed image is combined with the environment generated in the means. 18. Among the materials necessary for defining the physical conditions stored in the physical material storage means, few of the materials used for calculating the physical conditions of the environment at the location of the symbol. Physical material change operation means for changing a part of other material or newly input material to at least one, and if the physical material change operation means changes the material, the physical material change operation means And a physical material change operation execution means for performing a necessary correcting action on the symbol display mode determining means and the symbol display mode control means according to the change. The simulated experience device according to claim 17. 19. The symbol position-indicating means is capable of exerting a function only by exercising one hand of a user, so that an operation of causing a magnetic change and an operation of causing acceleration,
The simulated experience according to claim 18, further comprising: a detection unit that detects at least one of a push button operation and a switch operation, and a conversion unit that converts the detection result of the detection unit into the content of the instruction. apparatus. 20. The symbol location instructing means includes a voice input unit that receives a voice input of a user, and a voice instruction conversion unit that converts the voice received by the voice input unit into instruction content. 20. The simulated experience device according to claim 19, wherein: 21. The symbol display rule storage means has a numerical value display rule storage unit for storing the inputted rule for displaying the physical value itself as a numerical value. Alternatively, the simulated experience device according to claim 20. 22. A simulated experience device for visually simulating different environmental conditions in which a user is to exist according to a user's operation, and a stereoscopic means worn on both eyes of the user, A storage means for storing the materials necessary for generating the environment to be simulated, which is input prior to the simulated experience, and a user position that allows the user's location in the environment to be specified and changed. Input operation means, and a stereoscopic body that creates an environment for a simulated experience in the stereoscopic means based on the material stored in the storage means according to the user's location input by the user position input operation means. Environment generating means, boundary wall recognizing means for recognizing a boundary wall of the environment for which the user has a simulated experience based on the material stored in the storage means, and the user position Recognizing the position of the user in the environment generated as the target of the simulated experience in the stereoscopic viewing means under the action of the stereoscopic environment generating means based on the input operation to the position input operation means. If the position of the user based on the boundary wall recognized by the boundary wall recognizing means is outside the environment that is the target of the simulated experience, this is detected. At the same time, when the user's location is outside the boundary wall, the user recognition means outside the boundary wall that finds the mutual relationship between the current position of the user and the position in the environment that the user had just had a pseudo experience with. Is notified of the mutual relationship between the current position of the user and the position within the boundary where the user had a pseudo experience immediately before from the user outside the boundary wall recognizing unit, and refers to the stored content of the storage unit, Phases of both positions in the stereoscopic means A simulated experience device having a user environment return promotion means for displaying and generating information on mutual relationships. 23. The user position input operation means is capable of performing an input operation only by exercising one hand of a user, so that an operation of causing a magnetic change, an operation of causing an acceleration,
23. A detection unit that detects at least one of a push button operation and a switch operation, and an operation content conversion unit that converts the detection result of the detection unit into the content of the input operation.
The simulated experience device described. 24. The user's environmental return return promoting means determines, from the position outside the environment wall where the user is currently located, the position within the environment that the user had simulated before the user left the environment wall. 24. An environment landscape perspective display unit for displaying a landscape in which a boundary wall existing between them is seen as transparent is provided.
The simulated experience device described. 25. In a simulated experience device for simulating a different environment in which a user will exist in accordance with a user's operation, a stereoscopic means mounted on both eyes of the user, and an environment as a target to be visually simulated. And a storage means for storing the material necessary to generate the above, which is input prior to the simulated experience, and a stereoscopic environment generation means for generating an environment in the stereoscopic means based on the material stored in the storage means. The physical material storage means stores the material necessary for determining the physical condition in the environment stored by the storage means, and the material stored by the physical material storage means. A physical condition distribution calculation storage means for calculating and storing the distribution of physical conditions in the environment, and at least one virtual condition in the environment generated in the stereoscopic means under user's instruction. Set the plane A virtual plane setting operation means, and a distribution of physical conditions in the environment stored by the physical condition distribution calculation storage means on the virtual plane set by the virtual plane setting operation means. The pseudo-experience device, further comprising: a contour map creation means for drawing a contour map of physical conditions in the environment and displaying the contour map together with the stereoscopic environment in the stereoscopic means. 26. A virtual plane moving means for changing at least one of the position and direction of the virtual plane set by the virtual plane setting operation means by the movement of one hand of the user. 26. The simulated experience device according to claim 25, wherein: 27. The virtual plane setting unit has a plurality of virtual plane setting units capable of setting a plurality of virtual planes, and the contour map creating unit also has a function of the plurality of virtual plane setting units. When drawing and displaying a contour map on a plurality of virtual planes that have been set as above, by changing the color for each virtual plane, each contour map is divided into three-dimensionally It has, 2 characterized by the above.
The simulated experience device according to 6. 28. The physical material storage unit has an illuminance condition storage unit for storing a material for inputting a material defining a condition related to illuminance, and the physical condition distribution calculation storage unit includes an illuminance distribution in an environment. 26. An illuminance distribution calculation storage unit for calculating and storing the illuminance, and the contour map creating means includes an illuminance contour map creating unit for creating a contour map of illuminance. 26. The simulated experience device according to claim 26 or claim 27. 29. The physical material storage means has a temperature condition storage part for storing the material necessary for determining a condition relating to temperature, and the physical condition distribution calculation storage means has a temperature distribution. 26. A temperature distribution calculation storage unit for calculating and storing the above, and the contour map creating means has a temperature contour map creating unit for creating a temperature contour map. 26. The simulated experience device according to claim 26 or claim 27. 30. The physical material storage means has a sound condition storage unit for inputting and storing material necessary for defining a condition relating to at least one of a sound having a predetermined property or a sound from a sound source. The physical condition distribution calculation storage unit has a volume distribution calculation storage unit that calculates and stores a distribution of at least one volume of a sound of a predetermined property or a sound from a sound source, and the contour map creation unit is 28. The simulated experience device according to claim 25, claim 26, or claim 27, further comprising a volume contour map creation unit for creating a volume contour map. 31. In a simulated experience device for simulating a different environment in which a user will exist according to a user's operation, a stereoscopic means worn on both eyes of the user, and an environment as a target to be visually simulated. A storage unit for storing the data necessary to generate the above, which is input prior to the simulated experience, and a user for each primary color of room lighting in order to evaluate the light environment conditions in the environment stored by the storage unit. Intensity, a transmittance for each primary color of the glass surface, and a reflectance of a mirror surface, at least one selectable optical condition storage means for inputting and storing a selectable numerical material, and the selectable optical material storage means Of the numerical data stored by the user, the selection operation means for allowing the user to select the one used for the evaluation of the optical environment condition, the data stored in the storage means and the storage of the selectable optical data storage means A stereoscopic environment generating means for generating a light environment condition to be generated in the environment on the basis of the numerical material selected by the selection operation means among the selectable numerical materials, and displaying it in the stereoscopic means. A simulated experience device characterized by having. 32. A soft robot generating means for generating a soft robot in the environment generated in the stereoscopic vision means, and a position in the environment of the soft robot generated under the action of the soft robot generating means. In the environment determined by the three-dimensional environment generation means, the soft robot location position indicating means for allowing the user to specify and change the position, and the soft robot at the position designated and operated by the soft robot location position indicating means are displayed. 32. The simulated experience device according to claim 31, further comprising: a soft robot display control means for evaluating a light environment condition that reflects the light environment condition. 33. The soft robot location-position instructing and operating means includes a detection unit that detects at least one of an operation that causes a magnetic change by a user's one-handed movement, a change that causes an acceleration, a push button operation, and a switch operation. 33. The simulated experience device according to claim 32, further comprising an instruction conversion unit that converts the detection result of the unit into the content of the instruction. 34. A soft robot color designation operation means for allowing a user to designate and change a color of at least a part of a soft robot under white light, and the light environment evaluation soft robot display control means for controlling the light environment. When displaying at least a part of the soft robot designated by the soft robot color designation operation means, it has a color designation soft robot display control means for displaying the light environment conditions in the environment at the position where the soft robot is located. 35. The simulated experience device according to claim 31, 32, or 33. 35. In a simulated experience device that allows a plurality of users to simultaneously and independently experience different environments in which the users will exist according to their operations, a stereoscopic vision means that each user equips his or her eyes. And a storage means for storing the material necessary to generate the environment to be visually simulated, which is input prior to the simulated experience, and for each user, the user in the environmental conditions during the simulated experience. The location of the user, which allows the user to specify and change the location of the location, and the material for creating the environment stored in the storage in the stereoscopic means equipped to each user, and the location. Based on the environment generation means for each user that generates an environment determined by the position input by the position indicating means, and the input from the location position indicating means for each user, each user A user position recognizing unit that recognizes the current position and a position corresponding to the other user based on the recognition result of the user position recognizing unit in the environment generated in the stereoscopic viewing unit for each user. A virtual experience device, comprising: a soft robot generating means for generating and displaying a soft robot for use by another user. 36. The position input means for each user includes a detection unit that detects at least one of an operation that causes a magnetic change due to the movement of one hand, an operation that causes an acceleration, a push button operation, and a switch operation, and the detection unit. 36. The simulated experience device according to claim 35, further comprising: a conversion unit that converts the detection result of 1. into the content of the input operation.