JP2015087695A - Information processor and control method for information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processor for allowing a user to recognize the change of an environment or an erroneous operation on the basis of any of the situation of an external environment, the biological information of the user and control information accepted by the information processor.SOLUTION: An information processor includes: an information acquisition part for acquiring at least one of specific information in an environment where the information processor is used, biological information of a user who uses the information processor and control information for controlling the information processor; and a control part for controlling the information processor on the basis of at least one of the specific information, the biological information and the control information acquired by the information acquisition part.

Description

  The present invention relates to an information processing apparatus.

  A head-mounted display device (Head Mounted Display, HMD) that is a display device mounted on the head is known. The head-mounted display device, for example, generates image light representing an image using a liquid crystal display and a light source, and guides the generated image light to a user's eye using a projection optical system or a light guide plate This causes the user to visually recognize the virtual image. There are two types of head-mounted display devices: a transmission type in which the user can visually recognize the outside scene in addition to a virtual image, and a non-transmission type in which the user cannot visually recognize the outside scene. The transmissive head-mounted display device includes an optical transmissive type and a video transmissive type.

  In a transmissive head-mounted display device, a technique is known that allows a user to visually recognize a character image representing the sound by converting the sound. For example, in Patent Document 1, when a user of a head-mounted display device visually recognizes content recorded on a recording medium, the sound included in the content is classified into human voice and environmental sound, and environmental sound is distinguished. A technique is disclosed in which a text image representing the image is generated and the generated text image is visually recognized by a user. Patent Document 2 specifies a choir member whose tempo and pitch of the song are different in a chorus practice by a choir who sings a song and a conductor who conducts a choir equipped with a head-mounted display device. Thus, a technique for allowing a conductor to visually recognize an image showing a specified choir member is disclosed. Further, in Patent Document 3, in a head-mounted display device that allows a user to visually recognize an image, an area that emits only image light for notification, such as a warning or notification, is formed, so that image light for notification can be easily obtained. A technique for surely recognizing the user is disclosed.

JP 2011-250100 A JP 2010-145878 A JP 2007-52224 A

  However, in the technique described in Patent Document 1, the user can adjust the way the external sound is heard, which is different from the sound of the content, by adjusting the volume of the content being viewed by the user's operation. If the volume of the content is not adjusted and the volume of the content is high, it may be difficult to hear external sound. In addition, there is a problem that the user wants to recognize an unexpected external sound that occurs suddenly, such as in an emergency, while the volume of the content is high. In Patent Document 2, the user can recognize a sound source in which a tempo of a song or a pitch difference has occurred, but it cannot adjust the volume of the sound being viewed by the user. Further, in Patent Document 3, image light that informs the user about the remaining battery level and the radio wave state is generated. For example, it is desired to detect a change in the environment in which the user is used and notify the user of the change. There was a problem. The above-described problem is not limited to the head-mounted display device, and is a problem common to sound output devices that output sound.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms.

(1) According to an aspect of the present invention, an information processing apparatus is provided. The information processing apparatus includes specific information in an environment where the information processing apparatus is used, biological information of a user who uses the information processing apparatus, and control information for controlling the information processing apparatus. An information acquisition unit that acquires at least one of the control unit, and a control unit that controls the information processing apparatus based on at least one of the acquired specific information, the biological information, and the control information. According to the information processing apparatus of this aspect, an instruction relating to control of the information processing apparatus is transmitted to the user based on any of the external environment status, the user's biological information, and the control information received by the information processing apparatus. It is possible to make the user aware of changes in the environment and biological information and erroneous operations.

(2) The information processing apparatus according to the above aspect may further include: a sound output unit that outputs sound; and the control unit may control an output sound output from the sound output unit. According to the information processing apparatus of this aspect, even if the user does not perform an operation such as visually recognizing a specific location, the user can be made aware of environmental changes and erroneous operations, and the convenience of the user is improved. To do.

(3) In the information processing apparatus of the above aspect, the information acquisition unit acquires an external sound that is an external sound different from the output sound as the specific information; the control unit is based on the external sound And controlling the output sound. In the information processing apparatus of this aspect, the output sound is controlled based on the external sound, so that the user can listen to the external sound while viewing the output sound of the supplied content or the like, and can quickly change the external sound. Can be recognized.

(4) In the information processing apparatus according to the above aspect, an image display unit that forms image light representing an image based on image data, allows a user to visually recognize the image light, and transmits an outside scene; and the external sound A conversion unit that converts the image into a character image represented as a character; the control unit may cause the image display unit to form character image light that is the image light representing the character image. In the information processing apparatus of this form, the user can visually recognize the external sound acquired by the information acquisition unit as a character image representing the external sound, and can make the user recognize the external sound in more detail.

(5) In the information processing apparatus of the above aspect, the control unit may set the size of the character image light that the image display unit causes the user to visually recognize based on the external sound. According to the information processing apparatus of this aspect, since the character size of the character image is set based on the external sound, the user is allowed to view the external sound, and the difference in the volume and frequency of the external sound is determined. The size of the character can be visually recognized, and the external sound can be recognized in more detail.

(6) In the information processing apparatus according to the aspect described above, the control unit may be configured such that the image display unit excludes a central portion in an image formable region that is a region where the image display unit can form the image light. The character image light may be formed. According to the information processing apparatus of this aspect, since the character image representing the external sound is not displayed at the central portion in the image formable region, the user's field of view is not obstructed more than necessary, and the user can The user can visually recognize the outside scene and the character image, thereby improving the convenience for the user.

(7) In the information processing device of the above aspect, the information processing device includes a plurality of the information acquisition units that are arranged at different positions; and the information processing device further includes: a volume of the external sound acquired by the one information acquisition unit; A sound source direction estimation unit that estimates a sound source direction that is a direction from the image display unit to the sound source of the external sound, based on the volume of the external sound acquired by another information acquisition unit; The image display unit may form the character image light in the image formable region, which is a region where the image display unit can form the image light, in association with the sound source direction. According to the information processing apparatus of this aspect, the user can visually recognize the character image representing the external sound as a character at a position near the sound source, and can make the user recognize the position of the sound source.

(8) In the information processing apparatus of the above aspect, the sound control unit measures the volume of the external sound, and the measured volume of the external sound changes from less than a first threshold value to more than the first threshold value. In this case, the volume of the output sound may be reduced. According to the information processing apparatus of this aspect, even when the volume of the output sound such as content is large, the volume of the output sound is lowered when the volume of the external sound is large. Even when an external sound is acquired, the external sound can be heard more clearly.

(9) In the information processing apparatus of the above aspect, the information processing device further includes: a specific sound detection unit that detects a specific sound included in the external sound; and the control unit detects the specific sound detected by the specific sound detection unit. The output sound may be controlled based on this. According to the information processing apparatus of this form, when the user detects a specific sound that the user wants to detect, the volume of the output sound is lowered, so that the user can hear only the necessary sound included in the external sound, User convenience is improved.

(10) The information processing apparatus according to the above aspect further includes: a motion detection unit that detects a change in the motion of the user's head; and the control unit detects the motion of the user's head detected by the motion detection unit The output sound may be controlled on the basis of the change. According to the information processing apparatus of this aspect, since the volume and frequency of the output sound are adjusted based on the two indexes of the change of the external sound and the change of the user's line of sight, the output is performed only by the change of the external sound. Compared with the case where the sound volume is adjusted, unnecessary adjustment is suppressed, and the convenience for the user is improved.

(11) In the information processing apparatus of the above aspect, the control unit may cause the sound output unit to output a sound in which the volume of the external sound is set based on a change in the external sound as the output sound. Good. According to the information processing apparatus of this aspect, when a specific sound such as a warning sound included in the external sound is detected at a volume lower than the output sound, the sound is used as an output sound having a volume larger than the volume of the external sound. Can be viewed by the user, and the convenience for the user is improved.

(12) In the information processing apparatus of the above aspect, when the information acquisition unit acquires a voice of a specific person, the control unit changes a frequency of the acquired voice of the specific person, and the sound The voice of the specific person whose frequency is changed may be output to the output unit, and the volume of sound other than the voice of the specific person may be reduced. According to the information processing apparatus of this aspect, when a voice having a frequency that is difficult for a person to hear is acquired, the user can easily recognize the external sound in order to easily view the acquired voice.

(13) In the information processing apparatus according to the above aspect, the control unit measures the volume of the external sound and controls the output sound based on the measured volume of the external sound and the volume of the output sound. May be. According to the information processing apparatus of this aspect, since the volume of the output sound is adjusted based on the volume of the external sound and the volume of the output sound, the user can view the output sound at a volume that reflects the user's intention. This can improve the convenience for the user.

(14) In the information processing apparatus of the above aspect, the sound output unit may allow the user to view the output sound in a state of being mounted on the user's head. According to the information processing apparatus of this aspect, since the sound output unit is attached to the user's head, the sound output unit is hardly detached from the user's ear, and the user can stably view the output sound.

(15) In the information processing apparatus of the above aspect, the change in the movement of the head is at least one of an angular velocity and an amount of change in the angle of the user's head; When the change is equal to or greater than the second threshold, the volume of the output sound may be reduced. According to the information processing apparatus of this aspect, the volume of the output sound is adjusted based on the two indexes of the change in the external sound and the change in the user's line-of-sight direction. Compared with the case where the adjustment is made, unnecessary adjustment is suppressed, and the convenience for the user is improved.

(16) In the information processing apparatus of the above aspect, further comprising: an analysis unit that analyzes an intensity for each frequency in the frequency spectrum of the external sound; and the control unit has a specific frequency in the frequency spectrum analyzed by the analysis unit The volume of the output voice may be controlled based on the above. According to the information processing apparatus of this aspect, when an abnormal sound or the like having a different frequency is detected in the acquired external sound, the user can be made to recognize the abnormal sound or the like, and the convenience for the user is improved. .

  (17) In the information processing apparatus of the above aspect, the specific information may be information related to at least one of temperature, humidity, magnetism, a component in the air, and adhesion of liquid in the information processing apparatus. Good. According to the information processing apparatus of this aspect, it is possible to make the user recognize the control method of the information processing apparatus based on a change in the environment outside the information processing apparatus, and to quickly and easily understand the dangerous situation of the environment. The user can be made aware.

  (18) The information processing apparatus according to the above aspect further includes: an operation unit that receives a predetermined operation as the control information; the control unit receives an operation different from the predetermined operation received by the operation unit In some cases, the information processing apparatus may be controlled. According to the information processing apparatus of this aspect, when a predetermined operation is not performed, the user recognizes that the user is performing an operation different from the predetermined operation. It is easy to perform and improves the convenience for the user.

  (19) In the information processing apparatus of the above aspect, the information acquisition unit acquires an acceleration of the information processing apparatus; the specific information may be an acceleration equal to or higher than a threshold in the information processing apparatus. According to the information processing apparatus of this form, the user can be made to recognize the control information of the information processing apparatus according to the change of the user's own situation different from the change of the environment in which the information processing apparatus is used, User convenience is improved.

  (20) In the information processing apparatus of the above aspect, the control unit may perform control for notifying a user of the information processing apparatus of information that restricts use of the information processing apparatus. According to the information processing apparatus of this aspect, since the control information of the information processing apparatus is notified to the user, the user can stop using the information processing apparatus based on a change in the external environment or an erroneous operation. Improved convenience.

  (21) In the information processing apparatus according to the above aspect, the image display unit further forms image light representing an image based on image data, allows the user to visually recognize the image light, and transmits an outside scene; and the setting information A conversion unit that converts the image into a character image represented as a character; and the control unit may cause the image display unit to form character image light that is the image light representing the character image. According to the information processing apparatus of this form, the user can visually recognize the text information representing the control information of the information processing apparatus and recognize the control information in more detail.

  A plurality of constituent elements of each embodiment of the present invention described above are not essential, and some or all of the effects described in the present specification are to be solved to solve part or all of the above-described problems. In order to achieve the above, it is possible to appropriately change, delete, replace with another new component, and partially delete the limited contents of some of the plurality of components. In order to solve some or all of the above-described problems or achieve some or all of the effects described in this specification, technical features included in one embodiment of the present invention described above. A part or all of the technical features included in the other aspects of the present invention described above may be combined to form an independent form of the present invention.

  For example, one embodiment of the present invention can be realized as an apparatus including one or more or all of the two elements of the information acquisition unit and the control unit. That is, this apparatus may or may not have an information acquisition unit. The device may or may not have a control unit. The information acquisition unit includes, for example, specific information in an environment where the information processing device is used, biological information of a user who uses the information processing device, and control information for controlling the information processing device. At least one of them may be acquired. For example, the control unit may control the information processing apparatus based on at least one of the acquired specific information, the biological information, and the control information. Such an apparatus can be realized as an information processing apparatus, for example, but can also be realized as an apparatus other than the information processing apparatus. According to such a form, it is possible to solve at least one of various problems such as improvement of convenience for a user who uses the apparatus, integration of the apparatus, and improvement of usability. Any or all of the technical features of each form of the information processing apparatus described above can be applied to this apparatus.

  The present invention can also be realized in various forms other than the information processing apparatus. For example, sound processing device, image display device, head-mounted display device, information processing device control method, sound processing device control method, image display device control method, head-mounted display device control method, information processing It can be realized in the form of a system, a sound processing system, an image display system, a head-mounted image display system, or the like. Further, a computer program for realizing the functions of an information processing device system, a sound processing device system, an image display device system, a head-mounted display device system, a recording medium on which the computer program is recorded, and a carrier wave including the computer program It can be realized in the form of a data signal or the like embodied therein.

2 is an explanatory diagram showing an external configuration of a head-mounted display device 100. FIG. 3 is a block diagram functionally showing the configuration of the head-mounted display device 100. FIG. It is explanatory drawing which shows a mode that image light is inject | emitted by the image light production | generation part. It is explanatory drawing which shows the flow of an output volume adjustment process. It is explanatory drawing which shows an example of the visual field VR visually recognized by the user. It is explanatory drawing which shows an example of the change of the volume of the external audio | voice acquired. It is explanatory drawing which shows an example of the frequency of the external audio | voice acquired. It is a block diagram which shows the structure of 100b in 2nd Embodiment functionally. It is explanatory drawing which shows the flow of the information alerting | reporting process in 2nd Embodiment. It is explanatory drawing which shows an example of visual field VR2 visually recognized by a user. It is explanatory drawing which shows an example of visual field VR 'visually recognized by the driver | operator of a motor vehicle. It is explanatory drawing which shows the external appearance structure of the head mounted display apparatus in a modification.

Next, embodiments of the present invention will be described in the following order based on the embodiments.
A. First embodiment:
A-1. Configuration of head mounted display device:
A-2. Output volume adjustment processing:
B. Second embodiment:
C. Variation:

A. First embodiment:
A-1. Configuration of head mounted display device:
FIG. 1 is an explanatory diagram showing an external configuration of the head-mounted display device 100. The head-mounted display device 100 is a display device mounted on the head, and is also called a head mounted display (HMD). The head-mounted display device 100 according to this embodiment is an optically transmissive head-mounted display device that allows a user to visually recognize a virtual image and at the same time directly view an outside scene. In this specification, a virtual image visually recognized by the user with the head-mounted display device 100 is also referred to as a “display image” for convenience. Moreover, emitting image light generated based on image data is also referred to as “displaying an image”.

  The head-mounted display device 100 includes an image display unit 20 that allows a user to visually recognize a virtual image when mounted on the user's head, and a control unit 10 (controller 10) that controls the image display unit 20. I have.

  The image display unit 20 is a mounting body that is mounted on the user's head, and has a glasses shape in the present embodiment. The image display unit 20 includes a right holding unit 21, a right display driving unit 22, a left holding unit 23, a left display driving unit 24, a right optical image display unit 26, a left optical image display unit 28, and a camera 61. And microphones 62 and 64. Each of the right optical image display unit 26 and the left optical image display unit 28 is disposed so as to be positioned in front of the right and left eyes of the user when the user wears the image display unit 20. One end of the right optical image display unit 26 and one end of the left optical image display unit 28 are connected to each other at a position corresponding to the eyebrow of the user when the user wears the image display unit 20.

  The right holding unit 21 extends from the end ER which is the other end of the right optical image display unit 26 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member. Similarly, the left holding unit 23 extends from the end EL which is the other end of the left optical image display unit 28 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member provided. The right holding unit 21 and the left holding unit 23 hold the image display unit 20 on the user's head like a temple of glasses.

  The right display drive unit 22 and the left display drive unit 24 are disposed on the side facing the user's head when the user wears the image display unit 20. Hereinafter, the right holding unit 21 and the left holding unit 23 are collectively referred to simply as “holding unit”, and the right display driving unit 22 and the left display driving unit 24 are collectively referred to simply as “display driving unit”. The right optical image display unit 26 and the left optical image display unit 28 are collectively referred to simply as “optical image display unit”.

  The display driving units 22 and 24 include liquid crystal displays 241 and 242 (hereinafter referred to as “LCDs 241 and 242”), projection optical systems 251 and 252 and the like (see FIG. 2). Details of the configuration of the display driving units 22 and 24 will be described later. The optical image display units 26 and 28 as optical members include light guide plates 261 and 262 (see FIG. 2) and a light control plate. The light guide plates 261 and 262 are formed of a light transmissive resin material or the like, and guide the image light output from the display driving units 22 and 24 to the eyes of the user. The light control plate is a thin plate-like optical element, and is arranged so as to cover the front side of the image display unit 20 which is the side opposite to the user's eye side. The light control plate protects the light guide plates 261 and 262 and suppresses damage to the light guide plates 261 and 262 and adhesion of dirt. In addition, by adjusting the light transmittance of the light control plate, it is possible to adjust the amount of external light entering the user's eyes and adjust the ease of visual recognition of the virtual image. The light control plate can be omitted.

  The camera 61 is disposed at a position corresponding to the user's eyebrow when the user wears the image display unit 20. The camera 61 captures an outside scene that is an external scenery in a direction opposite to the user's eye side, and acquires an outside scene image. The camera 61 in the present embodiment is a monocular camera, but may be a stereo camera. Note that the user can visually recognize the outside scene transmitted through the light guide plates 261 and 262 of the image display unit 20 separately from the outside scene image acquired by the camera 61. Further, the range of the outside scene image acquired by the camera 61 and the range of the outside scene that the user can see through the light guide plates 261 and 262 may be the same or different.

  The right microphone 62 is arranged on the opposite side of the right display drive unit 22 in the right holding unit 21. The left microphone 64 is disposed on the opposite side of the left display driving unit 24 in the left holding unit 23. Since the right microphone 62 and the left microphone 64 are arranged at different positions with respect to the image display unit 20, the external volume that is the volume of the external sound acquired by the right microphone 62 and the external volume that the left microphone 64 acquires are Is different. Note that “speech” in this specification represents the meaning of “sound” in a broad sense including not only human voice but also mechanical sound and the like. The right microphone 62 and the left microphone 64 correspond to the sound acquisition unit in the claims.

  The image display unit 20 further includes a connection unit 40 for connecting the image display unit 20 to the control unit 10. The connection unit 40 includes a main body cord 48, a right cord 42, a left cord 44, and a connecting member 46 that are connected to the control unit 10. The right cord 42 and the left cord 44 are codes in which the main body cord 48 is branched into two. The right cord 42 is inserted into the casing of the right holding unit 21 from the distal end AP in the extending direction of the right holding unit 21 and connected to the right display driving unit 22. Similarly, the left cord 44 is inserted into the housing of the left holding unit 23 from the distal end AP in the extending direction of the left holding unit 23 and connected to the left display driving unit 24. The connecting member 46 is provided at a branch point between the main body cord 48, the right cord 42 and the left cord 44, and has a jack for connecting the earphone plug 30. A right earphone 32 and a left earphone 34 extend from the earphone plug 30. The right earphone 32 and the left earphone 34 correspond to a sound output unit in the claims.

  The image display unit 20 and the control unit 10 transmit various signals via the connection unit 40. A connector (not shown) that fits each other is provided at each of the end of the main body cord 48 opposite to the connecting member 46 and the control unit 10. By fitting / releasing the connector of the main body cord 48 and the connector of the control unit 10, the control unit 10 and the image display unit 20 are connected or disconnected. For the right cord 42, the left cord 44, and the main body cord 48, for example, a metal cable or an optical fiber can be adopted.

  The control unit 10 is a device for controlling the head-mounted display device 100. The control unit 10 includes a determination key 11, a lighting unit 12, a display switching key 13, a track pad 14, a luminance switching key 15, a direction key 16, a menu key 17, and a power switch 18. Yes. The determination key 11 detects a pressing operation and outputs a signal for determining the content operated by the control unit 10. The lighting unit 12 notifies the operation state of the head-mounted display device 100 by its light emission state. Examples of the operating state of the head-mounted display device 100 include power ON / OFF. For example, an LED (Light Emitting Diode) is used as the lighting unit 12. The display switching key 13 detects a pressing operation and outputs a signal for switching the display mode of the content video between 3D and 2D, for example. The track pad 14 detects the operation of the user's finger on the operation surface of the track pad 14 and outputs a signal corresponding to the detected content. As the track pad 14, various track pads such as an electrostatic type, a pressure detection type, and an optical type can be adopted. The luminance switching key 15 detects a pressing operation and outputs a signal for increasing or decreasing the luminance of the image display unit 20. The direction key 16 detects a pressing operation on a key corresponding to the up / down / left / right direction, and outputs a signal corresponding to the detected content. The power switch 18 switches the power-on state of the head-mounted display device 100 by detecting a slide operation of the switch.

  FIG. 2 is a block diagram functionally showing the configuration of the head-mounted display device 100. As shown in FIG. 2, the control unit 10 includes a CPU 140, an operation unit 135, an input information acquisition unit 110, a storage unit 120, a power supply 130, an interface 180, a transmission unit 51 (Tx51), and a transmission unit 52. (Tx52). The operation unit 135 receives an operation by the user and includes an enter key 11, a display switch key 13, a track pad 14, a luminance switch key 15, a direction key 16, a menu key 17, and a power switch 18.

  The input information acquisition unit 110 acquires a signal corresponding to an operation input by the user. As a signal corresponding to the operation input, for example, there is an operation input to the track pad 14, the direction key 16, and the power switch 18. The power supply 130 supplies power to each part of the head-mounted display device 100. As the power supply 130, for example, a secondary battery can be used. The storage unit 120 stores various computer programs. The storage unit 120 is configured by a ROM, a RAM, or the like. The CPU 140 reads out and executes the computer program stored in the storage unit 120, thereby operating the operating system 150 (OS 150), the image processing unit 160, the sound processing unit 170, the conversion unit 185, the direction determination unit 161, and the display control unit. 190.

  The image processing unit 160 acquires an image signal included in the content. The image processing unit 160 separates synchronization signals such as a vertical synchronization signal VSync and a horizontal synchronization signal HSync from the acquired image signal. Further, the image processing unit 160 generates a clock signal PCLK using a PLL (Phase Locked Loop) circuit or the like (not shown) according to the period of the separated vertical synchronization signal VSync and horizontal synchronization signal HSync. The image processing unit 160 converts the analog image signal from which the synchronization signal is separated into a digital image signal using an A / D conversion circuit or the like (not shown). Thereafter, the image processing unit 160 stores the converted digital image signal as image data Data (RGB data) of the target image in the DRAM in the storage unit 120 for each frame. Note that the image processing unit 160 may execute image processing such as various tone correction processing such as resolution conversion processing, brightness and saturation adjustment, and keystone correction processing on the image data as necessary. .

  The image processing unit 160 transmits the generated clock signal PCLK, vertical synchronization signal VSync, horizontal synchronization signal HSync, and image data Data stored in the DRAM in the storage unit 120 via the transmission units 51 and 52, respectively. To do. The image data Data transmitted via the transmission unit 51 is also referred to as “right eye image data”, and the image data Data transmitted via the transmission unit 52 is also referred to as “left eye image data”. The transmission units 51 and 52 function as a transceiver for serial transmission between the control unit 10 and the image display unit 20.

  The sound processing unit 170 performs various processes on the external sound to be acquired and the output sound that is the sound to be output. The audio processing unit 170 acquires an audio signal included in the content, amplifies the acquired audio signal, and a speaker (not shown) in the right earphone 32 and a speaker (not shown) connected to the connecting member 46 ( (Not shown). For example, when the Dolby (registered trademark) system is adopted, processing on the audio signal is performed, and different sounds with different frequencies or the like are output from the right earphone 32 and the left earphone 34, for example.

  In addition, the sound processing unit 170 specifies the external sound volume acquired by the microphones 62 and 64 and the output sound volume that is the sound volume of the output sound as a numerical value of decibel (dB), or is included in the external sound and stored in the storage unit 120 in advance. A specific sound such as a stored warning sound is detected. The detection of a specific voice included in the external voice is performed by collating the waveform of the frequency spectrum such as a warning sound stored in advance in the storage unit 120 with the waveform of the frequency spectrum of the external voice acquired during a predetermined period. It is done by doing. The voice processing unit 170 can also discriminate between human voices and other voices by collating waveforms of frequency spectra. In addition, the sound processing unit 170 analyzes the frequency spectrum of the acquired external sound and calculates the intensity for each frequency. In the present embodiment, the sound processing unit 170 acquires the external sound volume every second, and in the analysis of the frequency spectrum, analyzes the external sound acquired per second.

  Also, the sound processing unit 170 determines whether or not the external volume acquired at a certain time is equal to or higher than a predetermined volume, or the external volume acquired at a certain time and the external volume acquired one second before that. The output volume is adjusted based on the change. The sound processing unit 170 adjusts the output volume based on a change in the frequency spectrum of the external sound acquired in one second from a certain time point with respect to the frequency spectrum of the external sound acquired in the immediately preceding one second. In addition, the sound processing unit 170 adjusts the output volume based on specific sound included in the detected external sound.

  The sound processing unit 170 estimates the direction of the external sound from the image display unit 20 to the sound source based on the external volume acquired by the right microphone 62 and the external volume acquired by the left microphone 64. Specifically, in this embodiment, when the volume acquired by the right microphone 62 is larger than the volume acquired by the left microphone 64, the audio processing unit 170 estimates that there is a sound source in the right direction with the user at the center. . The voice processing unit 170 corresponds to a sound control unit, an analysis unit, a specific sound detection unit, and a sound source direction estimation unit in the claims.

  The conversion unit 185 converts the sound acquired by the microphones 62 and 64 into a character image in which the sound is represented by characters. The direction determination unit 161 specifies the angular velocity and the amount of change in the angle of the user's head based on the change in the movement of the image display unit 20 detected by the 9-axis sensor 66 described later.

  The display control unit 190 generates control signals for controlling the right display drive unit 22 and the left display drive unit 24. Specifically, the display control unit 190 controls driving of the right LCD 241 by the right LCD control unit 211, driving ON / OFF of the right backlight 221 by the right backlight control unit 201, and left LCD control unit according to control signals. The left LCD 242 driving ON / OFF by 212, the left backlight 222 driving ON / OFF by the left backlight control unit 202, and the like are individually controlled. Thus, the display control unit 190 controls the generation and emission of image light by the right display driving unit 22 and the left display driving unit 24, respectively. For example, the display control unit 190 may cause both the right display driving unit 22 and the left display driving unit 24 to generate image light, generate only one image light, or neither may generate image light. The display control unit 190 transmits control signals for the right LCD control unit 211 and the left LCD control unit 212 via the transmission units 51 and 52, respectively. In addition, the display control unit 190 transmits control signals to the right backlight control unit 201 and the left backlight control unit 202, respectively.

  Further, the display control unit 190 sets the character size of the character image converted by the direction determination unit 161 based on the external volume acquired by the microphones 62 and 64, and represents the character image in which the character size is set. It transmits to the image display part 20 as a control signal. The image display unit 20 generates image light representing a character image based on the transmitted control signal and emits it to the user's eyes, so that the user can visually recognize the sound as a character image.

  The interface 180 is an interface for connecting various external devices OA that are content supply sources to the control unit 10. Examples of the external device OA include a personal computer (PC), a mobile phone terminal, and a game terminal. As the interface 180, for example, a USB interface, a micro USB interface, a memory card interface, or the like can be used.

  The image display unit 20 includes a right display drive unit 22, a left display drive unit 24, a right light guide plate 261 as a right optical image display unit 26, a left light guide plate 262 as a left optical image display unit 28, and a camera 61. A 9-axis sensor 66, a right microphone 62, and a left microphone 64.

  The 9-axis sensor 66 is a motion sensor that detects acceleration (3 axes), angular velocity (3 axes), and geomagnetism (3 axes). Since the 9-axis sensor 66 is provided in the image display unit 20, when the image display unit 20 is mounted on the user's head, the movement of the user's head is detected. Since the orientation of the image display unit 20 is known from the detected movement of the user's head, the direction determination unit 161 can estimate the user's line-of-sight direction. The direction determination unit 161 and the 9-axis sensor 66 correspond to a motion detection unit in claims. The microphones 62 and 64 transmit the acquired audio signal to the conversion unit 185 and the audio processing unit 170.

  The right display driving unit 22 includes a receiving unit 53 (Rx53), a right backlight control unit 201 (right BL control unit 201) and a right backlight 221 (right BL221) that function as a light source, and a right LCD that functions as a display element. A control unit 211, a right LCD 241 and a right projection optical system 251 are included. The right backlight control unit 201 and the right backlight 221 function as a light source. The right LCD control unit 211 and the right LCD 241 function as display elements. The right backlight control unit 201, the right LCD control unit 211, the right backlight 221 and the right LCD 241 are collectively referred to as “image light generation unit”.

  The receiving unit 53 functions as a receiver for serial transmission between the control unit 10 and the image display unit 20. The right backlight control unit 201 drives the right backlight 221 based on the input control signal. The right backlight 221 is a light emitter such as an LED or electroluminescence (EL). The right LCD control unit 211 drives the right LCD 241 based on the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the right-eye image data input via the reception unit 53. The right LCD 241 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

  The right projection optical system 251 is configured by a collimator lens that converts the image light emitted from the right LCD 241 to light beams in a parallel state. The right light guide plate 261 as the right optical image display unit 26 guides the image light output from the right projection optical system 251 to the right eye RE of the user while reflecting the image light along a predetermined optical path. The right projection optical system 251 and the right light guide plate 261 are collectively referred to as “light guide unit”.

  The left display drive unit 24 has the same configuration as the right display drive unit 22. The left display driving unit 24 includes a receiving unit 54 (Rx54), a left backlight control unit 202 (left BL control unit 202) and a left backlight 222 (left BL202) that function as a light source, and a left LCD that functions as a display element. A control unit 212 and a left LCD 242 and a left projection optical system 252 are included. The left backlight control unit 202 and the left backlight 222 function as a light source. The left LCD control unit 212 and the left LCD 242 function as display elements. The left backlight control unit 202, the left LCD control unit 212, the left backlight 222, and the left LCD 242 are also collectively referred to as “image light generation unit”. The left projection optical system 252 is configured by a collimating lens that converts the image light emitted from the left LCD 242 into a light beam in a parallel state. The left light guide plate 262 as the left optical image display unit 28 guides the image light output from the left projection optical system 252 to the left eye LE of the user while reflecting the image light along a predetermined optical path. The left projection optical system 252 and the left light guide plate 262 are collectively referred to as “light guide unit”.

  FIG. 3 is an explanatory diagram illustrating a state in which image light is emitted by the image light generation unit. The right LCD 241 changes the transmittance of the light transmitted through the right LCD 241 by driving the liquid crystal at each pixel position arranged in a matrix, thereby changing the illumination light IL emitted from the right backlight 221 into an image. Is modulated into an effective image light PL representing The same applies to the left side. As shown in FIG. 4, the backlight system is used in the present embodiment, but it may be configured to emit image light using a front light system or a reflection system.

A-2. Output volume adjustment processing:
FIG. 4 is an explanatory diagram showing the flow of output volume adjustment processing. The output volume adjustment process is a process for adjusting the output volume output by each unit of the control unit 10 via the earphones 32 and 34 based on the change in the external sound acquired by the microphones 62 and 64. First, the microphones 62 and 64 acquire external sound (step S310). The sound processing unit 170 performs sound volume acquisition per second, frequency spectrum analysis, and specific sound detection for the external sound acquired by the microphones 62 and 64.

  Next, the sound processing unit 170 monitors whether a specific sound such as a warning sound is detected in the external sound (step S320). When a specific sound is detected (step S320: YES), the sound processing unit 170 decreases the output volume output from the earphones 32 and 34 (step S360). In this embodiment, the audio processing unit 170 lowers the output volume to a preset volume, but in other embodiments, the volume to be lowered may be set freely by the user, or based on the external volume The volume may be set. Further, it may be set based on the output volume and the external volume.

  When the output volume is lowered, next, the display control unit 190 displays a text image representing the acquired external sound on the image display unit 20 (step S370). FIG. 5 is an explanatory diagram showing an example of the visual field VR visually recognized by the user. FIG. 5 shows a visual field VR visually recognized by the user and a maximum image display area PN that is an area where the image display unit 20 can display an image. As shown in FIG. 5, the user can visually recognize a teacher TE, a plurality of students ST receiving a lecture of the teacher TE, and a text image TX1 representing the acquired external voice as a character image as an outside scene. . The user views the voice acquired by the lecture microphone attached to the teacher TE as output voice from the earphones 32 and 34 via the interface 180, and visually recognizes the character written on the whiteboard WB by the teacher TE. In the present embodiment, in the process of step S330, an announcement sound “ping-pong pampong” flowing before the announcement is detected as a specific sound, and the conversion unit 185 converts the external sound acquired by the microphones 62 and 64 into the external sound. Is converted to a character image representing the character as a character. The display control unit 190 displays the converted character image as the text image TX1 in the maximum image display area PN. The volume of the external audio “Ping Pong Pampong” included in the announcement sound is larger than the volume of the external audio “Now the earthquake has occurred.” Therefore, as shown in FIG. 5, the display control unit 190 increases the size of each character in the character image representing “An earthquake has occurred” rather than the character image representing the sound of “ping-pong pampong”. .

  The announcement sound is output from the speaker SP shown in FIG. 5, and the left microphone 64 is closer to the position of the speaker SP than the right microphone 62, so that the external volume acquired is larger than that of the right microphone 62. Therefore, the audio processing unit 170 determines that the speaker SP, which is a sound source of external audio, is on the left side with respect to the user. In the maximum image display area PN, the display control unit 190 displays the text image TX1 in a peripheral part that excludes the central part and increases in the part that occupies the left part of the center. In the present embodiment, the maximum image display area PN has 960 horizontal pixels and 540 vertical pixels. The maximum image display area PN corresponds to an image formable area in claims. The portion excluding the central portion in the maximum image display region PN refers to a region excluding the region having 320 horizontal pixels and 180 vertical pixels, and the vertical number of horizontal pixels 480 and the vertical region. It is more preferable that the region excluding the region of 270 pixels. In the present embodiment, the part excluding the center is also simply referred to as “peripheral part”, and the part excluding the center does not necessarily indicate the vicinity of the outside of the maximum image display area PN.

  Next, the sound processing unit 170 monitors whether the detected specific sound has returned to the original state where it is not detected (step S380). When the specific sound is not detected (step S380: YES), the sound processing unit 170 returns the output volume reduced in the process of step S360 to the output volume before the decrease (step S390). Thereafter, the control unit 10 monitors an operation for ending the output audio adjustment process (step S400). When the operation for ending the output volume adjustment process is not detected (step S400: NO), the sound processing unit 170 again monitors whether a specific sound such as a warning sound is detected in the external sound (step S320). ). When an operation for ending the output volume adjustment processing is detected (step S400: YES), the control unit 10 hides the text image TX1 displayed in the maximum image display area PN by the display control unit 190, and the control unit 10 Then, the output volume adjustment process is terminated.

  In the process of step S380, when a specific sound is detected continuously (step S380: NO), the control unit 10 monitors an operation for ending the output sound adjustment process (step S410). When the operation for ending the output volume adjustment process is not detected (step S380: NO), the voice processing unit 170 continues to monitor whether the original state where the detected specific voice is not detected is restored (step S380). . When an operation for ending the output volume adjustment process is detected (step S410: YES), the control unit 10 ends the output volume adjustment process.

  If a specific sound is not detected in the process of step 320 (step S320: NO), the sound processing unit 170 monitors whether the acquired external sound volume is changed and the sound volume is equal to or higher than a predetermined threshold. (Step S330). FIG. 6 is an explanatory diagram illustrating an example of a change in the volume of the acquired external sound. FIG. 6 shows a transition Nout (dB) of the volume of the external sound acquired by the microphones 62 and 64 and a predetermined volume threshold Nth (dB). As shown in FIG. 6, the acquired external volume is a volume smaller than the volume threshold Nth until time t1, and is a volume equal to or higher than the volume threshold Nth at time t2 one second after time t1. In this case, the volume changes from the volume N1 at time t1 to the volume N2 at time t2, and the volume N2 is greater than or equal to the volume threshold Nth (step S330 in FIG. 4: YES). Each part of performs the process after step S360.

  In the process of step S330, if the external volume does not change or the volume is smaller than the volume threshold value Nth even if the external volume changes (step S330: NO), the audio processing unit 170 specifies the external audio. It is monitored whether the frequency is detected (step S340). FIG. 7 is an explanatory diagram showing an example of the frequency of the acquired external audio. FIG. 7 shows a frequency spectrum obtained by analyzing the external sound acquired in each of the period T1 and the period T2 after the period T1. As shown in FIG. 7, when a frequency of a specific frequency band fth is detected in the change from the frequency spectrum fT1 in the period T1 to the frequency spectrum fT2 in the period T2 (step S340: YES), the control unit 10 Each unit performs the processing after step S360. Note that it is generally known that sound having a frequency of 3000 hertz (Hz) is easy for humans to hear even when the volume is low. Therefore, in another embodiment, in the case of a sound having a frequency close to 20 Hz or 20 000 Hz out of 20 Hz to 20000 Hz, which is a frequency that humans can hear, the output sound is output even if the external sound has the same volume. It may be small.

  In the process of step S340, when a specific frequency is not detected in the external sound (step S340: NO), the direction determination unit 161 in a state where the external sound is changed and a human voice is detected in the external sound. Monitors the detection of the movement of the user's head (step S350). While the voice processing unit 170 detects a human voice in the external voice, the direction determination unit 161 detects a change amount equal to or greater than a predetermined threshold in at least one of the angular velocity of the head and the change amount of the angle. Then (step S350: YES), each unit of the control unit 10 performs the processing after step S360. When the human voice is not detected in the process of step S350, or when the amount of change in the head movement equal to or greater than the threshold is not detected (step S350: NO), the voice processing unit 170 again converts the voice into an external voice. It is monitored whether a specific sound such as a warning sound is detected (step S320).

  As described above, in the head-mounted display device 100 according to the present embodiment, the audio processing unit 170 outputs audio output from the earphones 32 and 34 based on the change in external audio acquired by the microphones 62 and 64. Adjust the volume. Therefore, in the head-mounted display device 100, the volume of the output sound is reduced when the volume of the external sound or the like changes, so that the user can watch the sound of the content supplied via the interface 180. , Can hear external audio and can recognize external changes quickly.

  Further, in the head-mounted display device 100 according to the present embodiment, the conversion unit 185 converts the sound acquired by the microphones 62 and 64 into a character image in which the sound is represented by characters. The display control unit 190 transmits a control signal representing a character image to the image display unit 20, and image light representing the character image is generated by the image display unit 20. Therefore, in the head-mounted display device 100, the user can visually recognize the external sound acquired by the microphones 62 and 64 as the text image TX1 representing the external sound, and can make the user recognize the external sound in more detail. .

  In the head-mounted display device 100 according to this embodiment, the display control unit 190 sets the character size of the character image based on the external volume acquired by the microphones 62 and 64, and sets the character size. A control signal representing the character image is transmitted to the image display unit 20. Therefore, in the head-mounted display device 100, the character size of the text image TX1 is set based on the volume of the external sound, so that the user can watch the external sound and the difference in the external sound volume is text. Even the character size of the image TX1 can be visually recognized, and the external sound can be recognized in more detail.

  In the head-mounted display device 100 according to the present embodiment, the display control unit 190 includes the text image TX1 in the peripheral portion excluding the central portion in the maximum image display region PN, which is a region where the image display unit 20 can display an image. Is displayed. Therefore, in the head-mounted display device 100, since the character image representing the external voice is not displayed at the central portion in the maximum image display area PN, the user's visual field VR is not unnecessarily disturbed, and the user can In addition, it is possible to visually recognize an outside scene that is transmitted through the image display unit 20 and to visually recognize a character image, thereby improving user convenience.

  In the head-mounted display device 100 according to the present embodiment, the right microphone 62 and the left microphone 64 are arranged on the image display unit 20 at different positions. The sound processing unit 170 estimates the direction of the external sound from the image display unit 20 to the sound source based on the external volume acquired by the right microphone 62 and the external volume acquired by the left microphone 64. The sound processing unit 170 estimates that the speaker SP is on the left side with respect to the user, and displays the text image TX1 in a portion occupying the left portion of the center in the maximum image display region PN. Therefore, in the head-mounted display device 100, in the user's visual field VR, it is possible to make the user recognize the position of the sound source by visually recognizing a character image representing the external sound as a character near the sound source.

  Further, in the head-mounted display device 100 of the present embodiment, the audio processing unit 170 changes the output volume when the acquired volume changes from the volume N1 less than the volume threshold Nth to the volume N2 greater than or equal to the volume threshold Nth. Lower. Therefore, in the head-mounted display device 100, even when the volume of the content sound is high, the output sound volume is lowered when the external sound volume is high. Even if it is, you can hear the external sound more clearly.

  Further, in the head-mounted display device 100 according to the present embodiment, the sound processing unit 170 detects specific sound such as a warning sound included in the acquired external sound, and specifies the specific sound included in the detected external sound. The output sound is adjusted based on the sound. Therefore, in this head-mounted display device 100, when the user detects a specific sound that the user wants to detect, the output volume is lowered, so that the user can hear only the necessary sound included in the external sound, User convenience is improved.

  Further, in the head-mounted display device 100 of the present embodiment, the 9-axis sensor 66 detects the movement of the user's head, and based on the change in the movement of the image display unit 20 detected by the direction determination unit 161. Then, the angular velocity and the amount of change of the angle in the user's head are specified. The sound processing unit 170 reduces the output volume based on the human voice included in the external sound and the amount of change equal to or greater than a predetermined threshold in the movement of the user's head. For this reason, in this head-mounted display device 100, the output volume is adjusted based on two indicators, the change in the external sound and the change in the user's line of sight, so the output volume is adjusted only by the change in the external sound. Compared with the case where it is done, unnecessary adjustment is suppressed and the convenience of the user is improved.

  In the head-mounted display device 100 of the present embodiment, the sound processing unit 170 analyzes the frequency spectrum of the acquired external sound, calculates the intensity for each frequency, and calculates the frequency spectrum of the analyzed external sound. Adjust the output audio based on the change. Therefore, in the head-mounted display device 100, when an abnormal sound having a different frequency is detected in the acquired external sound, the user can recognize the abnormal sound or the like, which is convenient for the user. improves.

B. Second embodiment:
FIG. 8 is a block diagram functionally showing the configuration of 100b in the second embodiment. As shown in FIG. 8, in the second embodiment, an environment information sensor 67 is formed in the image display unit 20 b in the present embodiment instead of the 9-axis sensor 66, and the CPU 140 b of the control unit 10 b replaces the direction determination unit 161. An environment information determination unit 162 and an erroneous operation determination unit 163 are included.

  The environment information sensor 67 detects an external temperature as information on the environment in which the head-mounted display device 100b is used. The environment information determination unit 162 compares the detected external temperature with a predetermined threshold value. The erroneous operation determination unit 163 determines whether the operation received by the operation unit 135 is the same as a predetermined operation for controlling the head-mounted display device 100b. When the result of the comparison by the environment information determination unit 162 and the result of the operation determined by the erroneous operation determination unit 163 are predetermined results, the user is allowed to recognize information such as advice based on the predetermined results. The predetermined information is transmitted to the conversion unit 185 and the audio processing unit 170. The conversion unit 185 converts the information transmitted from the environment information determination unit 162 into a character image represented by characters. The sound processing unit 170 converts the information transmitted from the environment information determination unit 162 into a sound signal and transmits the sound signal to the microphones 62 and 64. Note that at least one of the environment information sensor 67 and the operation unit 135 in the second embodiment corresponds to an information acquisition unit in the claims.

  FIG. 9 is an explanatory diagram showing a flow of information notification processing in the second embodiment. The information notification process is a process of notifying the user of information such as advice as a voice or text image when the detected environment information or an operation determined to be an erroneous operation by the operation unit 135 is received.

  In the information notification process, first, the environmental information determination unit 162 acquires an external temperature as environmental information (step S510). Next, the environment information determination unit 162 determines whether or not the acquired external temperature meets a preset condition (step S520). In the second embodiment, the preset conditions are set such that the external temperature is 40 degrees Celsius (40 ° C.) or more and the case where the external temperature is minus 10 degrees Celsius (−10 ° C.) or less. If the external temperature does not satisfy the condition (step S520: NO), has the erroneous operation determination unit 163 received an erroneous operation different from the predetermined operation for the operation unit 135 to operate the head-mounted display device 100b? It is determined whether or not (step S530). As an erroneous operation, for example, when one of a plurality of options displayed in the maximum image display area PN is selected, the track pad 14, the direction key 16, and the enter key 11 should be operated. Regardless, this is an operation in which another key is selected or the enter key 11 is repeatedly hit a predetermined number of times within a predetermined time. If it is determined that no erroneous operation has been received by the operation unit 135 (step S530: NO), the environmental information determination unit 162 continues to monitor whether the external temperature meets a preset condition ( Step S520).

  When an operation error is received by the operation unit 135 (step S530: YES), or when the external temperature meets a preset condition (step S520: YES), the audio processing unit 170 is the environment information determination unit 162. Alternatively, based on the information transmitted from the erroneous operation determination unit 163, the microphones 62 and 64 are caused to output sounds of the detected contents (hereinafter also simply referred to as “advice”) (step S540). That is, the microphones 62 and 64 output sound that restricts the use of the head-mounted display device 100b. Next, the display control unit 190 causes the image display unit 20b to display a text image that represents the advice converted by the conversion unit 185 based on the information transmitted from the environment information determination unit 162 or the erroneous operation determination unit 163 (step S550). ).

  FIG. 10 is an explanatory diagram illustrating an example of the visual field VR2 visually recognized by the user. FIG. 10 shows a text image TX11 indicating that an external temperature of 45 degrees Celsius corresponding to a preset condition is detected and the head-mounted display device 100b is removed. Please remove "is visually recognized by the user. As shown in FIG. 10, the user visually recognizes the outside scene SC and the display image VI displayed in the maximum image display area PN. In the maximum image display area PN, the user can visually recognize the transmitted outside scene SC. The display image VI is a content video in which the automobile is traveling. The display image VI includes a text image TX11. In addition, the text image TX11 is displayed in the maximum image display area PN, and the microphones 62 and 64 repeat the sound “Please remove HMD because of high fever”, which means advice to the user, at regular intervals. Output.

  When the sound having the same content as the text image TX11 is output from the microphones 62 and 64 (step S540 in FIG. 9) and the text image TX11 is displayed in the maximum image display area PN (step S550), the environment information determination unit 162 and erroneous operation are performed. The determination unit 163 determines whether or not at least one of the environment information and the operation received by the operation unit 135 continues to satisfy the condition (step S560). For example, when it is determined that the external temperature is less than 40 degrees Celsius and greater than minus 10 degrees Celsius (step S560: NO), the voice processing unit 170 and the microphones 62 and 64 end the output of the advice voice. At the same time, the display control unit 190 hides the text image TX11 (step S570). Thereafter, the control unit 10b monitors an operation for ending the information notification process (step S580).

  In the process of step S560, when at least one of the environmental information and the operation received by the operation unit 135 satisfies the condition (step S560: YES), the control unit 10b performs an operation to end the information notification process. Is monitored (step S590).

  As described above, in the head-mounted display device 100b according to the second embodiment, the environment information sensor 67 detects the external temperature as information on the environment in which the head-mounted display device 100b is used, and the operation unit 135 receives a predetermined operation for controlling the head-mounted display device 100b. When the detected external temperature meets a preset condition, the environmental information determination unit 162 of the control unit 10b performs voice output of advice and display of the text image TX11, or erroneous operation of the control unit 10b. When the operation unit 135 accepts a word operation, the determination unit 163 performs voice output of advice and displays the text image TX11. Therefore, in the head-mounted display device 100b according to the second embodiment, the head-mounted display device 100b for advice or the like is based on the external environment or the operation content received by the head-mounted display device 100b. It is possible to transmit an instruction regarding control of the user to the user, and to allow the user to recognize an environmental change or an erroneous operation.

  In the head-mounted display device 100b according to the second embodiment, the environment information determination unit 162 or the erroneous operation determination unit 163 in the control unit 10b outputs a voice of advice by the voice processing unit 170 and the microphones 62 and 63. Therefore, in the head-mounted display device 100b according to the second embodiment, the user can be made aware of environmental changes and erroneous operations without performing an operation such as the user visually recognizing a specific location. User convenience is improved.

  In the head-mounted display device 100b according to the second embodiment, when the operation unit 135 receives an erroneous operation different from a predetermined operation for operating the head-mounted display device 100b, the erroneous operation determination unit 163 The voice of the advice is output and the text image TX11 is displayed in the maximum image display area PN. Therefore, in the head-mounted display device 100b according to the second embodiment, when the formal operation is not performed, the user recognizes that the user is performing an erroneous operation. The convenience of the user is improved.

  Further, in the head-mounted display device 100b according to the second embodiment, the voice processing unit 170 and the display control unit 190 in the control unit 10b use a voice to advise the user to limit the use of the head-mounted display device 100b. At the same time, the text image TX11 is displayed in the maximum image display area PN. Therefore, in the head-mounted display device 100b according to the second embodiment, the user is notified of information related to the control of the head-mounted display device 100b, so that the user can change the head based on a change in the external environment or an erroneous operation. Use of the wearable display device 100b can be stopped, and user convenience is improved.

  In the head-mounted display device 100b of the second embodiment, the conversion unit 185 converts the advice or the like into a character image represented by characters. The display control unit 190 transmits a control signal representing a character image to the image display unit 20, and image light representing the character image is generated by the image display unit 20. Therefore, in the head-mounted display device 100b, the user can visually recognize the text and the like as the text image TX11 representing the advice and the like so that the advice and the like can be recognized in more detail.

C. Variation:
In addition, this invention is not limited to the said embodiment, It can implement in a various aspect in the range which does not deviate from the summary, For example, the following deformation | transformation is also possible.

C1. Modification 1:
In the above embodiment, the head-mounted display device 100 including the sound processing unit 170 and the image display unit 20 has been described as an example. However, the device including the sound processing unit 170 and the image display unit 20 is described. Various modifications can be made. FIG. 11 is an explanatory diagram showing an example of a visual field VR ′ visually recognized by the driver of the automobile. In this modification, as shown in FIG. 11, a head-up display (HUD) formed on a windshield of an automobile is used as an image display device that allows a driver driving the automobile to visually recognize a character image. As audio processing devices, car audio mounted on a car and microphones for acquiring external sound attached to the front, rear, left and right of the car are used.

  FIG. 11 shows a maximum image display area PN and a text image TX2 in which the acquired external sound is displayed as a character image in the maximum image display area PN. The driver is listening to music with the car audio installed in the car. The sound source of the external sound acquired by the microphone is an ambulance (not shown) estimated to be left front from the vehicle based on the sound volume acquired by the plurality of microphones. In this modification, when the external volume changes from the state where the external volume is lower than the volume threshold Nth to the volume threshold Nth or more by the sound emitted by the ambulance (“Peeper Paw” shown in FIG. 11), the sound for adjusting the volume of the car audio The processing unit 170 ′ decreases the volume of the music generated by the car audio. In the maximum image display area PN, the display control unit 190 displays a text image TX2 that is a character image representing a sound emitted by an ambulance. The text image TX2 is displayed in the upper left peripheral part in the maximum image display area PN. Note that the text image TX2 may not be displayed, and only the volume generated by the car audio may be reduced. Therefore, in this modified example, when there is some abnormality outside the automobile, it is easy for the driver of the automobile to recognize the abnormality, and the convenience of the driver is improved.

  Moreover, in the said embodiment, although it was an aspect provided with the image display part which can display the acquired external audio | voice as a character image, an image display part is not an essential structural requirement, and can change variously about the aspect of an audio processing apparatus. It is. For example, the audio processing device may be a portable music playback device that can play music content. When a user of a portable music playback device views the output sound of music content with a sealed earphone, external sound is acquired by a microphone formed in the portable music playback device, and the change of the external sound Based on this, the volume of the output sound may be set.

  In the above embodiment, the audio processing unit 170 performs the adjustment for decreasing the output sound based on the acquired change in the external sound, but may perform the adjustment for increasing the output sound. For example, when the user can view both the output sound and the external sound, the sound processing unit 170 adjusts to increase or decrease the output sound volume based on the difference between the external sound volume and the output sound volume. May be. In this modification, since the output volume is adjusted based on the difference between the external volume and the output volume, the user can view the output sound at a volume that reflects the user's intention, which is convenient for the user. Improves.

C2. Modification 2:
In the above embodiment, the volume of the output sound is adjusted based on the change of the external sound. However, various modifications can be made to the adjustment of the output sound volume. For example, the sound processing unit 170 may set the volume of the external sound acquired by the microphones 62 and 64 and output it from the earphones 32 and 34 as output sound. In this modification, when a specific sound such as a warning sound included in the external sound is detected with a volume lower than the output sound, the user can view the output sound with a volume larger than the external volume. , User convenience is improved.

C3. Modification 3:
In the above embodiment, the display control unit 190 sets the position for displaying the text image TX1 in the maximum image display area PN in association with the direction from the image display unit 20 to the external sound source. The position where the text image TX1 is displayed in the display area PN can be variously modified. For example, the head-mounted display device 100 may be configured such that only one microphone is arranged and the direction of the external sound source is not specified. Even if the direction of the external sound source can be specified, the display control unit 190 may set the position where the text image TX1 is displayed in the maximum image display area PN regardless of the direction of the external sound source.

  Also, various changes can be made to the size of each character of the character image displayed in the maximum image display area PN and the method of setting the size. The display control unit 190 may display each character in the character image in the maximum image display area PN with a predetermined size regardless of the external volume. The size of each character in the character image displayed in the maximum image display area PN may be set based on the frequency, the type of sound, and the amount of change in the movement of the user's head. In addition, the font of the character may be changed regardless of the size of the character.

C4. Modification 4:
In the above embodiment, the character image representing the external sound displayed in the maximum image display area PN is displayed in a predetermined manner. However, the setting of the displayed character image can be variously modified. When the user is listening to the output sound, the character image representing the external sound may be displayed as a character image different from that before the operation is performed by performing a predetermined operation on the operation unit 135.

  In the above embodiment, the microphones 62 and 64 are arranged at positions near both ears when the user wears the image display unit 20. However, the arrangement and structure of the microphones 62 and 64 are not limited thereto. Various modifications are possible. For example, the microphones 62 and 64 may be microphones having a mechanical structure that can change the orientation with respect to the image display unit 20 and having directivity. When the direction from the image display unit 20 to the sound source of the external sound can be estimated, the sound processing unit 170 can acquire the external sound in more detail by changing the direction of the microphones 62 and 64, and the external sound can be acquired. It becomes easy to detect the change of.

  In the above embodiment, the sound processing unit 170 detects a change in the external sound based on the frequency of the external sound. Therefore, the detection of a specific sound included in the external sound can be variously modified. For example, even if the voice is an external voice including a plurality of voices, the voice processing unit 170 may recognize and identify each voice. In this case, the sound processing unit 170 may be configured to adjust the external sound volume when a predetermined specific voice of one person is detected.

  In the above embodiment, the specific sound included in the external sound is detected and the output sound volume is adjusted. However, the specific sound may be detected and the output sound volume may be adjusted. For example, from the viewpoint of privacy protection, a specific word may not be viewed by the user by increasing the output volume. In addition, by registering specific words such as personal names in advance, the registered words may not be converted into character images even when voice is acquired. The same applies to the aspect in which the acquired external sound is converted as a character image representing the external sound, and a specific word may not be displayed on the image display unit 20 as a character image.

C5. Modification 5:
Moreover, in the said embodiment, although the output audio | voice was controlled based on the change of an external audio | voice, an output audio | voice may be controlled based on an external audio | voice. For example, it is in a state in which almost no external sound is always acquired, and control such as decreasing the volume of the output sound may be performed even if there is no change in the volume or frequency of the external sound. In this modified example, since the output sound is controlled even if the acquired external sound does not change, the user can listen to the output sound having an appropriate volume and frequency.

  Further, when the camera 61 acquires a predetermined human voice, the audio processing unit 170 changes the frequency of the acquired human voice to the output voice of the earphones 32 and 34. A mode in which a human voice is output and an output volume other than the voice of the person whose frequency is changed may be reduced. In this modified example, when a voice having a frequency that is difficult for a person to hear is acquired, the user can easily recognize the external voice in order to easily view the acquired voice. Further, when external sounds having the same frequency are acquired from a plurality of sound sources, the frequencies of the external sounds acquired from several sound sources are changed, and the external sounds with the changed frequencies are output from the earphones 32 and 34. May be. In general, when a person acquires a plurality of sounds having frequencies close to each other, it is difficult to hear a sound having a low frequency due to frequency masking. Therefore, in this modification, it is easy to make the user recognize the sound acquired from a plurality of sound sources by suppressing the influence of frequency masking.

C6. Modification 6:
In the second embodiment, the external temperature is detected by the environmental information sensor 67 as the environmental information in which the head-mounted display device 100b is used. However, the detected environmental information is not limited to this, and various information is available. It can be deformed. The detected environment information may be, for example, humidity, magnetism, components in the air, or the degree of wetting of the head-mounted display device 100b. Humidity may be measured by a humidity sensor, or magnetic strength may be measured by a magnetic sensor. Further, as a component in the air, carbon monoxide in the air may be measured with a carbon monoxide meter, or a minute particulate matter (for example, PM2.5) contained in the atmosphere is measured with a concentration measuring device. May be. Further, when the user wears the image display unit 20b, an image display is formed by forming a sensor that detects water droplets in a direction opposite to the direction facing the user (hereinafter, also simply referred to as “outward”). The adhesion of the liquid in the part 20b may be detected. The sensor that detects water droplets can detect the presence or absence of water droplets by emitting infrared rays outward from the image display unit 20b and detecting reflected light that varies depending on the presence or absence of water droplets. In the head-mounted display device 100b according to this modification, it is possible to give advice to the user based on a change in the environment outside the head-mounted display device 100b. In addition, it is possible to make the user recognize in an easy-to-understand manner.

  The environment information sensor 67 may detect light of a specific wavelength as environment information. The ultraviolet ray intensity meter may detect ultraviolet rays having a wavelength range of 200 nanometers (nm) to 440 nm, and the user may be advised of sunburn or the like. Further, when cesium (Cs) equal to or higher than a predetermined threshold is detected by the radiation detector, a user may be advised regarding radiation.

  Further, advice or the like may be given to the user by changing the control unit 10 or the image display unit 20 itself in the head-mounted display device 100. For example, when the 9-axis sensor 66 in the image display unit 20 detects an acceleration equal to or higher than a predetermined threshold, the control unit 10 may give advice or the like to the user by voice or an image. In the head-mounted display device 100 of this modification, advice or the like can be given to the user according to a change in the user's own situation that is different from a change in the environment in which the head-mounted display device 100 is used. This improves user convenience.

  In addition, biological information such as a user's body temperature and blood pressure may be detected by a sensor formed in the image display unit 20 or the control unit 10, and advice or the like may be given to the user according to the detected biological information. For example, in this modified example, when the image display unit 20 is mounted on the user's head, the right display driving unit 22 or the left display driving unit 24 in the image display unit 20 is in contact with the user's temple. A piezoelectric blood pressure sensor for detecting the blood pressure of the user is formed. When the detected user's blood pressure is greater than or equal to the lower limit value of the blood pressure stored in the storage unit 120 in advance and less than or equal to the upper limit value, the user is told, “The blood pressure value is over. Please go to the hospital. "You may be advised." The blood pressure sensor is not limited to the piezoelectric type, and may be a sensor that detects reflected light emitted from the LED with respect to the blood of the user. Further, the detected biological information of the user is not limited to blood pressure, and can be variously modified. For example, it may be a user's breathing speed or body temperature. Also, if the number of eyelids per unit time is decreasing due to infrared sensors that detect the opening and closing of the user's eyelids and eye imaging cameras that capture the periphery of the user's eyes, the user It may be determined that there is an abnormality in the agency, and advice to the abnormality may be given to the user.

  Further, in the second embodiment, as shown in FIG. 10, when the external temperature meets the preset condition, the advice of the text image TX11 is displayed and the voice of the advice is output. Information relating to the control of the head-mounted display device 100b for the user to recognize is not limited thereto, and can be variously modified. For example, when the operation unit 135 accepts an erroneous operation, the user may be allowed to recognize information such as “the correct operation is not performed” or “the operation unit 135 may be defective”. . Also, if the 9-axis sensor 66 detects an acceleration exceeding the threshold value in the image display unit 20, the user is made to recognize information such as “there is a possibility of breakage” or “the connector may be disconnected”. May be. In addition, when periodic shaking is detected, the user may be allowed to recognize information that prompts the occurrence of an earthquake. In addition, when it is detected that a certain amount or more of water droplets are attached to the image display unit 20, the image display unit 20 may generate heat. Therefore, information indicating that the image display unit 20 should be removed is given to the user. It may be recognized.

C7. Modification 7:
FIG. 12 is an explanatory diagram showing an external configuration of a head-mounted display device in a modified example. In the case of the example of FIG. 12A, the difference from the head-mounted display device 100 shown in FIG. 1 is that the image display unit 20c includes a right optical image display unit 26c instead of the right optical image display unit 26. And a point provided with a left optical image display unit 28 c instead of the left optical image display unit 28. The right optical image display unit 26c is formed smaller than the optical member of the above-described embodiment, and is disposed obliquely above the right eye of the user when the head-mounted display device 100c is worn. Similarly, the left optical image display unit 28c is formed smaller than the optical member of the above-described embodiment, and is disposed obliquely above the left eye of the user when the head-mounted display device 100c is worn. In the example of FIG. 12B, the difference from the head-mounted display device 100 shown in FIG. 1 is that the image display unit 20d includes a right optical image display unit 26d instead of the right optical image display unit 26. And a point provided with a left optical image display unit 28d instead of the left optical image display unit 28. The right optical image display unit 26d is formed smaller than the optical member of the above-described embodiment, and is disposed obliquely below the right eye of the user when the head mounted display is mounted. The left optical image display unit 28d is formed smaller than the optical member of the above-described embodiment, and is disposed obliquely below the left eye of the user when the head mounted display is mounted. Thus, it is sufficient that the optical image display unit is disposed in the vicinity of the user's eyes. The size of the optical member forming the optical image display unit is also arbitrary, and the optical image display unit covers only a part of the user's eye, in other words, the optical image display unit completely covers the user's eye. This can be realized as a head-mounted display device 100 in an uncovered form.

C8. Modification 8:
As the image display unit, instead of the image display unit 20 worn like glasses, another type of image display unit such as an image display unit worn like a hat may be adopted. Moreover, in the said embodiment, although LCD and a light source are utilized as a structure which produces | generates image light, it replaces with these and you may employ | adopt other display elements, such as an organic EL display. In the above embodiment, the 9-axis sensor 66 is used as a sensor for detecting the movement of the user's head. Instead, one or two of an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor are used. You may use the sensor comprised from. In the above embodiment, the head-mounted display device 100 is a binocular optical transmission type. However, the present invention can be applied to other types of head-mounted display such as a video transmission type and a monocular type. The same applies to the apparatus.

  In the above embodiment, the head-mounted display device 100 may guide image light representing the same image to the left and right eyes of the user so that the user can visually recognize the two-dimensional image. It is also possible to guide the user to visually recognize a three-dimensional image by guiding image light representing a different image to his eyes.

  In the above embodiment, a part of the configuration realized by hardware may be replaced by software, and conversely, a part of the configuration realized by software may be replaced by hardware. Good. For example, in the above-described embodiment, the image processing unit 160 and the sound processing unit 170 are realized by the CPU 140 reading and executing a computer program, but these functional units may be realized by a hardware circuit. Good.

  In addition, when part or all of the functions of the present invention are realized by software, the software (computer program) can be provided in a form stored in a computer-readable recording medium. In the present invention, the “computer-readable recording medium” is not limited to a portable recording medium such as a flexible disk or a CD-ROM, but an internal storage device in a computer such as various RAMs and ROMs, a hard disk, etc. It also includes an external storage device fixed to the computer.

  Moreover, in the said embodiment, as shown in FIG. 1 and FIG. 2, the control part 10 and the image display part 20 are formed as a separate structure, However, about the structure of the control part 10 and the image display part 20, about. However, the present invention is not limited to this, and various modifications are possible. For example, all of the components formed in the control unit 10 may be formed inside the image display unit 20 or a part thereof may be formed. Further, among the configurations formed in the control unit 10, only the operation unit 135 may be formed as a single user interface (UI), or the power source 130 in the above embodiment is formed independently and can be replaced. It may be. Further, the configuration formed in the control unit 10 may be formed in the image display unit 20 in an overlapping manner. For example, the CPU 140 shown in FIG. 2 may be formed in both the control unit 10 and the image display unit 20, or a function performed by the CPU 140 formed in the control unit 10 and the CPU formed in the image display unit 20. May be configured separately.

  In the above embodiment, the voice processing unit 170 and the conversion unit 185 are formed in the control unit 10, but the present invention can also be realized by a voice processing system configured independently as another device. . For example, output audio control and audio processing may be performed by cloud computing, a server, a host computer, or a smartphone via a wireless communication line.

  In the above embodiment, the microphones 62 and 64 are arranged on the image display unit 20 and the earphones 32 and 34 are connected to the control unit 10. However, the arrangement of the microphones 62 and 64 and the earphones 32 and 34 is described. Various modifications are possible. For example, the earphones 32 and 34 may be connected to the head-mounted display device 100 like a head-mounted audio processing device mounted on the head. Further, as the sound output device, a speaker may be used instead of the earphones 32 and 34. Also, the microphones 62 and 64 may be sound acquisition devices provided at specific locations in the facility without being arranged in the image display unit 20. The sound output device may be a hearing aid, for example, attached to the head. In this modification, since it is mounted on the user's head, the sound output device is unlikely to come off from the user's ear, and the user can stably view the output sound.

C9. Modification 9:
For example, the image light generation unit may include an organic EL (Organic Electro-Luminescence) display and an organic EL control unit. Further, for example, the image generation unit may use LCOS (Liquid crystal on silicon, LCoS is a registered trademark), a digital micromirror device, or the like instead of the LCD. Further, for example, the present invention can be applied to a laser retinal projection type head mounted display. In the case of the laser retinal projection type, the “image formable region” can be defined as an image region recognized by the user's eyes.

  Further, for example, the head-mounted display may be a head-mounted display in which the optical image display unit covers only a part of the user's eye, in other words, the optical image display unit does not completely cover the user's eye. Good. The head mounted display may be a so-called monocular type head mounted display.

  Further, the earphone may be an ear-hook type or a headband type, or may be omitted. Further, for example, it may be configured as a head mounted display mounted on a vehicle such as an automobile or an airplane. Further, for example, it may be configured as a head-mounted display built in a body protective device such as a helmet.

  The present invention is not limited to the above-described embodiments and modifications, and can be realized with various configurations without departing from the spirit of the present invention. For example, the technical features in the embodiments and the modifications corresponding to the technical features in each form described in the summary section of the invention are to solve some or all of the above-described problems, or In order to achieve part or all of the effects, replacement or combination can be performed as appropriate. Further, if the technical feature is not described as essential in the present specification, it can be deleted as appropriate.

DESCRIPTION OF SYMBOLS 10 ... Control part 11 ... Decision key 12 ... Illumination part 13 ... Display switching key 14 ... Trackpad 15 ... Luminance switching key 16 ... Direction key 17 ... Menu key 18 ... Power switch 20 ... Image display part 21 ... Right holding part 22 ... Right display drive unit 23 ... Left holding unit 24 ... Left display drive unit 26 ... Right optical image display unit 28 ... Left optical image display unit 30 ... Earphone plug 32 ... Right earphone (sound output unit)
34 ... Left earphone (sound output part)
DESCRIPTION OF SYMBOLS 40 ... Connection part 42 ... Right code 44 ... Left code 46 ... Connecting member 48 ... Main body code 51 ... Transmission part 52 ... Transmission part 53 ... Reception part 54 ... Reception part 61 ... Camera 62 ... Right microphone (information acquisition part)
64 ... Left microphone (information acquisition unit)
66 ... 9-axis sensor (motion detection unit, information acquisition unit)
67 ... Environmental information sensor (information acquisition unit)
DESCRIPTION OF SYMBOLS 100 ... Head-mounted display apparatus 110 ... Input information acquisition part 120 ... Memory | storage part 130 ... Power supply 135 ... Operation part (information acquisition part)
140 ... CPU
DESCRIPTION OF SYMBOLS 150 ... Operating system 160 ... Image processing part 161 ... Direction determination part (motion detection part, control part)
162... Environmental information determination unit (control unit)
163 ... erroneous operation determination unit (control unit)
170 ... voice processing unit (control unit, analysis unit, specific sound detection unit, sound source direction estimation unit)
180 ... interface 185 ... conversion unit 190 ... display control unit (control unit)
201 ... Right backlight control unit 202 ... Left backlight control unit 211 ... Right LCD control unit 212 ... Left LCD control unit 221 ... Right backlight 222 ... Left backlight 241 ... Right LCD
242 ... Left LCD
251 ... Right projection optical system 252 ... Left projection optical system 261 ... Right light guide plate 262 ... Left light guide plate Nout ... Transition of volume t1, t2 ... Time T1, T2 ... Period N1, N2 ... Volume (volume of external sound)
Nth ... Volume threshold (first threshold)
fT1, fT2 ... frequency spectrum fth ... frequency band TX1, TX11, TX2 ... text image (character image)
OA ... External device WB ... White board RE ... Right eye LE ... Left eye SC ... Outside view IL ... Illumination light PL ... Image light PN ... Maximum image display area (image formable area)
AP ... tip SP ... speaker VR ... field of view

Claims (19)

An information processing apparatus,
Acquire at least one of specific information in an environment in which the information processing device is used, biological information of a user who uses the information processing device, and control information for controlling the information processing device An information acquisition unit to
An information processing apparatus comprising: a control unit that controls the information processing apparatus based on at least one of the acquired specific information, the biological information, and the control information. The information processing apparatus according to claim 1, further comprising:
It has a sound output unit that outputs sound,
The information processing apparatus, wherein the control unit controls an output sound output from the sound output unit. An information processing apparatus according to claim 2,
The information acquisition unit acquires an external sound that is an external sound different from the output sound as the specific information,
The information processing apparatus, wherein the control unit controls the output sound based on the external sound. The information processing apparatus according to claim 3, further comprising:
Forming an image light representing an image based on the image data, allowing the user to visually recognize the image light, and transmitting an outside scene;
A conversion unit that converts the external sound into a character image represented as a character,
The control unit causes the image display unit to form character image light that is the image light representing the character image. The information processing apparatus according to claim 4,
The information processing apparatus, wherein the control unit sets a size of the character image light that the image display unit causes a user to visually recognize based on the external sound. An information processing apparatus according to claim 4 or claim 5, wherein
The control unit causes the image display unit to form the character image light in a portion excluding a central portion in an image formable region that is a region where the image display unit can form the image light. . An information processing apparatus according to any one of claims 4 to 6,
A plurality of the information acquisition units at different positions;
The information processing apparatus further includes:
Based on the volume of the external sound acquired by one information acquisition unit and the volume of the external sound acquired by another information acquisition unit, in the direction from the image display unit to the sound source of the external sound. A sound source direction estimation unit for estimating a sound source direction;
The control unit causes the image display unit to form the character image light in an image formable region, which is a region where the image display unit can form the image light, in association with the sound source direction. Processing equipment. An information processing apparatus according to any one of claims 4 to 7,
The control unit measures the volume of the external sound, and reduces the volume of the output sound when the measured volume of the external sound changes from less than a first threshold to more than the first threshold; Information processing device. The information processing apparatus according to any one of claims 4 to 8, further comprising:
A specific sound detection unit for detecting a specific sound included in the external sound;
The information processing apparatus, wherein the control unit controls the output sound based on the specific sound detected by the specific sound detection unit. The information processing apparatus according to any one of claims 4 to 9, further comprising:
It has a motion detector that detects changes in the movement of the user's head,
The said control part is an information processing apparatus which controls the said output sound based on the change of the motion of the user's head which the said motion detection part detected. An information processing apparatus according to any one of claims 4 to 10,
The control unit causes the sound output unit to output, as the output sound, a sound in which a volume of the external sound is set based on a change in the external sound. An information processing apparatus according to any one of claims 4 to 11,
When the information acquisition unit acquires a voice of a specific person, the control unit changes the frequency of the acquired voice of the specific person and changes the frequency to the sound output unit An information processing apparatus that outputs a voice of a person and reduces the volume of sound other than the voice of the specific person. An information processing apparatus according to any one of claims 2 to 12,
The sound output unit is an information processing apparatus that allows a user to view the output sound in a state of being mounted on a user's head. The information processing apparatus according to claim 1 or 2,
The specific information is information processing apparatus that is information related to at least one of temperature, humidity, magnetism, a component in air, and adhesion of liquid in the information processing apparatus. The information processing apparatus according to claim 1, further comprising:
As the control information, an operation unit that receives a predetermined operation is provided,
The information processing apparatus, wherein the control unit controls the information processing apparatus when an operation different from the predetermined operation received by the operation unit is received. The information processing apparatus according to claim 1 or 2,
The information acquisition unit acquires acceleration of the information processing device,
The information processing apparatus, wherein the specific information is an acceleration equal to or higher than a threshold in the information processing apparatus. An information processing apparatus according to any one of claims 14 to 16, comprising:
The said control part is information processing apparatus which performs control which alert | reports the information which restrict | limits use of the said information processing apparatus to the user of the said information processing apparatus. The information processing apparatus according to any one of claims 14 to 17, further comprising:
Forming an image light representing an image based on the image data, allowing the user to visually recognize the image light, and transmitting an outside scene;
A conversion unit that converts the setting information into a character image represented as characters,
The information processing apparatus, wherein the control unit causes the image display unit to form character image light that is the image light representing the character image. Acquire at least one of specific information in an environment where the information processing device is used, biological information of a user who uses the information processing device, and control information for controlling the information processing device. An information processing apparatus control method,
A method comprising the step of controlling the information processing device based on at least one of the acquired specific information, the biological information, and the control information.

Images