JP2015023435A - Display device, transmissive display device, and method of controlling display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device, a transmissive display device, and a method of controlling the display device that are capable of resolving difficulty in reading character information in displaying a 3D content.SOLUTION: A head mounted display device HM for allowing a user to visually recognize a content as a virtual image comprises: an interface 72 that acquires a 3D content including image information and/or character information; a conversion processing unit 52a that performs conversion processing for eliminating parallax on the character information of the 3D content or on other than the image information thereof; and a display unit 40 that displays the 3D content after the conversion processing.

Description

  The present invention relates to a display device capable of displaying 3D content, a transmissive display device, and a display device control method.

  2. Description of the Related Art Conventionally, a head-mounted display device (head mounted display (HMD)) that uses a glasses-shaped transmissive display mounted on the head is known as a transmissive display device. In addition, a head-mounted display device that can display 3D content has been proposed (for example, Patent Document 1). In recent years, attention has been paid to use for business purposes such as displaying manuals and work instruction information on this head-mounted display device, and in the future, display needs for more realistic and realistic 3D content will increase. It is assumed.

JP 2004-245889 A

  However, when 3D content is displayed on a 3D-compatible display device such as the head-mounted display device of Patent Document 1, not only image information but also character information is displayed in 3D, which makes it difficult to read. In particular, when the head-mounted display device is used for business purposes, it is necessary to watch the 3D-displayed character information for a long time, and eye fatigue becomes a problem. Furthermore, in the case of a head-mounted display device that does not require a controller (for example, a device that can be operated without using a controller by moving a finger over the content displayed on a transmissive display) Since it becomes difficult to visually recognize character information, symbols, icons, and the like by 3D display, it becomes difficult to specify the operation position, which causes erroneous operation.

  In view of the above problems, an object of the present invention is to provide a display device, a transmissive display device, and a display device control method that can eliminate difficulty in reading character information when displaying 3D content.

  The display device according to the present invention includes an acquisition unit that acquires 3D content including image information and / or character information, a conversion processing unit that performs a conversion process for eliminating parallax on characters other than the character information or image information of the 3D content, and And a display unit for displaying the 3D content after the conversion process.

  The display device control method according to the present invention includes an acquisition step of acquiring 3D content including image information and / or character information, and a conversion for performing a conversion process for eliminating parallax on characters other than the character information or image information of the 3D content. A processing step and a display step for displaying the 3D content after the conversion process are executed.

According to the present invention, when character information is included in the acquired 3D content, conversion processing for eliminating parallax is performed on the character information. In addition, when image information is included in the acquired 3D content, conversion processing is performed on other than the image information. By these conversion processes, it is possible to eliminate difficulty in reading the character information in the 3D content.
The format of the 3D content may be any type, such as a fixed layout format or a variable layout format. An example of the former is an image format that handles one page as one image. As an example of the latter, there is a text format that flows text data.
The file format of 3D content is also arbitrary. For example, left-eye image data and right-eye image data compressed to 1/2 in the horizontal direction are each doubled in the horizontal direction to produce left-eye video display data and right-eye video display data with parallax. By converting, it is possible to adopt a “side-by-side method” displayed as 3D display data. In addition, the “top and bottom method” in which the vertical widths of the upper and lower half images are compressed and arranged vertically, the “MVC method” in which the images for the right eye and the left eye are arranged in order from the front without changing the high-definition image quality, Examples include “IOM method” that enables editing of 3D moving images.
Further, when the 3D content includes image information and character information, the acquisition unit (acquisition step) may analyze the 3D content to distinguish the image information from the character information, or the image information and the character information can be originally identified. 3D content included in a certain state may be acquired. That is, 3D content that can divide image information and character information may be acquired on the display device side.
The image information may be still image information or moving image information. When the 3D content has an image format in which one page is handled as one image, the image information does not indicate the entire content but indicates an area such as an illustration part other than the text area.

  In the above display device, the 3D content is book content in a format in which one page is handled as one image, and the conversion processing unit extracts an image area including image information from each page data of the book content, and extracts the image A conversion process is performed on an area excluding the area.

According to the present invention, display information (character information, symbols, icons, etc. other than the illustration portion is included by performing conversion processing from the book content (electronic book) including the illustration, etc., excluding the illustration portion (image region). ) Can be resolved.
The “format that handles one page as one image” includes formats such as PDF (Portable Document Format) and JPEG (Joint Photographic Experts Group).

  In the display device, the 3D content is book content in a format in which one page is handled as one image, and the conversion processing unit extracts a text area including character information from each page data of the book content, and extracts the text A conversion process is performed on the area.

  According to the present invention, since the text region is extracted from the book content (electronic book) including illustrations and the conversion process is performed, it is difficult to read the character information while minimizing the processing load of the conversion process. Can be eliminated.

  The display device further includes a mode switching unit that switches between the 2D mode and the 3D mode, the conversion processing unit performs conversion processing when the mode switching unit switches to the 3D mode, and the display unit is operated by the mode switching unit. When switched to 2D mode, 3D content is displayed as 2D content.

  In the above display device, the mode switching unit can be switched to the non-conversion mode, and when the display unit is switched to the non-conversion mode by the mode switching unit, the conversion processing unit does not perform the conversion process. It is characterized by displaying content.

According to the present invention, the 2D mode, the 3D mode, and the non-conversion mode can be switched according to the user's needs, the type of content, and the like.
Note that the mode switching unit may perform mode switching according to a user operation, or may perform mode switching according to content. In the latter case, for example, it is conceivable to perform mode switching according to the type of content or the display content of the content.

  A transmissive display device of the present invention includes each unit in the above display device, and the display unit is a transmissive display unit that allows a user to visually recognize content as a virtual image.

  According to the present invention, even in a transmissive display device that allows a user to visually recognize content as a virtual image, it is possible to eliminate difficulty in reading character information when displaying 3D content.

  In the transmissive display device described above, the transmissive display device is used by being mounted on the user's head, and corresponds to the indicator detection unit that detects the movement of the indicator operated by the user and the operation of the indicator. A command execution unit that executes the command, the user can see the indicator through the content displayed on the transparent display unit, and the command execution unit is the indicator viewed from the user A command is executed in accordance with an operation position for the content.

  According to the present invention, even in a head-mounted display device, it is possible to eliminate difficulty in reading character information when displaying 3D content. In addition, since the head-mounted display device of the present invention is configured to execute a command in accordance with the operation position of the indicator that is visible through the content, the difficulty in reading the character information is eliminated. Along with this, erroneous operations can be suppressed.

  In the above-described transmissive display device, the display unit includes a right-eye transmissive display unit and a left-eye transmissive display unit, and the acquisition unit is a left-eye image compressed 1/2 in the horizontal direction as the 3D content. Data and right-eye image data are acquired, and the display unit expands the left-eye image data and the right-eye image data by a factor of 2 in the horizontal direction, respectively. Data converted into video display data is displayed by the right-eye transmissive display unit and the left-eye transmissive display unit, respectively.

  According to the present invention, a “side-by-side” file format can be supported. In addition, the present invention can be applied to a transmissive display device having a transmissive display unit for the right eye and a transmissive display unit for the left eye, such as a head-mounted display.

1 is an external perspective view of a head-mounted display device according to an embodiment of the present invention. It is a figure which shows the example of a display of a head mounting | wearing type display apparatus. (A) is a figure which shows an example of the image data for left eyes, (b) is a figure which shows an example of the image data for right eyes, (c) is a figure which shows an example of 3D display data. It is a block diagram of a head-mounted display device. It is explanatory drawing of the conversion process with respect to the area | region except an image area | region. It is explanatory drawing of a display processing mode. It is a flowchart which shows the flow of a content display process. It is explanatory drawing of the conversion process which concerns on the modification 2. 10 is a flowchart showing a flow of content display processing according to Modification 2.

  Hereinafter, a display device, a transmissive display device, and a display device control method according to an embodiment of the present invention will be described with reference to the accompanying drawings. FIG. 1 is an external perspective view of a head-mounted display device HM to which the transmissive display device of the present invention is applied. The head-mounted display device HM is worn by a user on the head and is also called a head mounted display (HMD). The head-mounted display device HM of this embodiment is an optically transmissive head-mounted display device HM (a transmissive head-mounted display device, a see-through type) that allows a user to visually recognize a virtual image and at the same time directly view an outside scene. -A head-mounted display) having a spectacle shape.

  The head-mounted display device HM includes a right holding unit 11, a right display driving unit 12, a left holding unit 13, a left display driving unit 14, a right optical image display unit 15, and a left optical image display unit 16. And an imaging sensor 17 (indicator detection unit).

  The right optical image display unit 15 and the left optical image display unit 16 are disposed at positions corresponding to the right and left eyes of the user when the head-mounted display device HM is mounted. One end of the right optical image display unit 15 and one end of the left optical image display unit 16 are connected at positions corresponding to the user's eyebrows when the head-mounted display device HM is mounted. The right holding unit 11 extends from the end ER that is the other end of the right optical image display unit 15. Similarly, the left holding unit 13 extends from the end EL which is the other end of the left optical image display unit 16.

  The right holding unit 11 is substantially perpendicular to the right optical image display unit 15 from the end ER of the right optical image display unit 15 to a position corresponding to the user's temporal region when the head-mounted display device HM is mounted. It is a member provided by stretching so as to be formed. Similarly, the left holding unit 13 is connected to the left optical image display unit 16 from the end EL of the left optical image display unit 16 to a position corresponding to the user's temporal region when the head-mounted display device HM is worn. It is a member provided by extending so as to form a substantially right angle. The right holding unit 11 and the left holding unit 13 hold the head-mounted display device HM on the user's head like a temple of glasses.

  The right display drive unit 12 is on the inner side of the right holding unit 11, in other words, on the side facing the user's head when the head-mounted display device HM is mounted, and the end of the right optical image display unit 15. It is arranged on the ER side. The left display driving unit 14 is disposed inside the left holding unit 13 and on the end EL side of the left optical image display unit 16.

  The imaging sensor 17 is disposed at a position corresponding to the user's eyebrow when the head-mounted display device HM is worn. The imaging sensor 17 images an outside scene in the user's viewing direction (in front of the user) in a state where the head-mounted display device HM is mounted. Then, the user's operation is determined from the captured image. That is, the head-mounted display device HM recognizes the indicator P operated by the user based on the captured image and generates an operation signal. In this embodiment, the user's “finger” is used as the indicator P (see FIG. 2). In addition, as the indicator P, a ring type input device, a pen (pen tip), a light emitter of a remote controller, or the like may be used. Moreover, it is preferable that the imaging range by the imaging sensor 17 is a range wider than the visual field 21 (see FIG. 2) of the user when the head-mounted display device HM is worn.

  In the present embodiment, a configuration including one imaging sensor 17 is illustrated, but a configuration including a plurality of imaging sensors 17 may be used. In addition, the means for detecting the indicator P is not limited to the imaging sensor 17, and a laser sensor, an ultrasonic sensor, or the like may be used.

  The head-mounted display device HM further includes a right earphone 18 for the right ear and a left earphone 19 for the left ear. The right earphone 18 and the left earphone 19 are respectively attached to the right and left ears when the user wears the head-mounted display device HM. Although not particularly illustrated, a control mechanism for realizing a control unit 30 described later is built in the right display drive unit 12 or the left display drive unit 14.

  Next, information that can be visually recognized by the user wearing the head-mounted display device HM will be described with reference to FIG. As shown in the figure, the virtual image 22 generated by the head-mounted display device HM, that is, the head-mounted display device HM, is input to the field of view 21 of the user wearing the head-mounted display device HM. Content is displayed. In the present embodiment, not only 2D content (2D content) but also 3D content (3D content) can be input and displayed. In addition, the user can see the outside scene 23 in an area other than the area where the virtual image 22 is displayed in the field of view 21. The outside scene 23 is information that can be seen when the right optical image display unit 15 and the left optical image display unit 16 have translucency. Hereinafter, the area where the virtual image 22 is displayed is referred to as a “virtual image display area 25”, and the other area is referred to as an “outside scene visually recognizing area 26”.

  By the way, the head-mounted display device HM of the present embodiment is configured such that the outside scene 23 can be seen through the virtual image 22 in the virtual image display region 25. For this reason, the user can visually recognize the indicator P (user's finger) through the content displayed as the virtual image 22. That is, the head-mounted display device HM identifies an operation position with respect to the content of the indicator P viewed from the user based on the imaging result of the imaging sensor 17, and executes a predetermined command according to the operation position. . For example, as shown in FIG. 2, when an icon 28 included in the content is designated by the indicator P, processing corresponding to the icon 28 is performed. Further, when a part of the character information 29 included in the content is designated by the indicator P, a process of selecting / copying the text at the position or pasting the text copied in advance at the position I do. In addition, although mentioned later for details, operation by the indicator P is also possible also about switching of a display processing mode (switching of 2D mode, 3D mode, and no conversion mode).

  Next, the display principle of 3D content will be described with reference to FIG. The 3D content exemplified in this embodiment is an image format that handles one page as one image. Moreover, the illustrated content is a book content used as an electronic book. The book content includes image information such as illustrations and / or character information such as sentences and tables.

  Furthermore, as a file format, for example, left-eye image data and right-eye image data compressed to 1/2 in the horizontal direction are each expanded twice in the horizontal direction to display video images for the left and right eyes with parallax. By converting to data, a “side-by-side method” displayed as 3D display data is adopted. In the “side-by-side method”, the left-eye image data DL (video signal for one frame) shown in FIG. 5A and the right-eye image data DR (video signal for one frame) shown in FIG. The left-eye image data DL and the right-eye image data DR that are respectively compressed in half in the horizontal direction and compressed in the horizontal direction in the head-mounted display device HM are doubled in the horizontal direction. It is displayed as 3D display data D0 (3D video) shown in FIG. 5C by expanding and converting it into video display data for left eye and right eye with parallax.

  Next, the functional configuration of the head-mounted display device HM will be described with reference to FIG. The head-mounted display device HM includes a display unit 40 that allows the user to visually recognize the virtual image 22, an image sensor 17, a right earphone 18, a left earphone 19, a power supply unit 71, an interface 72 (acquisition unit), It has the control part 30 which controls these each part.

  The power supply unit 71 supplies power to each unit of the head-mounted display device HM. The interface 72 is for connecting various external devices OA that are sources of contents such as images (still images, moving images) and audio. Examples of the external device OA include a personal computer, a mobile terminal (such as a mobile phone and a smartphone), and a game terminal. As the interface 72, for example, a USB interface, a micro USB interface, a memory card interface, a wireless LAN interface, or the like can be employed.

  The control unit 30 includes a CPU (Central Processing Unit) 50 and a storage unit 60. The storage unit 60 includes a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and stores various computer programs such as an application (viewer) corresponding to a content format. The CPU 50 reads out and executes a computer program from the storage unit 60, thereby operating as an operating system (OS) 51, an image processing unit 52, a display control unit 53, an image analysis unit 54, a command execution unit 55, and a voice processing unit 56. Function.

  The image processing unit 52 generates a signal to be supplied to the display unit 40 based on the content input via the interface 72 and transmits the signal to the display unit 40. At this time, the image processing unit 52 performs image processing such as resolution conversion processing, tone correction processing such as brightness / saturation adjustment, and keystone correction processing on the image data as necessary.

  The image processing unit 52 includes a conversion processing unit 52a that is a main part of the present invention. When image information is included in the acquired 3D content, the conversion processing unit 52a performs conversion processing for eliminating parallax with respect to other than the image information. Specifically, as shown in FIG. 5, an image region E1 including image information is extracted from each page data of the content (image data DL and DR shown in FIGS. 2A and 2B) and extracted. Conversion processing is performed on the area excluding the image area E1. In the example of FIG. 5, the conversion processing is performed on the left eye image data DL of the two pieces of image data with respect to an area (shown in FIG. 5A) excluding the image area E1. The conversion process includes a process of shifting the area excluding the image area E1 in the horizontal direction (either left or right), and the image area of the left-eye image data DL by copying the area excluding the image area E1 of the right-eye image data DR. A process of pasting in an area excluding E1 can be considered.

  The image region E1 is extracted by using a known image analysis process and specifying a region mainly including an image such as an illustration. In this case, only specific graphical information such as a photograph or a picture may be detected as image information, and an image area including the image information may be extracted (that is, a simple image such as an icon is not detected as image information). Is also good). Further, the image data to be subjected to the conversion process may be the right-eye image data DR instead of the left-eye image data DL, or both the left-eye image data DL and the right-eye image data DR.

  On the other hand, the display control unit 53 controls the image display state on the display unit 40 by generating a control signal for controlling the right display drive unit 12 and the left display drive unit 14 and outputting the control signal to the display unit 40. Specifically, the display control unit 53 uses the control signal to turn on / off the drive of the right LCD 84 by the right LCD control unit 83, drive the ON / OFF of the right backlight 82 by the right backlight control unit 81, and the left LCD. The right display drive unit 12 and the left display drive unit 14 are individually controlled by controlling ON / OFF of the left LCD 94 by the control unit 93 and ON / OFF of the left backlight 92 by the left backlight control unit 91, respectively. The generation and emission of image light by each of the above are controlled. When displaying 3D content, the display control unit 53 alternately drives the right display drive unit 12 and the left display drive unit 14 (frame sequential method).

  The display control unit 53 switches the display processing mode based on a user operation (mode switching unit). As described above, in the present embodiment, when 3D content is acquired, the mode can be switched to either the 2D mode, the 3D mode, or the non-conversion mode. However, when 2D content is acquired, the display processing mode setting is invalid and 2D display is performed.

  As illustrated in FIG. 6, when the 2D mode is selected by the user, the display control unit 53 uses, for example, right-eye image data DR for left-eye display and right-eye display. That is, 2D display is performed by displaying either one of the left and right frame data so that the user can see with both eyes (displayed as 2D content). When the 3D mode is selected, the left-eye image data DL is used for left-eye display, and the right-eye image data DR is used for right-eye display. At this time, with respect to the image data DL for the left eye, conversion processing for eliminating parallax is performed by the conversion processing unit 52a on the regions other than the image region E1. Further, when the non-conversion mode is selected, the left-eye image data DL is used for left-eye display, and the right-eye image data DR is used for right-eye display. However, in the non-conversion mode, the conversion processing by the conversion processing unit 52a is not performed. That is, the non-conversion mode corresponds to a conventional 3D display mode.

  Returning to the description of FIG. The image analysis unit 54 analyzes the image captured by the image sensor 17 and detects the indicator P. Further, the detection timing and detection position are output to the image processing unit 52 and the display control unit 53 as operation signals. The image processing unit 52 and the display control unit 53 perform image processing and display control based on the output operation signal of the indicator P. In addition, the command execution unit 55 executes various commands set in advance in accordance with the operation of the indicator. The audio processing unit 56 acquires an audio signal included in the content, amplifies the acquired audio signal, and outputs the amplified audio signal to the right earphone 18 and the left earphone 19.

  The display unit 40 includes a right display drive unit 12, a left display drive unit 14, a right light guide plate 86 as the right optical image display unit 15, and a left light guide plate 96 as the left optical image display unit 16. ing. In the following description, the right optical image display unit 15 (right light guide plate 86) and the left optical image display unit 16 (left light guide plate 96) are also collectively referred to as “optical members”.

  The right display driving unit 12 includes a right backlight (BL) 82 that functions as a light source, a right backlight (BL) control unit 81 that controls driving of the right backlight (BL) 82, and a right LCD 84 that functions as a display element. A right LCD control unit 83 that controls driving of the right LCD 84, and a right projection optical system 85. The right backlight control unit 81 drives and controls the right backlight 82 based on the input control signal. The right backlight 82 is a light emitter such as an LED or electroluminescence (EL). The right LCD control unit 83 drives and controls the right LCD 84 based on a clock signal, a vertical synchronization signal, a horizontal synchronization signal, and the like in addition to the right-eye image data. The right LCD 84 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

  The right projection optical system 85 projects image light emitted from the right LCD 84, and is configured using, for example, a collimator lens. The right light guide plate 86 as the right optical image display unit 15 is formed of a light-transmitting resin material or the like, and reflects the image light output from the right projection optical system 85 along a predetermined optical path while being reflected by the user. Lead to the right eye. The right projection optical system 85 and the right light guide plate 86 are collectively referred to as “light guide unit”. The light guide unit can use any method as long as it forms a virtual image in front of the user's eyes using image light. For example, a diffraction grating (a hologram element as an example) may be used, or a transflective film May be used.

  As with the right display drive unit 12, the left display drive unit 14 includes a left backlight (BL) control unit 91, a left backlight (BL) 92, a left LCD control unit 93, a left LCD 94, and left projection optics. System 95. The left light guide plate 96 as the left optical image display unit 16 is formed of a light transmissive resin material or the like, and is used while reflecting the image light output from the left projection optical system 95 along a predetermined optical path. To the left eye.

  In this way, the image light guided to both eyes of the user of the head-mounted display device HM forms an image on the retina, so that the user can enter the virtual image display area 25 as shown in FIG. The virtual image 22 is visually recognized. In the present embodiment, making the user visually recognize the virtual image 22 in this way is also expressed as “display”.

  Next, the flow of content display processing of the head-mounted display device HM will be described with reference to the flowchart of FIG. Here, description will be made assuming that 2D or 3D book content is input to the head-mounted display device HM. When the head-mounted display device HM acquires content (S01), the head-mounted display device HM determines whether the content is 3D content (S02). If the acquired content is not 3D content, that is, if it is 2D content (S02: No), 2D content is displayed (S03).

  On the other hand, if the acquired content is 3D content (S02: Yes), it is determined whether or not the image area E1 exists (S04). Here, when the image area E1 exists (S04: Yes), the conversion process by the conversion processing unit 52a is performed on the area excluding the image area E1 (S05), and the 3D content after the conversion process is displayed (S06). ). If the image area E1 does not exist (S04: No), the conversion processing unit 52a performs conversion processing on the entire page area of the content (S07), and the converted 3D content is displayed (S06).

  As described above, according to the present embodiment, conversion processing for eliminating parallax is performed on image information other than the acquired 3D content image information, so that it is possible to eliminate difficulty in reading character information in 3D content. In addition, in the case of book content in image format format, conversion processing is performed by removing the image area E1 such as an illustration from the book content, so that not only character information but also icons and symbols are not easily viewed. can do. Furthermore, since the head-mounted display device HM of the present embodiment is configured to execute a command according to the operation position of the indicator P that is visible through the content, it is difficult to read character information and icons. Along with the elimination, it can be expected to prevent erroneous operations.

  In addition, since the display processing mode includes a 2D mode, a 3D mode, and a non-conversion mode, it can be switched to a desired mode according to the type of content and the user's preference. That is, even when 3D content is acquired, the 2D mode may be selected when it is desired to minimize eye strain. Further, in order to emphasize the readability of text information while taking advantage of the 3D content, the 3D mode may be selected. Furthermore, in order to take advantage of the characteristics of the 3D content itself, the non-conversion mode may be selected.

Note that the present invention is not limited to the above-described embodiment, and the following modification examples can be employed.
(Modification 1)
In the above embodiment, when there is no image area E1 in the acquired book content, the conversion process is performed on the entire area of the page (see S04: No, S07 in FIG. 7). May be omitted. That is, as shown by the symbol A in FIG. 7, when the acquired 3D content does not include the image area E1 (S04: No), one of the left and right pair of image data is used as the left eye display and right eye. It may be displayed for display. That is, when the image area E1 does not exist in the acquired 3D content, it may be displayed as 2D content.

(Modification 2)
In the above embodiment, it is determined whether or not the image region E1 exists in the acquired 3D content. Instead, the presence or absence of a text region may be determined. FIG. 8 is an explanatory diagram of the conversion process according to this modification. As shown in the figure, in this modification, a text area E2 is extracted from one of the left and right pair of image data, and a conversion process is performed on the extracted text area E2 (illustrated, shaded). Part). FIG. 9 is a flowchart showing the flow of content display processing according to this modification. S11 to S13 are the same as S01 to S03 in FIG. In this modification, when the acquired content is 3D content (S12: Yes), it is determined whether or not the text area E2 exists (S14). The presence or absence of the text area E2 is determined using a known image analysis process. If the text area E2 exists (S14: Yes), the text area E2 is converted by the conversion processing unit 52a (S15), and the 3D content is displayed (S16). On the other hand, when the text area E2 does not exist (S14: No), the 3D content is displayed without performing the conversion process (S16). As described above, according to the present modification, the text area E2 is extracted and the conversion process is performed, so that it is possible to eliminate the difficulty in reading the character information while minimizing the processing load of the conversion process. it can. In particular, in the case of book contents with many graphics (picture book, art book, photo book, etc.), the load reduction effect of the conversion process is high.

(Modification 3)
In the above embodiment, the display processing mode is switched according to the user's operation. However, the mode may be switched according to the content. In addition, the mode switching may not be three options of 2D mode, 3D mode, and no conversion mode, but only two options such as 3D mode and no conversion mode. As a mode switching method according to content, for example, mode switching may be performed according to the display content of the content. For example, from the first few pages of page data, it is determined whether or not the content has a lot of character information. If there is a lot of character information, the mode is switched to the 3D mode. Conceivable. Further, mode switching may be performed according to the type of content. For example, processing such as switching to 3D mode for book content and switching to non-conversion mode for movie content can be considered. The type of content can be determined based on additional information (metadata) added to the content.

(Modification 4)
Further, mode switching may be performed according to the brightness of the content (such as the brightness of the text area E2) and the usage environment brightness. For example, in the case of content luminance and / or usage environment luminance that eases reading of character information (for example, when the luminance of the background color of the text area E2 is greater than or equal to a predetermined threshold or the usage environment luminance is predetermined) If the threshold is less than or equal to the threshold value), switching to the non-conversion mode, and if not, switching to the 3D mode may be considered.

(Modification 5)
In the above embodiment, the format of the image format is exemplified as the format of the 3D content. However, the format of the text format into which the text data is inserted may be adopted. A format including both an image file and a text file may be adopted. In these cases, the presence / absence of image information and character information may be determined from file attributes. For example, in the case of a format including both an image file and a text file, the image file corresponds to the image information in the claims, and the text file corresponds to the character information in the claims. In these cases, the image area including the image information and the text area including the character information may partially or entirely overlap in the user's view 21. For example, in the case of movie subtitles, a text area for displaying subtitles is provided so as to be superimposed on a part of an image area for displaying movies. In this case, the parallax is applied only to the text area (subtitles). It is sufficient to perform a conversion process to eliminate the problem.

(Modification 6)
In the above embodiment, the case where the size of the virtual image display area 25 is smaller than the size of the outside scene visual recognition area 26 is illustrated, but the present invention is not limited to this. When the virtual image display area 25 and the outside scene visual recognition area 26 have the same size (in other words, when the virtual image display area 25 has the same size as the visual field 21), or the virtual image display area 25 is larger than the external scene visual recognition area 26 In the case (in other words, when the virtual image display area 25 is larger than the field of view 21), the present invention can be applied.

(Modification 7)
In the above embodiment, the head mounted display device HM is mounted by mounting the display unit 40 that allows the user to visually recognize a virtual image, the control unit 30 that controls the display unit 40, and the like in one housing (device). Although implemented, these may be implemented as separate devices. That is, the head-mounted display device HM main body including the display unit 40, the imaging sensor 17, and the earphones 18 and 19 and the controller (not shown) including the control unit 30 may be configured to be communicable. In this case, the main body and the controller may be connected by wire, or may be connected by a wireless LAN, infrared communication, Bluetooth (registered trademark), or the like. Further, the function of the controller may be realized by a personal computer, a portable information terminal (PAD, mobile phone, watch-type mobile terminal) or the like.

(Modification 8)
In the above-described embodiment, the display processing mode can be switched by operating the indicator P. However, the display processing mode can be switched using an operator provided on the main body of the head-mounted display device HM. Also good. When a controller is used, an operator dedicated to switching the display processing mode may be provided on the controller.

(Other variations)
In the above embodiment, the binocular head-mounted display device HM (optical transmission type head-mounted display device) is exemplified as the transmission type display device, but the present invention is, for example, a video transmission type. It can also be applied to other types of head mounted display devices such as monocular type. In the above embodiment, the eyeglass-type head-mounted display device HM that covers the front of the eye is illustrated, but the present invention is not limited to this, and the type that does not completely cover the front of the eye (the front of the eye). The present invention can also be applied to a head-mounted display device of a type that partially covers). Furthermore, the present invention is not limited to a head-mounted display device, but other transmissive display devices such as a head-up display, or a general display device that does not have transparency (such as a television receiver, a tablet terminal, and a personal computer). It is also applicable to.

  In the above embodiment, the backlight control units 81 and 91, the backlights 82 and 92, the LCD control units 83 and 93, and the display drive units 12 and 14 including the LCDs 84 and 94 are illustrated. However, this aspect is merely an example. In addition to or in place of these components, a component for realizing another method may be provided.

  For example, an organic EL (Organic Electro-Luminescence) display and an organic EL control unit may be provided. In place of the LCD, LCOS (Liquid crystal on silicon, LCoS is a registered trademark), a digital micromirror device, or the like may be used. Further, the present invention can be applied to a laser retinal projection type head-mounted display device. In the case of the laser retinal projection type, the “image region” or “text region” can be defined as a region recognized by the user's eyes. The optical system of the head-mounted display device HM transmits external light through the optical member and enters the user's eye together with the image light. The optical member guides the image light into the member. It is not limited to this, and may be refracted or reflected in the direction of the user's eyes.

  In the present embodiment, the projection optical systems 85 and 95 are applied as the optical system, but this aspect is merely an example. For example, a scanning optical system composed of a MEMS mirror may be employed as the optical system, and a signal light modulation unit that emits signal light to the scanning optical system may be provided. In this case, the signal light formed and emitted by the signal light modulation unit is incident on a scanning optical system (MEMS mirror) that is a scanning unit. The scanning optical system emits signal light as scanning light toward a light guide having a half mirror layer, and the scanning light is scanned on the surface of the half mirror layer to form a virtual image by image light. The user can recognize the image by grasping with the eyes.

  Moreover, it is possible to provide each function of the head-mounted display device HM shown in the above embodiment as a program. Further, the program can be provided by being stored in various recording media (CD-ROM, flash memory, etc.). That is, a program for causing a computer to function as each component of the head-mounted display device HM and a recording medium recording the program are also included in the scope of the right of the present invention. In addition, regardless of the above-described embodiments, the device configuration and processing steps of the head-mounted display device HM can be changed as appropriate without departing from the scope of the present invention.

  DESCRIPTION OF SYMBOLS 11 ... Right holding part 12 ... Right display drive part 13 ... Left holding part 14 ... Left display drive part 15 ... Right optical image display part 16 ... Left optical image display part 17 ... Imaging sensor 21 ... Visual field 22 ... Virtual image 23 ... Outside scene 25 ... Virtual image display area 26 ... Outside scene visual recognition area 28 ... Icon 29 ... Character information 30 ... Control part 40 ... Display part 52a ... Conversion processing part 72 ... Interface D0 ... 3D display data DL ... Image data for left eye DR ... Image data for right eye E1 ... Image area E2 ... Text area HM ... Head-mounted display device OA ... External device P ... Indicator

Claims (9)

An acquisition unit for acquiring 3D content including image information and / or character information;
A conversion processing unit that performs conversion processing for eliminating parallax on the character information or the image information other than the 3D content;
And a display unit that displays the 3D content after the conversion process. The 3D content is book content in a format that handles one page as one image,
The said conversion process part extracts the image area | region containing the said image information from each page data of the said book content, and performs the conversion process with respect to the area | region except the said extracted image area | region. The display device described. The 3D content is book content in a format that handles one page as one image,
The display according to claim 1, wherein the conversion processing unit extracts a text region including the character information from each page data of the book content, and performs conversion processing on the extracted text region. apparatus. A mode switching unit for switching between 2D mode and 3D mode;
The conversion processing unit performs conversion processing when the mode switching unit is switched to the 3D mode,
4. The display device according to claim 1, wherein the display unit displays the 3D content as 2D content when the mode switching unit switches to the 2D mode. 5. The mode switching unit can be switched to a non-conversion mode,
The display device according to claim 4, wherein the display unit displays 3D content not subjected to conversion processing by the conversion processing unit when the mode switching unit switches to the non-conversion mode. Each part in the display device according to any one of claims 1 to 5,
The transmissive display device, wherein the display unit is a transmissive display unit that allows a user to visually recognize content as a virtual image. A transmissive display device that is used by being mounted on a user's head,
An indicator detection unit for detecting movement of the indicator operated by the user;
An instruction execution unit that executes an instruction corresponding to the operation of the indicator,
The user can see the indicator through the content displayed on the transmissive display unit,
The transmissive display apparatus according to claim 6, wherein the command execution unit executes the command according to an operation position of the indicator with respect to the content as viewed from the user. The display unit includes a right eye transparent display unit and a left eye transparent display unit,
The acquisition unit acquires, as the 3D content, left-eye image data and right-eye image data that have been compressed in half in the horizontal direction;
The display unit extends the image data for the left eye and the image data for the right eye twice in the horizontal direction, respectively, and converts them into video display data for the right eye and video display data for the left eye with parallax, respectively. The transmissive display device according to claim 7, wherein display is performed by the transmissive display unit for the right eye and the transmissive display unit for the left eye. An acquisition step of acquiring 3D content including image information and / or character information;
A conversion processing step for performing conversion processing for eliminating parallax on the text information or the image information other than the 3D content;
And a display step of displaying the 3D content after the conversion process.

Images