JP2021135304A - Image projection device, image projection method and program - Google Patents

Abstract

To assist a vision function with respect to users with retina diseases.SOLUTION: An image projection device has: a storage unit that stores input image data; a control unit that, with respect to the image data, divides an image the image data shows into an area with a width at equal intervals from a reference position in a state where an angle of view of the image is maintained, and makes corrections of the image so that the width of the area monotonically reduces or increases as getting apart from the reference position; and a laser irradiation unit that has a light source unit emitting a laser light beam, scans the laser light beam two-dimensionally on the basis of post-corrected image data by the control unit, and projects an image the post-corrected image data shows onto a retina of a user.SELECTED DRAWING: Figure 7

Description

The present invention relates to an image projection device, an image projection method, and a program.

The retinal projection type image projection device scans the user's retina with a laser beam based on the input image data and projects the image on the user's retina, so that it does not depend on the refraction function of the anterior segment of the eye. In addition, let the user visually recognize the image. Therefore, the retinal projection type image projection device is effective in supporting the visual function of a user having an anterior ocular disease such as keratoconus.

Another disease that impairs visual function is retinal disease. In the case of retinal disease, the laser beam radiated to the defective area where the retinal function is defective is not detected. Therefore, for users with retinal diseases, a method of irradiating a region other than the defective region of the retina with laser light has been proposed.

Japanese Unexamined Patent Publication No. 2016-134668

However, retinal diseases are diverse, such as central / partial scotoma and narrowing of the visual field, and the size and position of the defective region of the visual field also differ from person to person. Therefore, it is difficult to provide an image projection device customized according to the mode of the disease of each user.

Further, for example, as one of the customization methods, it is conceivable to correct the partial distortion of the image visually recognized by the user, but in this case, the symmetry of the obtained image is impaired and the feeling of discomfort is large. There is a possibility of becoming. As described above, the conventional retinal scanning type image projection device has insufficient support for visual function for a user having a retinal disease.

The disclosed technique was developed in view of the above circumstances, and aims to support the visual function of a user having a retinal disease.

The disclosed technique is a storage unit that stores input image data, and an image indicated by the image data with respect to the image data, with a width of equal intervals from a reference position while maintaining the angle of view of the image. It is divided into regions, and has a control unit that makes corrections so that the width of the region monotonously decreases or increases as the distance from the reference position increases, and a light source unit that emits a laser beam. This is an image projection device including a laser irradiation unit that scans the laser beam in two dimensions based on the image data of the above and projects the image shown by the corrected image data on the user's retina.

It can support visual function for users with retinal diseases.

It is a figure explaining the hardware structure of the image projection apparatus of 1st Embodiment. It is a figure explaining the function of the control part of the 1st Embodiment. It is a flowchart explaining the operation of the image projection apparatus of 1st Embodiment. It is a flowchart explaining the correction of an image in 1st Embodiment. It is a 1st figure explaining the correction of an image in 1st Embodiment. It is a 2nd figure explaining the correction of an image in 1st Embodiment. It is a figure which shows an example of the image data for projection. It is a figure explaining the function of the control part of the 2nd Embodiment. It is a figure explaining the setting of the reference position of the 2nd Embodiment. It is a flowchart explaining operation of the image projection apparatus of 2nd Embodiment. It is a figure explaining the image projection apparatus of the 3rd Embodiment. It is a figure explaining the hardware structure of the image projection apparatus of the 2nd Embodiment. It is a figure explaining the image projection apparatus of 4th Embodiment. It is a figure explaining the hardware configuration of each apparatus included in the image projection system of 4th Embodiment. It is a figure explaining the functional structure of the terminal apparatus of 4th Embodiment. It is a figure which shows the display example of a terminal device. It is a figure explaining the image projection apparatus of the 5th Embodiment. It is a figure which shows the hardware composition of the image projection apparatus of the 5th Embodiment.

(First Embodiment)
The first embodiment will be described below with reference to the drawings. FIG. 1 is a diagram illustrating a hardware configuration of the image projection device of the first embodiment.

The image projection device 100 of the present embodiment is a retinal projection type head-mounted display using Maxwell vision. An image is projected onto the user's retina using Maxwell vision. Maxwell vision is the process of converging an image ray based on image data at the center of the pupil and then projecting it onto the retina, so that the image shown by the image data to a person is displayed without being affected by the accommodation function of the human crystalline lens. This is a method that can be visually recognized.

Further, the image projection device 100 of the present embodiment may have a frame shaped like general eyeglasses, or may have a shape like goggles covering both eyes of the user. Is also good.

The image projection device 100 of the present embodiment includes a communication unit 20, a control unit 30, a storage unit 40, a laser output control unit (ray output control unit) 50, a laser irradiation unit 60, an image input unit 70, and an operation input unit 80. ..

The communication unit 20 is a communication device for communicating between the image projection device 100 and the external device. Specifically, for example, the communication unit 20 may acquire image data of an image to be projected on the image projection device 100 from an external device via a network or the like. The communication method by the communication unit 20 may be any method as long as the image projection device 100 and the external device can communicate with each other.

The control unit 30 is, for example, an arithmetic processing unit or the like, and controls the entire operation of the image projection device 100 of the present embodiment. Specifically, the control unit 30 corrects the image data input from the communication unit 20, the image data stored in the storage unit 40, and the image data input from the image input unit 70. The corrected image data is output to the laser output control unit 50.

More specifically, the control unit 30 of the present embodiment enlarges the central portion and reduces the peripheral portion or the center of the image without changing the size (angle of view) of the image indicated by the image data. The image data is corrected so that the portion is reduced and the peripheral portion is enlarged. This correction is performed according to the operation of the operation input unit 80. The control unit 30 outputs the corrected image data to the laser output control unit 50. Details of image correction by the control unit 30 will be described later.

The storage unit 40 stores a program executed by the control unit 30, various values acquired by calculation, and the like. Further, the storage unit 40 holds the image data input by the communication unit 20, the image input unit 70, and the like. Further, the storage unit 40 may store the corrected image data corrected by the control unit 30.

The laser output control unit 50 may be an arithmetic processing device or the like for controlling the laser irradiation unit 60, and for example, a laser beam based on the corrected image data stored in the storage unit 40 is set in advance. The laser irradiation unit 60 irradiates the laser with the amount of light.

The laser irradiation unit 60 has a light source unit that irradiates the laser light, scans the laser light based on the corrected image data in two dimensions, and irradiates the user's eyeball (retinal) 160 with a preset amount of light. By doing so, the image is projected onto the retina.

The image input unit 70 is for inputting image data to the image projection device 100. The image input unit 70 of the present embodiment may be, for example, an image pickup device such as a camera, and the image data captured by this image pickup device may be stored in the storage unit 40.

Further, the image input unit 70 uses an interface such as DVI (Digital Visual Interface), USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface) for image data and moving image data from an external device. You can also enter it.

The operation input unit 80 receives an operation instructing the user of the image projection device 100 to correct the image data. The operation received by the operation input unit 80 is an instruction for the control unit 30 to correct the image data.

Specifically, the operation input unit 80 of the present embodiment is an operation for enlarging the central portion of the image data and reducing the peripheral portion, or an operation for reducing the central portion and enlarging the peripheral portion. It may be a member.

Further, in the present embodiment, the degree of enlargement of the central portion and the degree of reduction of the peripheral portion of the image data may be continuously changed by the operation of the operation input unit 80. Similarly, in the present embodiment, the degree of enlargement of the peripheral portion and the degree of reduction of the central portion of the image data may be continuously changed by the operation of the operation input unit 80.

In the present embodiment, in this way, the image indicated by the corrected image data in which the central portion of the image is enlarged or the peripheral portion of the image is enlarged in accordance with the operation of the user of the image projection device 100. The image shown by the later image data is projected on the user's retina.

Further, in the present embodiment, the degree of enlargement / reduction / reduction or enlargement of the central portion and the peripheral portion of the image data can be continuously changed according to the operation.

Therefore, according to the present embodiment, for example, even when the user has a retinal disease, the user can correct the image data so that the image can be easily visually recognized, and the user has the retinal disease. It is possible to support the visual function for the user.

Further, in the present embodiment, since the image data is corrected so as not to change the angle of view, the size of the image projected on the retina by the user is maintained. In other words, according to the present embodiment, it is possible to improve the appearance for the user while allowing the user to visually recognize the entire image.

In FIG. 1, the image projection device 100 has each part, but the present invention is not limited to this. For example, the communication unit 20, the control unit 30, the storage unit 40, and the like may be provided in a control terminal or the like that is connected to the image projection device 100 and controls the image projection device 100. In this case, the image projection device 100 may be provided with at least a laser output control unit 50 and a laser irradiation unit 60.

Next, the function of the control unit of the image projection device 100 of the present embodiment will be described. FIG. 2 is a diagram illustrating a function of the control unit of the first embodiment.

The control unit 30 of the present embodiment includes an image data acquisition unit 31, an operation value acquisition unit 32, an image correction unit 33, and an image data output unit 34.

The image data acquisition unit 31 reads and acquires the image data stored in the storage unit 40. Further, the image data acquisition unit 31 acquires the image data received by the communication unit 20.

The operation value acquisition unit 32 acquires a value corresponding to the operation received by the operation input unit 80 and notifies the image correction unit 33 of the value.

The image correction unit 33 corrects the image data acquired by the image data acquisition unit 31. Specifically, in the present embodiment, this image is obtained according to the value notified from the operation value acquisition unit 32 without changing the size (angle of view) of the image indicated by the image data acquired by the image data acquisition unit 31. The central part of the image is enlarged and the peripheral part is reduced, or the central part of this image is reduced and the peripheral part is enlarged. The details of the image correction unit 33 will be described later.

The image data output unit 34 outputs the corrected image data corrected by the image correction unit 33 to the laser output control unit 50. In the following description, the image data after the correction by the image correction unit 33 is referred to as projection image data.

Next, the operation of the image projection device 100 of the present embodiment will be described with reference to FIG. FIG. 3 is a flowchart illustrating the operation of the image projection device of the first embodiment.

The control unit 30 of the image projection device 100 of the present embodiment acquires image data by the image data acquisition unit 31 and projects the image data on the user's retina (step S31). Specifically, the control unit 30 outputs the acquired image data to the laser output control unit 50, controls the laser irradiation unit 60 by the laser output control unit 50, and irradiates the laser beam according to the image data. The image (image before correction) is projected onto the user's retina.

In the present embodiment, for example, the image data acquired by the image data acquisition unit 31 may be set in advance in the control unit 30. Specifically, for example, the image data acquisition unit 31 is preset to determine whether to acquire the image data stored in the storage unit 40 or the image data received by the communication unit 20. Is also good.

Further, in the present embodiment, when the communication unit 20 receives the image data, the image data acquisition unit 31 preferentially acquires the received image data, and the communication unit 20 receives the image data. If not, the image data stored in the storage unit 40 may be acquired.

Subsequently, the control unit 30 determines whether or not the operation value acquisition unit 32 has accepted the operation for instructing the image correction (step S32). Specifically, the control unit 30 determines whether or not the operation value acquisition unit 32 has acquired the value corresponding to the operation of the operation input unit 80.

If the operation is not accepted in step S32, the control unit 30 waits until the operation is accepted.

When the operation is accepted in step S32, the control unit 30 corrects the acquired image data by the image correction unit 33 (step S33). Details of step S33 will be described later.

Subsequently, the control unit 30 acquires the projection image data output from the image correction unit 33 and outputs it to the laser output control unit 50 (step S34).

Subsequently, when the laser output control unit 50 acquires the projection image data, the laser output control unit 50 controls the laser irradiation unit 60 to irradiate the laser beam according to the projection image data, and uses the projection image (corrected image). It is projected onto a person's retina (step S35).

If the image data to be projected is a moving image from a camera or a moving image (video) source reproduced by an external device, the above processing is repeatedly executed to project the corrected moving image onto the user's retina in real time. be able to.

In the example of FIG. 3, first, the image data before correction is projected onto the retina of the user, but the present invention is not limited to this. The image data before correction does not have to be projected on the retina of the user, and the image data for projection after correction may be projected on the retina of the user.

Next, with reference to FIG. 4, the image correction by the image correction unit 33 of the present embodiment will be described. FIG. 4 is a flowchart illustrating image correction in the first embodiment. FIG. 4 shows the details of step S33 shown in FIG.

In the image projection device 100 of the present embodiment, the image correction unit 33 of the control unit 30 divides the image indicated by the image data acquired by the image data acquisition unit 31 at equal intervals (step S41). As for the dividing direction, it is preferable to divide both the vertical direction and the horizontal direction at equal intervals, but the division may be performed at equal intervals in either the vertical direction or the horizontal direction.

Subsequently, the image correction unit 33 acquires the value corresponding to the operation of the operation input unit 80 by the operation value acquisition unit 32 (step S42). In the following description, the value acquired by the operation value acquisition unit 32 is referred to as an operation value.

Hereinafter, for example, a case where the operation input unit 80 is a physical operation button or the like will be described. In this case, the operation value acquisition unit 32 may use, for example, the number of times the operation button is pressed, the time during which the operation button is pressed, or the like as the operation value. When the operation input unit 80 is a dial or the like, the operation value acquisition unit 32 may use the rotation amount of the dial or the like as the operation value.

Subsequently, the image correction unit 33 calculates the width of each region so that the width of the regions divided at equal intervals is a geometric progression having the operation value acquired in step S42 as a common ratio (step S43). ..

Subsequently, the image correction unit 33 calculates the height of each region so that the value of the height of the regions divided at equal intervals becomes a geometric progression with the operation value as a common ratio (step S44).

Subsequently, the image correction unit 33 changes the width and height of each region based on the calculated width and height of each region, and creates projection image data (step S45).

Hereinafter, image correction by the image correction unit 33 of the present embodiment will be further described with reference to FIGS. 5 and 6. FIG. 5 is a first diagram illustrating image correction in the first embodiment. FIG. 6 is a second diagram illustrating image correction in the first embodiment.

FIG. 5 shows an example of the image 51 before the correction, and FIG. 6 shows an example of the corrected images 51A and 51B after the correction. Note that, in FIGS. 5 and 6, for convenience of explanation, a one-color image is used. Further, in the examples of FIGS. 5 and 6, the image is divided into equal intervals in the horizontal direction.

The image 51 is an image indicated by the image data acquired by the image data acquisition unit 31. The image correction unit 33 identifies a line S that passes through the center point P in the image 51 and divides the image 51 into two equal parts. The center point P is, for example, the center of gravity of the rectangle shown in the image 51. Next, the image correction unit 33 divides the image 51 at equal intervals so that the number of regions divided by the line S is the same on the left and right.

In the example of FIG. 5, the image correction unit 33 divides the right side region and the left side region into 5 regions L1 to L5, respectively, with the line S as the center (reference). Therefore, in the example of FIG. 5, the region of the central portion is two regions L1 located on both sides of the line S.

Here, with respect to the line S, the width of the right region and the width of the left region are Wt, the number of divisions between the right region and the left region is n, and the width of the divided central region is defined as n. In the present embodiment, the relationship between the width Wt and the width Wm is expressed by the following equation.

Wt = Wm (1 + a + a ² + ... + a ^(n-1) ) Equation (1)
Here, a is a common ratio. In other words, a is an operation value acquired in response to the operation received by the operation input unit 80. In the example of FIG. 5, n = 5. Further, in the present embodiment, for example, when Wt = 1 and a = 1.2,
Wm = Wt / (1 + a + a ² + a ³ + a ⁴ ) = 0.1344
Will be.

Next, the image correction unit 33 corrects the width of each region Wn with the common ratio a = 1.2. Specifically, in the corrected image 51A shown in FIG. 6A, the width W _{1 of} the corrected region L1', the width W _{2 of} the corrected region L2', and the width W of the corrected region L3' _3, the width _{W 4} of the corrected region L4 ', as common ratio a = 1.2, and shows a state that is calculated using equation (1).

In FIG. 6A, since the common ratio a is a value larger than 1, the image is divided at equal intervals in the horizontal direction, the division width of the central portion is made the narrowest, and the division width becomes larger as the distance from the central portion increases. The image is corrected so that it increases monotonically.

In other words, in the present embodiment, the image is divided into regions having a width of equal intervals centered on the reference position without changing the angle of view of the image, and the width of the regions is geometric progression as the distance from the reference position increases. Correct so that it increases to.

In the present embodiment, by this correction, the central portion of the image can be reduced and the image can be enlarged toward the peripheral portion while maintaining the size (angle of view) of the image before the correction.

FIG. 6B shows the corrected image 51B obtained by correcting the image 51 with the common ratio set to a value less than 1. In the corrected image 51B shown in FIG. 6B, since the common ratio a is less than 1, the image is divided at equal intervals in the horizontal direction, the division width of the central portion is widest, and the division width is widened from the central portion. The image is corrected so that the division width decreases monotonically as the distance increases.

In other words, in the present embodiment, the image is divided into regions having a width of equal intervals centered on the reference position without changing the angle of view of the image, and the width of the regions is geometric progression as the distance from the reference position increases. Correct so that it decreases to.

In the present embodiment, by this correction, the central portion of the image can be enlarged and the image can be reduced toward the peripheral portion while maintaining the size (angle of view) of the image before the correction.

At this time, the range of the common ratio a is preferably, for example, about 0.7 <a <1.3, but the range of the common ratio a may be set in advance and is not limited to this range.

Further, in the present embodiment, the common ratio a is determined according to the operation value acquired by the operation value acquisition unit 32. Therefore, in the present embodiment, the degree to which the width of the region is geometrically decreased or increased is changed according to the operation on the operation input unit 80.

5 and 6 show a case where the width of the divided region in the horizontal direction is corrected, but in the present embodiment, the height of the divided region in the vertical direction is also corrected in the same manner.

Further, in the examples of FIGS. 5 and 6, the image correction unit 33 corrects the divided regions so that the width and height of the divided regions are geometric progressions, but the present invention is not limited to this. The image correction unit 33 may correct the width and height of the divided regions so that they are arithmetic progressions. In this case, the operation value acquired by the operation value acquisition unit 32 is a tolerance.

Specifically, in this case, the relationship between the width Wt of the image 51 shown in FIG. 5 and the width Wm of each region is as shown in the following equation (2).

Wt = Wm × (n / 2) + (b + 2b + 3b + 4b) Equation (2)
Here, for example, when Wt = 1, n = 10, and b = 0.05, the width Wm is as follows.

Wm = (2 × (Lt− (10 × b)) / n = 0.1
In this case, since the value of the width Wm cannot be negative, the range of the tolerance b is preferably -0.05 <b <0.05, for example, but the range of the tolerance b is It may be set in advance and is not limited to this range.

In the present embodiment, if the tolerance b is a value larger than 0, the image 51 has the narrowest division width of the central portion, and the image has a monotonically increasing division width as the distance from the central portion increases. It will be corrected. In the present embodiment, if the tolerance b is a value smaller than 0, the image 51 has the widest division width of the central portion, and the image has a monotonically decreasing division width as the distance from the central portion increases. It will be corrected.

FIG. 7 is a diagram showing an example of projection image data. The image 71 shown in FIG. 7A is an example of an image shown by the image data acquired by the image data acquisition unit 31. The image 71 includes a circular image 71a arranged in the central portion and circular images 71b, 71c, 71d, 71e arranged in the peripheral portion.

The image 72 shown in FIG. 7B is an example of an image shown by the projection image data after the image data showing the image 71 is corrected by the image correction unit 33.

In the image 72, the central portion is reduced and the peripheral portion is enlarged as compared with the image 71. Therefore, the projection image data showing the image 72 is obtained by correcting the image data showing the image 71 with the common ratio according to the operation value set to a value larger than 1.

In the image 72, by reducing the central portion of the image 71, the image 72a corresponding to the circular image 71a of the image 71 is shrunk toward the central portion, and corresponds to the circular images 71b, 71c, 71d, 71e of the image 71. Images 72b, 72c, 72d, 72e are stretched towards the central portion.

Therefore, for example, when the image 72 is projected onto the retina of a user whose visual field in the region corresponding to the circular image 71b of the image 71 is lost due to a retinal disease, the image corresponding to the circular image 71b is projected. It may be possible to visually recognize 72b.

The image 73 shown in FIG. 7C is an example of an image shown by the projection image data after the image data indicating the image 73 is corrected by the image correction unit 33.

In the image 73, the central portion is enlarged and the peripheral portion is reduced as compared with the image 71. Therefore, the projection image data showing the image 73 is obtained by correcting the image data showing the image 71 with the common ratio according to the operation value set to a value of less than 1.

In the image 73, by enlarging the central portion of the image 71, the image 73a corresponding to the circular image 71a of the image 71 is stretched toward the peripheral portion, and corresponds to the circular images 71b, 71c, 71d, 71e of the image 71. The images 73b, 73c, 73d, 73e are shrunk toward the peripheral portion.

Therefore, for example, when the image 73 is projected onto the retina of a user whose visual field in the region corresponding to the circular image 71a of the image 71 is lost due to a retinal disease, the image corresponding to the circular image 71a is projected. The 73a may be visible.

Further, in the present embodiment, the image 71 may be continuously changed to the image 72 or the image 73 according to the operation on the operation input unit 80. In this case, the image projection device 100 may cause the user to project as a moving image how the image 71 changes to the image 72 according to the operation input unit 80. Further, in the present embodiment, each of the change from the image 72 to the image 73 and the change from the image 73 to the image 72 may be projected on the user's retina as a moving image.

In this embodiment, in this way, while maintaining the symmetry of the image according to the operation of the user,
It can be expanded and contracted freely.

Therefore, according to the present embodiment, a user having a retinal disease such as a central / partial scotoma or a narrowed visual field can freely correct an image so that the user can easily see the image according to the mode of the disease. can do. Therefore, according to the present embodiment, it is possible to effectively support the visual function of a user having a retinal disease.

Further, in the present embodiment, since the image data is corrected so as not to change the angle of view, the size of the image projected on the retina by the user is maintained. Therefore, in the present embodiment, it is possible to improve the appearance of the central portion or the peripheral portion while allowing the user to visually recognize the entire image.

(Second embodiment)
The second embodiment will be described below with reference to the drawings. The second embodiment differs from the first embodiment in that a reference position can be set when the image before correction is divided. Therefore, in the following description of the second embodiment, the differences from the first embodiment will be described, and those having the same functional configuration as the first embodiment will be described in the description of the first embodiment. A code similar to the code used will be assigned, and the description thereof will be omitted.

FIG. 8 is a diagram illustrating a function of the control unit of the second embodiment. The control unit 30A of the present embodiment includes an image data acquisition unit 31, an operation value acquisition unit 32, an image correction unit 33, an image data output unit 34, and a reference position setting unit 35.

The reference position setting unit 35 of the present embodiment sets the reference position when the image is divided into equal intervals in the image before correction.

The reference position will be described below with reference to FIG. FIG. 9 is a diagram illustrating the setting of the reference position of the second embodiment.

FIG. 9 shows a case where the line S1 is set as a reference in the image 51. In the example of FIG. 9, since the line S1 serves as a reference when dividing the image at equal intervals, the two regions L11 adjacent to each other with the line S1 in between are the central regions.

That is, in the present embodiment, the region centered on the line S1 is enlarged or reduced by the image correction unit 33.

In the example of FIG. 9, the line S1 is set as the reference position, but the reference position is not limited to this. The reference position may be a point. When a point is set as the reference position, the image 51 is divided into the vertical direction and the horizontal direction at equal intervals around the point, and the area adjacent to the vertical direction via the point and the point. The area adjacent to each other in the lateral direction may be set as the central area.

When the reference position is a point, the area of the circle with the shortest radius among the concentric circles centered on this point and the area where this circle and the circle with the next shortest radius do not overlap are adjacent to each other. It may be an area to be used.

Next, the operation of the control unit 30A of the present embodiment will be described with reference to FIG. FIG. 10 is a flowchart illustrating the operation of the image projection device of the second embodiment.

The control unit 30A of the present embodiment acquires image data by the image data acquisition unit 31 and projects the image data onto the user's retina (step S1001).

Subsequently, the control unit 30A determines a position that serves as a reference for correction by the image correction unit 33 by the reference position setting unit 35 (step S1002).

Since the processing from step S1003 to step S1005 in FIG. 10 is the same as the processing from step S33 to step S35 in FIG. 3, the description thereof will be omitted.

In the present embodiment, since the reference position for correction by the image correction unit 33 can be arbitrarily set in this way, an arbitrary region of the image projected on the user's retina is enlarged or reduced according to the user's request. be able to.

(Third embodiment)
The third embodiment will be described below with reference to the drawings. The third embodiment differs from the first embodiment in that the image projection device is an eyewear type. Therefore, in the following description of the third embodiment, the differences from the first embodiment will be described, and those having the same functional configuration as the first embodiment will be described in the description of the first embodiment. A code similar to the code used will be assigned, and the description thereof will be omitted.

FIG. 11 is a diagram illustrating an image projection device according to a third embodiment.

The image projection device 100A of the present embodiment includes a spectacle-shaped frame 110, a laser irradiation unit 60A, an operation input unit 80A, an optical projection unit 90, a camera 95, a cable 120, and a control device 130.

The laser irradiation unit 60A, the optical projection unit 90, and the camera 95 are attached to the frame 110. The laser irradiation unit 60A is connected to the control device 130 via the cable 120. Further, the laser irradiation unit 60A is provided with an operation input unit 80A.

In the example of FIG. 11, the image projection device 100A has a form including a spectacle-shaped frame 110, but the image projection device 100A may have a shape like goggles covering both eyes of the user.

Further, the image projection device 100A of the present embodiment is connected to the image reproduction device 200 via a cable 210.

The image reproduction device 200 is, for example, a device that reproduces and outputs an image of a tablet computer, a smartphone, a DVD (Digital Versatile Disk) player, a camera, a video camera, or the like.

In the image projection device 100A, the control device 130 is connected to the image reproduction device 200 by a cable 210 so that data communication is possible, so that image data is input, and the input image data is subjected to predetermined processing. Output the processed image data. The control device 130 may be connected to the image reproduction device 200 so that data communication can be performed wirelessly.

Hereinafter, the hardware configuration of the image projection device 100A of the present embodiment will be described with reference to FIG. FIG. 12 is a diagram illustrating a hardware configuration of the image projection device of the second embodiment.

The image projection device 100A of the present embodiment includes a control device 130 and an eyewear unit 140.

The control device 130 includes a control unit 30, a storage unit 40, a laser output control unit 50, and an image input unit 70A. Image data is input from the image reproduction device 200 to the image input unit 70A via the cable 210. The image input unit 70A of the present embodiment may be, for example, an HDMI (registered trademark) (High-Definition Multimedia Interface) connector or the like.

The eyewear unit 140 of the present embodiment includes a laser irradiation unit 60A, an optical projection unit 90, a camera 95, and an operation input unit 80A.

The optical projection unit 90 is, for example, a fixed mirror that reflects the laser light emitted from the laser irradiation unit 60A toward the user's eyeball.

The camera 95 is a part of the image input unit and captures an image of the field of view of the user wearing the eyewear unit 140. In the present embodiment, the image projection device 100A has the camera 95, but the image projection device 100A does not have to have the camera 95.

The operation input unit 80A is, for example, a touch sensor or the like. In the present embodiment, for example, when one end of the touch sensor is operated, the common ratio value increases from a value larger than 1, and when the other end is operated, the common ratio value decreases from a value less than 1. You may.

In the present embodiment, by configuring in this way, the user of the image projection device 100A can operate the operation input unit 80A while visually recognizing the image being reproduced by the image reproduction device 200. can. Therefore, according to the present embodiment, the user of the image projection device 100A can correct the image data into image data that is easy for him / her to see while visually recognizing the image output from the image reproduction device 200.

(Fourth Embodiment)
The fourth embodiment will be described below with reference to the drawings. The fourth embodiment is different from the third embodiment in that the terminal device 300 is used instead of the image reproduction device 200, and the terminal device 300 receives the correction instruction and corrects the image data. Therefore, in the following description of the fourth embodiment, the differences from the third embodiment will be described, and those having the same functional configuration as the third embodiment will be described in the third embodiment. A code similar to the code used will be assigned, and the description thereof will be omitted.

FIG. 13 is a diagram illustrating an image projection device according to a fourth embodiment.

The image projection device 100B of the present embodiment includes a spectacle-shaped frame 110, a laser irradiation unit 60A, an optical projection unit 90, a camera 95, a cable 120, and a control device 130A.

Further, in the image projection device 100B of the present embodiment, the control device 130A is connected to the terminal device 300 having the display 310 via the cable 120. The terminal device 300 is, for example, a tablet computer, a smartphone, or the like. The control device 130A may wirelessly communicate with the terminal device 300.

The image projection device 100B of the present embodiment may be included in the image projection system 500 together with the terminal device 300. In the image projection system 500 of the present embodiment, the terminal device 300 accepts an operation instructing the correction of the image data and corrects the image data.

FIG. 14 is a diagram illustrating a hardware configuration of each device included in the image projection system of the fourth embodiment.

The image projection device 100B has a control device 130A and an eyewear unit 140A. The control device 130A includes a control unit 30, a storage unit 40, a laser output control unit 50, and a communication unit 75.

The communication unit 75 of the present embodiment may be, for example, a USB (Universal Serial Bus) connector for communicating with the terminal device 300 or the like. Further, the communication unit 75 may perform wireless communication with the terminal device 300.

The eyewear unit 140A of the present embodiment includes a laser irradiation unit 60A, an optical projection unit 90, and a camera 95.

The terminal device 300 of the present embodiment includes an input unit 301, an output unit 302, an arithmetic processing unit 303, a storage unit 304, and the like.

The input unit 301 is, for example, a touch panel, an operation button, or the like for inputting information for the terminal device 300. The output unit 302 is for outputting information from the terminal device 300, for example, and is realized by a display 310 or the like.

The arithmetic processing unit 303 is, for example, a CPU (Central Processing Unit) or the like, and performs various arithmetic operations. The storage unit 304 stores a program read and executed by the arithmetic processing unit 303, data generated by an arithmetic operation by the arithmetic processing unit 303, and the like.

In the image projection system 500 of the present embodiment, the terminal device 300 corrects the image data, and the corrected image data is output to the image projection device 100B.

Hereinafter, the function of the terminal device 300 of the present embodiment will be described with reference to FIG. FIG. 15 is a diagram illustrating a functional configuration of the terminal device of the fourth embodiment.

The terminal device 300 of the present embodiment displays an operation screen for instructing image correction in addition to the functions of the control unit 30 of the first embodiment.

The terminal device 300 of the present embodiment has a correction processing unit 320. The correction processing unit 320 is realized by the arithmetic processing unit 303 reading and executing the program stored in the storage unit 304.

The correction processing unit 320 of the present embodiment includes an image data acquisition unit 31, an operation value acquisition unit 32, an image correction unit 33, an image data output unit 34, and a display control unit 36.

The display control unit 36 of the present embodiment displays an input screen for inputting an operation value on the display (display unit) 310. The operation value input on the input screen may be the tolerance a or the tolerance b itself.

FIG. 16 is a diagram showing a display example of the terminal device. On the screen 311 shown in FIG. 16, operation buttons 312, 313, and 314 are displayed.

The operation button 312 is for performing an operation for enlarging the central portion of the image and reducing the peripheral portion, and includes the operation buttons 312a and 312b. More specifically, the operation button 312 is an operation button for making the image 71 of FIG. 7 look like the image 73.

In other words, the operation button 312 is an operation button for changing the value of the common ratio a in the equation (1) from a value larger than 1 to a maximum value. In other words, the operation button 312 is an operation button for changing the value of the tolerance b in the equation (2) from a value larger than 0 to a maximum value.

In the present embodiment, when the geometric progression is used in the correction by the image correction unit 33, when the operation button 312a is operated, the value of the common ratio a becomes a value larger than the current value, and the operation button 312b When is manipulated, the value of the geometric ratio a becomes smaller than the current value. Further, when the arithmetic progression is used in the correction by the image correction unit 33, when the operation button 312a is operated, the value of the tolerance b becomes a value larger than the current value, and the operation button 312b is operated. Then, the value of the tolerance b is smaller than the current value.

The operation button 313 is for performing an operation for enlarging the peripheral portion of the image and reducing the central portion, and includes the operation buttons 313a and 313b. More specifically, the operation button 313 is an operation button for making the image 71 of FIG. 7 look like the image 72.

In other words, the operation button 312 is an operation button for changing the value of the common ratio a in the equation (1) from a value less than 1 to a minimum value. In other words, the operation button 312 is an operation button for changing the value of the tolerance b in the equation (2) from a value less than 0 to a minimum value.

Here, instead of separately providing the operation buttons 312a and 312b for enlarging and reducing the central portion and the operation buttons 313a and 313b for enlarging and reducing the peripheral portion, only the operation buttons 312a and 312b are provided and the 312a is operated. When this happens, the central portion may be enlarged and the peripheral portion may be reduced according to the enlargement ratio of the central portion.

In the present embodiment, when the geometric progression is used in the correction by the image correction unit 33, when the operation button 313a is operated, the value of the common ratio a becomes a value larger than the current value, and the operation button 313b When is manipulated, the value of the geometric ratio a becomes smaller than the current value. Further, when the arithmetic progression is used in the correction by the image correction unit 33, when the operation button 312a is operated, the value of the tolerance b becomes a value larger than the current value, and the operation button 312b is operated. Then, the value of the tolerance b is smaller than the current value.

The operation button 314 is an operation button for returning the corrected image corrected by the operation buttons 312 and 313 to the state before the correction (initial state). Specifically, the operation button 314 is an operation button for returning the image 72 or the image 73 of FIG. 7 to the image 71.

The screen shown in FIG. 16 is an example. As a means for changing the tolerance a and the tolerance b, for example, instead of the operation buttons 312 and 313, a predetermined area is provided on the touch panel, and a pinch-out operation / pinch-in operation is performed in this area to change the tolerance a. Or a means of changing the tolerance b may be realized.

Further, the means for changing the tolerance a and the tolerance b may be realized by, for example, a hardware switch provided in the terminal device 300. Specifically, for example, a hardware switch for adjusting the volume of the terminal device 300 or the like may be used.

In the present embodiment, the processing load of the image projection device 100B can be reduced by correcting the image data in the terminal device 300 in this way. Further, it is not necessary to provide the image projection device 100B with an operating member for instructing the correction of the image data, and the configuration of the image projection device 100B can be simplified.

(Fifth Embodiment)
The fifth embodiment will be described below with reference to the drawings. The fifth embodiment differs from the fourth embodiment in that the terminal device has a laser irradiation unit. Therefore, in the following description of the fifth embodiment, the differences from the fourth embodiment will be described, and those having the same functional configuration as the fourth embodiment will be described in the fourth embodiment. A code similar to the code used will be assigned, and the description thereof will be omitted.

FIG. 17 is a diagram illustrating an image projection device according to a fifth embodiment. The image projection device 100C of the present embodiment has a terminal device 300A, a case 400, and an optical projection unit 90A, and the optical projection unit 90A is attached to the terminal device 300A. The terminal device 300A is, for example, a smartphone.

The terminal device 300A includes a housing 330, a display (display unit) 310, a home button 350, and a laser irradiation unit 60 (see FIG. 18). The housing 330 exists on a portion of the outer surface of the terminal device 300A other than the display 310. The display 310 is provided on the + Z side surface parallel to the XY plane in a state of being superposed on the touch panel. The home button 350 is provided at the end of the display 310 on the −Y direction side and in the center of the X direction.

In the following, among the outer surfaces of the terminal device 300A, the surface parallel to the XY plane on the + Z direction side where the display 310 is located and the surface parallel to the XY plane on the −Z direction side opposite to the display 310 are excluded. The surface is referred to as a side surface of the terminal device 300A.

The laser irradiation unit 60 emits laser light in the + Y direction from an opening provided on the side surface of the housing 330 of the terminal device 300A on the + Y direction side. The laser beam emitted by the laser irradiation unit 60 is a laser beam capable of projecting an image.

The laser irradiation unit 60 is built in the terminal device 300A as an irradiation unit of a projector (pico projector), and emits laser light from the laser irradiation unit 60 with the + Y direction side surface of the terminal device 300A facing the screen or the like. , Project an image on a screen or the like.

Further, the terminal device 300A of the present embodiment is attached with a case 400 that covers a portion other than the display 310. The case 400 is a so-called jacket, and is made of resin as an example. A holder 450 is provided at the end of the case 400 on the + Y direction side.

The case 400 has notches 410, 420, 430. The cutout portion 410 is provided in a portion corresponding to the side surface of the terminal device 300A on the + Y direction side. The cutout portion 410 is a portion cut out so that the case 400 does not cover the side surface of the terminal device 300A on the + Y direction side, and is a portion that does not cover the opening of the terminal device 300A.

The holder 450 is integrally molded with the case 400 as an example, and extends so as to rise from the edge of the notch 410 in the + Y direction.

The cutout portion 420 is a portion cut out so as not to cover the display 310 and communicates with the cutout portion 410. Further, the cutout portion 430 is provided in a portion corresponding to the side surface of the terminal device 300A on the −Y direction side, and communicates with the cutout portion 420.

FIG. 18 is a diagram showing a hardware configuration of the image projection device according to the fifth embodiment.

The image projection device 100C of the present embodiment includes a control unit 30B, a storage unit 40, a laser output control unit 50, a laser irradiation unit 60, an image input unit 70, and an operation input unit 80B.

The operation input unit 80B is a touch panel included in the terminal device 300A. Further, in the present embodiment, the optical projection unit 90A includes an optical projection unit 90A including a mirror that reflects the laser light emitted from the laser irradiation unit 60 toward the user's eyeball.

The control unit 30B of the present embodiment has the function of the correction processing unit 320 in addition to the control of the laser output control unit 50 for projecting an image.

In other words, the image projection device 100C of the present embodiment displays an input screen for causing the display unit to input a value indicating the degree of decrease or increase in the width of the region when the image is divided at equal intervals. Has.

Therefore, in the present embodiment, the screen 311 shown in FIG. 16 may be displayed on the display 310 of the terminal device 300A.

In the present embodiment, by reducing the size of the image projection device 100C in this way, the image projection device 100C can be rented out to the user during a free time such as waiting time at a medical institution. The user can use the image projection device 100C to search for an image that is easy for the user to see.

Although the present invention has been described above based on each embodiment, the present invention is not limited to the requirements shown here, such as the configuration described in the above embodiment and the combination with other elements. With respect to these points, the gist of the present invention can be changed without impairing the gist of the present invention, and can be appropriately determined according to the application form thereof.

30, 30A, 30B Control unit 31 Image data acquisition unit 32 Operation value acquisition unit 33 Image correction unit 34 Image data output unit 35 Reference position determination unit 36 Display control unit 40 Storage unit 50 Laser output control unit 60, 60A Laser irradiation unit 70 , 70A Image input unit 80, 80A, 80B Operation input unit 90, 90A Optical projection unit 100, 100A to 100C Image projection device 300, 300A Terminal device

Claims (8)

A storage unit that stores the input image data,
With respect to the image data, the image indicated by the image data is divided into regions having a width equal to each other from the reference position while maintaining the angle of view of the image, and the width of the region increases as the distance from the reference position increases. A control unit that makes corrections so that it decreases or increases monotonously,
It has a light source unit that emits a laser beam, scans the laser beam in two dimensions based on the image data corrected by the control unit, and projects the image indicated by the corrected image data on the user's retina. An image projection device including a laser irradiation unit. The control unit
The image projection according to claim 1, wherein the width of the region closest to the reference position is made wider than the width of the equidistant interval, and the width of the region is geometrically decreased or increased as the distance from the reference position increases. Device. The reference position is
The image projection device according to claim 1 or 2, wherein the position indicated by a straight line including the center point of the image indicated by the image data. It has an operation reception unit that receives the correction instruction.
The control unit
The image projection device according to any one of claims 1 to 3, wherein the width of the region is monotonically decreased or increased in response to an instruction received by the operation receiving unit. The control unit
It has an operation value acquisition unit that acquires a value according to the operation received by the operation reception unit.
The image projection device according to claim 4, wherein the degree of decrease or increase in the width of the region is changed according to the value acquired by the operation value acquisition unit. Display and
The image projection device according to any one of claims 1 to 5, further comprising a display control unit for displaying an input screen for inputting a value indicating the degree of decrease or increase in the width of the area to the display unit. An image projection method using an image projection device, wherein the image projection device
The procedure for storing the input image data in the storage unit and
With respect to the image data, the image indicated by the image data is divided into regions having a width equal to each other from the reference position while maintaining the angle of view of the image, and the width of the region increases as the distance from the reference position increases. Procedures for making corrections to decrease or increase monotonically or geometrically, and
A procedure of having a light source unit that emits a laser beam, scanning the laser beam in two dimensions based on the corrected image data, and projecting the image indicated by the corrected image data on the user's retina. Image projection method having. The input image data is stored in the storage unit,
With respect to the image data, the image indicated by the image data is divided into regions having a width equal to each other from the reference position while maintaining the angle of view of the image, and the width of the region increases as the distance from the reference position increases. Make corrections to decrease or increase monotonically or geometrically.
A program that causes a computer to execute a process that outputs the corrected image data to a retinal scanning type image projection device.

Images