WO2017113307A1

WO2017113307A1 - Head-mounted display and method for adjusting camera thereof

Info

Publication number: WO2017113307A1
Application number: PCT/CN2015/100151
Authority: WO
Inventors: 王记
Original assignee: 深圳市柔宇科技有限公司
Priority date: 2015-12-31
Filing date: 2015-12-31
Publication date: 2017-07-06
Also published as: CN107250895A

Abstract

A method for adjusting a camera (30) of a head-mounted display (100), for use in adjusting the camera (30) of the head-mounted display (100). The method comprises the steps of: the head-mounted display (100) obtains an input operation for moving the camera (30); and controlling, according to the input operation, the camera (30) to move in a corresponding direction for a corresponding distance, wherein there is a preset corresponding relationship between the direction of movement of the camera (30) and the input operation. Also provided is a head-mounted display (100) having a camera (30). By means of the head-mounted display and the method for adjusting a camera thereof, the viewing angle can be greatly enlarged using only one camera.

Description

Head mounted display device and camera adjustment method thereof

Technical field

The present invention relates to a display device, and more particularly to a head mounted display device and a method for adjusting the same.

Background technique

Current head mounted display devices typically include a display device for outputting a display screen and a headphone device for outputting sound. Generally, when the wearer wears the head-mounted display device, only the display screen output by the display device can be seen and the external environment cannot be seen, which results in the wearer needing to remove the head-mounted display device when the wearer needs to observe the surrounding environment. Some head-mounted display devices are now equipped with a camera disposed on the display device for capturing ambient image for the wearer to view. However, the camera positions on the current head-mounted display devices are fixed, and the range of viewing angles is limited. If you want to capture more viewing angles, you need to set multiple cameras, which makes the system more complicated and costly.

Summary of the invention

The embodiment of the invention discloses a head-mounted display device and a control method thereof for the camera, which only needs to set a camera to achieve a rich viewing angle range.

A head-mounted display device disclosed in an embodiment of the invention includes a display device, a camera, and an input unit for providing near-eye display. The camera is movably disposed on an outer surface of the head mounted display device, and the input unit is configured to acquire an input operation. The display device includes a mobile drive and a controller, the mobile drive being coupled to the camera. The controller is connected to the moving driving component and the input unit, and is configured to control the moving driving component to drive the camera to move on an outer surface of the display device when the input unit inputs an input operation for the mobile camera, wherein the camera The direction and distance of movement have a preset correspondence with the input operation.

A method for adjusting a camera of a head mounted display device for adjusting a camera of a head mounted display device, the method comprising the steps of: the head mounted display device acquiring an input operation for moving the camera; and controlling the input according to the input operation The camera moves a corresponding distance in a corresponding direction, wherein the camera The direction and distance of the head movement have a preset correspondence with the input operation.

The head-mounted display device and the method for adjusting the same according to the present invention increase the imaging field of view of the camera by moving the position of the camera, without adding a plurality of cameras, saving cost and having a simple structure.

DRAWINGS

In order to more clearly illustrate that the drawings in the following description of the embodiments of the present invention are only some embodiments of the present invention, those skilled in the art can also Get other obvious ways of deformation.

1 is a perspective view of a first perspective view of a head mounted display device according to an embodiment of the invention;

2 is a functional block diagram of some components of a display device of a head mounted display device according to an embodiment of the present invention;

3 is a perspective view of a second perspective view of a head mounted display device according to an embodiment of the invention;

4 is a cross-sectional view showing a camera of a head mounted display device housed in a display device according to an embodiment of the present invention;

5 is a functional block diagram of some components of a display device of a head mounted display device according to an embodiment of the present invention;

FIG. 6 is a flowchart of a method for adjusting a camera of a head mounted display device according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

1 and FIG. 2, FIG. 1 is a perspective view of a first perspective view of a head mounted display device 100 according to an embodiment of the invention. The head mounted display device 100 includes a display device 10, an earphone device 20, a camera 30, and an input unit 40. The camera 30 is movably disposed on the display device 10 The outer surface S1. The input unit 40 is for the wearer to perform an input operation.

As shown in FIG. 2, the display device 10 includes a controller 11 and a moving drive member 12. The mobile drive 12 is coupled to the controller 11 and the camera 30. The controller 11 is further connected to the input unit 40 for controlling the mobile driving member 12 to drive the camera 30 to move on the outer surface S1 of the display device 10 when the wearer inputs an input operation for the mobile camera through the input unit 40. To get a different perspective. The direction and distance of movement of the camera 30 have a preset correspondence with the input operation. Obviously, in other embodiments, the controller 11 and the mobile drive 12 can be disposed on the earphone device 20.

Therefore, in the present invention, since the camera 30 can be moved, imaging can be performed at different positions, and the viewing angle range is increased.

Wherein, as shown in FIG. 2, the display device 10 further includes a rotary driving member 13. The rotary driving member 13 is also connected to the controller 11 and the camera 30. The controller 11 is further configured to control the rotary driving member 13 to drive the camera when the wearer inputs an input operation for the rotating camera through the input unit 40. 30 rotates at the current position, and changes the orientation of the camera 30 (the direction in which the lens is directed) to obtain different angles of view. Therefore, by controlling the rotation of the camera 30, the angle of view can be further expanded. The direction and the arc/angle of the rotation of the camera 30 have a preset correspondence with the input operation.

In an application scenario, when the wearer is dissatisfied with the range of viewing angles acquired by the camera 30, the operation of rotating the camera 30 may be performed first, so that the orientation of the camera 30 is rotated to obtain different viewing angles, when the wearer feels that the viewing angle is not satisfactory. The operation of the moving camera 30 can be performed again, so that the camera 30 is moved, and then the operation of the rotating camera 30 can be performed after stopping at the required position, and the orientation of the camera 30 is controlled to rotate. Obviously, the wearer can also perform the operation of the moving camera 30 before performing the operation of rotating the camera 30.

Referring to FIG. 3 together, the outer surface S1 of the display device 10 includes a horizontal track L1 and a vertical track L2 which intersect perpendicularly at a substantially central position.

The camera 30 is movably housed in the horizontal rail L1 or the vertical rail L2, and is movable along the horizontal rail L1 or the vertical rail L2 under the driving of the moving drive member 12.

In this embodiment, the input unit 40 is disposed on the earphone device 10, and the input unit 40 is Touchpad. In other embodiments, the input unit 40 can be a mechanical button control panel or a control panel that combines a touchpad with mechanical buttons. The wearer can select the corresponding menu option through the input unit 40. The display device 10 can display a menu option for setting a camera, and the wearer can select the menu option of the camera to activate the camera adjustment mode. The wearer can also activate the camera adjustment mode by performing a specific touch action, which can be a double tap touch operation or the like. The input unit may further include a physical button, and when the physical button is triggered, for example, when the button is pressed, or when the rotary button is rotated, the controller 11 controls the camera 30 to be turned on, and controls the display device 10 to display the output of the camera 30. Captured image.

The input unit 40 is used for the wearer to input the operation of adjusting the camera 30 when the camera adjustment mode is activated. That is, after the camera adjustment mode is activated, the operation input by the input unit 40 is regarded as an operation of adjusting the camera. In the present embodiment, the outer surface S1 of the display device 10 is mapped to the input unit 40. Wherein, when the touch action of the wearer is sliding, the controller 11 determines that the input of the wearer is an input operation for controlling the movement of the camera 30, and controls the movement of the camera 30. The controller 11 controls the mobile driving unit 12 to drive the camera 30 to move in a corresponding direction by a corresponding distance according to the direction and distance of the touch action. The distance that the camera 30 moves may be equal to or proportional to the distance of the touch action, for example, 2 times, 2.5 times, or the like of the distance of the touch action.

Wherein, when the camera 30 is currently in the horizontal track L1 and the touch action input by the input unit 40 is vertical sliding, the controller 11 controls the mobile driving member 12 to drive the camera 30 to move to the intersection of the horizontal track L1 and the vertical track L2. At this point, the camera 30 is then driven to move a corresponding distance along the vertical track L2 in the vertical direction of motion.

In an embodiment, after the touch action of the wearer ends, the controller 11 determines the distance and direction of movement of the camera 30 according to the start point and the end point of the touch action, and then controls the mobile driving component 12 to drive the camera 30 to perform corresponding mobile. In another embodiment, the controller 11 controls the camera 30 to perform real-time movement based on real-time changes in the touch action.

Wherein, when the trajectory of the touch action of the wearer is a circular arc line, the controller 11 determines that the input of the wearer is an input operation for controlling the rotation of the camera 30. The controller 11 controls the movement driving member 12 to drive the camera 30 to rotate in a corresponding direction by a corresponding angle according to the direction and the arc/angle of the circular arc input by the wearer. Wherein, the angle of rotation of the camera 30 is equal to the arc of the arc line input by the wearer or proportional to the arc of the arc line input by the household, for example, the curvature of the user input 1/3, 1/2, etc.

The controller 11 also resets the camera 30 to a predetermined initial position in response to a reset operation input by the wearer at the input unit 40. In this embodiment, the reset operation may be a touch action of a fork "X", and the controller 11 controls the mobile drive member 12 to drive the camera 30 to the preset initial position in response to the "X" input by the input unit 40. . The preset initial position may be a position of the intersection of the horizontal track L1 and the vertical track L2, an end of the horizontal track L1, or an end of the vertical track L2.

The input unit 40 generates a touch signal in response to a touch operation of the wearer, and the controller 11 receives the touch signal to determine a touch position and a touch track, thereby determining an input operation of the wearer.

Wherein, the controller 11 also controls the display device when the camera 30 moves to the end of the horizontal track L1 or the end of the vertical track L2 and can no longer move, that is, when the camera 30 moves to the farthest distance in one direction and cannot move any more. 10 generates a prompt screen or controls the earphone device 20 to generate a prompt tone, prompting the wearer to move to the farthest position in this direction at this time.

Wherein, when the wearer turns on the camera 30 to perform imaging and the camera adjustment mode is activated, the controller 11 further combines the pictures taken during the moving process or the rotation of the camera 30 in response to the panoramic shooting operation input by the wearer through the input unit 40. A panoramic image is formed, or the video captured during the moving process or the rotation of the camera 30 is combined into a panoramic video. The panoramic photographing operation input by the wearer is an operation of selecting a menu option for panoramic shooting.

Please refer to FIG. 4 together, which is a schematic cross-sectional view of the camera 30 housed in the horizontal track L1 or the vertical track L2. The camera 30 includes a connecting member 31 and a camera body 32 fixedly disposed on the connecting member 31. The connecting member 31 is fitted into the horizontal rail L1 or the vertical rail L2 in cooperation with the horizontal rail L1 or the vertical rail L2 and is movable along the horizontal rail L1 or the vertical rail L2.

In the present embodiment, the connecting member 31 is a T-shaped structure, and the horizontal rail L1 or the vertical rail L2 forms an opening T1 on the outer surface and extends along the opening T1 toward the inner direction of the head mounted display device 100. The groove, and the width of the opening T1 is smaller than the width of the bottom surface of the track. The opening T1 extends in the direction of the horizontal track L1 or the vertical track L2. The connector 31 is housed in the horizontal rail L1 or the vertical rail L2 and the camera body 32 protrudes from the horizontal rail L1 or the opening T1 of the vertical rail L2.

In an embodiment, the mobile driving member 12 is connected to the connecting member 31 for controlling the movement of the connecting member 31 to drive the camera body 32 of the camera 30 to move. The rotary driving member 13 can be disposed on The connecting member 31 is connected to the camera body 32 for driving the orientation of the camera body 32 to change, that is, changing the orientation of the camera 30.

Referring to FIG. 5 together, the display device 10 further includes a display module 14 for generating a display screen to the wearer's eyes 200. The controller 11 is also connected to the camera 30 for integrating the image or video captured by the camera 30 with the content originally displayed by the display module 14. For example, the controller 11 displays the image or video taken by the camera 30 in the form of picture-in-picture in the content originally displayed by the display module 14.

The display module 14 can include a micro display and an optical module for generating a display screen for projecting the display image into the wearer's eye 200 through a certain optical path.

The moving driving member 12 and the rotating driving member 13 may be motors. The controller 11 can be a central processing unit, a microcontroller, a single chip microcomputer, a digital signal processor, or the like.

As shown in FIG. 1 , the earphone device 20 includes an endless belt 21 and two earpieces 22 . The two earpieces 22 are respectively disposed at two ends of the endless belt 21 and connected by the endless belt 21 . The input unit 40 is disposed on an outer surface of any of the earpieces 22.

In other embodiments, the head mounted display device 100 may further include a control box (not shown) connected to the display device 10 and/or the earphone device 20, and the input unit 40 may be disposed on the On the control box. It will be apparent that the head mounted display device 100 may also include other components, which are not described herein because they are not related to the improvements of the present invention.

Please refer to FIG. 6 , which illustrates a method for adjusting a camera of a head mounted display device according to an embodiment of the invention. The method is for adjusting the position and/or angle of the camera 30 of the wearable display device 100 of any of the above embodiments. The order of the steps involved in the method can be arbitrarily replaced, and is not limited to the order in the flowchart. The method includes the steps of:

When the input unit 40 of the head mounted display device inputs an input operation for the moving camera, the controller 11 controls the camera to move on the display device 10 (S601). The direction and distance of movement of the camera 40 have a preset correspondence with the input operation. The input unit 40 is a touch panel. When the touch action is sliding, the controller 11 controls the camera 30 to move a corresponding distance in a corresponding direction according to the direction and distance of the touch action. The distance that the camera 30 moves is proportional to the distance of the touch action.

When the input operation of the rotary camera is input from the input unit 40 of the head mounted display device, the camera rotation is controlled (S603). The direction and angle of rotation of the camera 40 have a preset correspondence with the input operation. When the trajectory of the touch action of the wearer is a circular arc line, the controller 11 determines that the input of the wearer is an input operation for controlling the rotation of the camera 30, and the controller 11 according to the direction and curvature/angle of the circular arc line input by the wearer The camera 30 is controlled to rotate in a corresponding direction by a corresponding angle. The angle of rotation of the camera 30 is equal to the arc of the arc line input by the wearer or proportional to the arc of the arc line input by the household.

Wherein, the method further comprises the step of resetting the camera 30 to a preset initial position on the display device 10 in response to a reset operation input by the wearer at the input unit.

Wherein, the method further includes the step of: in response to the camera 30 moving to the farthest position in one direction, controlling the display device 10 to generate a prompt screen or controlling the earphone device 20 to generate a prompt sound, prompting the wearer to move to the farthest direction in the direction at this time. position.

Wherein, the method further includes the step of: when the wearer turns on the camera 30 and the camera adjustment mode is activated, the controller 11 moves the camera 30 during the moving process or the rotation process in response to the panoramic shooting operation input by the wearer through the input unit 40. The captured pictures are combined into a panoramic image, or the video captured during the moving process or the rotation of the camera 30 is combined into a panoramic video.

The method further includes the step of: the controller 11 integrating the image or video captured by the camera 30 with the content originally displayed by the display device 10 for display.

The above is a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It is the scope of protection of the present invention.

Claims

A head mounted display device includes a display device for providing a near-eye display, wherein the head mounted display device further includes a camera and an input unit, the camera is movably disposed on an outer surface of the head mounted display device, The input unit is configured to acquire an input operation; the display device includes a mobile driving component and a controller, the mobile driving component is connected to the camera, and the controller is connected to the moving driving component and the input unit, for When the input unit inputs an input operation of the mobile camera, the mobile driving device is controlled to drive the camera to move on the outer surface of the display device, wherein the direction and distance of the camera movement have a preset correspondence with the input operation.
A head mounted display device according to claim 1, wherein said outer surface is provided with a track through which said camera is movably disposed on a head mounted display device.
A head mounted display device according to claim 2, further comprising an earphone device connected to the display device for outputting audio; said track being disposed on an outer surface of said display device and/or an earphone device The outer surface.
A head mounted display device according to claim 1, wherein said display device further comprises a rotary driving member, said moving driving member being coupled to said controller and said camera, said controller being further for When the input unit acquires an input operation of the rotating camera, the rotating driving member is driven to drive the camera to rotate at the current position, and the orientation of the camera is changed, and the direction and the arc/angle of the camera rotation and the input operation are pre- Correspondence relationship.
A head mounted display device according to claim 2, wherein said display means comprises a horizontal track and a vertical track on an outer surface, said horizontal track and said vertical track intersecting perpendicularly at a substantially central position The camera is movably received in a horizontal track or a vertical track and is movable along a horizontal track or a vertical track driven by a moving drive.
The head-mounted display device according to claim 1, wherein the input unit is a touch panel, and the input operation comprises selecting a menu option for setting a camera or performing a specific touch action to activate a camera adjustment mode. After the camera adjustment mode is activated, the input unit is configured to acquire an input operation of adjusting the camera.
The head-mounted display device according to claim 1, wherein the input unit is a touch panel, and when the touch input operation acquired by the touch panel is sliding, the controller determines the acquired In order to control the input operation of the camera movement, according to the direction and distance of the touch input operation, the mobile driving device is controlled to drive the camera to move in a corresponding direction by a corresponding distance, wherein the distance moved by the camera and the touch input operation The distance is proportional.
The head-mounted display device according to claim 4, wherein the input unit is a touch panel, and when the trajectory of the touch input operation acquired by the touch panel is a circular arc line, the controller determines that the acquired control is The input operation of the camera rotation, and according to the direction and the arc/angle of the circular arc, the rotation driving member is driven to rotate the camera to a corresponding angle in a corresponding direction, wherein the angle of rotation of the camera is proportional to the arc of the circular arc relationship.
A head mounted display device according to claim 1, wherein said controller further resets the camera to a predetermined initial position in response to a reset operation acquired by the input unit.
The head-mounted display device according to claim 1, wherein the controller controls the display device to generate a prompt screen or control the earphone device to generate a prompt when the camera moves to the farthest distance in one direction and cannot move any more. Tone, the camera has moved to the farthest position in this direction.
The head-mounted display device according to claim 4, wherein the controller further combines the pictures taken during the camera moving process or the rotation into a panoramic image in response to the panoramic shooting operation acquired by the input unit, or The video captured during the camera movement or rotation is combined into a panoramic video.
The head-mounted display device according to claim 2, 3 or 5, wherein the camera comprises a connecting member and a camera body fixedly disposed on the connecting member, wherein the connecting member is engaged with the rail and is received by the camera The track is movable within the track.
A head mounted display device according to claim 12, wherein said connecting member is a T-shaped structure, said rail forming an opening in said outer surface and facing an interior of said head mounted display device along said opening The direction extends to form a through slot, and the width of the opening is smaller than the width of the bottom surface of the track, the connector is received in the track and the camera body projects from the opening of the track.
The head-mounted display device according to claim 1, wherein the input unit comprises a physical button, and when the physical button is triggered, the controller controls the camera to be turned on, and controls the display device to display the output. The image captured by the camera.
Method for adjusting camera of head mounted display device for adjusting head mounted display device Camera, characterized in that the method comprises the steps of:

The head mounted display device acquires an input operation for moving the camera;

The camera is controlled to move a corresponding distance in a corresponding direction according to the input operation, wherein the direction and distance of movement of the camera have a preset correspondence with the input operation.
The adjustment method according to claim 15, further comprising the steps of:

The head mounted display device acquires an input operation for rotating the camera;

The control camera rotates the corresponding angle in a corresponding direction, wherein the direction and the arc/angle of the camera rotation have a preset correspondence with the input operation.
The method of adjusting according to claim 15, wherein the method further comprises:

The input operation further includes a reset operation, and the head mounted display device resets the camera to a preset initial position according to the reset operation.
The method of adjusting according to claim 15, wherein the method further comprises:

In response to the camera moving to the farthest position in one direction, the control display device generates a prompt screen or controls the earphone device to generate a prompt tone, prompting the wearer to move to the farthest position in this direction.
The method of adjusting according to claim 16, wherein the method further comprises:

The input operation further includes a panoramic shooting operation, and the head mounted display device combines the images captured during the camera moving process or the rotation into a panoramic image according to the panoramic shooting operation, or takes a picture during the moving process or the rotation of the camera The video is combined into a panoramic video.