WO2018223469A1

WO2018223469A1 - Dynamic projection device and operation method thereof

Info

Publication number: WO2018223469A1
Application number: PCT/CN2017/091410
Authority: WO
Inventors: 杨伟樑; 高志强; 林清云
Original assignee: 广景视睿科技（深圳）有限公司
Priority date: 2017-06-08
Filing date: 2017-07-03
Publication date: 2018-12-13
Also published as: CN107065409A

Abstract

A dynamic projection device (200) and an operation method. The dynamic projection device (200) comprises a projection display unit (10), a first image acquisition unit (20), a second image acquisition unit (30), a first direction control unit (40), a second direction control unit (50), and a central processing unit (60). The dynamic projection device (200) can follow the intended projection direction of a user (100), change, according to the intention of the user (100) and in real time, a direction of a projection lens and an acquisition direction of a projection image, and perform real-time image correction on the acquired projection image, thereby achieving a high-quality and intelligent projection display effect.

Description

Moving projection device and working method thereof

Technical field

The present invention relates to the field of digital projection display technology, and more particularly to a motion projection apparatus and a method of operating the same.

Background technique

With the development of science and technology, especially the promotion of semiconductor technology, portable electronic devices are constantly being designed and manufactured. The ever-improving and upgrading of portable electronic devices has made users increasingly demanding display devices with human-machine interfaces toward micro, large screen and high resolution. Driven by the strong demand of users, projector technology has developed rapidly in recent years. DLP, LCOS and other products have launched portable projectors with high performance, small size and light weight.

In the field of projection display technology, the functions of various projection devices vary depending on their use scenarios. For example, in a home or a large stage, the projection device needs to perform multi-directional projection display according to the user's intentional projection direction, which requires the projection device to recognize and track the user's intentional projection position direction, thereby changing the projection direction of the projection lens, and performing high. Intelligent projection of quality. Therefore, the development of an intelligent projection system and method for tracking the intentional projection direction of the user, changing the direction of the projection lens in real time and performing projection image correction processing to realize high-quality projection display has become one of the research focuses in the field of projection display technology in the future.

It is to be understood that the information disclosed in this Background section is only intended to increase the understanding of the general background of the invention, and should not be construed as an admission or in any way suggesting that the information constitutes an existing one that is known to those of ordinary skill in the art. technology.

Summary of the invention

In view of the above technical problems, an object of the present invention is to provide a motion projection apparatus and a working method thereof, which can track a user's intentional projection direction, change the direction of the projection lens and the collection direction of the projection image in real time according to the user's intention, and The captured image is subjected to real-time image correction to achieve high-quality intelligent projection display. The motion projection device and the working method thereof can be applied to various occasions, giving the user different visual enjoyment and entertainment effects.

According to an aspect of the present disclosure, a motion projection apparatus is provided, the apparatus comprising: a projection display unit; a first image acquisition unit for acquiring an image containing directional information of a user; and a second image acquisition unit for collecting An image for display by the projection display unit; a first direction control unit for rotating when necessary to change an image acquisition direction of the first image acquisition unit; and a second direction control unit for rotating when necessary Changing a projection lens direction of the projection display unit and an image acquisition direction of the second image acquisition unit; and a central processing unit, the projection display unit, the first image acquisition unit, the second image acquisition unit, and the first direction control The unit and the second direction control unit are coupled to each other, and include: a movement processing unit, configured to acquire the directionality information of the user according to the image acquired by the first image acquisition unit, and calculate the first direction control according to the directionality information of the user. The respective rotation angles of the unit and the second direction control unit, and the image correction unit For second image acquisition unit for real-time correction of the projection image.

Preferably, the first image acquisition unit and/or the second image acquisition unit is an infrared three-dimensional tester or a camera.

Preferably, the first direction control unit and/or the second direction control unit is a pan/tilt or a multi-dimensional motion stage capable of performing spherical rotation.

Preferably, the projected image correction includes correction of projection autofocus, projected image/direction correction, projected background color, brightness, and surface unevenness, and the projected image/direction correction further includes projection image malformation correction and direction correction.

Preferably, the motion projection apparatus further includes: a storage unit configured to store content for display by the projection display unit; and a wireless communication unit configured to wirelessly transmit real-time projection information to the projection display unit.

Preferably, the user is a person, a robot or other animal, and the user's directional information is selected from the group consisting of One or more of the group consisting of the swinging direction of the user's head, the direction pointed by the user's hand, the direction of the user's eyes, and the user's voice information.

According to another aspect of the present disclosure, there is provided a method of operation of the foregoing motion projection apparatus, after the motion projection apparatus starts normal projection display, the working method includes: collecting an image including directional information of a user; And obtaining the directional information of the user; performing, according to the directional information of the user, determining the motion information; and determining, according to the result of the motion information, the first direction control unit and/or the second direction control unit, if necessary The corresponding movement.

Preferably, the determining, according to the directional information of the user, the moving direction information comprises: setting an angular range of the user to the directional movement; and calculating, according to the directional information of the user, the vertical direction of the user's intentional projection direction relative to the original projection image or The angle of the horizontal axis of symmetry deflection; determining whether the calculated deflection angle is within the set angle range; when the calculated deflection angle is within the set angle range, neither the first direction control unit nor the second direction control unit rotates And when the calculated deflection angle exceeds the set angle range, the first rotation angle of the first direction control unit and/or the second rotation angle of the second direction control unit is calculated according to the intentional projection direction of the user.

Preferably, setting the angular range of the user to the directional movement comprises automatically or manually setting an angular range of -5° to 5°, −10° to 10° or -20° to 20° according to the projected screen size.

Preferably, the first direction control unit and/or the second direction control unit perform corresponding motions: the first direction control unit and/or the second direction control unit respectively rotate the calculated first rotation angle and/or the second The angle of rotation.

Preferably, the working method further comprises: performing real-time projection image correction on the image acquired by the second image acquisition unit; and projecting and displaying the image corrected by the projection image.

Preferably, the working method further comprises: starting the moving projection device to perform initial projection, the initializing projection comprises: rotating the first direction control unit, changing an image capturing direction of the first image capturing unit, searching for a tracking user, and performing the user Obtaining image for the foreground; acquiring the distance and angle of the user relative to the moving projection device and the directionality information of the user according to the front and rear frame images captured by the first image acquiring unit; and obtaining the relative movement of the user according to the acquired The distance and angle of the projection device and the directivity information of the user, the second direction control unit rotates to change the direction and the projection lens of the projection display unit and the second image acquisition unit Like the acquisition direction; performing image correction processing on the projection screen image acquired by the second image acquisition unit; and the projection display unit starts to normally project and display the image subjected to the image correction processing.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description merely describe some embodiments of the invention. These drawings are not intended to be limiting of the invention, but are exemplary.

1 is a system block diagram of a motion projection apparatus according to an embodiment of the present invention;

2 is a flow chart showing a method of operating a motion projection apparatus according to an embodiment of the present invention;

3 is a flow chart of initializing projection in the working method shown in FIG. 2;

4 is a flow chart of determining movement information in the working method shown in FIG. 2;

Figure 5 is a schematic view showing the operation of the motion projection apparatus according to the present invention.

detailed description

Hereinafter, specific embodiments of the present invention will be described in detail in conjunction with the accompanying drawings. It is understood that the described embodiments are only a part of the embodiments of the invention, and not all of the embodiments, and the scope of the invention is not limited by the specific embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The term "comprising" or variations such as "comprises" or "comprises", etc., are to be understood to include the recited elements or components, and Other components or other components are not excluded.

1 is a system block diagram of a motion projection apparatus in accordance with an embodiment of the present invention. As shown in FIG. 1, the motion projection device includes a projection display unit 10, a first image acquisition unit 20, and a The second image acquisition unit 30, the first direction control unit 40, the second direction control unit 50, and the central processing unit 60. In the present embodiment, the first image acquisition unit 20 is used to acquire a user image, for example, and the second image acquisition unit 30 is used, for example, to completely capture a projection screen image of the projection display unit.

Specifically, the first direction control unit 40 is configured to change an image capturing direction of the first image capturing unit 20, and the second direction controlling unit 50 is configured to change a projection lens direction of the projection display unit 10 and the second image capturing unit 30. And image acquisition direction.

As also shown in FIG. 1, the central processing unit 60 is coupled to the projection display unit 10, the first image acquisition unit 20, the second image acquisition unit 30, the first direction control unit 40, and the second direction control unit 50. Thus, central processing unit 60 can receive relevant data/information from these units, and/or issue instructions to these units to cause them to perform predetermined operations.

As shown in FIG. 1, the central processing unit 60 further includes: a motion processing unit 61 that acquires directivity information of the user according to the image acquired by the first image capturing unit 20, and calculates the first direction control unit 40 and a rotation angle of the second direction control unit 50; and an image correction unit 62 for performing real-time projection image correction on the projection screen image acquired by the second image acquisition unit 30;

In the present embodiment, the motion projection device further includes a storage unit 70 and a wireless communication unit 80. The storage unit 70 may store, for example, an image previously acquired by the second image acquisition unit 30, and/or store an image input from the outside into the motion storage device. The wireless communication unit 80 can receive and transmit images acquired by the second image acquisition unit 30, for example, in real time. The content displayed by the projection display unit 10 may be the content stored by the storage unit 70 or the real-time projection information transmitted by the wireless communication unit 80. In addition, in particular, the first image acquisition unit 20 and/or the second image acquisition unit 30 may employ an infrared three-dimensional tester or a camera.

In the present embodiment, the first direction control unit 40 and/or the second direction control unit 50 may employ a pan/tilt or a multi-dimensional motion stage that enables spherical rotation.

2 is a flow chart of a method of operation of a motion projection apparatus in accordance with an embodiment of the present invention. As shown in FIG. 2, the working method of the motion projection apparatus comprises the steps of: (S1) starting the motion projection device to perform initial projection; (S2) acquiring an image foregrounded by the user (ie, user-themed and center-oriented) Image), get the user's directional information in real time, and make a movement letter (S3) calculating the rotation angle of the first direction control unit and/or the second direction control unit as necessary according to the result of the (S2) determination; (S4) according to the calculation result obtained in (S3), a direction control unit and/or a second direction control unit perform corresponding motions in real time; (S5) the projection display unit performs projection display, and performs real-time projection image correction on the projection screen image acquired by the second image acquisition unit; S6) The projection display unit performs clear projection after correction.

In this embodiment, the directional information of the user may be the direction of the user's head swinging or the direction pointed by the hand, or the direction the user's eyes see. And the user can be a person, a robot, or another animal.

In the present embodiment, the image correction processing includes projection autofocus, projection image/direction correction, and correction of projected background color, brightness, and surface unevenness. The projection image/direction correction further includes projection image malformation correction and direction correction, so that the corrected projection image is square, and the user's eyes can face the projection image. Projection autofocusing of the motion projection apparatus can be accomplished using, for example, the method taught in Chinese Patent Application No. 03100704.X, entitled "Projector Autofocus Method and Projector Using the Method". Projection image malformation correction can be performed using, for example, trapezoidal correction and correction of the boundary luminance of the trapezoid-corrected picture. The above-described direction correction can be performed using, for example, a known perspective transformation method. The correction of the background color of the projected image can be performed using, for example, the method taught in Chinese Patent Application No. 201510257645.8, entitled "A Projection Image Color Correction Method and Projector". The correction of the brightness of the projected image can be performed using, for example, the method taught in Chinese Patent No. 201310248520.X, entitled "Brightness Detection Correction Method and System for Projector". The correction of the degree of unevenness of the projected image surface can be performed using a method taught in, for example, Chinese Patent Application No. 201280035689.0, entitled "Projection Display and Method for Displaying a Whole Image for Projecting a Free-form Surface or Inclined Projection Surface".

FIG. 3 is a flow chart of initializing projection in the working method shown in FIG. As shown in FIG. 3, in the working method shown in FIG. 2, the initialization in the step (S1) includes the following steps:

(S11) the first direction control unit performs rotation, changes the acquisition direction of the first image acquisition unit, searches for the tracking user, and performs image acquisition with the foreground of the user (in this step, the first direction control unit preferably automatically tracks the user And starting the user-oriented image acquisition after, for example, ingesting the user's facial feature points or after ingesting the user's control gesture;

(S12) obtaining a distance and an angle of the user relative to the projection device and user directivity information according to the front and rear frame images captured by the first image acquisition unit and using the user as the foreground;

(S13) according to the distance and angle of the user relative to the projection device and the user directivity information, the second direction control unit performs rotation to change the projection lens direction and the image acquisition direction of the projection display unit and the second image acquisition unit, and the projection display unit and The second image acquisition unit respectively performs projection display and image acquisition;

(S14) performing image correction processing according to the projection screen image acquired by the second image acquisition unit;

(S15) The projection display unit starts normal projection display.

In this embodiment, the tracked user may be the user closest to the image collection unit, or the user who issues voice information or performs gesture control.

Fig. 4 is a flow chart showing the determination of the movement information in the working method shown in Fig. 2. As shown in FIG. 4, in the working method shown in FIG. 2, the motion information determination in step (S2) includes the following steps:

(S21) setting a range of angles at which the user points to the directional movement;

(S22) collecting an image with the user as the foreground, and obtaining the directional information of the user from the user;

(S23) calculating, according to the directivity information, an angle at which the user's intentional projection direction is deflected with respect to the vertical direction or the horizontal direction of the original projection screen;

(S24) determining (S23) whether the calculated deflection angle is within the range of angles set by (S21);

(S25) if the angle of the user's intentional projection direction being deflected relative to the original projection screen symmetry axis is within the set angle range, the first direction control unit and the second direction control unit are not rotated, and the first image acquisition unit is not changed. The original lens direction of the second image capturing unit and the projection display unit;

(S26) If the angle at which the user's intended projection direction is deflected from the symmetry axis of the original projection screen exceeds the set angle range boundary, the process proceeds to step S3.

Figure 5 is a schematic view showing the operation of the motion projection apparatus according to the present invention. As shown in FIG. 5, 100 denotes a user, 200 denotes a motion projection device, 300 denotes a projection display screen, and L denotes an axis of symmetry of the vertical direction of the projection display screen 300. It is worth noting that the axis of symmetry L It is parallel to the symmetry axis of the eyes of the user 100 and is in the same plane, and the plane is perpendicular to the projection display screen 300. The angle between the user 100's intentional projection direction (ie, the direction in which the user's eyes see, the direction in which the user's head swings, the direction pointed by the user's hand, the direction indicated by the user's voice information, etc.) and the axis of symmetry L is set to a. When the intentional projection direction of the user 100 is on the left side of the symmetry axis L, the angle is -a, and when the intentional projection direction of the user 100 is on the right side of the symmetry axis L, the angle is +a; when -a or +a is in the user's When the set user points within the angle range of the directional movement, the first direction control unit and the second direction control unit do not rotate, and the original lens of the first image acquisition unit, the second image acquisition unit, and the projection display unit are not changed. Direction; when -a or +a exceeds the set user-movable angular range boundary, the rotation angle of the first direction control unit and/or the second direction control unit is calculated according to the intentional projection direction of the user 100. It is worth noting that when the user's intentional projection direction is upward or downward, the axis of symmetry in the horizontal direction of the original projection display is used as a reference.

In the present embodiment, the following range can be set for the angle at which the user points to the orientable movement: -5 to 5, -10 to 10 or -20 to 20 . The angle range of the user pointing to the directional movement can be automatically set according to the size of the projection screen or manually set: when the projection screen size is small or the space where the user is located is small, a small angle range should be set; when the projection screen is displayed When the size is large or the space where the user is located is large, a larger angle range should be set. For example, when the length and width of the projected picture are 1.6m and 0.9m respectively and the user's space is small, the angle range should be set to -5°-5°, because the slight movement of the user may result in the projection screen. The plane is different from the previous one.

It should be noted that in the present disclosure, the user's directional information is not from the user's body information, but also the user's voice information. That is, the embodiment of controlling the change of the image capturing direction and the projecting direction by the user's directivity information falls within the protection scope of the present disclosure.

It should be noted that the motion projection apparatus and its method of operation according to the present invention can be applied to a variety of applications. For example, in a large-scale performance, the user controls the projection direction of the projection unit in real time by means of the image acquisition unit and the direction control unit, and projects and displays the relevant content at different positions of the stage background according to the needs of the stage performance, and performs projection correction processing to realize the combination of virtual reality. A dazzling stage effect that shows the effect. The user here can be a performer on the stage, or a stage effect control staff behind the scenes, and so on. In another example, in the family, the owner or pet uses the image collection form. The element and direction control unit controls the projection direction of the projection unit in real time, and can perform intelligent projection at different times and at different positions to realize the interactive entertainment experience. For example, in a large restaurant, the store owner or the machine attendant can control the projection direction of the projection unit in real time by means of the image acquisition unit and the direction control unit, and can realize the function of projecting the menu introduction or presenting other entertainment contents according to different customer requirements. Obviously, this enriches the customer's dining experience.

In summary, the motion projection apparatus according to the present invention can track the user's intentional projection direction in real time, change the direction of the projection lens in real time according to the user's intentional projection direction, and correct the projection image, thereby realizing high-quality intelligent projection display. The motion projection device according to the present invention can be applied to a large stage or the like to realize a dazzling effect in combination with a virtual reality display effect.

The above description of the disclosed embodiments enables those skilled in the art to make or use the invention. It should be understood that the features disclosed in the above embodiments may be used singly or in combination, unless otherwise specified. Various modifications to these embodiments are obvious to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the invention disclosed herein is not limited to the specific embodiments disclosed, but is intended to be

Claims

A motion projection device, comprising:

Projection display unit;

a first image acquisition unit, configured to collect an image including directional information of the user;

a second image acquisition unit, configured to collect an image for display by the projection display unit;

a first direction control unit, configured to rotate when necessary to change an image collection direction of the first image acquisition unit;

a second direction control unit, configured to perform rotation when necessary, changing a projection lens direction of the projection display unit and an image collection direction of the second image acquisition unit;

The central processing unit is coupled to the projection display unit, the first image acquisition unit, the second image acquisition unit, the first direction control unit, and the second direction control unit, and includes:

a movement processing unit, configured to acquire directionality information of the user according to the image acquired by the first image acquisition unit, and calculate the first direction control unit and the second direction according to the directionality information of the user The respective rotation angles of the control units, and

An image correcting unit is configured to perform real-time projection image correction on the image acquired by the second image capturing unit.
The motion projection apparatus according to claim 1, wherein the first image acquisition unit and/or the second image acquisition unit is an infrared three-dimensional tester or a camera.
The motion projection apparatus according to claim 1, wherein the first direction control unit and/or the second direction control unit is a pan/tilt or a multi-dimensional motion stage capable of performing a spherical rotation.
The motion projection apparatus according to claim 1, wherein said projected image The correction includes correction of projection autofocus, projected image/direction correction, projected background color, brightness, and surface unevenness, and the projected image/direction correction further includes projection image malformation correction and direction correction.
The motion projection apparatus according to claim 1, wherein the motion projection apparatus further comprises:

a storage unit, configured to store content for display by the projection display unit;

a wireless communication unit, configured to wirelessly transmit real-time projection information to the projection display unit.
The motion projection apparatus according to claim 1, wherein the user is a person, a robot or another animal, and the user's directivity information is selected from a direction in which the user's head swings, a direction pointed by the user's hand, and a user. One or more of the groups formed by the direction of the eye and the voice information of the user.
A method of operating a motion projection device according to any one of claims 1 to 6, wherein after the motion projection device starts to normally project display, the working method includes:

Acquire an image containing the user's directional information;

Obtaining directional information of the user according to the collected image;

Determining the movement information according to the directional information of the user;

According to the result of the motion information determination, the first direction control unit and/or the second direction control unit perform corresponding motions as necessary.
The working method according to claim 7, wherein the determining the direction information according to the directionality information of the user comprises:

Set the angle range in which the user points to the directional movement;

Calculating, according to the directional information of the user, an angle of the user's intentional projection direction being deflected relative to the vertical direction or the horizontal direction of the original projection picture;

Determining whether the calculated deflection angle is within the set angle range;

When the calculated deflection angle is within the set angular range, neither the first direction control unit nor the second direction control unit rotates;

Calculating a first rotation angle of the first direction control unit and/or a second direction of the second direction control unit according to a user's intentional projection direction when the calculated deflection angle exceeds the set angle range The angle of rotation.
The working method according to claim 8, wherein the setting the angle range of the user pointing to the directional movement comprises:

The angle range of -5° to 5°, -10° to 10°, or -20° to 20° is automatically or manually set according to the projected screen size.
The working method according to claim 8, wherein the first direction control unit and/or the second direction control unit perform corresponding motions: the first direction control unit and/or the The two-direction control unit respectively rotates the calculated first rotation angle and/or second rotation angle.
The working method according to claim 7, wherein the working method further comprises:

Performing real-time projection image correction on the image acquired by the second image acquisition unit;

The projection displays the image corrected by the projected image.
The working method according to claim 7, wherein the working method further comprises:

The motion projection device is activated to perform initial projection, and the initial projection includes:

The first direction control unit rotates, changes an image collection direction of the first image acquisition unit, searches for the user, and performs image acquisition with the user as a foreground;

Acquiring the distance and angle of the user relative to the moving projection device and the directivity information of the user according to the front and rear frame images captured by the first image collecting unit with the user as the foreground;

Determining, according to the obtained distance and angle of the user relative to the projection device and the directivity information of the user, the second direction control unit rotates to change the projection of the projection display unit and the second image acquisition unit Lens direction and image acquisition direction;

Performing image correction processing on the projection screen image acquired by the second image acquisition unit;

The projection display unit starts to normally project the image subjected to the image correction processing.