WO2022105277A1 - Projection control method and apparatus, projection optical machine, and readable storage medium - Google Patents

Abstract

The present invention relates to the technical field of image projection. Disclosed are a projection control method and apparatus, a projection optical machine, and a readable storage medium. The method comprises: acquiring a medium image captured when a photographing device performs image capture on a current projection medium; segmenting the medium image into multiple areas to be verified; automatically extracting, from the multiple areas, a maximum effective display area meeting a preset aspect ratio; performing conversion on an image to be displayed according to a corner position of the maximum effective display area in the medium image and an image mapping and conversion relationship between a projection optical machine and the photographing device, transferring the converted image to a projection area of the projection optical machine corresponding to the maximum effective display area, and obtaining a corresponding image to be projected; and directly controlling the projection optical machine to project said image. The invention enables the content of an image to be displayed to be quickly displayed in an area of the projection medium corresponding to the maximum effective display area and suitable for image projection, thereby improving image projection performance and image viewing experience of users.

Description

Projection control method, device, projector and readable storage medium technical field

The present application relates to the technical field of screen projection, and in particular, to a projection control method, device, projector and readable storage medium.

Background technique

At present, in the process of using the light projector, the user usually needs to select a special object (for example, a blank wall or a blank curtain) as the projection medium of the light projector, and then manually select a certain object on the current projection medium by observing the human eye. Each area is used as the projection area, and the screen is correspondingly projected into the selected projection area by manually adjusting the projector. However, in practice, the manually selected projection area usually cannot meet the requirements of image projection. Manual debugging of the projector will also affect the efficiency of image projection, and it is easy to produce image projection errors, so that the image cannot be truly projected into the selected projection area. For display, the screen projection effect cannot be guaranteed, which affects the user's screen browsing experience.

SUMMARY OF THE INVENTION

In view of this, the purpose of the present application is to provide a projection control method, device, projector and readable storage medium, which can automatically delineate an effective area suitable for image projection on the current projection medium, and automatically and quickly The to-be-displayed picture is projected into the effective area for display, so as to improve the picture projection effect and the user's picture browsing experience.

In order to achieve the above purpose, the technical solutions adopted in the embodiments of the present application are as follows:

In a first aspect, the present application provides a projection control method, the method comprising:

acquiring a medium image captured by the photographing device for the current projection medium;

Perform image segmentation on the medium image to obtain a plurality of areas to be verified included in the medium image;

extracting the maximum effective display area that meets the preset aspect ratio from the multiple areas to be verified;

According to the corner position of the maximum effective display area in the medium image and the image mapping transformation relationship between the projector and the photographing device, the to-be-displayed image is transformed to the image of the projector and the image to be displayed. In the delivery area corresponding to the largest effective display area, the corresponding to-be-delivered screen is obtained;

The projector is controlled to project the picture to be displayed, so that the picture content of the picture to be displayed is displayed on the projection medium.

In an optional implementation manner, the step of extracting a maximum effective display area that satisfies a preset screen ratio from the multiple areas to be checked includes:

Perform quadrilateral boundary fitting for each area to be verified;

If there is a target verification area to which the quadrilateral boundary is fitted, detecting whether the fitted boundary size ratio of the quadrilateral boundary satisfies the preset screen ratio;

When it is detected that the border size ratio satisfies the preset screen ratio, the target verification area whose corresponding border size ratio meets the preset screen ratio is directly used as the maximum effective display area.

In an optional implementation manner, the step of extracting a maximum effective display area that satisfies a preset screen ratio from the multiple areas to be checked further includes:

In the case that the boundary size ratio of the target verification area does not meet the preset screen ratio, or the target verification area does not exist, extract the image size that meets the preset screen ratio from the multiple to-be-verified areas. Maximum pixel contiguous area;

The largest continuous area of pixels is used as the largest effective display area.

In an optional implementation manner, the step of extracting a maximum pixel continuous area that satisfies the preset screen ratio from the multiple areas to be checked includes:

Select a preset number of areas to be screened from the plurality of areas to be checked, wherein the number of pixels in the area to be screened is greater than the number of pixels in the area to be checked that is not selected;

For each to-be-screened area, determine the inscribed rectangular continuous area with the largest area of the to-be-screened area;

Obtain the corresponding inscribed rectangular area according to the preset screen ratio in each obtained inscribed rectangular continuous area;

The inscribed rectangular area with the largest area is taken as the largest pixel continuous area.

In an optional implementation manner, the to-be-displayed picture is transformed according to the corner position of the maximum effective display area in the medium image and the image mapping transformation relationship between the projector and the photographing device. The step of obtaining the corresponding to-be-delivered picture in the projection area corresponding to the maximum effective display area of the light projector includes:

Perform position transformation on the corner position of the maximum effective display area according to the image mapping transformation relationship to obtain the corner position coordinates of the placement area under the optical-mechanical coordinate system where the projector is located;

establishing a coordinate matching relationship between the corner position coordinates and the vertex position coordinates of the to-be-displayed picture in the optical-mechanical coordinate system;

Coordinate transformation is performed on each pixel in the to-be-displayed image according to the coordinate matching relationship, to obtain the to-be-launched image overlapping the placement area.

In an optional embodiment, the method further includes:

Controlling the light projector to project a debugging picture to the current projection medium, and acquiring a medium calibration image captured by the photographing device for the debugging picture;

Calculate the coordinates of the first corner point of the debugging image in the optical-mechanical coordinate system where the projector is located, and the coordinates of the second corner of the debugging image in the photographing coordinate system corresponding to the medium calibration image;

According to the positional correspondence between the coordinates of the first corner point and the coordinates of the second corner point, the image mapping transformation relationship between the light projector and the photographing device is determined.

In a second aspect, the present application provides a projection control device, the device comprising:

a medium image acquisition module, configured to acquire a medium image photographed by the photographing device for the current projection medium;

an image area segmentation module, configured to perform image segmentation on the medium image to obtain a plurality of areas to be verified included in the medium image;

A display area extraction module, used for extracting the maximum effective display area that satisfies the preset screen ratio from the multiple areas to be checked;

A picture mapping transformation module, configured to transform the to-be-displayed picture into the said Obtaining a corresponding picture to be released in the delivery area corresponding to the maximum effective display area of the projector;

The picture projection control module is used for controlling the light projector to project the picture to be displayed, so that the picture content of the picture to be displayed is displayed on the projection medium.

In an optional implementation manner, the manner in which the display area extraction module extracts a maximum effective display area that satisfies a preset screen ratio from the plurality of areas to be verified includes:

Perform quadrilateral boundary fitting for each area to be verified;

If there is a target verification area to which the quadrilateral boundary is fitted, detecting whether the fitted boundary size ratio of the quadrilateral boundary satisfies the preset screen ratio;

When it is detected that the border size ratio satisfies the preset screen ratio, the target verification area whose corresponding border size ratio meets the preset screen ratio is directly used as the maximum effective display area.

In an optional implementation manner, the display area extraction module extracts a method of extracting a maximum effective display area that satisfies a preset screen ratio from the plurality of areas to be checked, further comprising:

In the case that the boundary size ratio of the target verification area does not meet the preset screen ratio, or the target verification area does not exist, extract the image size that meets the preset screen ratio from the multiple to-be-verified areas. Maximum pixel contiguous area;

The largest continuous area of pixels is used as the largest effective display area.

In an optional implementation manner, the manner in which the display area extraction module extracts a maximum pixel continuous area that satisfies the preset screen ratio from the plurality of areas to be verified includes:

Select a preset number of areas to be screened from the plurality of areas to be checked, wherein the number of pixels in the area to be screened is greater than the number of pixels in the area to be checked that is not selected;

For each to-be-screened area, determine the inscribed rectangular continuous area with the largest area of the to-be-screened area;

Obtain the corresponding inscribed rectangular area according to the preset screen ratio in each obtained inscribed rectangular continuous area;

The inscribed rectangular area with the largest area is taken as the largest pixel continuous area.

In an optional implementation manner, the image mapping transformation module, according to the corner position of the maximum effective display area in the medium image, and the image mapping transformation relationship between the projector and the photographing device, converts the The method of transforming the to-be-displayed picture into the delivery area of the projector light machine corresponding to the maximum effective display area to obtain the corresponding to-be-released picture includes:

Perform position transformation on the corner position of the maximum effective display area according to the image mapping transformation relationship to obtain the corner position coordinates of the placement area under the optical-mechanical coordinate system where the projector is located;

establishing a coordinate matching relationship between the corner position coordinates and the vertex position coordinates of the to-be-displayed picture in the optical-mechanical coordinate system;

Coordinate transformation is performed on each pixel in the to-be-displayed image according to the coordinate matching relationship, to obtain the to-be-launched image overlapping the placement area.

In an optional embodiment, the device further comprises:

a medium projection calibration module, configured to control the light projector to project a debugging picture to the current projection medium, and obtain a medium calibration image captured by the photographing device for the debugging picture;

The corner coordinate calculation module is used to calculate the first corner coordinates of the debugging screen in the optical-mechanical coordinate system where the projector is located, and the camera coordinate system corresponding to the medium calibration image of the debugging screen The coordinates of the second corner point below;

A transformation relationship creation module, configured to determine an image mapping transformation relationship between the light projector and the photographing device according to the positional correspondence between the coordinates of the first corner point and the coordinates of the second corner point.

In a third aspect, the present application provides a light projector, including a processor and a memory, where the memory stores a computer program executable by the processor, and the processor can execute the computer program to implement the foregoing embodiments The projection control method described in any one of.

In a fourth aspect, the present application provides a readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the projection control method described in any one of the foregoing embodiments.

The beneficial effects of the embodiments of the present application include the following:

In the present application, the medium image captured by the photographing device for the current projection medium is obtained, and a plurality of areas to be verified are divided from the images in the medium image, and then the maximum effective display that meets the preset screen ratio is extracted from the plurality of areas to be verified. area, and according to the image mapping transformation relationship between the projector and the photographing device, the image to be displayed is transformed into the projection area corresponding to the maximum effective display area of the projector to obtain the corresponding image to be released, and then directly control The projection light projector projects the screen to be displayed, so that the screen content of the screen to be displayed can be quickly displayed in the area of the projection medium corresponding to the maximum effective display area and suitable for screen projection, thereby improving the screen projection effect and the user's screen browsing experience. .

In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the preferred embodiments are exemplified below, and are described in detail as follows in conjunction with the accompanying drawings.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present application more clearly, the following drawings will briefly introduce the drawings that need to be used in the embodiments. It should be understood that the following drawings only show some embodiments of the present application, and therefore do not It should be regarded as a limitation of the scope, and for those of ordinary skill in the art, other related drawings can also be obtained according to these drawings without any creative effort.

FIG. 1 is one of the schematic flowcharts of a projection control method provided by an embodiment of the present application;

FIG. 2 is one of the schematic flowcharts of the sub-steps included in step S230 in FIG. 1;

3 is the second schematic flowchart of the sub-steps included in step S230 in FIG. 1;

FIG. 4 is a schematic flowchart of the sub-steps included in step S240 in FIG. 1;

FIG. 5 is the second schematic flowchart of the projection control method provided by the embodiment of the present application;

FIG. 6 is one of the schematic diagrams of the composition of the projection control device provided by the embodiment of the present application;

FIG. 7 is the second schematic diagram of the composition of the projection control device provided by the embodiment of the present application;

FIG. 8 is a schematic diagram of the composition of the light projector provided by the embodiment of the present application.

Icons: 100-projection control device; 110-media image acquisition module; 120-image area segmentation module; 130-display area extraction module; 140-image mapping transformation module; 150-image projection control module; 160-media projection calibration module; 170-corner coordinate calculation module; 180-transformation relationship creation module; 10-projector light machine; 11-memory; 12-processor; 13-communication unit; 14-photographing device.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of the present application, but not all of the embodiments. The components of the embodiments of the present application generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations.

Thus, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the application as claimed, but is merely representative of selected embodiments of the application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further definition and explanation in subsequent figures.

In the description of this application, it is to be understood that relational terms such as the terms "first" and "second" etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require Or imply that there is any such actual relationship or order between these entities or operations. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood in specific situations.

Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The following embodiments and features of the embodiments may be combined with each other without conflict.

Please refer to FIG. 1 . FIG. 1 is a schematic flowchart of a projection control method provided by an embodiment of the present application. In the embodiment of the present application, the projection control method shown in FIG. 1 can automatically delineate an effective area suitable for image projection on the current projection medium, and automatically and quickly project the to-be-displayed image into the effective area for display. This ensures that the area where the image is displayed on the projection medium can meet the image projection requirements, avoids image projection errors caused by manual adjustment of the projector light machine, and improves the image projection efficiency, so as to improve the image projection effect and the user's image browsing experience. Wherein, the projection medium can be randomly selected by the user of the light projector according to their own needs, and the projection medium can be, but not limited to, a blank wall, a blank newspaper board, a blank curtain, etc.; the projection control shown in FIG. 1 The method can be executed solely by the computer equipment communicatively connected with the projector and the photographing device, or directly by the projector communicatively connected with the photographing device, or by the projector integrated with the photographing device. The projection control method shown in FIG. 1 will be described in detail below.

Step S210, acquiring a medium image photographed by the photographing device for the current projection medium.

In this embodiment, after the current projection medium that needs to be projected is determined, a pure white image can be projected onto the current projection medium through a light projector or other light and shadow projection equipment, and then an image of the current projection medium is captured by the photographing device. Obtain the medium image corresponding to the current projection medium. In this process, in order to improve the projection accuracy of the projection control method shown in FIG. 1, the brightness of the projected pure white image needs to be higher than 20% of the maximum projection brightness of the projector to ensure that all the collected The media features contained in the media images are richer and more detailed.

Wherein, after the photographing device captures the medium image, an electronic device (for example, a computer device that is communicatively connected to the projector and the photographing device, or an electronic device that is communicatively connected to the photographing device) executes the projection control method shown in FIG. 1 . projector) can directly obtain the medium image from the photographing device through the network.

Step S220: Perform image segmentation on the medium image to obtain a plurality of regions to be verified included in the medium image.

In this embodiment, after the medium image of the current projection medium is obtained, the flood filling algorithm or the watershed algorithm can be used to perform similar chromaticity clustering on each pixel in the medium image, and the corresponding chromaticity can be clustered according to the clustering result. Image segmentation is performed on the medium image to segment a plurality of regions to be verified from the medium image. Wherein, each pixel point in each area to be checked belongs to the same pixel chromaticity category.

Step S230, extracting a maximum effective display area that satisfies a preset screen ratio from a plurality of areas to be verified.

In this embodiment, the preset aspect ratio is used to represent a preset image size ratio that is suitable for the image projection area to carry, wherein the preset aspect ratio can be a range of image ratios (for example, 16: 9 to 16:10), or a combination of multiple specific ratios (for example, 3:2, 4:3, and 16:9), or a single size ratio (for example, 16:9). Express.

After the multiple areas to be verified included in the medium image are determined, it can be determined according to the preset screen ratio whether there is a certain area to be verified directly in the multiple areas to be verified, which can be directly used as the optimal image projection The maximum effective display area of the effect, or the largest image area that is free from foreign matter and noise and meets the preset screen ratio is cut out from the multiple areas to be verified as the maximum effective display area.

Step S240, according to the corner position of the maximum effective display area in the medium image, and the image mapping transformation relationship between the projector and the photographing device, transform the to-be-displayed picture into the projection corresponding to the maximum effective display area of the projector. In the area, the corresponding to-be-delivered screen is obtained.

In this embodiment, the image mapping transformation relationship is used to indicate that in the case where the projector and the photographing device use the current projection medium as a reference, the same thing is in the picture projected by the projector and the image captured by the photographing device. The mapping relationship between their corresponding thing positions. In other words, under the condition that the positions of the light projector and the photographing device do not change relative to the current projection medium, the light projector projects a picture including a certain thing to the current projection medium, and the photographing device When the device faces the current projection medium to take a picture of the picture including the object, the position information of the object in the optical-mechanical coordinate system where the projector is located is the same as the location of the object in the photographing coordinate system where the photographing device is located. The position matching relationship between the information is the above-mentioned image mapping transformation relationship. In this case, the delivery area is an area corresponding to the maximum effective display area in the optical-mechanical coordinate system where the projector is located. Wherein, the specific position information of the placement area can be obtained by converting the relevant position information of the maximum effective display area in the medium image through the image mapping transformation relationship.

After the corner position of the delivery area corresponding to the maximum effective display area is determined through the corner position of the maximum effective display area in the medium image, the image to be displayed can be aligned as a whole by means of coordinate transformation Within the range of the projection area, the corresponding to-be-released picture is obtained, so that when the projector directly projects the to-be-released picture toward the current projection medium, the current projection medium corresponds to the maximum effective display area and is suitable for The image content of the to-be-displayed image will be truly and effectively displayed in the image projection area.

Step S250 , controlling the light projector to project the picture to be displayed, so that the picture content of the picture to be displayed is displayed on the projection medium.

In this embodiment, after the image to be displayed is transformed into the delivery area corresponding to the maximum effective display area in the layer where the optical-machine coordinate system is located, the projector can be directly controlled to perform the operation on the obtained image to be displayed. Projection, so that the to-be-launched picture is correspondingly projected in the area of the current projection medium that corresponds to the maximum effective display area and is suitable for picture projection, so that the picture content of the to-be-displayed picture can be displayed normally in the suitable picture projection area of the current projection medium. To achieve the best screen projection effect, improve the user's screen browsing experience, without spending labor costs to determine the best projection area and debug the projector.

Therefore, the present application can implement the projection control method shown in FIG. 1 , so that the light projector can adaptively determine the effective area range suitable for picture projection on the current projection medium, and automatically and quickly convert the picture content of the picture to be displayed. Projecting into the effective area for display, avoiding the screen projection error caused by manual debugging of the projector, and improving the screen projection efficiency, so as to improve the screen projection effect and the user's screen browsing experience.

In the present application, the specific selection of the maximum effective display area in the medium image is an important factor affecting the screen projection effect of the projection control method. Therefore, the embodiment of the present application provides the following extraction methods that can extract the real and effective display area to ensure that The light projector can effectively project the picture content of the picture to be displayed into a suitable picture projection area of the current projection medium for display. The method of extracting the display area will be described in detail below.

Optionally, please refer to FIG. 2 , which is one of the schematic flowcharts of the sub-steps included in step S230 in FIG. 1 . In this embodiment, the step S230 may include sub-steps S231 to S233.

Sub-step S231, performing quadrilateral boundary fitting on each area to be checked.

In sub-step S232, if there is a target verification area in which the quadrilateral boundary is fitted, it is detected whether the boundary size ratio of the fitted quadrilateral boundary satisfies the preset screen ratio.

In sub-step S233, when it is detected that the border size ratio meets the preset screen ratio, the target verification area corresponding to the border size ratio satisfying the preset screen ratio is directly used as the maximum effective display area.

Wherein, if there are multiple target verification areas whose corresponding boundary size ratios meet the preset screen ratio, the target verification area with the largest area may be used as the maximum effective display area, so as to ensure that the screen content of the screen to be displayed can be displayed in the While ensuring the effect of screen projection, the function of maximizing screen projection is realized.

In this embodiment, the above-mentioned sub-steps S231 to S233 can be executed to determine the target verification area that can be directly used as the maximum effective display area for realizing the best image projection effect among the above-mentioned multiple areas to be verified, so as to It is ensured that the light projector can finally project the picture content of the picture to be displayed into an area suitable for picture projection in the current projection medium.

Optionally, please refer to FIG. 3 , which is the second schematic flowchart of the sub-steps included in step S230 in FIG. 1 . In this embodiment, the step S230 may further include sub-steps S235 to S236.

Sub-step S235, in the case that the boundary size ratio of the target verification area does not meet the preset screen ratio, or there is no target verification area, extract the maximum pixel continuous area that meets the preset screen ratio from the multiple to-be-verified areas .

In sub-step S236, the maximum continuous area of pixels is used as the maximum effective display area.

In this embodiment, when it is determined that there is no target verification area capable of fitting a quadrilateral boundary among the multiple areas to be verified included in the medium image, or the target verification area in the multiple areas to be verified does not exist When the boundary size ratio corresponding to the test area does not meet the preset screen ratio, the maximum size that does not exist foreign objects and noise and satisfies the preset screen ratio can be cut out from the multiple areas to be verified. The image area (ie, the maximum pixel continuous area) is used as the current maximum effective display area to ensure the screen projection effect.

Wherein, the step of extracting the largest pixel continuous area that meets the preset screen ratio from the multiple areas to be verified may include:

Select a preset number of areas to be screened from the plurality of areas to be checked, wherein the number of pixels in the area to be screened is greater than the number of pixels in the area to be checked that is not selected;

For each to-be-screened area, determine the inscribed rectangular continuous area with the largest area of the to-be-screened area;

Obtain the corresponding inscribed rectangular area according to the preset screen ratio in each obtained inscribed rectangular continuous area;

The inscribed rectangular area with the largest area is taken as the largest pixel continuous area.

In an implementation of this embodiment, after a preset number of areas to be screened are determined, an area contour can be extracted for each area to be screened, and a histogram projection algorithm is used to determine the largest area within the contour of the area to obtain the inscribed rectangular continuous area corresponding to the area to be screened.

Therefore, in this embodiment, the above-mentioned sub-step S235 to sub-step S236 can be performed to cut out the maximum of the preset screen ratio without foreign matter and noise from the above-mentioned multiple areas to be checked. The image area is used as the maximum effective display area for achieving the best picture projection effect, so as to ensure that the light projector can finally project the picture content of the picture to be displayed into the area suitable for picture projection in the current projection medium.

In the present application, the embodiment of the present application provides a picture transformation method for the picture to be displayed, so as to ensure that the essence of the picture finally projected by the light projector matches the maximum effective display area, and realize the automatic control operation of projection of the light projector. , to avoid projection errors. The screen transition method will be described in detail below.

Please refer to FIG. 4 , which is a schematic flowchart of sub-steps included in step S240 in FIG. 1 . In this embodiment, the step S240 may include sub-steps S241 to S243.

Sub-step S241: Perform positional transformation on the corner position of the maximum effective display area according to the image mapping transformation relationship to obtain the corner position coordinates of the delivery area in the optical-mechanical coordinate system where the projector is located.

Sub-step S242, establishing a coordinate matching relationship between the position coordinates of the corner points and the position coordinates of the vertices of the to-be-displayed picture in the optical-mechanical coordinate system.

In sub-step S243, coordinate transformation is performed on each pixel in the to-be-displayed image according to the coordinate matching relationship, so as to obtain the to-be-launched image overlapping the placement area.

The coordinate matching relationship is used to represent the position mapping relationship between the placement area corresponding to the maximum effective display area in the layer where the optical-mechanical coordinate system is located, and the outline area of the image to be displayed.

Therefore, the present application can effectively align the screen content of the screen to be displayed within the range of the delivery area by executing sub-steps S241 to S243, so as to realize the automatic projection control operation of the light projector and avoid projection errors.

Optionally, please refer to FIG. 5 , which is the second schematic flowchart of the projection control method provided by the embodiment of the present application. In the embodiment of the present application, the projection control method shown in FIG. 5 is compared with the projection control method shown in FIG. 1 , and the projection control method shown in FIG. 5 further includes step S207 , step S208 and step S209 . Wherein, the steps S207, S208 and S209 are used to accurately measure the projector with the current projection medium as a reference when the positions of the projector and the photographing device relative to the current projection medium remain unchanged. The image mapping transformation relationship between the camera and the photographing device ensures that the projector can normally project the to-be-displayed image on the current projection medium within an effective area suitable for image projection, thereby improving the user's image browsing experience. Wherein, when the position of the projector and/or the photographing device changes relative to the current projection medium, the steps S207, S208 and S209 need to be re-executed to parameterize the image mapping transformation relationship. calibration.

Step S207 , controlling the light projector to project a debugging picture to the current projection medium, and acquiring a medium calibration image captured by the photographing device for the debugging picture.

Step S208: Calculate the first corner coordinates of the debugging screen in the optical-mechanical coordinate system where the projector is located, and the second corner coordinates of the debugging screen in the photographing coordinate system corresponding to the medium calibration image.

Step S209, according to the positional correspondence between the coordinates of the first corner point and the coordinates of the second corner point, determine the image mapping transformation relationship between the projector and the photographing device.

In this embodiment, the debugging screen may be a black and white checkerboard screen or a black and white stripe screen, and the specific screen content may be configured differently according to user requirements. In an implementation of this embodiment, the positional correspondence between the coordinates of the first corner point and the coordinates of the second corner point corresponding to the debugging screen may be directly used as the image mapping transformation relationship.

Therefore, the present application can accurately measure the current projection medium as a reference by performing the above steps S207, S208 and S209 when the respective positions of the projector and the photographing device relative to the current projection medium remain unchanged. The image mapping transformation relationship between the projector and the photographing device, and when the position of the projector and/or the photographing device changes relative to the current projection medium, the image mapping transformation relationship is synchronously parameterized calibration, thereby ensuring that the light projector can finally normally project the picture content of the picture to be displayed into the effective area of the current projection medium suitable for picture projection, so as to improve the user's picture browsing experience.

In the present application, an embodiment of the present application provides a projection control device, so that an electronic device that stores or solidifies the projection control device can realize the above-mentioned by running the software function modules and computer programs included in the projection control device. The function corresponding to the projection control method. The specific composition of the projection control device provided by the present application will be described below.

Optionally, please refer to FIG. 6 . FIG. 6 is one of the schematic diagrams of the composition of the projection control apparatus 100 provided by the embodiment of the present application. In this embodiment of the present application, the projection control apparatus 100 may include a medium image acquisition module 110 , an image region segmentation module 120 , a display region extraction module 130 , an image mapping transformation module 140 , and an image projection control module 150 .

The medium image acquisition module 110 is configured to acquire a medium image photographed by the photographing device for the current projection medium.

The image area segmentation module 120 is configured to perform image segmentation on the medium image to obtain a plurality of areas to be verified included in the medium image.

The display area extraction module 130 is configured to extract the maximum effective display area that meets the preset screen ratio from the multiple areas to be checked.

The picture mapping transformation module 140 is used to transform the to-be-displayed picture into the maximum effective display area and the maximum effective display area according to the corner position of the maximum effective display area in the medium image and the image mapping transformation relationship between the projector and the photographing device. In the delivery area corresponding to the display area, the corresponding to-be-delivered screen is obtained.

The picture projection control module 150 is used for controlling the light projector to project the picture to be displayed, so that the picture content of the picture to be displayed is displayed on the projection medium.

In an implementation of this embodiment, the manner in which the display area extracting module 130 extracts the maximum effective display area that satisfies the preset screen ratio from the multiple areas to be checked may include:

Perform quadrilateral boundary fitting for each area to be verified;

If there is a target verification area to which the quadrilateral boundary is fitted, then check whether the boundary size ratio of the fitted quadrilateral boundary meets the preset screen ratio;

When it is detected that the border size ratio satisfies the preset screen ratio, the target verification area corresponding to the border size ratio satisfying the preset screen ratio is directly used as the maximum effective display area.

In another implementation of this embodiment, the manner in which the display area extraction module 130 extracts the maximum effective display area that satisfies the preset screen ratio from a plurality of areas to be checked may further include:

In the case that the boundary size ratio of the target verification area does not meet the preset screen ratio, or the target verification area does not exist, extract the maximum pixel continuous area that meets the preset screen ratio from the multiple to-be-verified areas;

Take the largest pixel contiguous area as the largest effective display area.

Wherein, the manner in which the display area extracting module 130 extracts the maximum pixel continuous area satisfying the preset screen ratio from the multiple areas to be verified includes:

Select a preset number of areas to be screened from a plurality of areas to be checked, wherein the number of pixels in the area to be screened is greater than the number of pixels in the area to be checked that is not selected;

For each to-be-screened area, determine the inscribed rectangular continuous area with the largest area of the to-be-screened area;

In each obtained inscribed rectangular continuous area, the corresponding inscribed rectangular area is obtained according to the preset screen ratio;

The inscribed rectangular area with the largest area is regarded as the largest pixel continuous area.

In this embodiment, the picture mapping transformation module 140 transforms the picture to be displayed into the projection light according to the corner position of the maximum effective display area in the medium image and the image mapping transformation relationship between the light projector and the camera device. The method of obtaining the corresponding to-be-delivered screen in the delivery area corresponding to the maximum effective display area of the computer may include:

Perform position transformation on the corner position of the maximum effective display area according to the image mapping transformation relationship, and obtain the corner position coordinates of the placement area under the optical-mechanical coordinate system where the projector is located;

Establish the coordinate matching relationship between the corner position coordinates and the vertex position coordinates of the to-be-displayed image in the optical-mechanical coordinate system;

According to the coordinate matching relationship, coordinate transformation is performed on each pixel in the to-be-displayed image to obtain the to-be-launched image overlapping the placement area.

Optionally, please refer to FIG. 7 . FIG. 7 is the second schematic diagram of the composition of the projection control apparatus 100 provided by the embodiment of the present application. In this embodiment of the present application, the projection control apparatus 100 may further include a medium projection calibration module 160 , a corner coordinate calculation module 170 and a transformation relationship creation module 180 .

The medium projection calibration module 160 is used to control the light projector to project the debugging picture to the current projection medium, and obtain the medium calibration image captured by the photographing device for the debugging picture.

The corner coordinate calculation module 170 is used to calculate the first corner coordinates of the debugging screen in the optical-mechanical coordinate system where the projector is located, and the second corner coordinates of the debugging screen in the photographing coordinate system corresponding to the medium calibration image. .

The transformation relationship creation module 180 is configured to determine the image mapping transformation relationship between the projector and the photographing device according to the positional correspondence between the coordinates of the first corner point and the coordinates of the second corner point.

It should be noted that the basic principles and technical effects of the projection control device 100 provided by the embodiments of the present application are the same as the aforementioned projection control methods. A description of the projection control method.

In the present application, an embodiment of the present application provides a light projector in which the projection control device 100 is stored or cured, which can implement the above-mentioned functions by running software function modules and computer programs included in the projection control device 100 . The function corresponding to the projection control method. The specific composition of the optical projector provided by the present application will be described below.

Please refer to FIG. 8 , which is a schematic diagram of the composition of the light projector 10 provided by the embodiment of the present application. In the embodiment of the present application, the light projector 10 can be used to automatically delineate an effective area suitable for image projection on the current projection medium for the to-be-displayed image, and automatically and quickly project the to-be-displayed image into the effective area. To ensure that the area where the image is displayed on the projection medium can meet the image projection requirements, avoid image projection errors caused by manual debugging of the projector 10, and improve the image projection efficiency, so as to improve the image projection effect and the user's image browsing experience.

The projector 10 may include a memory 11 , a processor 12 , a communication unit 13 , a photographing device 14 and the projection control device 100 . The elements of the memory 11 , the processor 12 , the communication unit 13 , and the photographing device 14 are electrically connected to each other indirectly or indirectly to realize data transmission or interaction. For example, the elements of the memory 11 , the processor 12 , the communication unit 13 and the photographing device 14 can be electrically connected to each other through one or more communication buses or signal lines.

In this embodiment, the memory 11 may be, but not limited to, a random access memory (Random Access Memory, RAM), a read only memory (Read Only Memory, ROM), a programmable read only memory (Programmable Read-Only Memory) Memory, PROM), Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Read-Only Memory (Electric Erasable Programmable Read-Only Memory, EEPROM), etc. Wherein, the memory 11 is used for storing a computer program, and the processor 12 can execute the computer program correspondingly after receiving the execution instruction.

In this embodiment, the processor 12 may be an integrated circuit chip with signal processing capability. The processor 12 may be a general-purpose processor, including at least one of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), and a network processor (Network Processor, NP). The general-purpose processor may be a microprocessor, or the processor may also be any conventional processor, etc., and may implement or execute the methods, steps, and logical block diagrams disclosed in the embodiments of this application.

In this embodiment, the communication unit 13 is configured to establish a communication connection between the light projector 10 and other electronic devices through a network, and to send and receive data through the network, wherein the network includes a wired communication network and a wireless Communications network.

In this embodiment, the photographing device 14 includes a camera, and the photographing device 14 collects images of the picture projected by the light projector 10 through the camera.

In this embodiment, the projection control device 100 includes at least one software function module that can be stored in the memory 11 in the form of software or firmware or be solidified in the operating system of the projector 10 . The processor 12 may be configured to execute executable modules stored in the memory 11 , such as software function modules and computer programs included in the projection control device 100 . The projector 10 automatically delineates an effective area suitable for image projection on the current projection medium through the projection control device 100 for the to-be-displayed image, and automatically and quickly projects the to-be-displayed image into the effective area for display. , so as to ensure that the area where the image is displayed on the projection medium can meet the image projection requirements, avoid image projection errors caused by manual debugging of the projector 10, and improve the image projection efficiency, so as to improve the image projection effect and the user's image browsing experience.

At the same time, the projector 10 can also accurately measure the current projection medium as The image mapping transformation relationship between the reference projector 10 and the photographing device 14, and when the position of the projector 10 and/or the photographing device 14 changes relative to the current projection medium, the image is synchronously The mapping transformation relationship is used for parameter calibration.

It can be understood that the block diagram shown in FIG. 8 is only a schematic diagram of the composition of the light projector 10, and the light projector 10 may further include more or less components than those shown in FIG. 8 different configurations are shown. Each component shown in FIG. 8 may be implemented in hardware, software, or a combination thereof.

In the embodiments provided in this application, it should be understood that the disclosed apparatus and method may also be implemented in other manners. The apparatus embodiments described above are merely illustrative, eg, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality and operation of possible implementations of apparatuses, methods and computer program products according to embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more functions for implementing the specified logical function(s) executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.

In addition, each functional module in each embodiment of the present application may be integrated together to form an independent part, or each module may exist independently, or two or more modules may be integrated to form an independent part. If the functions are implemented in the form of software function modules and sold or used as independent products, they may be stored in a readable storage medium. Based on such understanding, the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution, and the computer software product is stored in a readable storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned readable storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other various programs that can store program codes medium.

In summary, in the projection control method, device, projector, and readable storage medium provided by the embodiments of the present application, the present application obtains the medium image captured by the photographing device for the current projection medium, and obtains the image from the medium image. Divide a plurality of areas to be checked, and then extract the maximum effective display area that meets the preset screen ratio from the plurality of areas to be checked, and according to the image mapping transformation relationship between the projector and the camera, the to-be-displayed The screen is transformed into the projection area corresponding to the maximum effective display area of the projector, and the corresponding image to be displayed is obtained, and then the projector is directly controlled to project the image to be displayed, so that the content of the image to be displayed can be quickly displayed on the projection medium. It is displayed in the area corresponding to the maximum effective display area and suitable for screen projection, thereby improving the screen projection effect and the user's screen browsing experience.

In addition, the present application can also accurately measure the image mapping transformation relationship between the projector and the camera with the current projection medium as a reference when the positions of the projector and the photographing device remain unchanged relative to the current projection medium, and When the position of the projector and/or the photographing device changes relative to the current projection medium, the parameters of the image mapping transformation relationship are synchronously calibrated, thereby ensuring the accuracy of the image mapping transformation relationship and improving the image projection accuracy.

The above are only various embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, All should be covered within the scope of protection of this application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (10)

1. A projection control method, characterized in that the method comprises:

   acquiring a medium image captured by the photographing device for the current projection medium;

   Perform image segmentation on the medium image to obtain a plurality of areas to be verified included in the medium image;

   extracting the maximum effective display area that meets the preset aspect ratio from the multiple areas to be verified;

   According to the corner position of the maximum effective display area in the medium image and the image mapping transformation relationship between the projector and the photographing device, the to-be-displayed picture is transformed to the image of the projector and the image to be displayed. In the delivery area corresponding to the largest effective display area, the corresponding to-be-delivered screen is obtained;

   The projector is controlled to project the picture to be displayed, so that the picture content of the picture to be displayed is displayed on the projection medium.
2. The method according to claim 1, wherein the step of extracting a maximum effective display area satisfying a preset screen ratio from the plurality of areas to be verified comprises:

   Perform quadrilateral boundary fitting for each area to be verified;

   If there is a target verification area to which the quadrilateral boundary is fitted, detecting whether the fitted boundary size ratio of the quadrilateral boundary satisfies the preset screen ratio;

   When it is detected that the border size ratio satisfies the preset screen ratio, the target verification area whose corresponding border size ratio meets the preset screen ratio is directly used as the maximum effective display area.
3. The method according to claim 2, wherein the step of extracting a maximum effective display area satisfying a preset screen ratio from the plurality of areas to be checked further comprises:

   In the case that the boundary size ratio of the target verification area does not meet the preset screen ratio, or the target verification area does not exist, extract the image size that meets the preset screen ratio from the multiple to-be-verified areas. Maximum pixel contiguous area;

   The largest continuous area of pixels is used as the largest effective display area.
4. The method according to claim 3, wherein the step of extracting a maximum pixel continuous area satisfying the preset screen ratio from the plurality of areas to be verified comprises:

   Select a preset number of areas to be screened from the plurality of areas to be checked, wherein the number of pixels in the area to be screened is greater than the number of pixels in the area to be checked that is not selected;

   For each to-be-screened area, determine the inscribed rectangular continuous area with the largest area of the to-be-screened area;

   Obtain the corresponding inscribed rectangular area according to the preset screen ratio in each obtained inscribed rectangular continuous area;

   The inscribed rectangular area with the largest area is taken as the largest pixel continuous area.
5. The method according to claim 1, wherein, according to the corner position of the maximum effective display area in the medium image and the image mapping transformation relationship between the projector and the photographing device, The step of transforming the to-be-displayed picture into the projection area corresponding to the maximum effective display area of the projector to obtain the corresponding to-be-released picture includes:

   Perform position transformation on the corner position of the maximum effective display area according to the image mapping transformation relationship to obtain the corner position coordinates of the placement area under the optical-mechanical coordinate system where the projector is located;

   establishing a coordinate matching relationship between the corner position coordinates and the vertex position coordinates of the to-be-displayed picture in the optical-mechanical coordinate system;

   Coordinate transformation is performed on each pixel in the to-be-displayed image according to the coordinate matching relationship, to obtain the to-be-launched image overlapping the placement area.
6. The method according to any one of claims 1-5, wherein the method further comprises:

   Controlling the light projector to project a debugging picture to the current projection medium, and acquiring a medium calibration image captured by the photographing device for the debugging picture;

   Calculate the coordinates of the first corner point of the debugging image in the optical-mechanical coordinate system where the projector is located, and the coordinates of the second corner of the debugging image in the photographing coordinate system corresponding to the medium calibration image;

   According to the positional correspondence between the coordinates of the first corner point and the coordinates of the second corner point, the image mapping transformation relationship between the light projector and the photographing device is determined.
7. A projection control device, characterized in that the device comprises:

   a medium image acquisition module, configured to acquire a medium image photographed by the photographing device for the current projection medium;

   an image area segmentation module, configured to perform image segmentation on the medium image to obtain a plurality of areas to be verified included in the medium image;

   a display area extraction module, used for extracting a maximum effective display area that satisfies a preset screen ratio from the multiple areas to be verified;

   A picture mapping transformation module, configured to transform the to-be-displayed picture into the said Obtaining a corresponding picture to be released in the delivery area corresponding to the maximum effective display area of the projector;

   The picture projection control module is used for controlling the light projector to project the picture to be displayed, so that the picture content of the picture to be displayed is displayed on the projection medium.
8. The device according to claim 7, wherein the device further comprises:

   a medium projection calibration module, configured to control the light projector to project a debugging picture to the current projection medium, and obtain a medium calibration image captured by the photographing device for the debugging picture;

   The corner coordinate calculation module is used to calculate the first corner coordinates of the debugging screen in the optical-mechanical coordinate system where the projector is located, and the camera coordinate system corresponding to the medium calibration image of the debugging screen The coordinates of the second corner point below;

   A transformation relationship creation module, configured to determine an image mapping transformation relationship between the light projector and the photographing device according to the positional correspondence between the coordinates of the first corner point and the coordinates of the second corner point.
9. A light projector, characterized in that it comprises a processor and a memory, the memory stores a computer program executable by the processor, the processor can execute the computer program, and implements the computer program in claims 1-6. Any one of the projection control methods described above.
10. A readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the projection control method according to any one of claims 1-6 is implemented.

Images