WO2019085829A1

WO2019085829A1 - Method and apparatus for processing control system, and storage medium and electronic apparatus

Info

Publication number: WO2019085829A1
Application number: PCT/CN2018/112047
Authority: WO
Inventors: 周扬; 王金桂
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2017-11-03
Filing date: 2018-10-26
Publication date: 2019-05-09
Also published as: US20200033599A1; US11275239B2; CN109752951A; CN109752951B

Abstract

A method and apparatus for processing a control system, and a storage medium and an electronic apparatus. The method comprises: acquiring, by means of a target photographic device in a control system (104), first image information of a target object currently moving in a display scene; acquiring a first distance corresponding to the first image information, wherein the first distance is the distance between the target photographic device and the target object; and adjusting a target parameter of the control system according to the first distance, wherein the target parameter is used for controlling the control system so that same outputs media information to a virtual reality device (106), the virtual reality device (106) is connected to the control system (104), the media information corresponds to movement information of the target object moving in the display scene, and the movement information comprises the first distance. The method solves the technical problem of the high control cost of a control system.

Description

Processing method, device, storage medium and electronic device of control system

The present application claims priority to Chinese Patent Application No. 201711070963.9, entitled "Processing Method, Apparatus, Storage Medium and Electronic Device of Control System", filed on November 3, 2017, the entire contents of This is incorporated herein by reference.

Technical field

Embodiments of the present invention relate to the field of virtual reality, and in particular, to a processing method, apparatus, storage medium, and electronic device of a control system.

Background technique

At present, actors often move back and forth during performances, usually requiring staff to manually adjust the parameters of the control system to ensure the performance of the actors. For example, the staff needs to manually adjust the parameters of the tracking system of the control system to dynamically adjust the position of the light. To ensure that the actor's face is well lit, which requires higher labor costs.

In addition, the related technology is based on the binocular camera of the binocular camera, and an additional depth camera is provided to obtain the depth information, so that the actor can use virtual reality (Virtual Reality, for short live broadcast through the binocular camera). Watch the show for the VR) glasses case to experience the live feeling of face-to-face with the actors. However, the problem with this method is the introduction of a new camera, which increases the hardware cost of the control system.

The related art also processes a picture obtained by a binocular camera through a complicated algorithm, and calculates depth information of each pixel in the image. Although this method can obtain accurate depth information, the computational cost is huge and cannot be real-time.

In view of the above-mentioned problem of large control cost of the control system, an effective solution has not yet been proposed.

Summary of the invention

Embodiments of the present invention provide a processing method, apparatus, storage medium, and electronic device of a control system, so as to at least solve the technical problem of high control cost of a related art control system.

According to an aspect of an embodiment of the present invention, a processing method of a control system is provided. The method includes: acquiring, by a target imaging device in the control system, first image information of a target object currently moving in a real scene; acquiring a first distance corresponding to the first image information, wherein the first distance is a target imaging device and The distance between the target objects; the target parameters of the control system are adjusted according to the first distance, wherein the target parameters are used to control the control system to output media information to the virtual reality device, the virtual reality device is connected to the control system, and the media information and the target object are The moving information corresponding to the moving in the real scene corresponds to the first distance.

According to another aspect of an embodiment of the present invention, there is also provided a processing apparatus of a control system, comprising one or more processors, and one or more memories storing program units, wherein the program units are executed by a processor, The program unit includes: a first acquiring unit configured to acquire first image information of a target object currently moving in a real scene by a target imaging device in the control system; and a second acquiring unit configured to acquire the first image information Corresponding first distance, wherein the first distance is a distance between the target imaging device and the target object; the adjusting unit is configured to adjust a target parameter of the control system according to the first distance, wherein the target parameter is used to control the control system to virtual The real device outputs media information, and the virtual reality device is connected to the control system. The media information corresponds to the mobile information that the target object moves in the real scene, and the mobile information includes the first distance.

According to another aspect of an embodiment of the present invention, a storage medium is also provided. A computer program is stored in the storage medium, and the computer program is configured to execute the method of the embodiment of the present invention at runtime.

According to another aspect of an embodiment of the present invention, an electronic device is also provided. The electronic device includes a memory and a processor, wherein the computer stores a computer program, and the processor is configured to execute a computer program to perform the method of an embodiment of the present invention.

In the embodiment of the present invention, the first image information of the target object currently moving in the real scene is acquired by the target imaging device in the control system; and the first distance corresponding to the first image information is acquired, wherein the first distance is the target a distance between the camera device and the target object; adjusting a target parameter of the control system according to the first distance, wherein the target parameter is used to control the control system to output media information to the virtual reality device, the virtual reality device is connected to the control system, and the media information is The target object corresponds to the mobile information moving in the real scene, and the mobile information includes the first distance. According to the correspondence between the image information and the distance, the first distance between the target imaging device and the target object can be acquired through the first image information of the target object at a low cost, and the control system is further adjusted according to the first distance. a target parameter, by using the target parameter control control system to output media information corresponding to the movement information of the target object to the virtual reality device, thereby avoiding manual adjustment of the target parameter of the control system, and realizing the target parameter of the control system The purpose of the control control system outputting the media information to the virtual reality device achieves the technical effect of reducing the control cost of the control system, thereby solving the technical problem of the control cost of the related art control system.

DRAWINGS

The drawings are intended to provide a further understanding of the embodiments of the present invention, and are intended to be a part of the present invention, and the description of the present invention is not intended to limit the invention. In the drawing:

1 is a schematic diagram of a hardware environment of a processing method of a control system according to an embodiment of the present invention;

2 is a flow chart of a processing method of a control system according to an embodiment of the present invention;

3 is a schematic diagram of a control system in accordance with an embodiment of the present invention;

4 is a flowchart of a processing method of a computing center device of a control system according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a correspondence relationship between a parallax and a distance according to an embodiment of the present invention; FIG.

6 is a schematic diagram of a control effect of a virtual eyewear experience control system according to an embodiment of the invention;

7 is a schematic diagram of another control effect of a virtual glasses experience control system according to an embodiment of the present invention;

FIG. 8 is a schematic diagram of another control effect of a virtual glasses experience control system according to an embodiment of the present invention; FIG.

9 is a schematic diagram of a processing apparatus of a control system according to an embodiment of the present invention;

FIG. 10 is a block diagram showing the structure of an electronic device according to an embodiment of the invention.

Detailed ways

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is an embodiment of the invention, but not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the scope of the present invention.

It is to be understood that the terms "first", "second" and the like in the specification and claims of the present invention are used to distinguish similar objects, and are not necessarily used to describe a particular order or order. It is to be understood that the data so used may be interchanged where appropriate, so that the embodiments of the invention described herein can be implemented in a sequence other than those illustrated or described herein. In addition, the terms "comprises" and "comprises" and "the" and "the" are intended to cover a non-exclusive inclusion, for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to Those steps or units may include other steps or units not explicitly listed or inherent to such processes, methods, products or devices.

According to an aspect of an embodiment of the present invention, an embodiment of a processing method of a control system is provided.

Optionally, in the embodiment, the processing method of the foregoing control system may be applied to a hardware environment composed of the server 102, the control system 104 including the target imaging device, and the virtual reality device 106 as shown in FIG. 1. 1 is a schematic diagram of a hardware environment of a processing method of a control system according to an embodiment of the present invention. As shown in FIG. 1, the server 102 is connected to the control system 104 via a network, including but not limited to a wide area network, a metropolitan area network, or a local area network. The control system 104 is not limited to a stage control system or the like. The processing method of the control system of the embodiment of the present invention may be executed by the server 102, may be performed by the control system 104, or may be jointly executed by the server 102 and the control system 104. The processing method of the control system executing the control system of the embodiment of the present invention may also be performed by a client installed thereon. The virtual reality device 106 is not limited to: a virtual reality helmet, a virtual reality glasses, a virtual reality integrated device, etc., and is used for the user to experience media information output by the control system to the virtual reality device, and the media information is not limited to the sound information and the light. Information, etc.

2 is a flow chart of a method of processing a control system in accordance with an embodiment of the present invention. As shown in FIG. 2, the method may include the following steps:

In step S202, the first image information of the target object currently moving in the real scene is acquired by the target imaging device in the control system.

In the technical solution provided in the above step S202 of the present application, the control system may be a performance stage control system for controlling the performance effect of the actors on the stage, or controlling the performance effects of the actors in the live room, including sound effects, lighting effects, etc. Control effect. The control system includes a target imaging device, which may have two cameras, that is, the target imaging device is a binocular imaging device, for example, a binocular camera including a left camera and a right camera, a binocular camera, and the like. Compared with the single imaging device, the binocular imaging device of the embodiment obtains the synchronous exposure image through the calibrated dual camera by using the bionics principle, and then calculates the three-dimensional depth information of the acquired two-dimensional image pixel. Optionally, the realistic scene of this embodiment includes a performance scene of the actor on the stage.

This embodiment acquires first image information of a target object currently moving in a real scene by the above-described target imaging apparatus. The target object of this embodiment may be an object such as an actor, an anchor, an object, or the like in a real scene, wherein the target object moves in a real scene, that is, the distance between the target object and the target imaging device changes, through the target imaging device. The first image information of the target object may be collected in real time, and the first image information may be image information of the target object collected in real time, including image information, video information, etc. acquired by the binocular imaging device, and may also include the target imaging device. The difference between the midpoint lateral coordinate of the image acquired by the left camera and the midpoint lateral coordinate of the image acquired by the right camera, that is, the first image information further includes image parallax, and no limitation is made herein.

Step S204: Acquire a first distance corresponding to the first image information.

In the technical solution provided in the above step S204 of the present application, the first distance is the distance between the target imaging device and the target object.

After acquiring the first image information of the current target object by the target imaging device of the control system, acquiring a first distance corresponding to the first image information, where the first distance is a real-time distance of the target object from the target imaging device, and may be a target imaging The depth information of the device to the target object.

Optionally, the embodiment obtains a first distance corresponding to the first image information from the correspondence relationship table, where the correspondence relationship table includes a pre-established image parallax, a data relationship between the target object and a distance between the target cameras, and may be according to The image disparity in the first image information is searched from the correspondence table to the first distance corresponding to the current time.

Step S206, adjusting the target parameter of the control system according to the first distance.

In the technical solution provided in the above step S206 of the present application, after acquiring the first distance corresponding to the first image information, the target parameter of the control system is adjusted according to the first distance, wherein the target parameter is used to control the control system to the virtual reality device. The media information is output, and the virtual reality device is connected to the control system, and the media information corresponds to the mobile information that the target object moves in the real scene, and the mobile information includes the first distance.

The target parameter of the control system of this embodiment may be a control parameter that needs to achieve a certain performance effect when the stage is controlled, and is used for controlling the control system to output media information to the virtual reality device. The target parameter may include a sound parameter of the control system, a light parameter, and the like, wherein the sound parameter is used to control the control system to output sound information to the virtual reality device, and the light parameter is used to control the control system to output the light information to the virtual reality device. The virtual reality device of the embodiment is connected to a control system, and the virtual reality device can map image information and media information acquired by the control system, and can be a VR glasses box, which can be used by a user watching the performance to experience control of the control system. effect.

Optionally, in the process of moving the target object in the real scene, the target parameter of the control system is adjusted according to the change state of the distance between the target object and the target imaging device. Optionally, the sound parameters of the control system are adjusted, for example, the sound intensity of the control system (in dB), and optionally, the sound intensity is inversely proportional to the square of the distance. When the target object approaches the target imaging device during the moving of the real scene, the sound is made larger by adjusting the sound parameters of the control system; when the target object is away from the target imaging device during the moving of the real scene, the sound parameters of the control system are adjusted. The sound is smaller so that the sound that the user hears while watching the performance is more realistic, giving the user an immersive experience.

It should be noted that the embodiment does not limit the adjustment rules of the control system for adjusting the sound parameters. Any adjustment rule that achieves a louder sound when the target object is close to the target imaging device and a smaller sound when the target object is away from the target imaging device is It is within the scope of embodiments of the invention.

Optionally, the embodiment may also adjust the lighting parameters of the control system to control the light. For example, when the distance between the target object and the target imaging device decreases, the pan/tilt that controls the light automatically moves the focus of the light to the target camera. The area near the device; when the distance between the target object and the target camera device increases, the pan/tilt that controls the light automatically moves the focus of the light to an area farther from the target camera device, so that the control spotlight can follow the target object. Move back and forth to ensure that the light shines well on the actor, giving the user an immersive experience.

It should be noted that the embodiment does not specifically limit the adjustment rules for adjusting the light parameters. Any one can realize that when the target object approaches the target imaging device, the pan/tilt of the light automatically moves the focus of the light to an area close to the target imaging device. When the distance between the target object and the target imaging device increases, the adjustment rule that the pan/tilt that controls the light automatically moves the focus of the light to the region farther from the target imaging device is within the scope of the embodiment of the present invention. , here is no longer an example.

The media information of this embodiment corresponds to the mobile information that the target object moves in the real scene. The media information includes sound information, lighting information, and the like, and information required by the user when watching the stage performance, wherein the sound information includes sound information having a certain size, for example, when the target object approaches the target imaging device, the sound becomes louder. Sound information; when the target object is far away from the target imaging device, it is a sound information with a small sound. In this way, when the user experiences through the virtual reality device, for example, when viewing through the VR glasses box, when the target object is closer to the user, the user experiences that the heard sound becomes larger, and when the target object is more from the user. In the faraway, what the user experiences is that the sound that is heard becomes smaller, so that the sound that the user hears while watching the performance is more realistic, bringing the user an immersive experience.

Optionally, when the target object is close to the target imaging device, the media information is light information that is automatically generated when the pan/tilt of the light moves the focus of the light to an area close to the target imaging device; when the target object is close to the target imaging device, The media information is the light information that the pan/tilt of the light automatically moves when the light focus is moved to the far area of the target camera device, thereby ensuring the light of the light on the actor is good, and bringing the user an immersive experience.

It should be noted that this embodiment may include other information for stage control in addition to the above media information, and no limitation is imposed herein.

Obtaining, by the step S202 to the step S206, the first image information of the target object currently moving in the real scene by acquiring the target imaging device in the control system; acquiring a first distance corresponding to the first image information, where the first distance is the target a distance between the camera device and the target object; adjusting a target parameter of the control system according to the first distance, the target parameter is used to control the control system to output media information to the virtual reality device, and the virtual reality device is connected with the control system, the media information and the target The object corresponds to the mobile information moving in the real scene, and the mobile information includes the first distance. According to the correspondence between the image information and the distance, the first distance between the target imaging device and the target object can be acquired through the first image information of the target object at low cost, and the target of the control system is adjusted according to the first distance. a parameter, by which the control system outputs the media information corresponding to the movement information of the target object to the virtual reality device, thereby avoiding manual adjustment of the target parameter of the control system, and realizing control by the target parameter of the control system The purpose of the control system outputting the media information to the virtual reality device achieves the technical effect of reducing the control cost of the control system, thereby solving the technical problem of the control cost of the related technology control system.

As an optional embodiment, in step S204, acquiring the first distance corresponding to the first image information comprises: acquiring the first image parallax between the first sub-image information and the second sub-image information in the first image information. The first sub-image information is obtained by the first camera, and the second sub-image information is obtained by the second camera, and the first camera and the second camera are deployed in the target imaging device, the first image. The disparity is used to represent a difference between the first image of the target object indicated by the first sub-image information and the second image of the target object indicated by the second sub-image information; and the disparity with the first image is obtained in the target correspondence table Corresponding first distance.

In this embodiment, the image information acquired by the target imaging device includes image parallax, that is, the first image information includes a first image disparity for characterizing the target object indicated by the first sub-image information. The difference between the first image and the second image of the target object indicated by the second sub-image information is obtained by the first sub-image information and the second sub-image information, for example, the first image disparity passes through the first sub-image The difference between the midpoint lateral coordinate and the midpoint lateral coordinate of the second sub-image is obtained. The first sub-image information is obtained by the first camera in the target imaging device, and the first camera may be a left camera or a right camera of the binocular camera; the second sub-image information is included in the target imaging device. The second camera captures the target object. In the case that the first camera is the left camera of the binocular camera, the second camera device may be the right camera of the binocular camera, and the first camera is the right camera of the binocular camera. In this case, the second imaging device may be a left camera of the binocular camera.

The target correspondence table of the embodiment is a data relationship table of a relationship between the image parallax and the distance established in advance, and includes a correspondence relationship between the image parallax and the distance, and the image parallax is used to represent the image capturing device acquired by the target image capturing device. The difference between the different images, including the first image disparity of this embodiment, is the distance between the target imaging device and the target object, including the first distance of this embodiment. With the target correspondence table, the distance can be determined based on the image parallax and the correspondence between the image parallax and the distance in the case where the image parallax is determined, thereby achieving the purpose of quickly and inexpensively acquiring the distance corresponding to the image parallax. For example, the target correspondence relationship table stores a correspondence relationship between the first image disparity and the first distance, and after acquiring the first image disparity between the first sub-image information and the second sub-image information, the target correspondence relationship Obtaining a first distance corresponding to the disparity of the first image in the table, so that the first distance corresponding to the parallax of the first image can be quickly and cost-effectively acquired in the target correspondence table, and then the target of the control system is adjusted according to the first distance The parameter and the output of the media information corresponding to the target parameter achieve the technical effect of reducing the control cost of the control system and improve the user experience.

Optionally, the target correspondence table may store other correspondences between the image disparity and the distance in advance, in addition to storing the correspondence between the first image disparity and the first distance. The image parallax corresponding to the distance may be acquired when the distance between the target imaging device and the target object is determined, so that the distance and the corresponding image parallax are stored in the target correspondence table, for example, setting the target imaging device and The distance between the target objects is D1 meters, the image information of the target object from the target imaging device D1 is acquired by the target imaging device, the image parallax is obtained from the image information, and the image parallax corresponding to the D1 meter and the D1 meter is further obtained. Stored in the target correspondence table; set the distance between the target camera device and the target object to be D2 meters. The D2 meter is different from D1 meters, and the image information of the target object from the target imaging device D2 is acquired by the target imaging device. Obtaining the image disparity from the image information, and storing the image disparity corresponding to the D2 meter and the D2 meter in the target correspondence table to establish a target correspondence table, thereby more distances and corresponding values by the above method. The image disparity is stored in the target correspondence table.

As an optional embodiment, acquiring the first image disparity between the first sub-image information and the second sub-image information in the first image information comprises: acquiring a first midpoint lateral coordinate in the first sub-image information Wherein the first midpoint lateral coordinate is a lateral coordinate of the center point of the first image in the target coordinate system; the second midpoint lateral coordinate in the second sub-image information is obtained, wherein the second midpoint lateral coordinate is The lateral coordinate of the center point of the two images in the target coordinate system; the difference between the first midpoint lateral coordinate and the second midpoint lateral coordinate is determined as the first image disparity.

In this embodiment, the image information includes a midpoint lateral coordinate, which is a lateral coordinate value of the center point of the image in the target coordinate system. Obtaining the first midpoint lateral coordinate in the first sub-image information, for example, the first sub-image information is the screen information collected by the left camera, and the screen information may be a left portrait, and the left portrait is at a center point in the target coordinate system. For (X1, Y1), the first midpoint lateral coordinate of the left portrait is X1; the second midpoint lateral coordinate in the second sub-image information is acquired, and the second sub-image information may be the screen information collected by the right camera. The screen information may be a right portrait, the center point of the right portrait in the target coordinate system is (X2, Y2), and the second midpoint horizontal coordinate of the right portrait is X2. Obtaining a difference between the first midpoint lateral coordinate and the second midpoint lateral coordinate after acquiring the first midpoint lateral coordinate in the first sub image information and the second midpoint lateral coordinate in the second sub image information Determining a difference between the first midpoint lateral coordinate and the second midpoint lateral coordinate as the first image parallax, that is, (X1-X2) may be determined as the first image parallax, thereby acquiring the above The first distance corresponding to the image disparity adjusts the target parameter of the control system according to the first distance, and outputs the media information corresponding to the target parameter, thereby achieving the technical effect of reducing the control cost of the control system and improving the user experience.

As an optional embodiment, acquiring the first distance corresponding to the first image disparity in the target correspondence table includes: searching for the target image disparity with the smallest difference between the disparity and the first image disparity in the target correspondence table The distance corresponding to the parallax of the target image is determined as the first distance in the target correspondence table.

In this embodiment, when the first distance corresponding to the disparity of the first image is acquired, since the target correspondence table is a data relationship between the pre-established image disparity and the distance, but the image disparity is calculated in real time, the calculated The image disparity may not be in the pre-established correspondence table. In the above case, the target image disparity which is the smallest difference between the disparity of the first image and the disparity of the first image may be found in the target correspondence table, and the difference is an absolute difference, that is, the target correspondence table is searched. The image parallax closest to the disparity of the first image is determined as the target image disparity that is closest to the disparity of the first image, and in the target correspondence table, the distance corresponding to the disparity of the target image is determined as the first distance, Similarly, the target parameter of the control system can be adjusted according to the first distance, and the media information corresponding to the target parameter is output, thereby achieving the technical effect of reducing the control cost of the control system and improving the user experience.

As an optional embodiment, before acquiring the first distance corresponding to the disparity of the first image in the target correspondence table, the method further includes: acquiring, by the target imaging device, second image information of the target object, where the target object a distance from the target imaging device is a first target distance; and a second image disparity between the third sub-image information and the fourth sub-image information is acquired in the second image information, wherein the third sub-image information is first The camera obtains the target object, the fourth sub-image information is obtained by the second camera, and the second image disparity is used to represent the third image and the fourth sub-image information of the target object indicated by the third sub-image information. a difference between the fourth image of the indicated target object; establishing a correspondence between the first target distance and the second image disparity in the target correspondence table; acquiring third image information of the target object by the target imaging device, wherein the target object The distance from the target imaging device is a second target distance, and the second target distance is different from the first target distance; Obtaining, in the image information, a third image disparity between the fifth sub-image information and the sixth sub-image information, wherein the fifth sub-image information is obtained by the first camera, and the sixth sub-image information is obtained by the second camera pair. Obtaining a target object, the third image disparity is used to represent a difference between the fifth image of the target object indicated by the fifth sub-image information and the sixth image of the target object indicated by the sixth sub-image information; A correspondence relationship between the second target distance and the third image disparity is established in the table.

In this embodiment, the data relationship in the target correspondence table is established before the first distance corresponding to the first image disparity is acquired from the target correspondence table. Acquiring, by the target imaging device, second image information of the target object at a first target distance from the target imaging device, the first target distance being a preset distance, for example, D1 meters, the first target distance being a basic setting The distance may be the farthest distance between the target camera device and the target object when the user has a three-dimensional (3D) experience. The target object is placed in an area away from the first target distance of the target imaging device, and the second image information obtained by capturing the target object in real time is acquired by the target imaging device. After acquiring the second image information, acquiring, from the second image information, a second image disparity between the third sub image information and the fourth sub image information, the second image disparity being used to represent the third sub image information a difference between the indicated third target image of the target object and the fourth image of the target object indicated by the fourth sub-image information, the second image disparity being obtained by the third sub-image information and the fourth sub-image information, for example, the second The image parallax is obtained by the difference between the midpoint lateral coordinate of the third sub image and the midpoint lateral coordinate of the fourth sub image. The third sub-image information is obtained by the first camera in the target imaging device for capturing a target object in the target correspondence table, and the first camera may be a left camera of the binocular camera; the fourth sub-image information is The second camera in the target imaging device captures the target object. In the case where the first camera is the left camera of the binocular camera, the second camera device may be the right camera of the binocular camera. In the target correspondence table, a correspondence relationship between the first target distance and the second image disparity is established.

Optionally, acquiring, by the target imaging device, third image information of the target object that is a second target distance from the target imaging device, where the second target distance is a preset distance, for example, D2 meters, which may be a relative first target. The distance of the distance change, for example, the second target distance is a distance that varies by 5 meters from the first distance. The target object is placed in an area from the second target distance of the target imaging device, and the third image information obtained by capturing the target object in real time is acquired by the target imaging device. After acquiring the third image information, acquiring, from the third image information, a third image disparity between the fifth sub image information and the sixth sub image information, the third image disparity being used to represent the fifth sub image information a difference between the indicated fifth target image of the target object and the sixth image of the target object indicated by the sixth sub-image information, the third image disparity being obtained by the fifth sub-image information and the sixth sub-image information, for example, The three image parallax is obtained by the difference between the midpoint lateral coordinate of the fifth sub image and the midpoint lateral coordinate of the sixth sub image. The fifth sub-image information is obtained by the first camera in the target imaging device for capturing a target object in the target correspondence table, the first camera may be a left camera of the binocular camera; the sixth sub-image information is The second camera in the target imaging device captures the target object. In the case where the first camera is the left camera of the binocular camera, the second camera device may be the right camera of the binocular camera. In the target correspondence table, a correspondence relationship between the second target distance and the third image parallax is established.

The embodiment may continuously change the distance between the target imaging device and the target object, repeat the above steps, and further establish a third correspondence relationship between the third target distance and the fourth image parallax in the target correspondence table, and so on. Thereby, a target correspondence table including a data relationship between image disparity and distance is established.

It should be noted that the method for establishing the target correspondence table including the data relationship between the image parallax and the distance is only a preferred embodiment of the embodiment of the present invention, and does not represent the method for establishing the target correspondence table of the present invention. For the foregoing method, any method for establishing a target correspondence table is within the scope of the embodiments of the present invention, and is not illustrated herein.

As an optional embodiment, acquiring the second image disparity between the third sub-image information and the fourth sub-image information comprises: acquiring a third midpoint lateral coordinate in the third sub-image information, wherein the third The lateral coordinate of the point is the lateral coordinate of the center point of the third image in the target coordinate system; the fourth midpoint lateral coordinate in the fourth sub-image information is acquired, wherein the fourth midpoint lateral coordinate is the center point of the fourth image a lateral coordinate in the target coordinate system; a difference between the third midpoint lateral coordinate and the fourth midpoint lateral coordinate is determined as a second image parallax; and a second between the fifth sub image information and the sixth sub image information is acquired The three image disparity includes: acquiring a fifth midpoint lateral coordinate in the fifth sub image information, wherein the fifth midpoint lateral coordinate is a lateral coordinate of the center point of the fifth image in the target coordinate system; and acquiring the sixth sub image information a sixth midpoint lateral coordinate, wherein the sixth midpoint lateral coordinate is a lateral coordinate of the center point of the sixth image in the target coordinate system; the fifth midpoint lateral coordinate and the sixth midpoint lateral coordinate are Determining a third difference image is disparity.

In this embodiment, when the target correspondence table is established, the third midpoint horizontal coordinate in the third sub-image information is acquired. For example, the third sub-image information is the screen information collected by the left camera, and the screen information may be The left portrait, the center point of the left portrait in the target coordinate system is (X3, Y3), the third midpoint lateral coordinate of the left portrait is X3; the fourth midpoint lateral coordinate in the fourth sub-image information is acquired, The four sub-image information may be the screen information collected by the right camera, and the screen information may be a right portrait, the center point of the right portrait in the target coordinate system is (X4, Y4), and the fourth midpoint lateral coordinate of the right portrait For X4. Obtaining a difference between the third midpoint lateral coordinate and the fourth midpoint lateral coordinate after acquiring the third midpoint lateral coordinate in the third sub image information and the fourth midpoint lateral coordinate in the fourth sub image information Determining a difference between the third midpoint lateral coordinate and the fourth midpoint lateral coordinate as the second image parallax, that is, determining (X3-X4) as the second image parallax, and further in the target correspondence table And establishing a correspondence between the first target distance and the second image parallax.

Optionally, the fifth midpoint lateral coordinate in the fifth sub-image information is obtained. For example, the fifth sub-image information is the image information collected by the left camera, and may be a left portrait, and the left portrait is in the center of the target coordinate system. The point is (X5, Y5), the fifth midpoint horizontal coordinate of the left portrait is X5; the sixth midpoint lateral coordinate in the sixth sub-image information is acquired, and the sixth sub-image information may be the screen information collected by the right camera. The picture information may be a right portrait, the center point of the right portrait in the target coordinate system is (X6, Y6), and the sixth midpoint horizontal coordinate of the right portrait is X6. Obtaining a difference between the fifth midpoint lateral coordinate and the sixth midpoint lateral coordinate after acquiring the fifth midpoint lateral coordinate in the fifth sub image information and the sixth midpoint lateral coordinate in the sixth sub image information Determining a difference between the fifth midpoint lateral coordinate and the sixth midpoint lateral coordinate as the third image parallax, that is, determining (X5-X6) as the third image parallax, and further in the target correspondence table And establishing a correspondence between the second target distance and the third image disparity.

It should be noted that, in the target correspondence table, the correspondence between the other target distances and the image disparity can also be performed by the foregoing method, and is not illustrated here.

As an optional embodiment, acquiring the third midpoint lateral coordinate in the third sub image information includes at least one of: in a case where the first image information is image information of a human face, the center point of the left eye image is The average value between the lateral coordinate in the target coordinate system and the lateral coordinate of the right eye image in the target coordinate system is determined as the first midpoint lateral coordinate; in the case where the first image information is the image information of the face Next, the lateral coordinate of the center point of the nose image in the target coordinate system is determined as the first midpoint lateral coordinate; in the case where the first image information is the image information of the portrait, the center point of the left hand image is in the target coordinate system The average value between the lateral coordinate and the lateral coordinate of the right-hand image in the target coordinate system is determined as the first midpoint lateral coordinate; in the case where the first image information is the image information of the portrait, the left arm image is The average value of the center point of the center point in the target coordinate system and the horizontal coordinate of the center point of the right arm image in the target coordinate system is determined to be the first midpoint horizontally sitting .

In this embodiment, an open source face recognition algorithm may be used to obtain an image area acquired by the first camera and the second camera in the target imaging device, for example, using an open source face recognition algorithm to obtain a left camera and a right camera. a portrait area, and calculating a third midpoint lateral coordinate of the third sub-image information according to a certain rule, and a fourth midpoint lateral coordinate in the fourth sub-image information, respectively obtaining a lateral coordinate of the left camera and a lateral coordinate of the right camera . The above rules can be, but are not limited to, the following rules:

In the case that the second image information is the image information of the face, the average coordinate of the binocular pixel coordinates in the face is determined as the third midpoint lateral coordinate, that is, the pixel coordinates of the two eyes in the face The average value is determined as the third midpoint lateral coordinate; in the case where the second image information is the image information of the face, the pixel coordinates of the nose in the face are determined as the third midpoint lateral coordinate; the second image information is In the case of the image information of the portrait, the average coordinates of the pixel coordinates of the left hand and the right hand in the portrait are determined as the third midpoint lateral coordinate, that is, the average value of the pixel coordinate values of the left hand and the right hand in the portrait is determined as the first Three midpoint lateral coordinates; in the case where the second image information is image information of a portrait, the average value of the pixel coordinate values of the left arm and the right arm in the portrait is determined as the third midpoint lateral coordinate, that is, in the portrait In the middle, the average value of the pixel coordinate values of the left arm and the right arm is determined as the third midpoint lateral coordinate.

It should be noted that the method for acquiring the first midpoint lateral coordinate, the second midpoint lateral coordinate, the fourth midpoint lateral coordinate, and the fifth midpoint lateral coordinate enumerated in this embodiment may all determine the third midpoint through the foregoing. The rules for obtaining the horizontal coordinates are not illustrated here.

As an optional embodiment, adjusting the target parameter of the control system according to the first distance comprises: increasing the sound parameter of the control system when the change state of the first distance indicates that the first distance becomes smaller, wherein the target parameter The sound parameter is included, the media information includes sound information, and the sound parameter is used to control the control system to output sound information to the virtual reality device; and when the change state of the first distance indicates that the first distance becomes large, the sound parameter of the control system is reduced.

The target parameter of this embodiment may include a sound parameter, when the target parameter of the control system is adjusted according to the first distance, when the change state of the first distance indicates that the first distance becomes smaller, the sound parameter of the control system is increased, such that When the user experiences through the virtual glasses, if the target object is closer to the user, the sound heard by the user will be larger. Alternatively, the sound intensity (unit: dB) is inversely proportional to the square of the first distance; at the first distance The change state indicates that the first distance is large, and the sound parameter of the control system is reduced, so that when the target object is further away from the user, the sound heard by the user is smaller. In this way, when the actor uses the binocular camera to shoot, the control system can also automatically detect the change of the distance between the target object and the target camera device, and adjust the control system to output the sound information to the virtual reality device in real time, that is, adjust the user reception. The size of the sound, so that the user experience the scene more realistic when watching the stage performance, to simulate the user-to-face live or communication experience.

As an optional embodiment, adjusting the target parameter of the control system according to the first distance includes: adjusting a light parameter of the control system to a first value when the change state of the first distance indicates that the first distance becomes smaller, So that the light of the control system is focused on the target area of the target imaging device, wherein the target parameter includes a light parameter, the media information includes light information, and the light parameter is used to control the control system to output the light information to the virtual reality device; at the first distance The change state indicates that the first distance becomes larger, and the light parameter of the control system is adjusted to a second value such that the light of the control system is focused outside the target area of the target imaging device.

The target parameter of the embodiment may include a light parameter. When the target parameter of the control system is adjusted according to the first distance, the light parameter of the control system is adjusted to be the first when the change state of the first distance indicates that the first distance becomes smaller. Value, the first value of the light parameter causes the control system's light to be focused within the target area of the target imaging device, such that when the distance between the target object and the target imaging device is reduced, for example, when the distance of the object/actor to the camera is reduced In hours, the pan/tilt of the light can automatically move the focus of the light to an area close to the camera; when the change state of the first distance indicates that the first distance becomes larger, the light parameter of the control system is adjusted to the second value, The binary light parameter makes the control system's light focus on the target area of the target camera device, and realizes that the spotlight moves with the actor moving back and forth to ensure that the light of the light is good on the actor.

As an optional embodiment, in step S204, acquiring the first distance corresponding to the first image information includes: acquiring, by the computing center device in the control system, a first distance corresponding to the first image information, where the computing center device And connecting to the target imaging device; adjusting the target parameter of the control system according to the first distance comprises: receiving, by the controller in the control system, the first distance sent by the computing center device, and adjusting the target parameter of the control system according to the first distance.

The control system of this embodiment includes a target imaging device, a computing center device, and a controller. Among them, the target imaging device can be a binocular camera. The target imaging device is configured to collect the first image information in real time, and transmit the first image information to the computing center device, where the first image information may be a binocular picture or video, and the target imaging device and the computing center device are wireless or wired. The wireless connection may be microwave communication, infrared communication, laser communication, etc. The wired mode may be a Universal Serial Bus (USB), a network cable, etc., and no limitation is imposed herein. The computing center device obtains a first distance corresponding to the first image information, for example, the computing center device is configured to complete processing on the binocular picture or video, and obtain a first distance of the target object from the target imaging device, for example, establishing image parallax and The data relationship of the depth information, real-time calculation of image parallax, obtaining real-time depth data, and issuing control commands to the controller. The controller receives the first distance sent by the computing center device, triggers the control logic of the controller, and adjusts the target parameter of the control system according to the first distance, and outputs the media information corresponding to the target parameter by the controller.

This embodiment utilizes the principle that the target imaging device captures different image parallax sizes of the same target object at different distances, and obtains the correspondence between the distance and the corresponding image parallax size according to the method of actual measurement or optical simulation, and then according to the real-time and low-cost basis. The image parallax in the image information of the target object calculates the distance of the target object camera, completes the automatic control of the stage lighting and the sound, and achieves the technical effect of reducing the control cost of the control system, thereby improving the user experience.

It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence. Because certain steps may be performed in other sequences or concurrently in accordance with the present invention. In addition, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the present invention in essence or the contribution to the related art can be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM). The instructions include a number of instructions for causing a terminal device (which may be a cell phone, computer, server, or network device, etc.) to perform the methods described in various embodiments of the present invention.

The technical solution of the present invention will be described below in conjunction with preferred embodiments.

This embodiment utilizes the principle that the binocular camera captures different parallax sizes of the same object/user at different distances, and obtains the correspondence between different depth distances of the object and the corresponding image parallax size according to the method of actual measurement or optical simulation, thereby real-time low cost. Calculate the distance between the object/user and the camera to complete the automatic control of the stage lighting and sound.

The constituent modules of the stage control system based on the binocular camera of the embodiment will be described below.

3 is a schematic diagram of a control system in accordance with an embodiment of the present invention. As shown in FIG. 3, the control system includes: a binocular camera 1, a computing center device 2, and a controller 3.

The binocular camera 1 is the first module of the stage control system for collecting the binocular picture or video information of the object in real time and transmitting it to the computing center device 2.

The computing center device 2 is a second module of the stage control system for completing the processing of the binocular picture or video, obtaining the real-time distance of the user from the camera, and issuing a control command to the controller 3.

The controller 3 is a third module of the stage control system, and is configured to receive a control instruction of the computing center device 2, and complete other controls such as a volume controller (volume control), a light regulator (light control), and the like through the control command.

The binocular camera of the embodiment of the present invention will be described below.

A binocular camera refers to the real-time acquisition of images through two cameras and transmission to a computing center device. The binocular camera is connected to the computing center device and can be connected to the computing center device via wireless or wired (eg USB, network cable, etc.) without any restrictions.

The computing center device of the embodiment of the present invention is introduced below.

4 is a flow chart of a method of processing a computing center device of a control system in accordance with an embodiment of the present invention. As shown in FIG. 4, the method includes the following steps:

In step S401, a data relationship between the disparity and the depth information is established.

First, place the object in the area at the camera D1 (D1 meter is a known value), and the calculation center device obtains the real-time picture (binocular picture or video) captured by the binocular camera. Optionally, the computing center device uses an open source face recognition algorithm to obtain a portrait area of the left camera and the right camera, and calculates a midpoint lateral coordinate of the left and right portraits according to a certain rule. For example, the midpoint horizontal coordinate of the left portrait is The left camera's x1, the right portrait's midpoint horizontal coordinate is the right camera's x2.

Optionally, the foregoing rules for respectively calculating the midpoint lateral coordinates of the left and right portraits may be, but are not limited to, the following:

In the face, the average of the pixel coordinates of the two eyes;

The pixel coordinates of the nose in the face;

In the portrait, the average of the pixel coordinates of the left and right hands;

In the portrait, the average of the pixel coordinates of the left arm and the right arm.

Then, the difference between the midpoint lateral coordinate x1 of the left portrait and the midpoint lateral coordinate x2 of the right portrait in the left camera screen and the right camera screen is calculated.

Finally, the distance D2 from the camera to the object is constantly changed (D2 is a known value), and the lateral coordinate difference of the center pixel points of the left and right portraits is calculated.

By repeating the above steps, the difference between the midpoint lateral coordinate x1 of the left portrait and the midpoint lateral coordinate x2 of the right portrait can be obtained under different distances, and the correspondence between the parallax and the distance of the same object by the left and right cameras can be obtained.

FIG. 5 is a schematic diagram of a correspondence relationship between a parallax and a distance according to an embodiment of the present invention. As shown in FIG. 5, the distance D1 is the image parallax corresponding to the midpoint lateral coordinate X1 of the left camera screen and the midpoint lateral coordinate X2 of the right camera screen, wherein the left portrait center point (X1, Y1), the right portrait center point (X2, Y2). The distance D2 meters corresponds to the parallax of the midpoint lateral coordinate X3 of the left camera picture and the midpoint lateral coordinate X4 of the right camera picture, wherein the left portrait center point (X3, Y3) and the right portrait center point (X4, Y4).

Step S402, calculating image disparity in real time to obtain real-time depth data.

First, the computing center device obtains the left and right camera images transmitted by the binocular camera in real time, and based on the above method, the difference between the midpoint lateral coordinate X1 of the real left portrait and the midpoint lateral coordinate X2 of the right portrait can be obtained.

Then, according to the correspondence between the image parallax and the distance of the same object of the left and right cameras, the reverse search is performed to obtain the distance from the object to the camera at the current time point.

The controller of the embodiment of the present invention will be described below.

The computing center device sends the real-time object/actor-to-camera distance to the controller, triggering the controller's control logic, which includes the following logic: First, the volume-related logic, when the object/actor-to-camera distance is reduced The control system automatically adjusts the volume. The numerical rules for adjustment are not limited here (but the principle that can be followed is that the sound intensity (in dB) is inversely proportional to the square of the distance); second, the logic associated with the light, when the object / When the distance from the actor to the camera is reduced, the pan/tilt of the light automatically moves the focus of the light to an area close to the camera. The adjusted numerical rules are not limited here.

The application environment of the embodiment of the present invention may be, but is not limited to, the reference to the application environment in the foregoing embodiment, which is not described in this embodiment. An embodiment of the present invention provides an optional specific application for implementing the processing method of the above control system.

FIG. 6 is a schematic diagram of a control effect of a virtual eyewear experience control system according to an embodiment of the invention. FIG. 7 is a schematic diagram of another control effect of a virtual eyewear experience control system according to an embodiment of the present invention. As shown in the display screens shown in FIG. 6 to FIG. 7, the image of the anchor/actor becomes smaller, and the change state of the distance from the binocular camera indicates that the distance between the anchor/actor and the binocular camera becomes large, and the distance is automatically reduced. Control the sound parameters of the system so that the sound heard by the user becomes smaller; from the display screens shown in Figures 7 to 6, it can be seen that the image of the anchor/actor becomes larger, and the status of the change of the distance of the anchor/actor from the binocular camera is indicated. The distance between the anchor/actor and the binocular camera becomes smaller, and the sound parameters of the control system are automatically increased at this time, so that the sound heard by the user becomes larger, so that the anchor/actor is using the binocular camera for real-time online. During the live broadcast, even without the help of assistants, the anchor/actor can realize the dynamic control of the sound following its own position, so that the sound heard by the user is more true, and thus the user and the user watch the live broadcast through the virtual glasses. A similar experience of actors face to face.

FIG. 8 is a schematic diagram of another control effect of a virtual eyewear experience control system according to an embodiment of the present invention. As shown in Fig. 7 and Fig. 8, the image of the anchor/actor becomes larger, the change state of the distance of the anchor/actor from the binocular camera indicates that the distance becomes smaller, the light parameters of the control system are adjusted, and the adjusted light parameters make the control system The light is focused on the target area of the target camera, so that when the distance between the target object and the target camera is reduced, the pan/tilt of the light can automatically move the focus of the light to an area close to the camera; Figure 8 to Figure The display screen shown in 7 shows that the image of the anchor/actor is smaller, the change status of the distance between the anchor/actor and the binocular camera is larger, the lighting parameters of the control system are adjusted, and the adjusted lighting parameters make the lighting of the control system Focus on the target area of the target camera device. In this way, the anchor/actor can realize the dynamic control of the light following its position by one person, and realize that the spotlight will move with the actor moving back and forth, so that the image seen by the user is more true, thereby ensuring that when the user watches the live broadcast through the virtual glasses, there is a user and A similar experience of actors face to face.

In this embodiment, when the actor uses the binocular camera to shoot, the control system can automatically detect the change of the distance between the actor and the camera, and adjust the size of the sound received by the user in real time to simulate the face-to-face live broadcast or communication experience. When the anchor is closer to the user, the sound will be louder. When the anchor is farther away from the user, the sound will be smaller, making the user experience the sound more realistic; the spotlight will move with the actors moving back and forth to ensure that the photo is illuminated. The actor’s light is good, and the purpose of the light is followed to ensure that the light is shining on the actor.

According to another aspect of an embodiment of the present invention, there is also provided a processing apparatus of a control system for implementing a processing method of the above control system, comprising one or more processors, and one or more memories storing the program units, The program unit is executed by a processor, and the program unit includes a first acquiring unit, a second acquiring unit, and an adjusting unit. 9 is a schematic diagram of a processing device of a control system in accordance with an embodiment of the present invention. As shown in FIG. 9, the apparatus may include: a first acquisition unit 10, a second acquisition unit 20, and an adjustment unit 30.

The first obtaining unit 10 is configured to acquire first image information of a target object currently moving in a real scene by a target imaging device in the control system.

The second obtaining unit 20 is configured to acquire a first distance corresponding to the first image information, wherein the first distance is a distance between the target imaging device and the target object.

The adjusting unit 30 is configured to adjust a target parameter of the control system according to the first distance, wherein the target parameter is used to control the control system to output media information to the virtual reality device, the virtual reality device is connected to the control system, and the media information and the target object are The moving information corresponding to the moving in the real scene corresponds to the first distance.

It should be noted that the first acquiring unit 10, the second obtaining unit 20, and the adjusting unit 30 may be operated in the terminal as a part of the device, and the functions implemented by the foregoing unit may be performed by a processor in the terminal, and the terminal also It can be a smart phone (such as Android phone, iOS phone, etc.), tablet computer, applause computer, and mobile Internet devices (MID), PAD and other terminal devices.

Optionally, the second obtaining unit 20 of the embodiment includes: a first acquiring module and a second acquiring module. The first obtaining module is configured to acquire, in the first image information, a first image disparity between the first sub-image information and the second sub-image information, wherein the first sub-image information is used by the first camera to the target object Obtaining, the second sub-image information is obtained by the second camera, and the first camera and the second camera are deployed in the target imaging device, and the first image disparity is set to represent the target object indicated by the first sub-image information. a difference between the first image and the second image of the target object indicated by the second sub-image information; the second acquisition module is configured to acquire a first distance corresponding to the first image disparity in the target correspondence table.

It should be noted that the first acquiring module and the second acquiring module may be run in the terminal as part of the device, and the functions implemented by the foregoing module may be performed by a processor in the terminal.

Optionally, the first obtaining module of the embodiment includes: a first acquiring submodule, a second acquiring submodule, and determining a submodule. The first obtaining sub-module is configured to acquire a first midpoint lateral coordinate in the first sub-image information, wherein the first midpoint lateral coordinate is a lateral coordinate of the center point of the first image in the target coordinate system; a second obtaining submodule configured to acquire a second midpoint lateral coordinate in the second sub image information, wherein the second midpoint lateral coordinate is a lateral coordinate of the center point of the second image in the target coordinate system; And a module configured to determine a difference between the first midpoint lateral coordinate and the second midpoint lateral coordinate as the first image disparity.

It should be noted that the foregoing first obtaining sub-module, the second obtaining sub-module and the determining sub-module may be run in the terminal as part of the device, and the functions implemented by the above-mentioned modules may be performed by a processor in the terminal.

It should be noted that the first obtaining unit 10 in this embodiment may be configured to perform step S202 in the embodiment of the present application, and the second obtaining unit 20 in the embodiment may be configured to perform the method in the embodiment of the present application. In step S204, the adjusting unit 30 in this embodiment may be configured to perform step S206 in the embodiment of the present application.

It should be noted that the above-mentioned units and modules are the same as the examples and application scenarios implemented by the corresponding steps, but are not limited to the contents disclosed in the above embodiments. It should be noted that the foregoing module may be implemented in a hardware environment as shown in FIG. 1 as part of the device, and may be implemented by software or by hardware. Among them, the hardware environment includes the network environment.

In this embodiment, the first acquiring unit 10 acquires first image information of the target object currently moving in the real scene by the target imaging device in the control system; and acquires the first image information corresponding to the first image information by the second acquiring unit 20 a distance, wherein the first distance is a distance between the target imaging device and the target object; and the target parameter of the control system is adjusted according to the first distance by the adjusting unit 30, wherein the target parameter is used to control the control system to output the media to the virtual reality device The information, the virtual reality device is connected with the control system, the media information corresponds to the moving information of the target object moving in the real scene, the mobile information includes the first distance, and the technical effect of reducing the control cost of the control system is achieved, thereby solving the related technical control The technical problems of the system's control cost are large.

According to another aspect of an embodiment of the present invention, there is also provided an electronic device for implementing the processing method of the above control system.

As an optional implementation manner, the electronic device of this embodiment is deployed in the control system as part of the control system of the embodiment of the present invention. For example, the electronic device is deployed in the control system 104 shown in FIG. A processing method for executing a control system of an embodiment of the present invention. The control system is connected to a virtual reality device, including but not limited to a virtual reality helmet, a virtual reality glasses, a virtual reality integrated machine, etc., for receiving media information output by the control system, for example, receiving the output of the control system. Sound information, lighting information, etc.

As another alternative embodiment, the electronic device of this embodiment can be connected as a separate part to the control system of the embodiment of the present invention. For example, the electronic device is connected to the control system 104 shown in FIG. A processing method for executing a control system of an embodiment of the present invention by a control system. The control system is connected to the virtual reality device through an electronic device, including but not limited to a virtual reality helmet, a virtual reality glasses, a virtual reality integrated machine, etc., for receiving media information output by the control system through the electronic device, such as Receiving sound information, lighting information, and the like output by the control system through the electronic device.

FIG. 10 is a block diagram showing the structure of an electronic device according to an embodiment of the invention. As shown in FIG. 10, the electronic device may include one or more (only one shown in the figure) processor 101, a memory 103, wherein a computer program may be stored in the memory 103, and the processor 101 may be set to run. The computer program is a processing method of a control system that performs an embodiment of the present invention.

Alternatively, the memory 103 can be used to store a computer program and a module, such as a processing method of the control system and a program instruction/module corresponding to the device in the embodiment of the present invention, the processor 101 being configured to run the software stored in the memory 103 The program and the module, thereby performing various functional applications and data processing, that is, implementing the processing method of the above control system. Memory 103 may include high speed random access memory, and may also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, memory 103 can further include memory remotely located relative to processor 101, which can be connected to the electronic device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

Optionally, as shown in FIG. 10, the electronic device may further include: a transmission device 105 and an input and output device 107. The storage device 105 is configured to receive or transmit data via a network, and can also be used for data transmission between the processor and the memory. Specific examples of the above network may include a wired network and a wireless network. In one example, the transmission device 105 includes a Network Interface Controller (NIC) that can be connected to other network devices and routers via a network cable to communicate with the Internet or a local area network. In one example, the storage device 105 is a Radio Frequency (RF) module for communicating with the Internet wirelessly.

Among them, specifically, the memory 103 is used to store a computer program.

The processor 101 can be configured to run the transfer device 105 to call a computer program stored by the memory 103 to perform the following steps:

Acquiring first image information of a target object currently moving in a real scene by using a target imaging device in the control system;

Obtaining a first distance corresponding to the first image information, where the first distance is a distance between the target imaging device and the target object;

Adjusting a target parameter of the control system according to the first distance, wherein the target parameter is used to control the control system to output media information to the virtual reality device, the virtual reality device is connected to the control system, and the media information and the moving information of the target object moving in the real scene are Correspondingly, the movement information includes a first distance.

The processor 101 is further configured to: acquire a first image disparity between the first sub-image information and the second sub-image information in the first image information, wherein the first sub-image information is targeted by the first camera Obtaining the object, the second sub-image information is obtained by the second camera, and the first camera and the second camera are deployed in the target imaging device, and the first image disparity is used to represent the target object indicated by the first sub-image information. a difference between the first image and the second image of the target object indicated by the second sub-image information; acquiring a first distance corresponding to the first image disparity in the target correspondence table.

The processor 101 is further configured to: acquire a first midpoint lateral coordinate in the first sub-image information, wherein the first midpoint lateral coordinate is a lateral coordinate of a center point of the first image in the target coordinate system; Obtaining a second midpoint lateral coordinate in the second sub-image information, wherein the second midpoint lateral coordinate is a lateral coordinate of the center point of the second image in the target coordinate system; the first midpoint lateral coordinate and the second middle The difference between the point lateral coordinates is determined as the first image disparity.

The processor 101 is further configured to: search for a target image disparity with a smallest difference between the first image disparity in the target correspondence table; and determine, in the target correspondence table, a distance corresponding to the target image disparity as The first distance.

The processor 101 is further configured to: obtain the second image information of the target object by the target imaging device before acquiring the first distance corresponding to the first image disparity in the target correspondence table, where the target object and the target camera The distance between the devices is a first target distance; the second image disparity between the third sub-image information and the fourth sub-image information is acquired in the second image information, wherein the third sub-image information is targeted by the first camera Obtaining the object, the fourth sub-image information is obtained by the second camera, and the second image disparity is used to represent the target indicated by the third image and the fourth sub-image information indicated by the third sub-image information. a difference between the fourth image of the object; establishing a correspondence between the first target distance and the second image disparity in the target correspondence table; acquiring third image information of the target object by the target imaging device, wherein the target object and the target camera The distance between the devices is a second target distance, the second target distance is different from the first target distance; in the third image letter Obtaining a third image disparity between the fifth sub-image information and the sixth sub-image information, wherein the fifth sub-image information is obtained by the first camera, and the sixth sub-image information is obtained by the second camera Obtaining, the third image disparity is used to represent a difference between the fifth image of the target object indicated by the fifth sub-image information and the sixth image of the target object indicated by the sixth sub-image information; in the target correspondence table A correspondence relationship between the second target distance and the third image disparity is established.

The processor 101 is further configured to: acquire a third midpoint lateral coordinate in the third sub-image information, wherein the third midpoint lateral coordinate is a lateral coordinate of the center point of the third image in the target coordinate system; Obtaining a fourth midpoint lateral coordinate in the fourth sub-image information, wherein the fourth midpoint lateral coordinate is a lateral coordinate of the center point of the fourth image in the target coordinate system; the third midpoint lateral coordinate and the fourth middle The difference between the point lateral coordinates is determined as the second image disparity; acquiring the third image disparity between the fifth sub image information and the sixth sub image information includes: acquiring the fifth midpoint lateral coordinate in the fifth sub image information Wherein the fifth midpoint lateral coordinate is the lateral coordinate of the center point of the fifth image in the target coordinate system; the sixth midpoint lateral coordinate in the sixth sub image information is obtained, wherein the sixth midpoint lateral coordinate is the The lateral coordinate of the center point of the six image in the target coordinate system; the difference between the fifth midpoint lateral coordinate and the sixth midpoint lateral coordinate is determined as the third image parallax.

The processor 101 is further configured to: when the change state of the first distance indicates that the first distance becomes smaller, increase the sound parameter of the control system, wherein the target parameter includes a sound parameter, and the media information includes sound information, The sound parameter is used to control the control system to output sound information to the virtual reality device; and when the change state of the first distance indicates that the first distance becomes large, the sound parameter of the control system is reduced.

The processor 101 is further configured to: adjust the light parameter of the control system to a first value when the change state of the first distance indicates that the first distance becomes smaller, so that the light of the control system is focused on the target camera Within the target area of the device, wherein the target parameter includes a light parameter, the media information includes light information, and the light parameter is used to control the control system to output the light information to the virtual reality device; the change state at the first distance indicates that the first distance becomes larger. In this case, the lighting parameters of the control system are adjusted to a second value such that the lights of the control system are focused outside of the target area of the target imaging device.

The processor 101 is further configured to: acquire a first distance corresponding to the first image information by using a computing center device in the control system, wherein the computing center device is connected to the target imaging device; and the controller in the control system Receiving a first distance sent by the computing center device, and adjusting a target parameter of the control system according to the first distance.

Optionally, the input/output device 107 of the embodiment is connected to the virtual reality device, and the processor 101 may output media information corresponding to the target parameter to the virtual reality device through the input/output device 107, for example, outputting sound information and lighting information. Wait.

Optionally, the above input and output device 107 includes, but is not limited to, an audio device for outputting sound information, and further includes a lighting device for outputting light information, and including other devices for outputting media information.

It should be noted that the functions implemented by the input/output device 107 are only preferred implementations of the embodiments of the present invention, and may include other input and output functions of the control system, and any technical effect that can reduce the control cost of the control system is solved. The input and output devices of the control system which are technically expensive to control are also within the scope of the present invention, and will not be exemplified herein.

Optionally, in the case that the electronic device of the embodiment of the present invention is deployed in the control system, the electronic device includes: a target imaging device, a computing center device, and a controller. For example, the processor 101 in the electronic device includes: a target imaging device. , computing center equipment and controllers. The target image capturing device is configured to acquire first image information of a target object currently moving in a real scene; and the computing center device is configured to acquire a first distance corresponding to the first image information, where the computing center device and the target camera device The controller is configured to receive the first distance sent by the computing center device, and adjust the target parameter of the control system according to the first distance, and the controller outputs the media information corresponding to the target parameter to the virtual reality device through the input/output device 107, For example, output sound information, lighting information, and the like.

Optionally, in the case where the electronic device of the embodiment is connected to the control system of the embodiment of the present invention, the control system includes: a target imaging device, a computing center device, and a controller. The electronic device acquires first image information of a target object currently moving in a real scene through a target imaging device of the control system; the electronic device acquires a first distance corresponding to the first image information by using a computing center device of the control system, where The central device may be connected to the target imaging device; the electronic device receives the first distance sent by the computing center device through the controller of the control system, and adjusts the target parameter of the control system according to the first distance, and then passes the input/output device 107 to the virtual reality device. Output media information corresponding to the target parameter, for example, output sound information, light information, and the like.

According to the embodiment of the present invention, the first image information of the current target object is acquired by the target imaging device of the control system, wherein the target object moves in the real scene; and the first distance corresponding to the first image information is acquired, wherein the first distance is a distance between the target imaging device and the target object; adjusting a target parameter of the control system according to the first distance; and outputting media information corresponding to the target parameter. According to the correspondence between the image information and the distance, the first distance between the target imaging device and the target object can be acquired through the first image information of the target object at low cost, and the target of the control system is adjusted according to the first distance. a parameter, by which the control system outputs the media information corresponding to the movement information of the target object to the virtual reality device, thereby avoiding manual adjustment of the target parameter of the control system, and realizing control by the target parameter of the control system The purpose of the control system outputting the media information to the virtual reality device achieves the technical effect of reducing the control cost of the control system, thereby solving the technical problem of the control cost of the related technology control system.

For example, the specific examples in this embodiment may refer to the examples described in the foregoing embodiments, and details are not described herein again.

A person skilled in the art can understand that the structure shown in FIG. 10 is merely illustrative, and the electronic device can be a smart phone (such as an Android mobile phone, an iOS mobile phone, etc.), a tablet computer, a palm computer, and a mobile Internet device (MID). , PAD and other electronic devices. FIG. 10 does not limit the structure of the above electronic device. For example, the electronic device may also include more or fewer components (such as a network interface, display device, etc.) than shown in FIG. 10, or have a different configuration than that shown in FIG.

A person of ordinary skill in the art may understand that all or part of the steps of the foregoing embodiments may be completed by a program to instruct electronic device related hardware, and the program may be stored in a computer readable storage medium, and the storage medium may be Including: flash disk, read-only memory (ROM), random access memory (RAM), disk or optical disk.

Embodiments of the present invention also provide a storage medium. Optionally, in this embodiment, a computer program is stored in the storage medium, wherein the computer program is set to be a processing method that can be used to execute the control system at runtime.

Optionally, in this embodiment, the foregoing storage medium may be located on at least one of the plurality of network devices in the network shown in the foregoing embodiment.

Optionally, in the present embodiment, the storage medium is arranged to store program code for performing the following steps:

Optionally, the storage medium is further configured to store program code for: acquiring, in the first image information, a first image disparity between the first sub-image information and the second sub-image information, wherein the first The sub-image information is obtained by the first camera, and the second sub-image information is obtained by the second camera, and the first camera and the second camera are deployed in the target imaging device, and the first image disparity is used to represent the image. a difference between the first image of the target object indicated by the sub-image information and the second image of the target object indicated by the second sub-image information; acquiring a first distance corresponding to the disparity of the first image in the target correspondence table .

Optionally, the storage medium is further configured to store program code for performing the step of: acquiring a first midpoint lateral coordinate in the first sub-image information, wherein the first midpoint lateral coordinate is a center point of the first image a lateral coordinate in the target coordinate system; acquiring a second midpoint lateral coordinate in the second sub-image information, wherein the second midpoint lateral coordinate is a lateral coordinate of the center point of the second image in the target coordinate system; The difference between the midpoint lateral coordinate and the second midpoint lateral coordinate is determined as the first image parallax.

Optionally, the storage medium is further configured to store program code for performing the following steps: finding a target image disparity having the smallest difference from the disparity of the first image in the target correspondence table; in the target correspondence table The distance corresponding to the parallax of the target image is determined as the first distance.

Optionally, the storage medium is further configured to store program code for performing: acquiring a second image of the target object by the target imaging device before acquiring the first distance corresponding to the first image disparity in the target correspondence table Information, wherein a distance between the target object and the target imaging device is a first target distance; and a second image parallax between the third sub-image information and the fourth sub-image information is acquired in the second image information, wherein the third The sub-image information is obtained by the first camera, and the fourth sub-image information is obtained by the second camera, and the second image disparity is used to represent the third image of the target object indicated by the third sub-image information. a difference between the fourth image of the target object indicated by the fourth sub-image information; establishing a correspondence between the first target distance and the second image disparity in the target correspondence table; acquiring the third image of the target object by the target imaging device Information, wherein the distance between the target object and the target imaging device is a second target distance, and the second target distance is not Obtaining a third image disparity between the fifth sub-image information and the sixth sub-image information in the third image information, wherein the fifth sub-image information is obtained by the first camera on the target object, The six-sub-image information is obtained by the second camera, and the third image disparity is used to represent the fifth image of the target object indicated by the fifth sub-image information and the sixth image of the target object indicated by the sixth sub-image information. The difference between the second target distance and the third image parallax is established in the target correspondence table.

Optionally, the storage medium is further configured to store program code for performing the step of: acquiring a third midpoint lateral coordinate in the third sub-image information, wherein the third midpoint lateral coordinate is a center point of the third image a lateral coordinate in the target coordinate system; acquiring a fourth midpoint lateral coordinate in the fourth sub-image information, wherein the fourth midpoint lateral coordinate is a lateral coordinate of the center point of the fourth image in the target coordinate system; The difference between the three midpoint lateral coordinates and the fourth midpoint lateral coordinate is determined as the second image disparity; and acquiring the third image disparity between the fifth sub image information and the sixth sub image information includes: acquiring the fifth sub image a fifth midpoint lateral coordinate in the information, wherein the fifth midpoint lateral coordinate is a lateral coordinate of the center point of the fifth image in the target coordinate system; and the sixth midpoint lateral coordinate in the sixth sub image information is acquired, wherein The sixth midpoint lateral coordinate is the lateral coordinate of the center point of the sixth image in the target coordinate system; the difference between the fifth midpoint lateral coordinate and the sixth midpoint lateral coordinate is determined as the third image Parallax.

Optionally, the storage medium is further configured to store program code for performing the step of increasing a sound parameter of the control system if the change state of the first distance indicates that the first distance becomes smaller, wherein the target parameter comprises The sound parameter, the media information includes sound information, and the sound parameter is used to control the control system to output the sound information to the virtual reality device; and when the change state of the first distance indicates that the first distance becomes larger, the sound parameter of the control system is reduced.

Optionally, the storage medium is further configured to store program code for performing the following steps: adjusting the light parameter of the control system to a first value when the change state of the first distance indicates that the first distance becomes smaller, The light of the control system is focused on the target area of the target imaging device, wherein the target parameter includes a light parameter, the media information includes light information, and the light parameter is used to control the control system to output the light information to the virtual reality device; at the first distance The change state indicates that the first distance becomes larger, and the light parameter of the control system is adjusted to a second value such that the light of the control system is focused outside the target area of the target imaging device.

Optionally, the storage medium is further configured to store program code for performing a step of: acquiring, by the computing center device in the control system, a first distance corresponding to the first image information, wherein the computing center device is associated with the target imaging device Connecting; adjusting the target parameter of the control system according to the first distance comprises: receiving, by the controller in the control system, the first distance sent by the computing center device, and adjusting the target parameter of the control system according to the first distance.

Optionally, in this embodiment, the foregoing storage medium may include, but not limited to, a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, and a magnetic A variety of media that can store program code, such as a disc or a disc.

The processing method, apparatus, storage medium, and electronic apparatus of the control system according to an embodiment of the present invention are described above by way of example with reference to the accompanying drawings. However, it should be understood by those skilled in the art that various modifications may be made to the processing method, apparatus, storage medium and electronic device of the control system proposed in the above embodiments of the present invention without departing from the scope of the present invention. Therefore, the scope of protection of the embodiments of the invention should be determined by the content of the appended claims.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

The integrated unit in the above embodiment, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in the above-described computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product in the form of a software product, or the whole or part of the technical solution, which is stored in a storage medium, including The instructions are used to cause one or more computer devices (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.

In the above-mentioned embodiments of the present invention, the descriptions of the various embodiments are different, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.

In the several embodiments provided by the present application, it should be understood that the disclosed client may be implemented in other manners. The device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, unit or module, and may be electrical or otherwise.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The above description is only a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It should be considered as the scope of protection of the present invention.

Industrial applicability

In the embodiment of the present invention, the first image information of the target object currently moving in the real scene is acquired by the target imaging device in the control system; and the first distance corresponding to the first image information is acquired, wherein the first distance is the target a distance between the camera device and the target object; adjusting a target parameter of the control system according to the first distance, wherein the target parameter is used to control the control system to output media information to the virtual reality device, the virtual reality device is connected to the control system, and the media information is The target object corresponds to the mobile information moving in the real scene, and the mobile information includes the first distance. According to the correspondence between the image information and the distance, the first distance between the target imaging device and the target object can be acquired through the first image information of the target object at low cost, and the target of the control system is adjusted according to the first distance. a parameter, by which the control system outputs the media information corresponding to the movement information of the target object to the virtual reality device, thereby avoiding manual adjustment of the target parameter of the control system, and realizing control by the target parameter of the control system The purpose of the control system outputting the media information to the virtual reality device achieves the technical effect of reducing the control cost of the control system, thereby solving the technical problem of the control cost of the related technology control system.

Claims

A method of processing a control system, comprising:

Acquiring first image information of a target object currently moving in a real scene by using a target imaging device in the control system;

Obtaining a first distance corresponding to the first image information, wherein the first distance is a distance between the target imaging device and the target object;

And adjusting, according to the first distance, a target parameter of the control system, where the target parameter is used to control the control system to output media information to a virtual reality device, where the virtual reality device is connected to the control system, where The media information corresponds to the mobile information that the target object moves in the real scene, and the mobile information includes the first distance.
The method of claim 1, wherein acquiring the first distance corresponding to the first image information comprises:

Obtaining, in the first image information, a first image disparity between the first sub-image information and the second sub-image information, wherein the first sub-image information is obtained by the first camera to capture the target object, where The second sub-image information is obtained by the second camera, and the first camera and the second camera are deployed in the target imaging device, and the first image disparity is used to represent the a difference between the first image of the target object indicated by a sub-image information and the second image of the target object indicated by the second sub-image information;

Obtaining the first distance corresponding to the first image disparity in the target correspondence table.
The method of claim 2, wherein acquiring the first image disparity between the first sub-image information and the second sub-image information in the first image information comprises:

Obtaining a first midpoint lateral coordinate in the first sub-image information, wherein the first midpoint lateral coordinate is a horizontal coordinate of a center point of the first image in a target coordinate system;

Obtaining a second midpoint lateral coordinate in the second sub-image information, wherein the second midpoint lateral coordinate is a lateral coordinate of a center point of the second image in the target coordinate system;

A difference between the first midpoint lateral coordinate and the second midpoint lateral coordinate is determined as the first image parallax.
The method of claim 2, wherein acquiring the first distance corresponding to the first image disparity in the target correspondence table comprises:

Finding, in the target correspondence table, a target image disparity that is the smallest difference from the disparity of the first image;

A distance corresponding to the target image disparity is determined as the first distance in the target correspondence table.
The method of claim 2, wherein before the obtaining the first distance corresponding to the first image disparity in the target correspondence table, the method further comprises:

Obtaining, by the target imaging device, second image information of the target object, where a distance between the target object and the target imaging device is a first target distance;

Obtaining, in the second image information, a second image disparity between the third sub-image information and the fourth sub-image information, wherein the third sub-image information is captured by the first camera to the target object And the fourth sub-image information is obtained by the second camera, and the second image disparity is used to represent a third image of the target object indicated by the third sub-image information. a difference between the fourth images of the target object indicated by the fourth sub-image information;

Establishing a correspondence between the first target distance and the second image disparity in the target correspondence table;

Obtaining, by the target imaging device, third image information of the target object, wherein a distance between the target object and the target imaging device is a second target distance, and the second target distance is different from the first a target distance

Obtaining, in the third image information, a third image disparity between the fifth sub-image information and the sixth sub-image information, wherein the fifth sub-image information is captured by the first camera to the target object And the sixth sub-image information is obtained by the second camera, and the third image disparity is used to represent a fifth image of the target object indicated by the fifth sub-image information. a difference between the sixth images of the target object indicated by the sixth sub-image information;

Corresponding relationship between the second target distance and the third image disparity is established in the target correspondence table.
The method of claim 5, wherein

Obtaining the second image disparity between the third sub-image information and the fourth sub-image information comprises: acquiring a third midpoint lateral coordinate in the third sub-image information, wherein the third a midpoint lateral coordinate is a lateral coordinate of a center point of the third image in a target coordinate system; and a fourth midpoint lateral coordinate in the fourth sub image information is acquired, wherein the fourth midpoint lateral coordinate is a lateral coordinate of the center point of the fourth image in the target coordinate system; a difference between the third midpoint lateral coordinate and the fourth midpoint lateral coordinate is determined as the second image parallax ;

Obtaining the third image disparity between the fifth sub-image information and the sixth sub-image information comprises: acquiring a fifth midpoint lateral coordinate in the fifth sub-image information, wherein the fifth a midpoint lateral coordinate is a lateral coordinate of a center point of the fifth image in the target coordinate system; a sixth midpoint lateral coordinate in the sixth sub image information is acquired, wherein the sixth midpoint laterally a coordinate is a lateral coordinate of a center point of the sixth image in the target coordinate system; a difference between the fifth midpoint lateral coordinate and the sixth midpoint lateral coordinate is determined as the third Image parallax.
The method of claim 3, wherein acquiring the first midpoint lateral coordinate in the first sub-image information comprises at least one of the following:

In a case where the first image information is image information of a face, a lateral coordinate of a center point of the left eye image in the target coordinate system and a lateral coordinate of a center point of the right eye image in the target coordinate system An average value between the first midpoint lateral coordinates;

In a case where the first image information is image information of the face, the lateral coordinate of the center point of the nose image in the target coordinate system is determined as the first midpoint lateral coordinate;

In a case where the first image information is image information of a portrait, the center point of the left hand image is between the horizontal coordinate of the target coordinate system and the center point of the right hand image between the horizontal coordinates of the right coordinate image An average value determined as the first midpoint lateral coordinate;

In a case where the first image information is image information of the portrait, the lateral coordinate of the center point of the left arm image in the target coordinate system and the center point of the right arm image are in the target coordinate system The average value between the lateral coordinates is determined as the first midpoint lateral coordinate.
The method according to any one of claims 1 to 7, wherein adjusting the target parameter of the control system according to the first distance comprises:

And increasing a sound parameter of the control system when the change state of the first distance indicates that the first distance becomes smaller, wherein the target parameter includes the sound parameter, and the media information includes sound information The sound parameter is used to control the control system to output the sound information to the virtual reality device;

The sound parameter of the control system is reduced in a case where the change state of the first distance indicates that the first distance becomes large.
The method according to any one of claims 1 to 7, wherein adjusting the target parameter of the control system according to the first distance comprises:

Adjusting, in a case where the change state of the first distance indicates that the first distance becomes smaller, adjusting a light parameter of the control system to a first value, so that a light of the control system is focused on the target imaging device Within the target area, wherein the target parameter includes the light parameter, the media information includes light information, and the light parameter is used to control the control system to output the light information to the virtual reality device;

Adjusting the light parameter of the control system to a second value when the change state of the first distance indicates that the first distance becomes larger, so that the light of the control system is focused on the target Outside the target area of the imaging device.
The method according to any one of claims 1 to 7, wherein

Acquiring the first distance corresponding to the first image information includes: acquiring, by the computing center device in the control system, the first distance corresponding to the first image information, where the computing center device Connected to the target imaging device;

Adjusting the target parameter of the control system according to the first distance includes: receiving, by a controller in the control system, the first distance sent by the computing center device, and adjusting the first distance according to the first distance Said target parameter of the control system.
A processing device for a control system, comprising one or more processors, and one or more memories storing program units, wherein the program units are executed by the processor, the program units comprising:

a first acquiring unit, configured to acquire first image information of a target object currently moving in a real scene by using a target imaging device in the control system;

a second acquiring unit, configured to acquire a first distance corresponding to the first image information, wherein the first distance is a distance between the target imaging device and the target object;

And an adjustment unit configured to adjust a target parameter of the control system according to the first distance, wherein the target parameter is used to control the control system to output media information to a virtual reality device, the virtual reality device and the The control system is connected, the media information corresponding to the movement information of the target object moving in the real scene, the movement information including the first distance.
The apparatus of claim 11, wherein the second obtaining unit comprises:

a first acquiring module, configured to acquire, in the first image information, a first image disparity between the first sub-image information and the second sub-image information, wherein the first sub-image information is configured by the first camera Obtaining the target object, the second sub-image information is obtained by the second camera, and the first camera and the second camera are deployed in the target imaging device, the first The image disparity is used to characterize a difference between the first image of the target object indicated by the first sub-image information and the second image of the target object indicated by the second sub-image information;

The second obtaining module is configured to acquire the first distance corresponding to the first image disparity in the target correspondence table.
The apparatus of claim 12, wherein the first obtaining module comprises:

a first acquiring submodule configured to acquire a first midpoint lateral coordinate in the first sub image information, wherein the first midpoint lateral coordinate is a center point of the first image in a target coordinate system Horizontal coordinate

a second obtaining submodule configured to acquire a second midpoint lateral coordinate in the second sub image information, wherein the second midpoint lateral coordinate is a center point of the second image at the target coordinate The horizontal coordinate of the system;

The determining submodule is configured to determine a difference between the first midpoint lateral coordinate and the second midpoint lateral coordinate as the first image disparity.
A storage medium, wherein a computer program is stored in the storage medium, the computer program being arranged to perform the method of any one of claims 1 to 10 at runtime.
An electronic device comprising a memory and a processor, wherein the memory stores a computer program, the processor being arranged to execute the computer program to perform the method of any one of claims 1 to 10 method.