CN117440110A - Virtual shooting control method, medium and mobile terminal - Google Patents
Virtual shooting control method, medium and mobile terminal Download PDFInfo
- Publication number
- CN117440110A CN117440110A CN202311386416.7A CN202311386416A CN117440110A CN 117440110 A CN117440110 A CN 117440110A CN 202311386416 A CN202311386416 A CN 202311386416A CN 117440110 A CN117440110 A CN 117440110A
- Authority
- CN
- China
- Prior art keywords
- control
- service
- virtual shooting
- virtual
- mobile terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000012545 processing Methods 0.000 claims abstract description 27
- 238000005457 optimization Methods 0.000 claims description 22
- 238000009877 rendering Methods 0.000 claims description 22
- 230000004927 fusion Effects 0.000 claims description 9
- 238000003860 storage Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 7
- 230000004044 response Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 13
- 230000000694 effects Effects 0.000 description 13
- 230000006870 function Effects 0.000 description 11
- 230000008569 process Effects 0.000 description 11
- 238000001514 detection method Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000012790 confirmation Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000002537 cosmetic Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
A virtual photographing control method, medium and mobile terminal, the method is applied to a virtual photographing control service running in a mobile terminal, the mobile terminal and at least one processing device running with the virtual photographing service are connected to the same wireless local area network; the method comprises the following steps: detecting an operation performed by a user on the mobile terminal; generating a control instruction based on the operation; the control instruction is sent to a target virtual shooting service, so that the target virtual shooting service adjusts shooting pictures of a virtual shooting scene based on the control instruction; and after the at least one processing device performs service release on the virtual shooting service operated on the device through the wireless local area network, the target virtual shooting service is obtained by selecting the released virtual shooting service through the mobile terminal.
Description
Technical Field
The disclosure relates to the technical field of virtual shooting, and in particular relates to a virtual shooting control method, a medium and a mobile terminal.
Background
In the virtual shooting scene, the shooting screen of the virtual shooting scene needs to be adjusted by the virtual shooting service, so that a desired virtual shooting effect is obtained. In the related art, generally, an electronic device is fixedly installed on the back of a display screen, a virtual shooting service is deployed in the electronic device, and when a user adjusts a shooting picture of a virtual shooting scene through the virtual shooting service, the electronic device with the virtual shooting service deployed can only be operated on the back of the display screen, so that the operation flexibility is low.
Disclosure of Invention
In a first aspect, an embodiment of the present disclosure provides a virtual photographing control method applied to a virtual photographing control service operated in a mobile terminal connected to the same wireless lan as at least one processing device operated with the virtual photographing service; the method comprises the following steps: detecting an operation performed by a user on the mobile terminal; generating a control instruction based on the operation; the control instruction is sent to a target virtual shooting service, so that the target virtual shooting service adjusts shooting pictures of a virtual shooting scene based on the control instruction; and after the at least one processing device performs service release on the virtual shooting service operated on the device through the wireless local area network, the target virtual shooting service is obtained by selecting the released virtual shooting service through the mobile terminal.
In a second aspect, an embodiment of the present disclosure provides a virtual photographing control apparatus applied to a virtual photographing control service operated in a mobile terminal connected to the same wireless lan as at least one processing device operated with the virtual photographing service; the device comprises: the detection module is used for detecting operations executed by a user on the mobile terminal; the generation module is used for generating a control instruction based on the operation; the sending module is used for sending the control instruction to a target virtual shooting service so that the target virtual shooting service adjusts shooting pictures of a virtual shooting scene based on the control instruction; and after the at least one processing device performs service release on the virtual shooting service operated on the device through the wireless local area network, the target virtual shooting service is obtained by selecting the released virtual shooting service through the mobile terminal.
In a third aspect, the disclosed embodiments provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method as described in any of the embodiments of the disclosure.
In a fourth aspect, an embodiment of the present disclosure provides a mobile terminal, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the method of any embodiment of the present disclosure when the program is executed.
In the embodiment of the disclosure, a virtual shooting control service is deployed in a mobile terminal, and the mobile terminal and at least one processing device running with the virtual shooting service are connected to the same wireless local area network, so that a user can execute an operation on the mobile terminal, thereby generating a control instruction through the virtual shooting control service running in the mobile terminal and sending the control instruction to a target virtual shooting service to adjust a shooting picture of a virtual shooting scene. Because the mobile terminal is convenient to carry and move, a user does not need to operate at a fixed position, and the operation flexibility in the process of adjusting the shooting picture is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the technical aspects of the disclosure.
Fig. 1 is a schematic diagram of an application scenario of an embodiment of the present disclosure.
Fig. 2 is a schematic diagram of a shot adjustment process in the related art.
Fig. 3 is a schematic diagram of a shot screen adjustment process according to an embodiment of the present disclosure.
Fig. 4 is a flowchart of a virtual photographing control method according to an embodiment of the present disclosure.
FIG. 5 is a schematic diagram of an operational state and non-operational state control assembly of an embodiment of the present disclosure.
Fig. 6 is a schematic diagram of an interface for selecting a history virtual shooting service according to an embodiment of the present disclosure.
Fig. 7 is a schematic diagram of a process of sending control instructions to a master service and a slave service according to an embodiment of the present disclosure.
Fig. 8 is a schematic diagram of a process of setting up a master service and a slave service according to an embodiment of the present disclosure.
Fig. 9 is a schematic diagram of an editing interface of a control instruction corresponding to a combination control according to an embodiment of the disclosure.
Fig. 10 is a schematic diagram of a control instruction of an embodiment of the present disclosure.
Fig. 11 is a block diagram of a virtual photographing control apparatus according to an embodiment of the present disclosure.
Fig. 12 is a schematic diagram of a hardware structure of a mobile terminal according to an embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.
The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any or all possible combinations of one or more of the associated listed items. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality.
It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.
In order to better understand the technical solutions in the embodiments of the present disclosure and make the above objects, features and advantages of the embodiments of the present disclosure more comprehensible, the technical solutions in the embodiments of the present disclosure are described in further detail below with reference to the accompanying drawings.
Virtual shooting utilizes computer graphics and digital synthesis technology, and achieves vivid visual effect by establishing digital assets such as virtual scenes, virtual roles, virtual props and the like in a computer and synthesizing the digital assets with actual shooting objects (such as live action, actors and the like). Fig. 1 shows a schematic diagram of an application scenario according to an embodiment of the present disclosure, and as shown in fig. 1, a virtual shooting system includes a processing device 01, a display screen 02, and a camera 03.
The processing device 01 may be configured to deploy a virtual shooting service, which is configured to adjust a shooting picture of a virtual shooting scene (i.e., a display picture of the display screen 02), for example, may switch types of digital assets displayed on the display screen 02, adjust rendering effects of the digital assets on the display screen 02, calibrate various parameters affecting the shooting picture in the virtual shooting process, and so on.
The display 02 may be used to display digital assets. As shown in fig. 1, the number of the display screens 02 is 3, and for convenience of distinction, each display screen is denoted as a display screen 021, a display screen 022, and a display screen 023, respectively. The display screens (021, 022, 023) can display the digital assets independently or in conjunction. The display screen 02 used in the virtual shooting system may be a physical screen, and the physical screen may be an LED display screen, a liquid crystal display screen, or may be a curved screen or a planar screen, and it should be understood that, according to actual needs, a person skilled in the art may set the type, the number, the size, the resolution, the installation position, etc. of the physical screen in the virtual shooting system in a user-defined manner, and the embodiments of the present disclosure are not limited.
The camera 03 can acquire images of the virtual shooting scene including the display screen 02, and obtain a shooting picture of the virtual shooting scene. The virtual shooting scene may further include an actual shooting object, so that the shooting picture acquired by the camera 03 may include both the digital asset displayed on the display screen 02 and the actual shooting object.
The size of the display screen 02 is generally large, and there is not enough space in the virtual shooting scene to place the processing device 01 in front of the display screen 02, and if the processing device 01 is placed on the side of the display screen 02, the processing device 01 may be included in the shooting picture acquired by the camera 03, so that the viewing effect of the shooting picture is affected. Therefore, the processing apparatus 01 is generally fixedly mounted on the back surface of the display screen 02. When a user adjusts a virtual shooting scene, the electronic device with the virtual shooting service deployed thereon can be operated only on the back surface of the display screen 02, resulting in low operation flexibility.
Further, referring to fig. 2, when the user is on the back of the display screen 02, the display effect of the display screen 02 cannot be intuitively observed, and therefore, it is generally necessary to adjust the photographed screen by the user in front of the screen (the user located in front of the display screen 02) and the user behind the screen (the user located behind the display screen 02) in cooperation with each other. Specifically, the user in front of the screen can observe the display effect of the digital asset on the display screen 02 and communicate with the user behind the screen through the interphone. In some cases, the person in front of the screen also needs to receive an adjustment instruction for adjusting the shooting picture sent by a director, a shooting instruction, and other roles, and inform the user behind the screen of the received adjustment instruction through the interphone. The processing device 01 is controlled by the user behind the scenes according to the communication result, so that the shot picture can be adjusted. The mode is high in labor cost and low in control efficiency.
Based on this, the present disclosure provides a virtual photographing control method, referring to fig. 3, which is applied to a virtual photographing control service operated in a mobile terminal 04, the mobile terminal 04 being connected to the same wireless local area network as at least one processing device 01 operating with the virtual photographing service. In the present embodiment, the mobile terminal 04 may be a portable electronic device, such as a mobile phone, a tablet computer, a notebook computer, or the like. The portable electronic device is convenient to carry and move, so that a user does not need to operate at a fixed position, but can send a control instruction to the virtual shooting service deployed on the processing device 01 through the virtual shooting control service deployed on the mobile terminal 04 at any position of the virtual shooting scene, and the virtual shooting service can adjust the shooting picture of the virtual shooting scene in response to the control instruction. The method improves the operation flexibility in the process of adjusting the shooting picture, and because the user can carry the mobile terminal 04 in front of the display screen 02, the display effect of the display screen 02 can be observed conveniently, the virtual shooting scene can be directly adjusted based on the observed display effect, and the adjustment of the virtual shooting scene is realized without communication between the user in front of the screen and the user behind the screen. Therefore, the mode effectively improves the efficiency of shooting picture adjustment and reduces the labor cost.
An embodiment of the virtual photographing control method will be specifically described with reference to fig. 1, 3, and 4. The virtual shooting control method of the embodiment of the disclosure comprises the following steps:
step S1: detecting an operation performed by a user on the mobile terminal 04;
step S2: generating a control instruction based on the operation;
step S3: transmitting a control instruction to a target virtual shooting service so that the target virtual shooting service adjusts shooting pictures of the virtual shooting scene based on the control instruction; after at least one processing device performs service release on the virtual shooting service running on the processing device through a wireless local area network, the target virtual shooting service is obtained by selecting the released virtual shooting service through the mobile terminal.
In step S1, the user may perform an operation on the mobile terminal 04, which may be detected by a detection component on the mobile terminal 04. For example, in the case where the mobile terminal 04 includes a display interface, the operation may be a touch screen operation performed on the display interface. In particular, the display interface may include at least one control component thereon, each for transmitting a different control instruction. The user's execution operation on the mobile terminal 04 may be a selection operation of a target control component among the at least one control component. Accordingly, the detection assembly may include a capacitive body.
In other examples, one or more physical control components may also be included on mobile terminal 04, and the operations performed by the user on mobile terminal 04 may be operations performed on the physical control components by one or more of clicking, sliding, rotating, etc. The operation of the entity control components may be detected by corresponding detection components, which are not exemplified here.
In some embodiments, the operation performed by the user on the mobile terminal 04 is an operation within the control authority range of the current login account of the virtual photographing control service. The control authority is used to define the type of control instruction that the virtual photographing control service can send. That is, the user can send the corresponding control instruction through the virtual photographing control service on the mobile terminal 04 only when the current login account has a certain control right. If the current login account does not have a certain control authority, the user is forbidden to send a corresponding control instruction through the virtual shooting control service on the mobile terminal 04. In this way, the operation safety in the process of adjusting the photographed picture is improved.
The user may log in a pre-registered account on mobile terminal 04. After the login is successful, the virtual shooting control service can acquire the control authority of the current login account. Different accounts may have the same or different control rights, and the control rights of some accounts may partially overlap. For example, account 1 has control authority A1, account 2 has control authorities A1 and A2, and account 3 and account 4 each have control authority A3.
The control authority of the account number may be assigned when registering the account number. For example, the type of the role to which the account belongs may be obtained, and different control rights may be assigned to accounts of different roles. Wherein the character may include, but is not limited to, a director, a light artist, a cosmetic artist, and/or a photographic guide, among others. By the method, order of instruction sending in the process of adjusting the shooting picture is improved, different control authorities are allocated for different roles, and conflicts when the same control instruction is sent by different roles are reduced.
In some embodiments, the account number may include a primary account number and at least one sub-account number of the secondary and primary account numbers, and the control rights assigned to the sub-account numbers may be a subset of the control rights assigned to the primary account number. Optionally, the primary account number may manage control permissions of each sub-account number, including increasing permissions, decreasing permissions, changing permission types, and/or setting valid times of permissions, etc.
In embodiments in which at least one control component is included on the display interface of mobile terminal 04, and different control components correspond to different control instructions, a first control component of the at least one control component that is in an operable state may be determined based on the control authority of the current login account and the first control component may be displayed on the display interface of mobile terminal 04. Wherein the first control component is selectable by a user to generate corresponding control instructions. As shown in fig. 5, the display interface includes four control components, namely, a component 1, a component 2, a component 3 and a component 4, where the component 1 and the component 3 are a first control component in an operable state, and a user can select at least one of the two control components, so as to generate a control instruction corresponding to the selected control component. As shown, the user selects component 1, and thus, control instructions corresponding to component 1 may be generated.
Further, a second control component in an inoperable state in the at least one control component can be determined based on the control authority of the current login account, and the second control component is displayed on the display interface. Still referring to fig. 5, the components 2 and 4 are second control components in an inoperable state, and a user cannot operate the components 2 and 4 when logging in the current login account, so that a control instruction corresponding to the component 2 and a control instruction corresponding to the component 4 cannot be generated.
As shown, the first control component and the second control component may be displayed on the display interface with different visual features, thereby enabling a user to intuitively distinguish the first control component from the second control component. For example, the first control component and the second control component are displayed as different colored control components. For another example, a graphic representing "inhibit operation" may be added to the second control component, representing that the control component is not operable.
In step S2, the virtual photographing control service may generate a control instruction based on the operation. Assuming that the above operation is a selection operation of a target control component of the at least one control component, a control instruction corresponding to the target control component may be generated in this step. For example, the target control component is a control component for realizing spatial calibration, and the control instruction is a spatial calibration instruction for calibrating the position of the virtual camera with respect to the virtual scene and the position of the camera 03 with respect to the actual shooting scene. For another example, if the target control unit is a control unit for performing color calibration, the control instruction is a color calibration instruction for calibrating the color of the display screen on the display screen 02 and the color of the photographed screen of the camera 03.
In step S3, the virtual photographing control service may transmit a control instruction to the target virtual photographing service. The target virtual photographing service may be a virtual photographing service previously issued through a wireless local area network. Specifically, the processing device 01 may perform service distribution on a virtual shooting service running on the device through a wireless local area network. After the mobile terminal 04 connects to the wireless lan, it is possible to acquire respective virtual photographing services that have been distributed to the wireless lan, and display a list of the respective virtual photographing services on a display interface. The user may select one or more virtual shooting services from the list as target virtual shooting services.
After selecting the target virtual photographing service, the virtual photographing control service may establish a connection (e.g., a TCP long connection) with the target virtual photographing service based on the wireless local area network, and the virtual photographing control service may transmit a control instruction to the target virtual photographing service through the connection. After receiving the control instruction, the target virtual shooting service may adjust the shooting picture of the virtual shooting scene based on the control instruction.
In some embodiments, the mobile terminal 04 and the processing device 01 may not be connected to the same wireless lan, but the wireless lan to which the processing device 01 is connected is a wireless lan to which the mobile terminal 04 has been historically connected, and thus, information of the wireless lan is already stored in the mobile terminal 04. In the conventional manner, the user needs to switch the wlan connected to the mobile terminal 04 to the wlan connected to the processing device 01, and then acquire the target virtual shooting service published through the wlan. The above mode is cumbersome to operate. To simplify the user operation, a list of history virtual shooting services may be displayed on the display interface of the mobile terminal 04. The history virtual shooting service is a virtual shooting service selected from the virtual shooting services released in the history by the mobile terminal 04. In response to receiving a selection instruction of the history virtual photographing service in the list, a first wireless local area network to which the mobile terminal 04 is connected, the connection information of which is stored in the mobile terminal 04, is determined. If the mobile terminal 04 is not connected with the first wireless local area network currently, the mobile terminal 04 is controlled to be connected with the first wireless local area network based on the connection information of the first wireless local area network, and after the connection is successful, the historical virtual shooting service is determined to be the target virtual shooting service.
For example, referring to fig. 6, the mobile terminal 04 connects to the wireless lan X at time T1 and selects the virtual photographing service U as a target virtual photographing service after connecting to the wireless lan X. However, at time T2 after time T1, the mobile terminal 04 is not connected to the wireless lan X but to the wireless lan Y, and only the virtual photographing service V and the virtual photographing service K among the virtual photographing services distributed through the wireless lan Y, but the user still desires to select the virtual photographing service U as the target virtual photographing service. In order to quickly select the virtual photographing service U as the target virtual photographing service, a list of history virtual photographing services, in which the virtual photographing service U is included in the present embodiment, may be displayed on the display interface of the mobile terminal 04. The information of the virtual photographing service U and the wireless local area network X to which the mobile terminal 04 has access, which is selected as the target virtual photographing service, may be stored in association with the mobile terminal 04 in advance. After the user selects the virtual photographing service U in the list of the history virtual photographing services, the mobile terminal 04 may be controlled to access the wireless local area network X based on the information of the wireless local area network X stored in association with the virtual photographing service U, and after the connection is successful, the virtual photographing service U may be determined as the target virtual photographing service.
Further, if the mobile terminal 04 does not enable the function of connecting to the wireless lan when the user selects the virtual photographing service U in the list of the history virtual photographing services, the mobile terminal 04 may be controlled to enable the function of connecting to the wireless lan through the virtual photographing control service first, then the mobile terminal 04 is controlled to access to the wireless lan X based on the information of the wireless lan X stored in association with the virtual photographing service U, and after the connection is successful, the virtual photographing service U is determined as the target virtual photographing service. In this way, the user does not need to manually enable the function of connecting to the wireless local area network for the mobile terminal 04, and the user operation is further simplified.
Further, if the mobile terminal 04 is not successfully controlled to access to the wireless lan X due to a change of information of the wireless lan, a network failure, or the like, a prompt message may be displayed on the display interface of the mobile terminal 04. After acquiring the prompt information, the user may manually access the mobile terminal 04 to the wireless local area network X.
In some embodiments, referring to fig. 7, the virtual shooting scene includes a plurality of display screens 02, for example, display screen 021, display screen 022, and display screen 023 shown in fig. 1. It will be appreciated that the number and relative positions of the display screens in a practical application are not limited thereto, as are merely exemplary illustrations herein. Wherein the plurality of display screens (021, 022, 023) may be located at different positions of the virtual shooting scene, e.g., display screen 021 is located above the virtual shooting scene, display screen 022 is located on the left side of the virtual shooting scene, display screen 023 is located on the right side of the virtual shooting scene, etc. The plurality of display screens (021, 022, 023) may be in one-to-one correspondence with the plurality of virtual shooting services. For example, display screen 021 corresponds to virtual shooting service 1, display screen 022 corresponds to virtual shooting service 2, display screen 023 corresponds to virtual shooting service 3, and so on. The plurality of virtual photographing services may include a master service and a slave service. Typically, the number of master services is 1, and the number of slave services may be greater than or equal to 1. As shown, service 1 may be a master service, while services 2 and 3 may be slave services. To simplify the communication, the virtual photographing control service may transmit a control instruction only to the master service (i.e., service 1), and service 1 may forward the control instruction transmitted by the virtual photographing control service to the slave services (i.e., service 2 and service 3). Therefore, if the target virtual photographing service includes the main service, the virtual photographing control service directly transmits a control instruction to the main service. If the target virtual shooting service includes a slave service, the virtual shooting control service may send a control instruction to the master service so that the master service forwards the control instruction to the slave service.
It is possible to display a list of a plurality of virtual photographing services on a display interface of the mobile terminal 04 and acquire a master service and a slave service selected by a user from the list of the plurality of virtual photographing services. Referring to fig. 8, it is assumed that a list of virtual photographing services displayed on a display interface includes a service 1, a service 2, and a service 3, and a user selects the service 1 in the list, so that the service 1 can be set as a master service and the service 2 and the service 3, which are not selected by the user, can be automatically set as slave services. Further, the master service and the slave service may also be identified on the display interface by identification information (as indicated by "master" and "slave" in the figure) so that the user can more intuitively distinguish the master service and the slave service.
In some embodiments, the processing device 01 is connected to the same wireless lan and includes other electronic devices besides the mobile terminal 04, so that the virtual shooting service can not only receive a control instruction sent by a virtual shooting control service deployed on the mobile terminal 04, but also receive a control instruction sent by a virtual shooting control service deployed in the other electronic device, and the current login account number of the virtual shooting control service in the other electronic device and the current login account number of the virtual shooting control service in the mobile terminal 04 have control authority to send the same control instruction. In this case, after the virtual photographing control service in the mobile terminal 04 transmits a control instruction to the target virtual photographing service, the hint information that the control instruction has transmitted may be transmitted to the virtual photographing control service in the other electronic device. After the virtual shooting control service in the other electronic device sends the control instruction to the target virtual shooting service, the prompt information sent by the control instruction sent by the virtual shooting control service in the other electronic device can be received. In this way, repeated transmissions of the same control instruction can be reduced.
In some embodiments, the target virtual shooting service may also send a shooting picture of the virtual shooting scene acquired by the camera 03 to the mobile terminal 04, and the mobile terminal 04 may display the shooting picture on its display interface. In step S1, the user may select a target control component from among at least one control component based on the photographing screen displayed on the display interface. A selection operation of the target control component is detected, and in step S2, a control instruction may be generated based on the operation, and in step S3, the control instruction is transmitted to the target virtual photographing service. By displaying the photographing screen on the display interface of the mobile terminal 04, the user can conveniently observe the adjustment effect on the virtual photographing scene at a position on the side, back or upper side of the display screen 02, etc. where the display effect of the display screen 02 is inconvenient to observe.
In other embodiments, the control component may be displayed only on the display interface of the mobile terminal 04, and the shooting screen is not displayed, so that the user can carry the mobile terminal 04 to the front of the display screen 02 and observe the adjustment effect on the virtual shooting scene by observing the display screen 02.
In some embodiments, the at least one control component includes a combined control, the combined control corresponding to the plurality of control instructions. For example, one combination control may correspond to both control instructions control instruction 1 and control instruction 2. If the operation in step S1 is the selection operation of the combination control, a plurality of control instructions corresponding to the combination control may be sent to the target virtual shooting service. By the mode, a user can send a plurality of control instructions by only operating one combined control, and a plurality of control components are not required to be operated for sending the plurality of control instructions, so that the operation complexity is reduced, and the operation efficiency is improved. In the case that the combined control corresponds to the two control instructions of the control instruction 1 and the control instruction 2 in the previous embodiment, if the operation in the step S1 is the selection operation of the combined control, the control instruction 1 and the control instruction 2 may be sent to the target virtual shooting service respectively, or the control instruction 1 and the control instruction 2 may be packaged into one control instruction and then sent to the target virtual shooting service.
The plurality of control instructions corresponding to the combined control may be default plurality of control instructions, for example, the plurality of control instructions may include a plurality of control instructions with highest historical transmission frequency. Or, the plurality of control instructions corresponding to the combination control can be edited by the user. In the latter case, an editing operation of the user on the plurality of control instructions corresponding to the combination control may be detected, and if so, the plurality of control instructions corresponding to the combination control may be edited in response to the editing operation, and after the editing is completed, the plurality of control instructions corresponding to the combination control may be stored.
Referring to fig. 9, an editing interface of a control instruction corresponding to the combination control may be displayed on the display interface of the mobile terminal 04. The user can add new control instructions through the new control on the editing interface (shown as a box comprising 'new' characters in the figure), and can delete the added control instructions through the deletion control on the editing interface (shown as a box comprising 'delete' characters in the figure). After the editing is completed, the user can complete the editing by operating the confirmation control (shown as a box including a 'confirmation' character in the figure) on the editing interface, so that the control instruction added on the editing interface is determined to be a plurality of control instructions corresponding to the combination control.
Referring to fig. 10, through the above-mentioned virtual shooting control method, transmission of various control instructions may be implemented, so as to implement adjustment of multiple dimensions of a shooting picture, including but not limited to: shooting picture monitoring, virtual fusion, frame rate optimization, on-screen control, on-screen zooming, virtual combination, space calibration, color calibration, delay calibration, asset management, screen model management, switching checkpoints, post-processing, animation playing, lamplight adjustment and other dimensions. In the related art, the above-described dimension adjustment function tends to be dispersed among a plurality of services (such as the virtual photographing service 1 and the virtual photographing service 2 in the drawing), which is inconvenient for the user to operate. According to the embodiment of the disclosure, the control functions of the adjustment functions of each dimension are integrated in the virtual shooting control service deployed on the mobile terminal 04, so that a user can control various adjustment functions through one service, and the operation convenience of the user is improved. The following describes the adjustment functions of the two dimensions of virtual fusion and frame rate optimization.
In some embodiments, if the display interface of the mobile terminal 04 is further used to display a shot image of the virtual shooting scene sent by the target virtual shooting service, the operation in step S1 may include a selection operation of a pixel area in the shot image. Specifically, a first pixel region and a second pixel region selected by the user from the photographed images may be acquired, where the first pixel region is a pixel region where a virtual scene in the virtual photographed scenes is located (for example, a pixel region corresponding to a display image of the display screen 02), and the second pixel is a pixel region where a real scene in the virtual photographed scenes is located (for example, a pixel region outside the display image of the display screen 02 and a pixel region blocked by an actual photographed object in the display image of the display screen 02). On this basis, the control instruction generated in step S2 may be a fusion instruction generated based on the first pixel region and the second pixel region, the fusion instruction being used to fuse the first pixel region and the second pixel region. The above process is referred to as virtual fusion, where the fusion may be, for example, a color or other aspect fusion.
In the related art, an transition between a virtual scene and a real scene in a virtual shooting scene is not natural enough. In this embodiment, the first pixel area and the second pixel area are fused, so that the virtual scene and the real scene are naturally excessive, and the sense of reality of the photographed image is improved.
In some embodiments, the operation in step S1 includes a selection operation of a rendering-optimized item of the display screen on the display screen 02 for selecting at least one target rendering-optimized item from among the candidate rendering-optimized items. Wherein the target rendering optimization term comprises a rendering optimization term for a shadow area in the photographed picture and/or a rendering optimization term for a background area in the photographed picture. By using the rendering optimization term of the shadow area and/or the background area as the target rendering optimization term, the rendering effect on the shadow area and/or the background area can be simplified, thereby reducing the resources consumed when rendering the shadow area and/or the background area. In step S2, the target rendering optimization item selected by the selection operation may be acquired, and an optimization instruction for the virtual scene is generated based on the target rendering optimization item, so that the virtual photographing service renders the display screen onto the display screen 02 based on the target rendering optimization item in the optimization instruction.
In the related art, the rendering of the shot frame is time-consuming, and the time-consuming in the rendering process can be reduced by selecting the target rendering optimization item in the embodiment. Further, since the shadow area and the background area are not generally areas of major interest to the user, the effect of rendering these areas is optimized, and the effect of displaying the photographed image is less affected.
In some embodiments, if the control instruction fails to be sent, a prompt message may be output on the display interface of the mobile terminal 04, so that the user intuitively knows that the control instruction fails to be sent. Further, when the control command is not transmitted, the control command may be automatically retransmitted, and if the number of retransmissions reaches the upper limit of the number of retransmissions, a prompt message may be output on the display interface.
Referring to fig. 11, the present disclosure also provides a virtual photographing control apparatus applied to a virtual photographing control service operated in a mobile terminal connected to the same wireless lan as at least one processing device operated with the virtual photographing service; the device comprises:
a detection module 110 for detecting an operation performed by a user on the mobile terminal;
A generation module 120 for generating control instructions based on the operations;
a sending module 130, configured to send the control instruction to a target virtual shooting service, so that the target virtual shooting service adjusts a shooting picture of a virtual shooting scene based on the control instruction; and after the at least one processing device performs service release on the virtual shooting service operated on the device through the wireless local area network, the target virtual shooting service is obtained by selecting the released virtual shooting service through the mobile terminal.
The functions or modules included in the apparatus provided by the embodiments of the present disclosure may be used to perform the methods described in the foregoing method embodiments, and specific implementations thereof may refer to descriptions of the foregoing method embodiments, which are not repeated herein for brevity.
The present disclosure also provides a mobile terminal 04, including a memory, a processor, and a computer program stored on the memory and executable on the processor, which when executed implements the virtual shooting control method of any of the embodiments of the present disclosure.
Fig. 12 shows a hardware configuration diagram of the mobile terminal 04. At the hardware level, as in fig. 12, the mobile terminal 04 includes a processor 041, an internal bus 042, a network interface 043, a memory 044 and a non-volatile storage 045, although it may also include other hardware required for services. The processor 041 reads a corresponding computer program from the nonvolatile memory 045 into the memory 044 and then runs to implement the virtual photographing control method as shown in fig. 4.
The present disclosure also provides a computer readable storage medium having stored thereon computer instructions which when executed by a processor implement the addressing method of any of the embodiments of the present disclosure. The computer-readable storage medium may be, among other things, a phase-change memory (PRAM), a Static Random Access Memory (SRAM), a Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a flash memory or other memory technology, a read only compact disc read only memory (CD-ROM), a Digital Versatile Disc (DVD) or other optical storage, a magnetic cassette, a magnetic tape magnetic disk storage or other magnetic storage device, or any other non-transmission medium, operable to store information that may be accessed by the computing device.
From the foregoing description of the embodiments, it will be apparent to those skilled in the art that the disclosed embodiments may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions of the embodiments of the present disclosure may be embodied in essence or a part contributing to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the embodiments or some parts of the embodiments of the present disclosure.
The system, apparatus, module or unit set forth in the above embodiments may be implemented in particular by a computer apparatus or entity, or by an article of manufacture having some function. A typical implementation device is a computer, which may be in the form of a personal computer, laptop computer, cellular telephone, camera phone, smart phone, personal digital assistant, media player, navigation device, email device, game console, tablet computer, wearable device, or a combination of any of these devices.
The various embodiments in this disclosure are described in a progressive manner, and identical and similar parts of the various embodiments are all referred to each other, and each embodiment is mainly described as different from other embodiments. In particular, for the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points. The apparatus embodiments described above are merely illustrative, in which the modules illustrated as separate components may or may not be physically separate, and the functions of the modules may be implemented in the same piece or pieces of software and/or hardware when implementing embodiments of the present disclosure. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
The foregoing is merely a specific implementation of the embodiments of this disclosure, and it should be noted that, for a person skilled in the art, several improvements and modifications may be made without departing from the principles of the embodiments of this disclosure, which should also be considered as the protection scope of the embodiments of this disclosure.
Claims (15)
1. A virtual photographing control method applied to a virtual photographing control service operated in a mobile terminal connected to the same wireless local area network as at least one processing device operated with the virtual photographing service; the method comprises the following steps:
detecting an operation performed by a user on the mobile terminal;
generating a control instruction based on the operation;
the control instruction is sent to a target virtual shooting service, so that the target virtual shooting service adjusts shooting pictures of a virtual shooting scene based on the control instruction; and after the at least one processing device performs service release on the virtual shooting service operated on the device through the wireless local area network, the target virtual shooting service is obtained by selecting the released virtual shooting service through the mobile terminal.
2. The method of claim 1, comprising at least one control component on a display interface of the mobile terminal, different control components corresponding to different control instructions; the operation is a selection operation of a target control component of the at least one control component; the sending the control instruction to the target virtual shooting service comprises the following steps:
And sending a control instruction corresponding to the target control component to a target virtual shooting service.
3. The method of claim 2, the display interface further configured to display a shot of the virtual shooting scene sent by the target virtual shooting service; the target control component is selected from the at least one control component by the user based on the photographed picture.
4. The method of claim 2, the at least one control component comprising a combined control, the combined control corresponding to a plurality of control instructions; the sending the control instruction to the target virtual shooting service comprises the following steps:
and if the operation is the selection operation of the combination control, transmitting a plurality of control instructions corresponding to the combination control to a target virtual shooting service.
5. The method of claim 4, the method further comprising:
responsive to detecting an editing operation of a plurality of control instructions corresponding to the combined control, editing the plurality of control instructions corresponding to the combined control;
and after the editing is completed, storing a plurality of control instructions corresponding to the combined control.
6. The method of claim 1, wherein the display interface of the mobile terminal is further configured to display a shot of the virtual shooting scene sent by the target virtual shooting service; the operation includes a selection operation of a pixel region in the photographing screen; the virtual shooting scene comprises a virtual scene and a real scene; the generating a control instruction based on the operation includes:
Acquiring a first pixel area and a second pixel area selected by a user from the shooting picture, wherein the first pixel area is the pixel area where the virtual scene is located, and the second pixel area is the pixel area where the real scene is located;
generating a fusion instruction based on the first pixel region and the second pixel region, wherein the fusion instruction is used for fusing the first pixel region and the second pixel region.
7. The method of claim 1, wherein the virtual shooting scene comprises a display screen, and the operation comprises a selection operation of rendering optimization items of a display screen on the display screen; the generating a control instruction based on the operation includes:
acquiring a target rendering optimization item selected by the selection operation; the target rendering optimization term comprises a rendering optimization term for a shadow area in the shooting picture and/or a rendering optimization term for a background area in the shooting picture;
generating an optimization instruction for the virtual scene based on the target rendering optimization item, so that the virtual shooting service renders a display picture on the display screen based on the target rendering optimization item in the optimization instruction.
8. The method of claim 1, the virtual shooting scene comprising a plurality of display screens in one-to-one correspondence with a plurality of virtual shooting services, the plurality of virtual shooting services comprising a master service and a slave service; the sending the control instruction to the target virtual shooting service comprises the following steps:
if the target virtual shooting service comprises the main service, sending the control instruction to the main service;
and if the target virtual shooting service comprises the slave service, sending the control instruction to the master service so that the master service forwards the control instruction to the slave service.
9. The method of claim 1, the operation being an operation within a control authority range of a current login account of the virtual photographing control service.
10. The method of claim 9, wherein the display interface of the mobile terminal includes at least one control component, different control components corresponding to different control instructions, and the operation is a selection operation of the at least one control component; the method further comprises the steps of:
determining a first control component in an operable state in the at least one control component based on the control authority of the current login account;
Displaying the first control component on the display interface, wherein the first control component can be selected by the user to generate corresponding control instructions; or alternatively
Determining a first control component in an operable state and a second control component in an inoperable state in the at least one control component based on the control authority of the current login account;
and displaying the first control component and the second control component on the display interface.
11. The method of claim 9, wherein the control authority of the current login account is assigned at the time of registration of the current login account.
12. The method of claim 9, the method further comprising:
the prompt information sent by the control instruction is sent to a virtual shooting control service in other electronic equipment, and/or the prompt information sent by the control instruction and sent by the virtual shooting control service in other electronic equipment is received;
the other electronic devices and the mobile terminal are connected to the same wireless local area network, and the current login account of the virtual shooting control service in the other electronic devices and the current login account of the virtual shooting control service in the mobile terminal have control rights for sending the control command.
13. The method of claim 1, the method further comprising:
displaying a list of historical virtual shooting services on a display interface of the mobile terminal, wherein the historical virtual shooting services are virtual shooting services selected from the virtual shooting services released in a historical manner through the mobile terminal;
in response to receiving a selection instruction of a history virtual shooting service in the list, determining a first wireless local area network connected with the mobile terminal when the history virtual shooting service is selected; the connection information of the first wireless local area network is stored in the mobile terminal;
and if the mobile terminal is not connected with the first wireless local area network currently, controlling the mobile terminal to be connected with the first wireless local area network based on the connection information of the first wireless local area network, and determining the historical virtual shooting service as a target virtual shooting service after the connection is successful.
14. A computer readable storage medium having stored thereon a computer program which when executed by a processor implements the method of any of claims 1 to 13.
15. A mobile terminal comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the method of any one of claims 1 to 13 when the computer program is executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311386416.7A CN117440110A (en) | 2023-10-23 | 2023-10-23 | Virtual shooting control method, medium and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311386416.7A CN117440110A (en) | 2023-10-23 | 2023-10-23 | Virtual shooting control method, medium and mobile terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117440110A true CN117440110A (en) | 2024-01-23 |
Family
ID=89557811
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311386416.7A Pending CN117440110A (en) | 2023-10-23 | 2023-10-23 | Virtual shooting control method, medium and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117440110A (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004305697A (en) * | 2003-03-26 | 2004-11-04 | Konica Minolta Holdings Inc | Medical imaging system |
| US20150100461A1 (en) * | 2011-04-12 | 2015-04-09 | Dan Baryakar | Robotic System Controlled by Multi Participants |
| CN108830937A (en) * | 2018-05-25 | 2018-11-16 | 链家网（北京）科技有限公司 | A kind of processing method and server of operation conflict |
| CN111054060A (en) * | 2019-12-17 | 2020-04-24 | 腾讯科技（深圳）有限公司 | Game control method, device, computer equipment and storage medium |
| CN111744185A (en) * | 2020-07-29 | 2020-10-09 | 腾讯科技（深圳）有限公司 | Virtual object control method and device, computer equipment and storage medium |
| CN113423017A (en) * | 2021-06-21 | 2021-09-21 | 腾讯科技（深圳）有限公司 | Live broadcast picture display method and device, computer equipment and storage medium |
| CN114520903A (en) * | 2022-02-17 | 2022-05-20 | 阿里巴巴（中国）有限公司 | Rendering display method, device, storage medium and computer program product |
| WO2022121751A1 (en) * | 2020-12-09 | 2022-06-16 | 华为技术有限公司 | Camera control method and apparatus, and storage medium |
| CN115228083A (en) * | 2022-07-25 | 2022-10-25 | 珠海金山数字网络科技有限公司 | Resource rendering method and device |
| CN115379514A (en) * | 2021-05-19 | 2022-11-22 | Oppo广东移动通信有限公司 | Wireless terminal equipment, screen projection method and device thereof and storage medium |
| CN116017163A (en) * | 2022-12-27 | 2023-04-25 | 北京爱奇艺科技有限公司 | Control method and system of virtual camera, electronic equipment and storage medium |
-
2023
- 2023-10-23 CN CN202311386416.7A patent/CN117440110A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004305697A (en) * | 2003-03-26 | 2004-11-04 | Konica Minolta Holdings Inc | Medical imaging system |
| US20150100461A1 (en) * | 2011-04-12 | 2015-04-09 | Dan Baryakar | Robotic System Controlled by Multi Participants |
| CN108830937A (en) * | 2018-05-25 | 2018-11-16 | 链家网（北京）科技有限公司 | A kind of processing method and server of operation conflict |
| CN111054060A (en) * | 2019-12-17 | 2020-04-24 | 腾讯科技（深圳）有限公司 | Game control method, device, computer equipment and storage medium |
| CN111744185A (en) * | 2020-07-29 | 2020-10-09 | 腾讯科技（深圳）有限公司 | Virtual object control method and device, computer equipment and storage medium |
| WO2022121751A1 (en) * | 2020-12-09 | 2022-06-16 | 华为技术有限公司 | Camera control method and apparatus, and storage medium |
| CN115379514A (en) * | 2021-05-19 | 2022-11-22 | Oppo广东移动通信有限公司 | Wireless terminal equipment, screen projection method and device thereof and storage medium |
| CN113423017A (en) * | 2021-06-21 | 2021-09-21 | 腾讯科技（深圳）有限公司 | Live broadcast picture display method and device, computer equipment and storage medium |
| CN114520903A (en) * | 2022-02-17 | 2022-05-20 | 阿里巴巴（中国）有限公司 | Rendering display method, device, storage medium and computer program product |
| CN115228083A (en) * | 2022-07-25 | 2022-10-25 | 珠海金山数字网络科技有限公司 | Resource rendering method and device |
| CN116017163A (en) * | 2022-12-27 | 2023-04-25 | 北京爱奇艺科技有限公司 | Control method and system of virtual camera, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2679144C (en) | Parameter setting superimposed upon an image | |
| US11074755B2 (en) | Method, device, terminal device and storage medium for realizing augmented reality image | |
| US9361319B2 (en) | Systems, methods, and computer program products for digital photography | |
| CN101969527B (en) | Content-aware video stabilization | |
| CN104796610A (en) | Mobile terminal and camera sharing method, device and system thereof | |
| CN110021071B (en) | Rendering method, device and equipment in augmented reality application | |
| CN109040589A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN112732089A (en) | Virtual reality equipment and quick interaction method | |
| US20190251682A1 (en) | Systems, methods, and computer program products for digital photography | |
| EP3014867B1 (en) | External device control method, imaging device control method, imaging system control method, external device, imaging device, and imaging system | |
| EP4298599A1 (en) | Image processing method, recording medium, image processing apparatus, and image processing system | |
| US20230245685A1 (en) | Removing Visual Content Representing a Reflection of a Screen | |
| CN117440110A (en) | Virtual shooting control method, medium and mobile terminal | |
| CN114422687B (en) | Preview image switching method and device, electronic equipment and storage medium | |
| US11435644B2 (en) | Glasses and related method for image processing | |
| KR20200114348A (en) | Apparatus for sharing contents using spatial map of augmented reality and method thereof | |
| CN104267875A (en) | Photo mode display method and device | |
| US11238658B2 (en) | AR space image projecting system, AR space image projecting method, and user terminal | |
| CN115967854A (en) | Photographing method and device and electronic equipment | |
| US20210110554A1 (en) | Systems, methods, and computer program products for digital photography using a neural network | |
| CN117440202A (en) | Virtual shooting picture display method, medium and mobile terminal | |
| KR101964661B1 (en) | Sharing system of virtual reality image for reducing traffic | |
| US11087526B2 (en) | Image processing program, image processing apparatus, and image processing method | |
| US20230156350A1 (en) | Systems, methods, and computer program products for digital photography | |
| CN117425080B (en) | Photographing method and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |