CN118625530A - Display control method and device - Google Patents
Display control method and device Download PDFInfo
- Publication number
- CN118625530A CN118625530A CN202410876485.4A CN202410876485A CN118625530A CN 118625530 A CN118625530 A CN 118625530A CN 202410876485 A CN202410876485 A CN 202410876485A CN 118625530 A CN118625530 A CN 118625530A
- Authority
- CN
- China
- Prior art keywords
- image
- display
- indication information
- area
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000004891 communication Methods 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 6
- 239000000758 substrate Substances 0.000 claims 2
- 230000001276 controlling effect Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 11
- 230000000875 corresponding effect Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 5
- 230000003190 augmentative effect Effects 0.000 description 4
- 230000007423 decrease Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A display control method and device, the method is applied to a head-mounted display device, and the head-mounted display device comprises shooting means and display means for acquiring images of the surrounding environment of the head-mounted display device. The method comprises the following steps: the method comprises the steps of receiving a first image acquired by a movable platform from the movable platform (S301), acquiring a second image acquired by a shooting device in the head-mounted display equipment (S302), acquiring display indication information, determining a target image from the first image and the second image according to the display indication information (S303), and controlling a display device in the head-mounted display equipment to display the target image (S304). When the user wears the head-mounted display device, the user can watch the target image through the display device, and the user can watch the surrounding environment where the user is located because the target image is determined from the first image and the second image, so that danger is avoided, and safety is guaranteed.
Description
Technical Field
The embodiment of the application relates to the technical field of control, in particular to a display control method and device.
Background
With the development of augmented reality (Augmented Reality, AR) technology, the application of head-mounted display devices is becoming wider, and currently, head-mounted display devices can be used in combination with movable platforms (e.g., unmanned aerial vehicles, unmanned vehicles). The photographing device on the movable platform can photograph a real-time picture of the surrounding environment of the movable platform, and display the real-time picture through the head-mounted display device, so that when a user wears the head-mounted display device, the user has an ornamental feeling of a first person-to-person viewing angle (First Person View, FPV). However, when the user wears the head-mounted display device, the user can only see the picture shot by the shooting device of the movable platform, and cannot observe the surrounding environment where the user is located, so that danger is easy to occur.
Disclosure of Invention
The embodiment of the application provides a display control method and device, which are used for enabling a user to observe the surrounding environment of the user through head-mounted display equipment so as to avoid danger.
In a first aspect, an embodiment of the present application provides a display control method, which is applied to a head-mounted display device, where the head-mounted display device includes a capturing apparatus and a display apparatus for capturing an image of a surrounding environment of the head-mounted display device.
The method comprises the following steps: receiving a first image acquired by a movable platform from the movable platform; acquiring a second image acquired by the shooting device; acquiring display indication information, and determining a target image from the first image and the second image according to the display indication information; and controlling the display device to display the target image.
In a second aspect, an embodiment of the present application provides a display control method, which is applied to a head-mounted display device, where the head-mounted display device includes a photographing apparatus and a display apparatus for capturing an image of a surrounding environment of the head-mounted display device.
The method comprises the following steps: receiving a first image acquired by a movable platform from the movable platform; acquiring a second image acquired by the shooting device; and controlling the display device to display the first image and the second image simultaneously.
In a third aspect, an embodiment of the present application provides a head-mounted display device, including: photographing device, display device, communication device and processor.
The communication device is used for receiving a first image acquired by the movable platform from the movable platform.
The shooting device is used for acquiring a second image of the surrounding environment of the head-mounted display device.
The processor is used for acquiring display indication information, determining a target image from the first image and the second image according to the display indication information, and controlling the display device to display the target image.
The display device is used for displaying the target image.
In a fourth aspect, an embodiment of the present application provides a head-mounted display device, including: photographing device, display device, communication device and processor.
The communication device is used for receiving a first image acquired by the movable platform from the movable platform.
The shooting device is used for acquiring a second image of the surrounding environment of the head-mounted display device.
The processor is used for controlling the display device to display the first image and the second image simultaneously.
The display device is used for simultaneously displaying the first image and the second image.
In a fifth aspect, embodiments of the present application provide a readable storage medium having a computer program stored thereon; the computer program, when executed, implements a display control method according to an embodiment of the first or second aspect of the present application.
In a sixth aspect, embodiments of the present application provide a program product comprising a computer program stored in a readable storage medium, from which at least one processor of a head mounted display device can read, the at least one processor executing the computer program causing the head mounted display device to implement a display control method according to embodiments of the first or second aspects.
According to the display control method and the device, the first image acquired by the movable platform is received from the movable platform, the second image acquired by the shooting device in the head-mounted display device is acquired, the display indication information is acquired, the target image is determined from the first image and the second image according to the display indication information, and the display device in the head-mounted display device is controlled to display the target image. When the user wears the head-mounted display device, the user can watch the target image through the display device, and the user can watch the surrounding environment where the user is located because the target image is determined from the first image and the second image, so that danger is avoided, and safety is guaranteed.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic view of an application scenario provided in an embodiment of the present application;
FIG. 2 is a schematic diagram of a head mounted display device according to an embodiment of the present application;
FIG. 3 is a flowchart of a display control method according to an embodiment of the present application;
FIG. 4a is a schematic diagram of a display device according to an embodiment of the application for simultaneously displaying a first image and a second image;
FIG. 4b is a schematic diagram of a display device according to another embodiment of the present application for simultaneously displaying a first image and a second image;
FIG. 4c is a schematic diagram of a display device according to another embodiment of the present application for simultaneously displaying a first image and a second image;
fig. 5 is a schematic diagram of a switch key for detecting a display indication operation of a user in a control terminal according to an embodiment of the present application;
FIG. 6 is a flowchart of a display control method according to another embodiment of the present application;
Fig. 7 is a schematic structural diagram of a head-mounted display device according to an embodiment of the present application;
Fig. 8 is a schematic structural diagram of a head-mounted display device according to another embodiment of the present application;
fig. 9 is a schematic structural diagram of a display control system according to an embodiment of the application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
It will be understood that when an element is referred to as being "fixed to" another element, it can be directly on the other element or intervening elements may also be present. When a component is considered to be "connected" to another component, it can be directly connected to the other component or intervening components may also be present.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The term "and/or" as used herein includes any and all combinations of one or more of the associated listed items.
The display control method and the display control device provided by the embodiment of the application can be applied to displaying the scene of the image shot in the moving process of the movable platform, and the movable platform can move through external force configuration or can move through self power driving. The movable platform is for example an unmanned aerial vehicle, a drone, a robot or the like, which for example may be a traversing machine. Fig. 1 is a schematic view of an application scenario provided in an embodiment of the present application, as shown in fig. 1, fig. 1 shows that a movable platform is an unmanned aerial vehicle 101, a control terminal 102 of the unmanned aerial vehicle, and a head-mounted display device 103. The control terminal 102 of the drone 101 may be one or more of a remote control, a smart phone, a desktop computer, a laptop computer, a wearable device (watch, bracelet). The embodiment of the present application is schematically illustrated by taking the control terminal 102 as a remote control 1021 and a terminal device 1022 as examples. The terminal device 1022 is, for example, a smart phone, a wearable device, a tablet computer, etc., but the embodiment of the present application is not limited thereto. The head mounted display device 103 may be, for example, head mounted display glasses, as shown in fig. 2.
The unmanned aerial vehicle 101 includes a photographing device 1011, and the unmanned aerial vehicle 101 can acquire an image output by the photographing device 1011. The head mounted display device 103 may receive images from the drone 101 by way of direct or indirect, wired or wireless communication. The head-mounted display device 103 includes a photographing apparatus 1031, and the head-mounted display device 103 can acquire an image output by the photographing apparatus 1031. The head mounted display device 103 further includes a display 1032, and the head mounted display device 103 can control the display 1032 to display the target image according to the image acquired from the unmanned aerial vehicle 101 and the image acquired from the photographing device 1031.
The head-mounted display device 103 may directly communicate with the unmanned aerial vehicle 101, or the head-mounted display device 103 may directly communicate with the control terminal 102 of the unmanned aerial vehicle, or may communicate with the unmanned aerial vehicle 101 through the control terminal 102.
In some embodiments, the user may control the head mounted display device 103 by operating the control terminal 102, or may control the head mounted display device 103 by directly operating the head mounted display device 103.
Some embodiments of the present application are described in detail below with reference to the accompanying drawings. The following embodiments and features of the embodiments may be combined with each other without conflict.
Fig. 3 is a flowchart of a display control method according to an embodiment of the present application, as shown in fig. 3, the method of the present embodiment may be applied to a head-mounted display device, and the method of the present embodiment may include:
S301, receiving a first image acquired by a movable platform from the movable platform.
In this embodiment, the head-mounted display apparatus includes a photographing device (e.g., photographing device 1031 in fig. 1) and a display device (e.g., display device 1032 in fig. 1) for capturing an image of the surrounding environment of the head-mounted display apparatus. The head mounted display device may receive an image acquired from a movable platform of the movable platform, the image being an image of an ambient environment of the movable platform, the image being referred to as a first image. The head mounted display device may communicate directly with the movable platform, the head mounted display device receiving a first image transmitted by the movable platform, for example: the head-mounted display device can receive the first image sent by the movable platform in a wired or wireless mode. Or the head-mounted display device can indirectly communicate with the movable platform, the movable platform sends the collected first image to a control terminal of the movable platform, and then the head-mounted display device receives the first image sent by the control terminal.
S302, acquiring a second image acquired by the shooting device.
In this embodiment, the head-mounted display device includes a photographing apparatus, and the photographing apparatus may photograph an image, which is referred to as a second image, of the surrounding environment of the head-mounted display device. The head-mounted display device may acquire the second image output by the photographing apparatus.
S303, acquiring display instruction information, and determining a target image from the first image and the second image according to the display instruction information.
In this embodiment, the head-mounted display device further includes a display apparatus. The head-mounted display device acquires display indication information which can be used for indicating a target image to be displayed by the head-mounted display device. And then determining a target image from the first image and the second image according to the display instruction information, wherein the target image is an image to be displayed by the display device.
S304, controlling the display device to display the target image.
In this embodiment, the head-mounted display apparatus controls the display device to display the target image after determining the target image. Accordingly, the user can watch the target image through the display device by wearing the head-mounted display device, so that the viewing experience of the FPV is realized, and the effect of being in the scene is realized.
Alternatively, the target image may be the first image, and accordingly, one possible implementation of S304 is to control the display device to display the first image. Or the target image is the second image, and accordingly, one possible implementation of S304 is to control the display device to display the second image. Or the target image is a first image and a second image, and accordingly, one possible implementation of S304 is to control the display device to display the first image and the second image simultaneously. Thus, the user can view the first image or the second image or view the first image and the second image simultaneously through the display device.
Optionally, the display device is disposed on a housing in the head-mounted display device, so that the display device may capture an image of an environment where the user is located when the user wears the head-mounted display device, for example, a position of the display device 1032 in the head-mounted display device 103 shown in fig. 1, and the embodiment is not limited thereto.
Optionally, the shooting direction of the shooting device is away from the display direction of the display device, for example as shown in fig. 1, so that the shooting direction of the shooting device is the same as the eye viewing direction of the user, so as to achieve as if the user is in the eye when the display device displays the image shot by the shooting device.
According to the display control method provided by the embodiment, the first image acquired by the movable platform is received from the movable platform, the second image acquired by the shooting device in the head-mounted display equipment is acquired, the display indication information is acquired, the target image is determined from the first image and the second image according to the display indication information, and the display device in the head-mounted display equipment is controlled to display the target image. When the user wears the head-mounted display device, the user can watch the target image through the display device, and the user can watch the surrounding environment where the user is located because the target image is determined from the first image and the second image, so that danger is avoided, and safety is guaranteed.
In some embodiments, the different target images are determined from the first image and the second image by the acquired display instruction information being different. The display instruction information may be, for example, first display instruction information or second display instruction information or third display instruction information.
One possible implementation of S303-S304 is: the display indication information is acquired as first display indication information, then a first image is determined from the first image and the second image according to the first display indication information, namely, the target image to be displayed by the display device is determined to be the first image, and then the display device is controlled to display the first image.
One possible implementation of S303-S304 is: and acquiring display indication information as second display indication information, determining a second image from the first image and the second image according to the second display indication information, namely determining a target image to be displayed by the display device as the second image, and controlling the display device to display the second image.
One possible implementation of S303-S304 is: and acquiring display indication information as third display indication information, determining a first image and a second image from the first image and the second image according to the third display indication information, namely determining target images to be displayed by the display device as the first image and the second image, and controlling the display device to display the first image and the second image simultaneously.
Therefore, the embodiment controls the display device to display different images by acquiring different display indication information so as to meet the display requirement under the condition of no application scene.
In some embodiments, one possible implementation manner of controlling the display device to display the first image and the second image simultaneously is: displaying the first image in a first preset display area of the display device; and displaying the second image in a second preset display area of the display device.
In this embodiment, the display area of the display device may be divided into two parts, one part is a first preset display area, and the other part is a second preset display area, where the first preset display area is used for displaying a first image, and the second preset display area is used for displaying a second image, for example, as shown in fig. 4a, and the first preset display area and the second display area occupy different display areas of the display device respectively. The user can view different images by viewing different display areas.
Optionally, the area of the first preset display area is larger than the area of the second preset display area. Because the area of the first preset display area is larger than that of the second preset display area, the display device mainly displays the image shot by the movable platform, the user mainly watches the image shot by the movable platform through the first preset display area with larger area, and when the user wants to watch the image of the surrounding environment, the user can watch the image of the surrounding environment where the user is located through the second preset display area with smaller area.
In another possible implementation, the second preset display area is a partial display area in the first preset display area. For example, as shown in fig. 4b, the first preset display area may be the entire display area of the display device, and the second preset display area may be a partial display area in the lower right corner, which corresponds to that the second image is displayed in a superimposed manner in a partial area of the first image, where the second image may obstruct a partial image in the first image.
In other embodiments, one possible implementation of controlling the display device to display the first image and the second image simultaneously is: and splicing the first image and the second image according to the first image and the second image to obtain spliced images, and then controlling a display device to display the spliced images, wherein the spliced images comprise part of the images in the first image and the second image. The first image and the second image are spliced, and the spliced image is obtained, for example: and determining the same image in the first image and the second image according to the first image and the second image, and stitching the first image and the second image according to the same image to obtain stitched images. For example: when the image capturing device in the head-mounted display device captures an image of the surrounding environment of the movable platform (a first image) and an image captured by the movable platform (a second image) are partially overlapped, the first image and the second image are spliced based on the overlapped images, and the picture of the movable platform in the second image is replaced by the first image, so that a display picture as shown in fig. 4c can be obtained, wherein the middle picture is the second image, and the surrounding picture is the second image. Thus, the user views the image photographed by the movable platform through the middle screen and views the image of the surrounding environment in which the user is located through the surrounding screen.
In some embodiments, one possible implementation of controlling the display device to display the first image and the second image simultaneously is: the first image and the second image are fused by an augmented reality (Augmented Reality, AR) technique, and the display device is controlled to display the fused images. Thus, the user may be presented with an experience of AR and Virtual Reality technology (VR) alternation or AR and VR fusion.
In some embodiments, the area of the first preset display area and the area of the second preset display area are determined according to a relative position parameter between a reference object and the movable platform. Or the area of the first preset display area and the area of the second preset display area are determined according to the relative orientation between the reference object and the movable platform.
The reference object is a user of the head-mounted display device, the head-mounted display device or a control terminal of the movable platform. The user is a user wearing a head mounted display device, the position of which may reflect the position of the head mounted display device. The control terminal of the movable platform is mainly operated by the user, so the position of the control terminal can reflect the position of the user wearing the head-mounted display device.
Optionally, the head-mounted display device displays the first image in a first preset display area of the display device, before a second preset display area of the display device displays the second image, the movable platform may acquire a relative position parameter or a relative orientation between the reference object and the movable platform, determine an area of the first preset display area and an area of the second preset display area according to the relative position parameter or the relative orientation, then send the area of the first preset display area and the area of the second preset display area to the head-mounted display device, and the head-mounted display device receives the area of the first preset display area and the area of the second preset display area from the movable platform, and determine the first preset display area and the second preset display area in the display device according to the area of the first preset display area and the area of the second preset display area.
Optionally, the head-mounted display device of this embodiment obtains a relative position parameter between the reference object and the movable platform before displaying the first image in a first preset display area of the display device and displaying the second image in a second preset display area of the display device, and determines an area of the first preset display area and an area of the second preset display area according to the relative position parameter or the relative orientation. And determining the first preset display area and the second preset display area in the display device according to the area of the first preset display area and the area of the second preset display area.
In some embodiments, the above-mentioned relative position parameter includes a relative distance, where when the relative distance is within a first preset distance range, an area of the first preset display area is smaller than an area of the second preset display area. When the relative distance is within a second preset distance range, the area of the first preset display area is larger than that of the second preset display area. Therefore, when the relative distance between the reference correspondence and the movable platform is in different preset distance ranges, the size relation between the area of the first preset display area and the area of the second preset display area is different, and when the relative distance is in a certain preset distance range, the area of the first preset display area is smaller than the area of the second preset display area, the larger part of the image observed by the user is the image shot by the shooting device in the head-mounted display equipment, and the smaller part of the image is the image shot by the movable platform. And when the other preset distance range is reached, the area of the first preset display area is larger than that of the second preset display area, the larger part of the image observed by the user is the image shot by the movable platform, and the smaller part of the image is the image shot by the shooting device in the head-mounted display equipment.
The first preset distance range is smaller than the second preset distance range, when the movable platform is closer to the reference object, most of pictures displayed by the display device are second images, namely images shot by the shooting device in the head-mounted display equipment, and when the movable platform is farther from the reference object, most of pictures displayed by the display device are first images, namely images shot by the movable platform. When the movable platform is far away from the reference object, the photographing device in the head-mounted display apparatus also has difficulty in photographing an image photographed by the movable platform, so that the user mainly views the image photographed by the movable platform by setting the area of the first preset display area to be larger than the area of the second preset display area. When the movable platform is close to the reference object, the shooting device in the head-mounted display equipment can possibly shoot the image shot by the movable platform, so that the user mainly views the image shot by the shooting device in the head-mounted display equipment by setting the area of the first preset display area to be smaller than that of the second preset display area, and the safety is ensured to a greater extent.
How to acquire the display instruction information is described in detail below.
In some embodiments, one possible implementation manner of the above method for obtaining the display indication information is: and acquiring display indication information sent by a control terminal of the movable platform, wherein the display indication information is generated by the control terminal detecting display indication operation of a user.
For example, when the user needs to control the head-mounted display device to display a corresponding target image, the user performs a corresponding display instruction operation on the control terminal, and after the control terminal detects the display instruction operation of the user, generates display instruction information according to the display instruction operation, and sends the display instruction information to the head-mounted display device, and accordingly, the head-mounted display device receives the display instruction information sent by the control terminal.
When a user wants to control the head-mounted display device to display a first image, the user executes a first display indication operation on the control terminal, the control terminal detects the first display indication operation of the user, generates first display indication information according to the first display indication operation, and sends the first display indication information to the head-mounted display device, and accordingly, the head-mounted display device receives the first display indication information sent by the control terminal.
When the user wants to control the head-mounted display device to display the second image, the user executes a second display indication operation on the control terminal, the control terminal detects the second display indication operation of the user, generates second display indication information according to the second display indication operation, and sends the second display indication information to the head-mounted display device, and accordingly, the head-mounted display device receives the second display indication information sent by the control terminal.
When the user wants to control the head-mounted display device to display the first image and the second image, the user executes a third display indication operation on the control terminal, the control terminal detects the third display indication operation of the user, generates third display indication information according to the third display indication operation, and sends the third display indication information to the head-mounted display device, and accordingly, the head-mounted display device receives the third display indication information sent by the control terminal.
Taking the control terminal 102 as the remote controller 1021 and the terminal device 1022 as an example, the user can operate a switch key (as shown in fig. 5) in the remote controller 1021 to perform different display instruction operations.
Therefore, the user can switch the display image of the head-mounted display device among the first image, the second image, the first image and the third image by executing different display instruction operations on the control terminal.
In other embodiments, one possible implementation manner of the method for obtaining the display indication information is: detecting display indication operation of a user, and acquiring display indication information according to the display indication operation.
For example, when the user needs to control the head-mounted display device to display a corresponding target image, the user performs a corresponding display indication operation on the head-mounted display device, and after the head-mounted display device detects the display indication operation of the user, display indication information is generated according to the display indication operation.
When the user wants to control the head-mounted display device to display the first image, the user performs a first display instruction operation on the head-mounted display device, the head-mounted display device detects the first display instruction operation of the user, and generates first display instruction information according to the first display instruction operation.
When the user wants to control the head-mounted display device to display the second image, the user performs a second display instruction operation on the head-mounted display device, the head-mounted display device detects the second display instruction operation of the user, and generates second display instruction information according to the second display instruction operation.
When the user wants to control the head-mounted display device to display the first image and the second image, the user performs a third display instruction operation on the head-mounted display device, the head-mounted display device detects the third display instruction operation of the user, and third display instruction information is generated according to the third display instruction operation.
For example: the head-mounted display device is provided with a switching key, and a user can operate the switching key to execute different display indication operations, wherein the switching key can be a physical key on the head-mounted display device or a virtual key displayed on a display device in the head-mounted display device.
Therefore, the user can switch the display image of the head-mounted display device among the first image, the second image, the first image, and the third image by performing different display instruction operations on the head-mounted display device.
In some embodiments, the display indication information is determined according to a relative position parameter between the reference object and the movable platform. Or the display indication information is determined according to the relative orientation between the reference object and the movable platform.
The reference object is a user of the head-mounted display device, the head-mounted display device or a control terminal of the movable platform. The user is a user wearing a head mounted display device, the position of which may reflect the position of the head mounted display device. The control terminal of the movable platform is mainly operated by the user, so the position of the control terminal can reflect the position of the user wearing the head-mounted display device.
The relative position parameters or relative orientations between the reference object and the movable platform may be different, and the display indication information acquired by the head-mounted display device may be different.
Optionally, before the head-mounted display device obtains the display indication information, the movable platform may obtain a relative position parameter or a relative orientation between the reference object and the movable platform, determine the display indication information according to the relative position parameter or the relative orientation, and then send the display indication information to the head-mounted display device. Accordingly, one possible implementation manner of the head-mounted display device to acquire the display indication information is: and receiving display indication information sent by the movable platform.
Optionally, one possible implementation manner of obtaining the display indication information by the head-mounted display device is: and acquiring relative position parameters or relative orientations between the reference object and the movable platform, and determining display indication information according to the relative position parameters or the relative orientations.
In some embodiments, the above-mentioned relative position parameter includes a relative distance, and when the relative distance between the reference object and the movable platform is in a different distance range, the determined display indication information is different, and the display indication information may be, for example, the first display indication information, the second display indication information or the third display indication information.
When the relative distance between the reference object and the movable platform is in a third preset distance range, the acquired display indication information is the first display indication information according to the relative distance. When the relative distance between the reference object and the mobile platform is in a fourth preset distance range, the acquired display indication information is second display indication information according to the relative distance. When the relative distance between the reference object and the mobile platform is in a fifth preset distance range, the acquired display indication information is third display indication information according to the relative distance.
And if the display instruction information acquired by the head-mounted display equipment is the first display instruction information, determining the target image as the first image from the first image and the second image according to the first display instruction information. And if the display instruction information acquired by the head-mounted display equipment is the second display instruction information, determining the target image as the second image from the first image and the second image according to the first display instruction information. And if the display instruction information acquired by the head-mounted display equipment is the third display instruction information, determining that the target image is the first image and the second image from the first image and the second image according to the first display instruction information.
Optionally, the third preset distance range is greater than the fifth preset distance range, and the fifth preset distance range is greater than the fourth preset distance range.
And when the movable platform starts to move, the relative distance between the movable platform and the reference object is in a fourth preset distance range, the head-mounted display equipment acquires second display indication information, determines the target image as a second image according to the second display indication information, and controls the display device to display the second image, namely the image shot by the shooting device in the head-mounted display equipment. And when the movable platform continues to move away from the reference object, if the relative distance between the movable platform and the reference object is in a fourth preset distance range, the display device displays the second image. When the movable platform continues to move away from the reference object until the relative distance between the movable platform and the reference object is in a fifth preset distance range, the head-mounted display device acquires third display indication information, determines that the target image is a first image and a second image according to the third display indication information, and controls the display device to simultaneously display the first image and the second image, namely, an image shot by the movable platform and an image shot by the shooting device in the head-mounted display device. When the movable platform continues to move away from the reference object until the relative distance between the movable platform and the reference object is in a third preset distance range, the head-mounted display device acquires first display indication information, determines that the target image is a first image according to the first display indication information, and controls the display device to display the first image, namely the image shot by the movable platform.
Therefore, as the movable platform is kept away, the image displayed on the head-mounted display device enlarges the image shot by the movable platform until the displayed image is switched from the image shot by the shooting device in the head-mounted display device to the image shot by the movable platform, so that a user can see the movable platform from a distance, then continuously get close to the movable platform, and finally become the field of view of the movable platform.
And when the movable platform starts to move, the relative distance between the movable platform and the reference object is in a third preset distance range, the head-mounted display equipment acquires first display indication information, determines the target image as a first image according to the first display indication information, and controls the display device to display the first image, namely the image shot by the movable platform. When the movable platform continues to move close to the reference object, if the relative distance between the movable platform and the reference object is in a third preset distance range, the display device still displays the first image. When the movable platform continues to move close to the reference object until the relative distance between the movable platform and the reference object is in a fifth preset distance range, the head-mounted display device acquires third display indication information, determines that the target image is a first image and a second image according to the third display indication information, and controls the display device to simultaneously display the first image and the second image, namely, an image shot by the movable platform and an image shot by the shooting device in the head-mounted display device. When the movable platform continues to move close to the reference object until the relative distance between the movable platform and the reference object is in a fourth preset distance range, the head-mounted display equipment acquires second display indication information, determines that the target image is a second image according to the second display indication information, and controls the display device to display the second image, namely the image shot by the shooting device in the head-mounted display equipment.
Therefore, as the movable platform is continuously approaching, the image displayed on the head-mounted display device enlarges the image captured by the capturing device in the head-mounted display device until the displayed image is switched from the image captured by the movable platform to the image captured by the capturing device in the head-mounted display device, so that the user can be seen from a distance in a user field of view, and then is continuously approaching the user, and finally the user field of view of the capturing device in the head-mounted display device of the user is changed.
Optionally, when the relative distance between the movable platform and the reference object is in the fifth preset distance range, one possible implementation manner of controlling the display device to display the first image and the second image simultaneously is that: displaying the first image in a first preset display area of the display device; and displaying the second image in a second preset display area of the display device.
The description of the first preset display area and the second preset display area may be referred to the description of the embodiments, and will not be repeated here. The fifth preset distance range includes the first preset distance range and the second preset distance range.
Optionally, when the relative distance between the movable platform and the reference object is in the fifth preset distance range, another possible implementation manner of controlling the display device to display the first image and the second image simultaneously is that: when the relative distance between the movable platform and the reference object is smaller than the preset distance, the area of the display device for displaying the first image is smaller than the area of the display area of the second image, when the relative distance between the movable platform and the reference object is equal to the preset distance, the area of the display device for displaying the first image is equal to the area of the display area of the second image, and when the relative distance between the movable platform and the reference object is greater than the preset distance, the area of the display device for displaying the first image is greater than the area of the display area of the second image.
Wherein the area of the display device in which the first image is displayed is positively correlated with the pair of opposing distances, the area of the display area in the display device in which the second image is displayed is inversely related to the pair of opposing distances. For example: when the relative distance between the movable platform and the reference object is within a fifth preset distance range and the movable platform moves away from the reference object, when the relative distance between the movable platform and the reference object is smaller than the preset distance and gradually increases with the relative distance, the area of the display area for displaying the first image gradually increases and the area of the display area for displaying the second image gradually decreases, and the area of the display area for displaying the first image is smaller than the display area for displaying the second image. When the relative distance between the movable platform and the reference object is gradually increased to be equal to the preset distance, the area of the display area for displaying the first image is equal to the area of the display area for displaying the second image. When the relative distance between the movable platform and the reference object is increased to be larger than the preset distance, the area of the display area for displaying the first image is gradually increased, the area of the display area for displaying the second image is gradually decreased, and the area of the display area for displaying the first image is larger than the area of the display area for displaying the second image. Therefore, as the movable platform is kept away, the picture displayed by the display device on the head-mounted display apparatus gradually increases the picture shot by the movable platform.
For example: when the relative distance between the movable platform and the reference object is within a fifth preset distance range and the movable platform moves close to the reference object, when the relative distance between the movable platform and the reference object is larger than the preset distance and gradually decreases along with the relative distance, the area of the display area for displaying the first image gradually decreases and the area of the display area for displaying the second image gradually increases, and the area of the display area for displaying the first image is larger than the display area for displaying the second image. When the relative distance between the movable platform and the reference object is gradually reduced to be equal to the preset distance, the area of the display area for displaying the first image is equal to the area of the display area for displaying the second image. When the relative distance between the movable platform and the reference object is reduced to be smaller than the preset distance, the area of the display area for displaying the first image is gradually reduced, the area of the display area for displaying the second image is gradually increased, and the area of the display area for displaying the first image is smaller than the display area for displaying the second image. Thus, as the movable platform is moved closer together, the screen displayed by the display device on the head-mounted display apparatus gradually enlarges the screen of the photographing device in the head-mounted display apparatus (for example, the screen of the surrounding environment in which the user is located).
In some embodiments, the display indication information is determined according to an operating state of the movable platform. The images that the user needs to view may be different according to the working state of the movable platform, and accordingly, the display indication information may be different.
Optionally, before the head-mounted display device obtains the display indication information, the movable platform may obtain the working state of the movable platform, obtain the display indication information according to the working state of the movable platform, and then send the display indication information to the head-mounted display device. Accordingly, one possible implementation manner of the head-mounted display device to acquire the display indication information is: and receiving display indication information sent by the movable platform.
Optionally, one possible implementation manner of obtaining the display indication information by the head-mounted display device is: and acquiring the working state of the movable platform, and acquiring the display indication information according to the working state. The acquiring, by the head-mounted display device, the working state of the movable platform may be: the head-mounted display device receives working state indicating information sent by the movable platform, wherein the working state indicating information is used for indicating the working state of the movable platform, and the head-mounted display device acquires the working state of the movable platform according to the working state indicating information.
For example: if the working state of the movable platform is the first working state, the acquired display indication information is the first display indication information, and accordingly, the display device is controlled to display the first image. And if the working state of the movable platform is the second working state, the acquired display indication information is the second display indication information, and accordingly, the display device is controlled to display a second image. If the working state of the movable platform is the third working state, the acquired display indication information is the third display indication information, and accordingly, the display device is controlled to display the first image and the second image simultaneously.
Or, for example, again: when the movable platform is in a starting-up state, the acquired display indication information is second display indication information, and accordingly, the display device is controlled to display a second image. When the movable platform is in a working state, the acquired display indication information is first display indication information, and accordingly, the display device is controlled to display a first image.
The following illustrates how to obtain display indication information according to the working state by taking the movable platform as the unmanned aerial vehicle.
When the working state of the unmanned aerial vehicle is the cruising state, the user is more concerned about the image shot by the unmanned aerial vehicle, and the display indication information is acquired to be the first display indication information. Accordingly, the target image is determined to be the first image from the first image and the second image according to the first display indication information, and then the display device is controlled to display the first image.
When the working state of the unmanned aerial vehicle is a take-off or landing state, the image which indicates that the user is more focused on the surrounding environment where the user is located is obtained, and the display indication information is second display indication information. Correspondingly, determining the target image as a second image from the first image and the second image according to the second display indication information, and then controlling the display device to display the second image so that a user can observe the image of the surrounding environment where the user is located, and the takeoff safety and landing safety of the unmanned aerial vehicle are ensured.
Fig. 6 is a flowchart of a display control method according to another embodiment of the present application, and as shown in fig. 6, the method of this embodiment may be applied to a head-mounted display device, where the head-mounted display device includes a capturing apparatus and a display apparatus for capturing an image of a surrounding environment of the head-mounted display device. The method of the embodiment can comprise the following steps:
s601, receiving a first image acquired by a movable platform from the movable platform.
S602, acquiring a second image acquired by the shooting device.
In this embodiment, the specific implementation process of S601-S602 may refer to the related description in the embodiment shown in fig. 3, which is not repeated here.
S603, controlling a display device to display the first image and the second image simultaneously.
In this embodiment, after the head-mounted display device acquires the first image acquired by the movable platform and the second image acquired by the photographing device, the display device in the head-mounted display device is controlled to display the first image and the second image simultaneously. Accordingly, by wearing the head-mounted display device, the user can view the image collected by the movable platform and the image collected by the shooting device in the head-mounted display device (namely, the image of the surrounding environment where the user is located) through the display device.
Optionally, the display device is disposed on a housing in the head-mounted display device, so that the display device may capture an image of an environment where the user is located when the user wears the head-mounted display device, for example, a position of the display device 1032 in the head-mounted display device 103 shown in fig. 1, and the embodiment is not limited thereto.
Optionally, the shooting direction of the shooting device is away from the display direction of the display device, for example as shown in fig. 1, so that the shooting direction of the shooting device is the same as the eye viewing direction of the user, so as to achieve as if the user is in the eye when the display device displays the image shot by the shooting device.
According to the display control method provided by the embodiment, the first image acquired by the movable platform is received from the movable platform, the second image acquired by the shooting device in the head-mounted display equipment is acquired, and then the display device is controlled to display the first image and the second image simultaneously. When the user wears the head-mounted display device, the user can observe the image acquired by the movable platform and the image acquired by the shooting device in the head-mounted display device through the display device, so that the user has the ornamental feeling of the FPV, has the effect of being on the scene, can observe the surrounding environment where the user is located, avoids danger and ensures safety.
In some embodiments, one possible implementation of S603 is as follows: displaying the first image in a first preset display area of the display device, and displaying the second image in a second preset display area of the display device.
In one possible implementation, the area of the first preset display area is larger than the area of the second preset display area.
In one possible implementation, the area of the first preset display area and the area of the second preset display area are determined according to a relative position parameter between the reference object and the movable platform.
In one possible implementation manner, the method of the present embodiment further includes: and acquiring relative position parameters between the reference object and the movable platform, and determining the area of the first preset display area and the area of the second preset display area according to the relative position parameters, wherein the reference object is a user of the head-mounted display device, the head-mounted display device or a control terminal of the movable platform.
In a possible implementation manner, the relative position parameter includes a relative distance, where when the relative distance is in a first preset distance range, an area of the first preset display area is smaller than an area of the second preset display area; when the relative distance is within a second preset distance range, the area of the first preset display area is larger than that of the second preset display area.
For a specific implementation process of each implementation manner, refer to the related description of displaying the first image in the first preset display area of the display device and displaying the second image in the second preset display area of the display device in the embodiment shown in fig. 3, which are not repeated herein.
On the basis of any of the above embodiments, if the display device displays the first image or simultaneously displays the first image and the second image, the display device also displays information such as the electric quantity of the movable platform, the motion parameters (such as speed, altitude, etc.), and the like, which are sent to the head-mounted display device by the movable platform.
Any of the above embodiments may be implemented alone or in combination with at least two of the above embodiments, and is not limited thereto.
The embodiment of the application also provides a computer storage medium, wherein the computer storage medium stores program instructions, and the program can comprise part or all of the steps of the display control method in any corresponding embodiment.
Fig. 7 is a schematic structural diagram of a head-mounted display device according to an embodiment of the present application, as shown in fig. 7, a head-mounted display device 700 of the present embodiment may include: a camera 701, a display 702, a communication device 703, and a processor 704. The photographing device 701, the display device 702, the communication device 703, and the processor 704 are connected by a communication bus, for example.
The communication device 703 is configured to receive a first image acquired by the mobile platform from the mobile platform.
The photographing device 701 is configured to collect a second image of the surrounding environment of the head-mounted display apparatus 700.
The processor 704 is configured to obtain display instruction information, determine a target image from the first image and the second image according to the display instruction information, and control the display device to display the target image.
The display device 702 is configured to display the target image.
In some embodiments, the target image is one of a first image, a second image, a first image, and a second image.
In some embodiments, the display indication information includes first display indication information, wherein the processor 704 is specifically configured to: first display instruction information is acquired, a first image is determined from the first image and the second image according to the first display instruction information, and the display device 702 is controlled to display the first image.
The display indication information includes second display indication information, where the processor 704 is specifically configured to: second display instruction information is acquired, a second image is determined from the first image and the second image according to the second display instruction information, and the display device 702 is controlled to display the second image.
In some embodiments, the display instruction information includes third display instruction information, wherein the processor 704 is specifically configured to: third display instruction information is acquired, and a first image and a second image are determined from the first image and the second image according to the third display instruction information, so that the display device 702 is controlled to display the first image and the second image simultaneously.
In some embodiments, the processor 704 is specifically configured to: the display device 702 is controlled to display the first image in a first preset display area and the second image in a second preset display area.
In some embodiments, the first preset display area has an area greater than an area of the second preset display area.
In some embodiments, the area of the first preset display area and the area of the second preset display area are determined according to a relative position parameter between a reference object and the movable platform, wherein the reference object is a user of the head mounted display device 700, the head mounted display device 700 or a control terminal of the movable platform.
In some embodiments, the processor 704 is further configured to: and acquiring relative position parameters between the reference object and the movable platform, and determining the area of the first preset display area and the area of the second preset display area according to the relative position parameters.
In some embodiments, the relative position parameter comprises a relative distance, wherein an area of the first preset display area is smaller than an area of the second preset display area when the relative distance is within a first preset distance range; when the relative distance is within a second preset distance range, the area of the first preset display area is larger than that of the second preset display area.
In some embodiments, the communication device 703 is further configured to receive display instruction information sent by a control terminal of the mobile platform, where the display instruction information is generated by the control terminal detecting a display instruction operation of a user. The processor 704 is specifically configured to: for acquiring the display instruction information received by the communication apparatus 703.
In some embodiments, the processor 704 is specifically configured to: detecting display indication operation of a user, and acquiring display indication information according to the display indication operation.
In some embodiments, the display indication information is determined from a relative position parameter between a reference object and the movable platform. Wherein the reference object is a user of the head mounted display device 700, the head mounted display device or a control terminal of the movable platform.
In some embodiments, the processor 704 is specifically configured to: and acquiring a relative position parameter between the reference object and the movable platform, and determining the display indication information according to the relative position parameter.
In some embodiments, the relative position parameter comprises a relative distance.
The display instruction information includes first display instruction information, and the processor 704 is specifically configured to: and when the relative distance is in a third preset distance range, acquiring first display indication information, and determining a first image from the first image and the second image according to the first display indication information.
The display instruction information includes second display instruction information, and the processor 704 is specifically configured to: and when the relative distance is in a fourth preset distance range, acquiring second display indication information, and determining a second image from the first image and the second image according to the second display indication information.
In some embodiments, the display instruction information includes third display instruction information, and the processor 704 is specifically configured to: and when the relative distance is in a fifth preset distance range, acquiring third display indication information, and determining a first image and a second image from the first image and the second image according to the third display indication information.
In some embodiments, the display indication information is determined according to an operating state of the movable platform.
In some embodiments, the processor 704 is specifically configured to: and acquiring the working state of the movable platform, and acquiring the display indication information according to the working state.
In some embodiments, the mobile platform comprises a drone. The display instruction information includes first display instruction information, and the processor 704 is specifically configured to: and when the working state is a cruising state, acquiring first display indication information, and determining a first image from the first image and the second image according to the first display indication information.
In some embodiments, the mobile platform comprises a drone. The display instruction information includes second display instruction information, and the processor 704 is specifically configured to: and when the working state is a take-off or landing state, acquiring second display indication information, and determining a second image from the first image and the second image according to the second display indication information.
In some embodiments, the display 702 is disposed on a housing in the head mounted display device 700.
In some embodiments, the shooting direction of the shooting device 701 is away from the display direction of the display device 702.
The head-mounted display device of the present embodiment may be used to implement the technical scheme of the head-mounted display device in the foregoing fig. 3 and the corresponding method embodiments of the present application, and its implementation principle and technical effects are similar, and are not repeated here.
Fig. 8 is a schematic structural diagram of a head-mounted display device according to another embodiment of the present application, as shown in fig. 8, the head-mounted display device 800 of this embodiment may include: a camera 801, a display 802, a communication 803, and a processor 804. The photographing device 801, the display device 802, the communication device 803, and the processor 804 are connected by a communication bus, for example.
The communication means 803 is configured to receive a first image acquired by the movable platform from the movable platform.
The photographing device 801 is configured to acquire a second image of a surrounding environment of the head-mounted display device 800.
The processor 804 is configured to control the display device 802 to display the first image and the second image simultaneously.
The display device 802 is configured to display the first image and the second image simultaneously.
In some embodiments, the processor 804 is specifically configured to: the control display device 802 displays the first image in a first preset display area and displays the second image in a second preset display area.
In some embodiments, the first preset display area has an area greater than an area of the second preset display area.
In some embodiments, the area of the first preset display area and the area of the second preset display area are determined according to a relative position parameter between a reference object and the movable platform, wherein the reference object is a user of the head mounted display device 800, the head mounted display device 800 or a control terminal of the movable platform.
In some embodiments, the processor 804 is further configured to: and acquiring relative position parameters between the reference object and the movable platform, and determining the area of the first preset display area and the area of the second preset display area according to the relative position parameters.
In some embodiments, the relative position parameter comprises a relative distance, wherein an area of the first preset display area is smaller than an area of the second preset display area when the relative distance is within a first preset distance range; when the relative distance is within a second preset distance range, the area of the first preset display area is larger than that of the second preset display area.
In some embodiments, the display device 802 is disposed on the same side of the housing in the head mounted display apparatus 800.
In some embodiments, the photographing direction of the photographing device 801 is away from the display direction of the display device 802.
The head-mounted display device of the present embodiment may be used to implement the technical scheme of the head-mounted display device in the foregoing fig. 6 and the corresponding method embodiments of the present application, and its implementation principle and technical effects are similar, and are not repeated here.
Fig. 9 is a schematic structural diagram of a display control system according to an embodiment of the present application, as shown in fig. 9, a display control system 900 according to the present embodiment may include: a removable platform 901 and a head mounted display device 902. The structure of the embodiment shown in fig. 7 or fig. 8 may be adopted by the head-mounted display device 902, which correspondingly may execute the technical solutions of the head-mounted display device in the above method embodiments, and the implementation principle and technical effects are similar, and are not repeated herein.
Optionally, the display control system 900 of the present embodiment may further include: the control terminal 903, where the control terminal 903 may execute the scheme of the control terminal related to the foregoing method embodiment, which is not described herein again.
Those of ordinary skill in the art will appreciate that: all or part of the steps for implementing the above method embodiments may be implemented by hardware associated with program instructions, where the foregoing program may be stored in a computer readable storage medium, and when executed, the program performs steps including the above method embodiments; and the aforementioned storage medium includes: read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic or optical disk, and the like.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.
Claims (15)
1. A display control method, characterized in that the method comprises:
Receiving a first image acquired by a movable platform;
acquiring a second image acquired by a shooting device, wherein the shooting device is used for acquiring an image of the surrounding environment of the head-mounted display equipment;
Acquiring display indication information, and determining a target image from the first image and the second image according to the display indication information; and
Controlling a display device of the head-mounted display device to display the target image;
The display area of the display device comprises a first preset display area and a second preset display area; the first preset display area is an area for displaying the first image; the second preset display area is an area for displaying the second image; the area of the first preset display area and the area of the second preset display area are determined according to the relative distance between the reference object and the movable platform; when the relative distances are in different preset distance ranges, the areas of the first preset display area and the second preset display area have different magnitude relations.
2. The method of claim 1, wherein the step of determining the position of the substrate comprises,
When the relative distance is in a first preset distance range, the area of the first preset display area is smaller than that of the second preset display area; and
When the relative distance is in a second preset distance range, the area of the first preset display area is larger than that of the second preset display area;
Wherein the first preset distance range is smaller than the second preset distance range.
3. The method of claim 1, wherein the step of determining the position of the substrate comprises,
The reference object is a user of the head-mounted display device, or a control terminal of the movable platform.
4. The method according to any one of claim 1 to 3, wherein,
The obtaining display indication information includes:
And acquiring the working state of the movable platform, and acquiring the display indication information according to the working state.
5. The method of claim 4, wherein the display indication information comprises a first display indication information, and wherein the obtaining the display indication information according to the operating state comprises:
when the working state is a cruising state, acquiring first display indication information;
the determining a target image from the first image and the second image according to the display indication information comprises the following steps:
And determining the first image from the first image and the second image according to the first display indication information.
6. The method of claim 4, wherein the display indication information includes a second display indication information, and wherein the obtaining the display indication information according to the operating state includes:
When the working state is a take-off or landing state, acquiring second display indication information;
the determining a target image from the first image and the second image according to the display indication information comprises the following steps:
And determining the second image from the first image and the second image according to the second display indication information.
7. The method according to any one of claim 1 to 3, wherein,
The display indication information comprises first display indication information, and the obtaining display indication information comprises:
When the relative distance is in a third preset distance range, acquiring the first display indication information;
the determining a target image from the first image and the second image according to the display indication information comprises the following steps:
determining the first image from the first image and the second image according to the first display indication information; and/or the number of the groups of groups,
The display indication information includes second display indication information, and the obtaining display indication information includes:
When the relative distance is in a fourth preset distance range, acquiring the second display indication information;
the determining a target image from the first image and the second image according to the display indication information comprises the following steps:
And determining the second image from the first image and the second image according to the second display indication information.
8. The method according to any one of claim 1 to 3, wherein,
The display instruction information includes third display instruction information, and the obtaining display instruction information includes:
When the relative distance is in a fifth preset distance range, acquiring the third display indication information;
the determining a target image from the first image and the second image according to the display indication information comprises the following steps:
And determining the first image and the second image from the first image and the second image according to the third display indication information.
9. The method according to any one of claim 1 to 3, wherein,
The controlling the display device of the head-mounted display apparatus to display the target image includes:
Splicing the first image and the second image according to the same image in the first image and the second image to obtain a spliced image, wherein the spliced image comprises a part of the image in the second image and the first image;
and controlling the display device to display the first image in the first preset display area, and simultaneously displaying the partial image in the second preset display area.
10. A method according to any one of claims 1 to 3, wherein the display instruction information is generated in the event that a display instruction operation by a user is detected.
11. A method according to any one of claims 1 to 3, wherein the target image is the first image and the second image, or the target image is one of the first image and the second image.
12. A method according to any one of claims 1 to 3, wherein the display device is provided on a housing in the head mounted display apparatus.
13. A method according to any one of claims 1 to 3, wherein a shooting direction of the shooting device is away from a display direction of the display device.
14. A head-mounted display device, comprising: a photographing device, a display device, a communication device, and a processor;
The communication device is used for receiving a first image acquired by the movable platform;
The shooting device is used for acquiring a second image of the surrounding environment of the head-mounted display device;
The processor is used for acquiring display indication information, determining a target image from the first image and the second image according to the display indication information, and controlling the display device to display the target image;
The display device is used for displaying the target image;
The display area of the display device comprises a first preset display area and a second preset display area; the first preset display area is an area for displaying the first image; the second preset display area is an area for displaying the second image; the area of the first preset display area and the area of the second preset display area are determined according to the relative distance between the reference object and the movable platform; when the relative distances are in different preset distance ranges, the areas of the first preset display area and the second preset display area have different magnitude relations.
15. A readable storage medium, characterized in that, the readable storage medium has a computer program stored thereon; the computer program, when executed, implements the display control method according to any one of claims 1 to 13.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410876485.4A CN118625530A (en) | 2019-12-31 | 2019-12-31 | Display control method and device |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410876485.4A CN118625530A (en) | 2019-12-31 | 2019-12-31 | Display control method and device |
PCT/CN2019/130733 WO2021134575A1 (en) | 2019-12-31 | 2019-12-31 | Display control method and device |
CN201980094964.8A CN113661429B (en) | 2019-12-31 | 2019-12-31 | Display control method and device |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201980094964.8A Division CN113661429B (en) | 2019-12-31 | 2019-12-31 | Display control method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN118625530A true CN118625530A (en) | 2024-09-10 |
Family
ID=76687169
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201980094964.8A Active CN113661429B (en) | 2019-12-31 | 2019-12-31 | Display control method and device |
CN202410876485.4A Pending CN118625530A (en) | 2019-12-31 | 2019-12-31 | Display control method and device |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201980094964.8A Active CN113661429B (en) | 2019-12-31 | 2019-12-31 | Display control method and device |
Country Status (2)
Country | Link |
---|---|
CN (2) | CN113661429B (en) |
WO (1) | WO2021134575A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023137758A1 (en) * | 2022-01-24 | 2023-07-27 | 深圳市大疆创新科技有限公司 | Control method for movable platform, head-mounted device, system, and storage medium |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030227542A1 (en) * | 2001-12-20 | 2003-12-11 | Xiang Zhang | Single-computer real-time stereo augmented reality system |
CN104065911B (en) * | 2013-03-18 | 2019-01-15 | 联想(北京)有限公司 | Display control method and device |
CN204203554U (en) * | 2014-11-05 | 2015-03-11 | 昆山优力电能运动科技有限公司 | head-mounted display apparatus |
CN105572870A (en) * | 2014-11-05 | 2016-05-11 | 优利科技有限公司 | Head-mounted display device |
CN106445088B (en) * | 2015-08-04 | 2020-05-22 | 上海宜维计算机科技有限公司 | Method and system for reality augmentation |
CN109041591A (en) * | 2017-09-12 | 2018-12-18 | 深圳市大疆创新科技有限公司 | Image transfer method, equipment, moveable platform, monitoring device and system |
CN108932058B (en) * | 2018-06-29 | 2021-05-18 | 联想(北京)有限公司 | Display method and device and electronic equipment |
-
2019
- 2019-12-31 WO PCT/CN2019/130733 patent/WO2021134575A1/en active Application Filing
- 2019-12-31 CN CN201980094964.8A patent/CN113661429B/en active Active
- 2019-12-31 CN CN202410876485.4A patent/CN118625530A/en active Pending
Also Published As
Publication number | Publication date |
---|---|
CN113661429A (en) | 2021-11-16 |
WO2021134575A1 (en) | 2021-07-08 |
CN113661429B (en) | 2024-07-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20220153412A1 (en) | Control method, control system, and smart glasses for first person view unmanned aerial vehicle flight | |
CN110488977B (en) | Virtual reality display method, device and system and storage medium | |
EP3379525B1 (en) | Image processing device and image generation method | |
US8441435B2 (en) | Image processing apparatus, image processing method, program, and recording medium | |
US20190243357A1 (en) | Wearable uav control device and uav system | |
JP6899875B2 (en) | Information processing device, video display system, information processing device control method, and program | |
CN108762501B (en) | AR display method, intelligent terminal, AR device and AR system | |
KR20220070292A (en) | Automated eyewear device sharing system | |
US11320667B2 (en) | Automated video capture and composition system | |
CN106303448B (en) | Aerial image processing method, unmanned aerial vehicle, head-mounted display device and system | |
US11443540B2 (en) | Information processing apparatus and information processing method | |
WO2015198692A1 (en) | Image display device and image display method | |
US20210004005A1 (en) | Image capture method and device, and machine-readable storage medium | |
JP2018137505A (en) | Display device and control method thereof | |
CN106327583A (en) | Virtual reality equipment for realizing panoramic image photographing and realization method thereof | |
JP6631014B2 (en) | Display system and display control method | |
CN113661429B (en) | Display control method and device | |
JP6649010B2 (en) | Information processing device | |
CN111050066A (en) | Zooming method and device, aircraft, flight system and storage medium | |
US20230071690A1 (en) | Remote control system, remote operation apparatus, video image processing apparatus, and computer-readable medium | |
US11610343B2 (en) | Video display control apparatus, method, and non-transitory computer readable medium | |
CN116125669A (en) | Display device and method for modulating imaging field of view | |
JP2016090853A (en) | Display device, control method of display device and program | |
WO2021237625A1 (en) | Image processing method, head-mounted display device, and storage medium | |
US9762891B2 (en) | Terminal device, image shooting system and image shooting method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |