CN114205669B - Free-angle video playback method, device and electronic equipment - Google Patents

Abstract

Embodiments of the present invention relate to the field of data processing technology, and disclose a free-view video playback method, device and electronic equipment. The method includes: when the user watches the free-view video, tracking the user's eye movements to determine the user's focus position on the free-view video on the playback screen; switching the playback perspective of the free-view video according to the focus position . Through the above method, embodiments of the present invention improve the efficiency of perspective switching and enhance the user's viewing experience.

Description

Free-angle video playback method, device and electronic equipment

Technical field

Embodiments of the present invention relate to the field of data processing technology, and specifically relate to a free-view video playback method, device and electronic equipment.

Background technique

With the continuous development of network technology, the number of video views is getting higher and higher. Compared with ordinary single-view videos, free-view videos allow users to watch videos from multiple different perspectives, improving the user's viewing experience.

In the related technology, when the user is watching a free-angle video, if the user needs to change the viewing angle, the playback device must be manually operated. The playback device determines a new video playback angle according to the user's manual operation signal, and plays the free-angle video based on the new video playback angle. However, in the process of implementing the embodiments of the present invention, the inventor found that the process of switching the playback angle of the free-angle video in the related technology is relatively cumbersome, which distracts the user's attention and affects the user's viewing experience.

Contents of the invention

In view of the above problems, embodiments of the present invention provide a free-angle video playback method, device, and electronic equipment to solve the problem in the prior art that the angle switching process is complicated.

According to one aspect of an embodiment of the present invention, a method for playing free-view video is provided, and the method includes:

When the user watches the free-view video, the user's eye movements are tracked to determine the user's focus position on the free-view video on the playback screen;

Switch the playback angle of the free-angle video according to the attention position.

In an optional manner, the attention position includes the user's gaze point on the playback screen, and switching the playback angle of the free-view video according to the attention position includes:

Determine the trigger point that triggers the viewing angle switch according to the gaze point, and determine the offset direction and offset ratio of the trigger point relative to the center point of the playback screen;

Determine the sum of the coverage angle differences between the adjacent camera positions between the target boundary camera position and the playback host position according to the offset direction;

The viewing angle switching angle is determined according to the sum of the difference in coverage angles of adjacent camera positions and the offset ratio, and the playback angle of the free-view video is switched according to the viewing angle switching angle.

In an optional manner, determining the offset direction and offset ratio of the trigger point relative to the center point of the playback screen includes:

Determine the screen position of the trigger point, and determine the offset direction of the trigger point relative to the center point of the play screen based on the positional relationship between the screen position and the screen position of the center point of the play screen;

Determine the playback screen boundary point corresponding to the offset direction;

The coordinate ratio of the trigger point and the playback screen boundary point on the preset screen coordinate axis is determined as the offset ratio of the trigger point relative to the playback screen center point.

In an optional manner, before determining the offset direction and offset ratio of the trigger point relative to the center point of the playback screen, the method includes:

Determine whether the trigger point is located in a preset trigger area;

When the trigger point is located in the preset trigger area, the step of determining the offset direction and offset ratio of the trigger point relative to the center point of the play screen is then performed.

In an optional manner, determining the viewing angle switching angle based on the sum of the difference in coverage angles of adjacent camera positions and the offset ratio includes:

Calculate the product of the sum of the coverage angle differences of adjacent camera positions and the offset ratio;

The product is determined as the viewing angle switching angle.

In an optional manner, before the user watches the free-view video, tracking the user's eye movements to determine the user's focus position on the free-view video on the play screen, the method further includes :

Obtain the free-view video to be played and the camera position information corresponding to the free-view video to be played from the video cloud;

Determine the production host location of the free-angle video to be played according to the camera location information;

The production host is determined to be the playback host that plays the free-view video to be played, and the free-view video to be played is played from the perspective of the playback host.

In an optional manner, determining the sum of the coverage angle differences between adjacent camera positions between the target boundary camera position and the playback host position according to the offset direction includes:

Determine the total number of aircraft and the coverage angle difference of all adjacent aircraft based on the aircraft location information;

Determine the target boundary aircraft location according to the offset direction and the total number of aircraft locations;

The sum of the coverage angle differences between the target boundary camera and the playing host position is determined based on the target boundary camera position and the coverage angle differences of all adjacent camera positions.

According to another aspect of the embodiment of the present invention, a free-view video playback device is provided, and the device includes:

A determination module configured to track the user's eyeball movements when the user watches the free-view video to determine the user's focus position on the free-view video on the playback screen;

A switching module, configured to switch the playback angle of the free-angle video according to the position of interest.

According to another aspect of the embodiment of the present invention, an electronic device is provided, including: a processor, a memory, a communication interface, and a communication bus. The processor, the memory, and the communication interface complete each other through the communication bus. communication between;

The memory is used to store at least one executable instruction, and the executable instruction causes the processor to perform the operation of the above-mentioned free-view video playback method.

According to yet another aspect of an embodiment of the present invention, a computer-readable storage medium is provided. At least one executable instruction is stored in the storage medium. When the executable instruction is run on an electronic device, it causes the electronic device to execute the above-mentioned The operation of the free-angle video playback method.

In the embodiment of the present invention, when the user watches the free-angle video, as the user's main area of concern for the free-angle video changes, the projection point of the user's eyeballs on the playback screen also changes; based on the tracking of the user's eyeball movements, The user's focus position on the free-view video can be determined on the playback screen, and the playback perspective of the free-view video can be switched based on the focus position. It can be seen that the embodiment of the present invention can intelligently identify the user's main area of concern on the free-view video, and further switch the playback angle of the free-view video according to the recognition result, and can realize the switching of the playback angle of the free-view video without manual operation by the user. , which can greatly simplify the process of switching the viewing angle of free-view video and improve the user's viewing experience.

The above description is only an overview of the technical solutions of the embodiments of the present invention. In order to have a clearer understanding of the technical means of the embodiments of the present invention, they can be implemented according to the content of the description, and in order to achieve the above and other purposes, features and The advantages can be more clearly understood, and specific embodiments of the present invention are listed below.

Description of the drawings

The drawings are only used to illustrate the embodiments and are not considered to be limitations of the present invention. Also throughout the drawings, the same reference characters are used to designate the same components. In the attached picture:

Figure 1 shows a schematic flow chart of a free-view video playback method provided by an embodiment of the present invention;

Figure 2 shows a schematic diagram of the camera position arrangement provided by an embodiment of the present invention;

Figure 3 shows a schematic diagram of the user's gaze point route provided by an embodiment of the present invention;

Figure 4 shows a schematic diagram of a display screen provided by an embodiment of the present invention;

Figure 5 shows a schematic structural diagram of a free-view video playback device provided by an embodiment of the present invention;

Figure 6 shows a schematic structural diagram of an electronic device provided by an embodiment of the present invention.

Detailed ways

Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention may be embodied in various forms and should not be limited to the embodiments set forth herein.

Figure 1 shows a flow chart of a free-view video playback method according to an embodiment of the present invention. The method is executed by an electronic device. The memory of the electronic device is used to store at least one executable instruction, and the executable instruction causes the processor of the electronic device to perform the operation of the above-mentioned free-view video playback method.

As shown in Figure 1, the method includes the following steps:

Step 110: When the user watches the free-view video, track the user's eyeball movements to determine the user's focus position on the free-view video on the play screen.

Among them, free-view video is a video that can be viewed from multiple viewing angles. When making free-view videos, it is necessary to deploy a certain number of cameras at the shooting site to collect videos, and then synchronize the alignment, splicing, and transcoding of the videos collected by each camera. When collecting video, first determine the total number of cameras based on the shooting location and camera position layout, and then determine the shooting focus based on the video content. For example, when the video content is a basketball game, the shooting focus can be determined to be basketball. Furthermore, each camera position can be numbered in a certain order, and the current production main position, the total coverage angle of all camera positions, and each adjacent camera can be calculated in real time based on the layout of each camera position and the distance to the shooting focus. Poor bit coverage angle. For example, after numbering, each camera position is C ₁ , C ₂ ..... C _N , and the production host position calculated in real time is C _m , (the production host position C _m is C ₁ to C _N a), the total coverage angle of all aircraft positions is PVT, and the coverage angle difference of each adjacent aircraft position is PV _{(i, j)} , where i and j represent two adjacent aircraft positions.

Figure 2 shows a schematic diagram of the camera position arrangement provided by an embodiment of the present invention. As shown in Figure 2, the total number of seats is N = 17. In the coverage angle difference PV _{(i, j)} of adjacent seats shown in the figure, i = 8 and j = 9. The production host position is C ₉ . Furthermore, the coverage angle differences of all adjacent camera positions can be expressed as the following array.

PV _1,N-1 = [PV _(1,2) PV _(2,3) ... PV _(N-1,N) ]

The total coverage angle PVT of all camera positions can be calculated by the following formula.

After each camera at the shooting site (collection end) completes video collection, the video stream and camera position information collected by each camera can be transmitted to the video cloud with low latency. The camera position information CIT at the current time T can include the total number of cameras N, the current production host position C _m , the current total coverage angle PVT of all camera positions, and the coverage angle difference of each adjacent camera position, that is:

CIT＝CI(N,C _m ,PVT,[PV _(1,2) PV _(2,3 )... PV _(N-1,N) ])

After the video cloud receives the video stream and camera location information returned from the shooting scene, it can complete the synchronous alignment, splicing and conversion of the video streams from each camera based on the video frame timestamp of the NTP (Network Time Protocol) clock. code, and send the transcoded video stream and camera location information to the terminal for playback. After receiving the video stream and camera location information sent by the video cloud, the terminal can play the video stream based on the camera location information. When playing the video stream according to the camera position information, the playback host position can be set to the production host position C _m , that is, the video is played from the perspective of the production host position C _m by default.

When a user watches a free-view video, as the user's main focus area on the free-view video changes, the projection point of the user's eyeballs on the playback screen also changes. Therefore, based on tracking the user's eye movements, the user's focus position on the free-view video can be determined on the playback screen. The user's focus position on the free-view video may include, for example, the user's gaze point on the playback screen. Furthermore, the playback screen of the playback device can be gridded so that each point on the playback screen corresponds to a unique screen coordinate.

Step 120: Switch the playback angle of the free-angle video according to the attention position.

Among them, according to the user's focus on the free-view video, the current best playback angle can be determined in real time, and the playback angle of the free-view video can be switched based on the current best playback angle. Furthermore, when switching the playback angle of the free-angle video based on the focus position, the trigger point for triggering the angle switch can be determined based on the user's gaze point on the playback screen. For example, the user's gaze point on the playback screen can be extracted through eye tracking technology. The gaze point constitutes the basic unit of measurement. One gaze point is equal to one sampling point captured by the eye tracker. Further, the gaze point that lasts longer than the first preset duration can be determined as the gaze point, which is a point where the eyes are locked on the screen; the gaze point that lasts longer than the second preset duration can be determined as the trigger point. .

Figure 3 shows a schematic diagram of the user's gaze point route provided by an embodiment of the present invention. As shown in Figure 3, the schematic diagram of the gaze point route includes a total of 5 points ①, ②, ③, ④ and ⑤. ①, ②, ③, ④ and ⑤ are all gaze points, and the duration of ① and ⑤ exceeds the second The preset duration is the trigger point.

Among them, after determining the trigger point that triggers the viewing angle switch, the offset direction and offset ratio of the trigger point relative to the center point of the playback screen can be determined, and the adjacent cameras between the target boundary camera position and the playback host position can be determined based on the offset direction. The viewing angle switching angle is determined based on the sum of the coverage angle differences of adjacent camera positions and the offset ratio, and the playback angle of the free-view video is switched according to the viewing angle switching angle. Before determining the offset direction and offset ratio of the trigger point relative to the center point of the playback screen, you can also determine whether the trigger point is located in the preset trigger area. When it is determined that the trigger point is located in the preset trigger area, then determine the trigger point relative to the playback screen center point. The offset direction and offset ratio of the screen center point. Furthermore, according to the user's free-view video viewing habits, a heat map area G can be set on the playback screen, and the area other than the heat map area G on the playback screen can be set as a preset trigger area. The heat map area G is generally a certain area near the center of the playback screen. Trigger points in this area will not trigger the perspective switching of the free-view video.

When determining the offset direction and offset ratio of the trigger point relative to the center point of the playback screen, first determine the screen position of the trigger point, and determine the relative position of the trigger point relative to the screen position of the trigger point based on the positional relationship between the screen position of the trigger point and the screen position of the center point of the playback screen. The offset direction of the center point of the playback screen; further, determine the playback screen boundary point corresponding to the offset direction, and determine the coordinate ratio of the trigger point and the playback screen boundary point on the preset screen coordinate axis as the trigger point relative to the playback screen The offset ratio of the center point. The preset screen coordinate axis can be a horizontal coordinate axis or a vertical coordinate axis.

For example, the preset screen coordinate axis is the horizontal coordinate axis, the coordinates of the trigger point are C(n,m), n is the coordinate of the trigger point in the horizontal direction, m is the coordinate of the trigger point in the vertical direction, and the center of the playback screen The coordinates of the point are (0,0). If n<0, the offset direction of the trigger point relative to the center point of the playback screen is D (Direction) = L (Left); if n>0, the offset direction of the trigger point relative to the center point of the playback screen. The offset direction of the center point is D (Direction) = R (Right). L means that the trigger point is shifted to the left of the center point of the playback screen, and R means that the trigger point is shifted to the right of the center point of the playback screen. When determining the coordinates of the playback screen boundary point on the preset screen coordinate axis, if the trigger point deviates to the left of the playback screen center point, then the horizontal coordinates of the playback screen left boundary point are determined as the playback screen boundary point on the preset screen coordinate axis. Set the coordinates on the screen coordinate axis; if the trigger point is offset to the right of the center point of the playback screen, then determine the horizontal coordinates of the right boundary point of the playback screen as the coordinates of the playback screen boundary point on the preset screen coordinate axis.

Figure 4 shows a schematic diagram of a display screen provided by an embodiment of the present invention. As shown in Figure 4, the X-axis is the horizontal coordinate axis, the Y-axis is the vertical coordinate axis, X1 is the right boundary point of the playback screen, and X2 is the left boundary point of the playback screen. When the trigger point shifts to the left of the center point of the playback screen, the shift ratio S=n/x2; when the trigger point shifts to the right of the center point of the playback screen, the shift ratio S=n/x1.

When the user watches the free-view video, the user's eyeball movements are tracked to determine the user's focus position on the free-view video on the playback screen. The free-view video to be played and the free-view video to be played can also be obtained from the video cloud. Play the camera position information corresponding to the free-view video, determine the production host position of the free-view video to be played based on the camera position information, determine the production host position as the playback host position for the free-view video to be played, and treat it from the perspective of the playback host position Play free-view video for playback. When determining the sum of the coverage angle differences between the target boundary camera and the broadcast host position based on the offset direction, the total number of cameras and the coverage angle differences of all adjacent cameras can be determined based on the camera position information. According to the offset The direction and the number of total cameras are used to determine the target boundary camera position; the sum of the coverage angle differences between the target border camera position and the broadcast host position is determined based on the target boundary camera position and the coverage angle differences of all adjacent camera positions.

For example, when determining the sum of the coverage angle differences between the target boundary camera and the playback host position based on the offset direction, if the trigger point shifts to the left of the center point of the playback screen, the target boundary camera can be The position is determined as C ₁ , and the sum of the coverage angle differences PVL between the target boundary camera and the playback host position can be expressed as If the trigger point shifts to the right of the center point of the playback screen, the target boundary camera position can be determined as C _N , and the sum of the coverage angle differences PVL between the target boundary camera position and the playback host position can be expressed as /> When determining the viewing angle switching angle based on the sum of the coverage angle differences of adjacent camera positions and the offset ratio, the product of the sum of the coverage angle differences of adjacent camera positions and the offset ratio can be calculated, and the product is determined as the viewing angle switching angle. For example, if the trigger point shifts to the left of the center point of the playback screen, the viewing angle switching angle SA=PVL*S; if the trigger point shifts to the left of the center point of the playback screen, the viewing angle switching angle SA=PVR*S. Furthermore, the terminal playback device can smoothly switch to the new playback host position based on the viewing angle switching angle.

In the embodiment of the present invention, when the user watches the free-angle video, as the user's main area of concern for the free-angle video changes, the projection point of the user's eyeballs on the playback screen also changes; based on the tracking of the user's eyeball movements, The user's focus position on the free-view video can be determined on the playback screen, and the playback perspective of the free-view video can be switched based on the focus position. It can be seen that the embodiment of the present invention can intelligently identify the user's main area of concern on the free-view video, and further switch the playback angle of the free-view video according to the recognition result, and can realize the switching of the playback angle of the free-view video without manual operation by the user. , which can greatly simplify the process of switching the viewing angle of free-view video and improve the user's viewing experience.

FIG. 5 shows a schematic structural diagram of a free-view video playback device according to an embodiment of the present invention. As shown in FIG. 5 , the device 300 includes: a determining module 310 and a switching module 320 .

Among them, the determination module 310 is used to track the user's eye movements when the user watches the free-view video to determine the user's focus position on the free-view video on the play screen; the switching module 320 is used to switch according to the focus position. The playback angle of the free-angle video.

In an optional manner, the attention position includes the user's gaze point on the play screen, and the switching module 320 is used to:

Determine the trigger point that triggers the viewing angle switch according to the gaze point, and determine the offset direction and offset ratio of the trigger point relative to the center point of the playback screen;

Determine the sum of the coverage angle differences between the adjacent camera positions between the target boundary camera position and the playback host position according to the offset direction;

The viewing angle switching angle is determined according to the sum of the difference in coverage angles of adjacent camera positions and the offset ratio, and the playback angle of the free-view video is switched according to the viewing angle switching angle.

In an optional manner, the switching module 320 is used to:

Determine the screen position of the trigger point, and determine the offset direction of the trigger point relative to the center point of the play screen based on the positional relationship between the screen position and the screen position of the center point of the play screen;

Determine the playback screen boundary point corresponding to the offset direction;

The coordinate ratio of the trigger point and the playback screen boundary point on the preset screen coordinate axis is determined as the offset ratio of the trigger point relative to the playback screen center point.

In an optional manner, the switching module 320 is used to:

Before determining the offset direction and offset ratio of the trigger point relative to the center point of the playback screen, determine whether the trigger point is located in a preset trigger area;

When the trigger point is located in the preset trigger area, the offset direction and offset ratio of the trigger point relative to the center point of the playback screen are determined.

In an optional manner, the switching module 320 is used to:

Calculate the product of the sum of the coverage angle differences of adjacent camera positions and the offset ratio;

The product is determined as the viewing angle switching angle.

In an optional manner, the switching module 320 is used to:

When the user watches the free-view video, the user's eyeball movements are tracked to determine the user's focus position on the free-view video on the play screen, and the free-view video to be played and the free-view video to be played are obtained from the video cloud. Camera position information corresponding to free-view video;

Determine the production host location of the free-angle video to be played according to the camera location information;

The production host is determined to be the playback host that plays the free-view video to be played, and the free-view video to be played is played from the perspective of the playback host.

In an optional manner, the switching module 320 is used to:

Determine the total number of aircraft and the coverage angle difference of all adjacent aircraft based on the aircraft location information;

Determine the target boundary aircraft location according to the offset direction and the total number of aircraft locations;

The sum of the coverage angle differences between the target boundary camera and the playing host position is determined based on the target boundary camera position and the coverage angle differences of all adjacent camera positions.

In the embodiment of the present invention, when the user watches the free-angle video, as the user's main area of concern for the free-angle video changes, the projection point of the user's eyeballs on the playback screen also changes; based on the tracking of the user's eyeball movements, The user's focus position on the free-view video can be determined on the playback screen, and the playback perspective of the free-view video can be switched based on the focus position. It can be seen that the embodiment of the present invention can intelligently identify the user's main area of concern on the free-view video, and further switch the playback angle of the free-view video according to the recognition result, and can realize the switching of the playback angle of the free-view video without manual operation by the user. , which can greatly simplify the process of switching the viewing angle of free-view video and improve the user's viewing experience.

FIG. 6 shows a schematic structural diagram of an electronic device according to an embodiment of the present invention. Specific embodiments of the present invention do not limit the specific implementation of the electronic device.

As shown in Figure 6, the electronic device may include: a processor (processor) 402, a communications interface (Communications Interface) 404, a memory (memory) 406, and a communication bus 408.

Among them: the processor 402, the communication interface 404, and the memory 406 complete communication with each other through the communication bus 408. The communication interface 404 is used to communicate with network elements of other devices such as clients or other servers. The processor 402 is configured to execute the program 410. Specifically, it may execute relevant steps in the above embodiment of the method for playing free-view video.

Specifically, program 410 may include program code including computer-executable instructions.

The processor 402 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. The one or more processors included in the electronic device may be the same type of processor, such as one or more CPUs; or they may be different types of processors, such as one or more CPUs and one or more ASICs.

Memory 406 is used to store programs 410. The memory 406 may include high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

Specifically, the program 410 can be called by the processor 402 to cause the electronic device to perform the following operations:

When the user watches the free-view video, the user's eye movements are tracked to determine the user's focus position on the free-view video on the playback screen;

Switch the playback angle of the free-angle video according to the attention position.

In an optional manner, the attention position includes the user's gaze point on the playback screen, and the program 410 is called by the processor 402 to cause the electronic device to perform the following operations:

Determine the trigger point that triggers the viewing angle switch according to the gaze point, and determine the offset direction and offset ratio of the trigger point relative to the center point of the playback screen;

Determine the sum of the coverage angle differences between the adjacent camera positions between the target boundary camera position and the playback host position according to the offset direction;

The viewing angle switching angle is determined according to the sum of the difference in coverage angles of adjacent camera positions and the offset ratio, and the playback angle of the free-view video is switched according to the viewing angle switching angle.

In an optional manner, the program 410 is called by the processor 402 to cause the electronic device to perform the following operations:

Determine the screen position of the trigger point, and determine the offset direction of the trigger point relative to the center point of the play screen based on the positional relationship between the screen position and the screen position of the center point of the play screen;

Determine the playback screen boundary point corresponding to the offset direction;

The coordinate ratio of the trigger point and the playback screen boundary point on the preset screen coordinate axis is determined as the offset ratio of the trigger point relative to the playback screen center point.

In an optional manner, the attention position includes the user's gaze point on the playback screen, and the program 410 is called by the processor 402 to cause the electronic device to perform the following operations:

Before determining the offset direction and offset ratio of the trigger point relative to the center point of the playback screen, determine whether the trigger point is located in a preset trigger area;

When the trigger point is located in the preset trigger area, the step of determining the offset direction and offset ratio of the trigger point relative to the center point of the play screen is then performed.

In an optional manner, the attention position includes the user's gaze point on the playback screen, and the program 410 is called by the processor 402 to cause the electronic device to perform the following operations:

Calculate the product of the sum of the coverage angle differences of adjacent camera positions and the offset ratio;

The product is determined as the viewing angle switching angle.

In an optional manner, the attention position includes the user's gaze point on the playback screen, and the program 410 is called by the processor 402 to cause the electronic device to perform the following operations:

When the user watches the free-view video, the user's eyeball movements are tracked to determine the user's focus position on the free-view video on the play screen, and the free-view video to be played and the free-view video to be played are obtained from the video cloud. Camera position information corresponding to free-view video;

Determine the production host location of the free-angle video to be played according to the camera location information;

The production host is determined to be the playback host that plays the free-view video to be played, and the free-view video to be played is played from the perspective of the playback host.

In an optional manner, the attention position includes the user's gaze point on the playback screen, and the program 410 is called by the processor 402 to cause the electronic device to perform the following operations:

Determine the total number of aircraft and the coverage angle difference of all adjacent aircraft based on the aircraft location information;

Determine the target boundary aircraft location according to the offset direction and the total number of aircraft locations;

The sum of the coverage angle differences between the target boundary camera and the playing host position is determined based on the target boundary camera position and the coverage angle differences of all adjacent camera positions.

In the embodiment of the present invention, when the user watches the free-angle video, as the user's main area of concern for the free-angle video changes, the projection point of the user's eyeballs on the playback screen also changes; based on the tracking of the user's eyeball movements, The user's focus position on the free-view video can be determined on the playback screen, and the playback perspective of the free-view video can be switched based on the focus position. It can be seen that the embodiment of the present invention can intelligently identify the user's main area of concern on the free-view video, and further switch the playback angle of the free-view video according to the recognition result, and can realize the switching of the playback angle of the free-view video without manual operation by the user. , which can greatly simplify the process of switching the viewing angle of free-view video and improve the user's viewing experience.

Embodiments of the present invention provide a computer-readable storage medium that stores at least one executable instruction. When the executable instruction is run on an electronic device, it causes the electronic device to execute any of the above method embodiments. How to play free-view videos.

An embodiment of the present invention provides a free-view video playback device, configured to perform the above free-view video playback method.

Embodiments of the present invention provide a computer program, which can be called by a processor to cause an electronic device to execute the free-view video playback method in any of the above method embodiments.

Embodiments of the present invention provide a computer program product. The computer program product includes a computer program stored on a computer-readable storage medium. The computer program includes program instructions. When the program instructions are run on a computer, the computer causes the computer to execute any of the above. The free-view video playback method in the method embodiment.

The algorithms or displays provided herein are not inherently associated with any particular computer, virtual system, or other device. Various general-purpose systems can also be used with teaching based on this. From the above description, the structure required to construct such a system is obvious. Furthermore, embodiments of the present invention are not directed to any specific programming language. It should be understood that a variety of programming languages may be utilized to implement the invention described herein, and that the above descriptions of specific languages are intended to disclose the best mode of carrying out the invention.

In the instructions provided here, a number of specific details are described. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures, and techniques have not been shown in detail so as not to obscure the understanding of this description.

Similarly, it will be understood that in the above description of exemplary embodiments of the invention, various features of embodiments of the invention are sometimes grouped together into a single implementation in order to streamline the invention and assist in understanding one or more of the various inventive aspects. examples, diagrams, or descriptions thereof. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim.

Those skilled in the art will understand that modules in the devices in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. The modules or units or components in the embodiments may be combined into one module or unit or component, and they may be divided into multiple sub-modules or sub-units or sub-components. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method so disclosed may be employed in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of the equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In the element claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, third, etc. does not indicate any order. These words can be interpreted as names. Unless otherwise specified, the steps in the above embodiments should not be understood as limiting the order of execution.

Claims (9)

1. A free-view video playback method, characterized in that the method includes: When the user watches the free-view video, the user's eyeball movements are tracked to determine the user's focus position on the free-view video on the playback screen; the focus position includes the user's gaze point on the playback screen; Switching the playback angle of the free-angle video according to the focus position includes: determining a trigger point that triggers the angle switch according to the gaze point, and determining the offset direction and offset ratio of the trigger point relative to the center point of the playback screen. ; Determine the sum of the coverage angle differences between the target boundary camera and the playing host position according to the offset direction; determine the viewing angle switching according to the sum of the coverage angle differences between the adjacent cameras and the offset ratio. angle, switching the playback angle of the free-angle video according to the angle switching angle. 2. The method according to claim 1, wherein determining the offset direction and offset ratio of the trigger point relative to the center point of the playback screen includes: Determine the screen position of the trigger point, and determine the offset direction of the trigger point relative to the center point of the play screen based on the positional relationship between the screen position and the screen position of the center point of the play screen; Determine the playback screen boundary point corresponding to the offset direction; The coordinate ratio of the trigger point and the playback screen boundary point on the preset screen coordinate axis is determined as the offset ratio of the trigger point relative to the playback screen center point. 3. The method according to claim 1 or 2, characterized in that, before determining the offset direction and offset ratio of the trigger point relative to the center point of the playback screen, the method includes: Determine whether the trigger point is located in a preset trigger area; When the trigger point is located in the preset trigger area, the step of determining the offset direction and offset ratio of the trigger point relative to the center point of the play screen is then performed. 4. The method according to claim 1, wherein determining the viewing angle switching angle based on the sum of the coverage angle differences of the adjacent camera positions and the offset ratio includes: Calculate the product of the sum of the coverage angle differences of adjacent camera positions and the offset ratio; The product is determined as the viewing angle switching angle. 5. The method according to claim 1, characterized in that, when the user watches the free-view video, the user's eyeball movements are tracked to determine the user's focus position on the free-view video on the playback screen. , the method also includes: Obtain the free-view video to be played and the camera location information corresponding to the free-view video to be played from the video cloud; Determine the production host location of the free-angle video to be played according to the camera location information; The production host is determined to be the playback host that plays the free-view video to be played, and the free-view video to be played is played from the perspective of the playback host. 6. The method according to claim 5, wherein determining the sum of the coverage angle differences between adjacent camera positions between the target boundary camera position and the playback host position according to the offset direction includes: Determine the total number of aircraft and the coverage angle difference of all adjacent aircraft based on the aircraft location information; Determine the target boundary aircraft location according to the offset direction and the total number of aircraft locations; The sum of the coverage angle differences between the target boundary camera and the playing host position is determined based on the target boundary camera position and the coverage angle differences of all adjacent camera positions. 7. A free-view video playback device, characterized in that the device includes: A determination module configured to track the user's eye movements when the user watches the free-view video to determine the user's focus position on the free-view video on the playback screen; the focus position includes the user's gaze point on the playback screen. ; A switching module, configured to switch the playback angle of the free-angle video according to the focus position, including: determining a trigger point that triggers the angle switch according to the gaze point, and determining an offset of the trigger point relative to the center point of the playback screen. direction and offset ratio; determine the sum of the coverage angle differences between the target boundary camera and the playing host position according to the offset direction; determine the sum of the coverage angle differences between the adjacent camera positions and the offset according to the offset direction. The shifting ratio determines the viewing angle switching angle, and the playback angle of the free-viewing video is switched according to the viewing angle switching angle. 8. An electronic device, characterized in that it includes: a processor, a memory, a communication interface and a communication bus, and the processor, the memory and the communication interface complete communication with each other through the communication bus; The memory is used to store at least one executable instruction, and the executable instruction causes the processor to perform the operation of the free-view video playback method according to any one of claims 1 to 6. 9. A computer-readable storage medium, characterized in that at least one executable instruction is stored in the storage medium. When the executable instruction is run on an electronic device, the electronic device executes any of claims 1-6. An operation of the free-view video playback method.