WO2016197654A1

WO2016197654A1 - Projection terminal and method thereof for realizing multi-terminal co-screen projection

Info

Publication number: WO2016197654A1
Application number: PCT/CN2016/076889
Authority: WO
Inventors: 付剑楠; 陈伟刚
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-12-09
Filing date: 2016-03-21
Publication date: 2016-12-15
Also published as: CN106856563A

Abstract

A projection terminal and a method thereof for realizing multi-terminal co-screen projection, which relate to communication techniques. The method comprises: a projection terminal receiving image data transmitted by a plurality of connected terminals; and performing co-screen projection and display on the received image data transmitted by the plurality of terminals. The technical solution is mainly used in existing intelligent projection terminal products. Realizing the projection solution of simultaneous access of a plurality of diversified terminals facilitates a user in using same in various scenarios and greatly improves user experience.

Description

Projection terminal and method for realizing multi-terminal same screen projection

Technical field

This article relates to, but is not limited to, communication technology, and in particular to a multi-terminal on-screen projection scheme.

Background technique

Most of the smart projection products currently on the market are based on mirroring technology to complete the projection. Mirroring Technology is a technology solution or virtual network computing (VNC) technology introduced by the Digital Living Network Alliance (DLNA). The use of DLNA technology is the sharing of multimedia files (music, pictures, movies); while VNC emphasizes the control of remote desktops. Currently, the technologies related to mirroring technology mainly include Apple's AirPlay Mirroring and Intel's WiDi. AMD's AWD 3.0, WiGig Alliance's WiGig, Silicon Image UltraGig (Wireless HD), WHDI Alliance's Wireless Digital Home Interface (WHDI), Car Connectivity Consortium's MirrorLink, and Miracast. In addition to WiGig and UltraGig use the 60GHz band, other technologies use 2.4GHz or 5GHz frequency bands, different technologies also have different transmission rates and audio and video formats.

It can be seen from the above that the projection of the current intelligent projection terminal is limited to accessing one terminal for projection, and is point-to-point, and cannot be simultaneously connected to multiple terminals for projection, so that the application is inconvenient and satisfying in many scenarios. Can not meet the diverse needs of users.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

Embodiments of the present invention provide a projection terminal and a method for realizing multi-terminal on-screen projection, which can realize common access projection between multiple terminals.

The embodiment of the invention discloses a method for realizing multi-terminal on-screen projection of a projection terminal, the method comprising:

The projection terminal receives image data transmitted by the connected plurality of terminals;

The projection terminal displays the received image data of the plurality of terminals on the same screen.

Optionally, in the foregoing method, before the projection terminal receives the image data transmitted by the multiple terminals, the method further includes:

The projection terminal establishes a connection with a plurality of terminals;

The projection terminal determines the number N of connected terminals, and divides the projection screen into n blocks of display regions, where N and n are positive integers greater than one.

Optionally, in the above method, the projection terminal performs on-screen projection display of the received image data transmitted by the plurality of terminals, including:

When N=n, the projection terminal respectively projects the received image data transmitted by the N terminals in the n-block display area;

When N<n, the projection terminal respectively projects the image data transmitted by the received image data transmitted by the N terminals in any N display areas in the n block display areas;

When N>n, the projection terminal respectively projects image data transmitted by n terminals of the N terminals in the n-block display area of the same projection screen, and respectively transmits image data transmitted by the remaining Nn terminals. Projected in the Nn block display area of another projection screen.

Optionally, in the foregoing method, the establishing, by the projection terminal, the connection with the multiple terminals includes:

The projection terminal generates a plurality of different wireless network channels, and establishes connections with the plurality of terminals through the generated plurality of different wireless network channels.

Optionally, in the foregoing method, the process in which the projection terminal generates a plurality of different wireless network channels and establishes a connection with multiple terminals through the generated multiple different wireless network channels includes:

When the projection terminal performs pair matching with the terminal, it is determined whether the current pairing match is the first terminal;

If the current pairing matches the first terminal, the first wireless network channel is generated according to the default multimedia access control MAC address, and a link is established with the terminal;

If the current pairing does not match the first terminal, a new virtual MAC address is calculated, a new wireless network channel is generated according to the calculated new virtual MAC address, and a link is established with the terminal.

Optionally, the method further includes: the projection terminal switching the projection mode according to a user operation, The projection manner includes one or more of the following:

The image data transmitted by the plurality of terminals is played by the timed projection, the image data transmitted by the specified one or more terminals is projected and played, and the image data transmitted by the plurality of terminals is sequentially projected and played.

In addition, an embodiment of the present invention further discloses a projection terminal, which mainly includes:

a control module configured to receive image data transmitted by the connected plurality of terminals;

The projection module is configured to perform on-screen projection display on the image data transmitted by the received plurality of terminals.

Optionally, the projection terminal further includes a projection distribution module;

At this time, the control module is further configured to determine the number N of connected terminals;

The projection distribution module is configured to divide the projection screen into n blocks of display areas;

Where N and n are positive integers greater than one.

Optionally, in the foregoing projection terminal, the projection module is configured to perform on-screen projection display of the image data transmitted by the received plurality of terminals by:

When N=n, the received image data transmitted by the N terminals are respectively projected and displayed in the n block display area;

When N<n, image data transmitted by the received image data transmitted by the N terminals are respectively projected into any N display areas in the n block display areas;

When N>n, the image data transmitted by the n terminals of the N terminals are respectively projected in the n-block display area of the same projection screen, and the image data transmitted by the remaining Nn terminals are respectively projected to another image. The Nn block of the projection screen is displayed in the area.

Optionally, in the foregoing projection terminal, the control module is configured to establish a connection with multiple terminals by:

A plurality of different wireless network channels are generated, and a plurality of terminals are respectively established through a plurality of different wireless network channels generated.

Optionally, the foregoing projection terminal further includes a storage module;

The storage module is configured to mark a connected terminal link;

At this time, the control module is configured to generate multiple different wireless networks by: The network channel establishes a connection with the plurality of terminals through the generated multiple different wireless network channels: when pairing and matching with the terminal, determining whether the current pairing match is based on the connected terminal link marked by the storage module a terminal

Optionally, in the foregoing projection terminal, the control module is further configured to switch a projection mode according to a user operation, where the projection manner includes one or more of the following:

The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the above method.

The technical solution of the present application is mainly used in the existing intelligent projection terminal products, and realizes diversification and multiple projections of multiple terminals simultaneously, which is convenient for users to use in various scenarios, thereby greatly improving the user experience.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a flow chart of a method for realizing multi-terminal on-screen projection of a projection terminal according to an embodiment of the present invention;

2 is a schematic structural view of a device provided in an embodiment of the present invention;

FIG. 3 is a flowchart of a method for multi-terminal simultaneous screen projection according to an embodiment of the present invention.

Embodiments of the invention

The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings. It should be noted, The features of the embodiments and the embodiments of the present application may be combined with each other arbitrarily without conflict.

Example 1

As shown in FIG. 1 , the embodiment provides a method for realizing multi-terminal on-screen projection of a projection terminal, which mainly includes the following operations:

The projection terminal receives image data transmitted by a plurality of terminals;

Among them, the on-screen projection display involves the division of the projection screen, and can be divided into horizontal screen, vertical screen, and nine-square grid, and the divided regions may be continuous or dispersed. The projection screen score can be determined according to the number of terminals connected in real time, or can be configured in advance by the system or configured by the user.

It is assumed that the projection terminal first determines the total number N of terminals that have been paired, and the number of projection screen divisions is n, that is, the projection screen is divided into n block display areas, where N and n are positive integers greater than one.

Optionally, the user can perform access setting on the smart projection terminal to meet a scenario in which multiple users need to simultaneously access the smart projection terminal for projection, that is, firstly, according to the number of user access requirements, on the smart projection terminal. The UI user interaction interface selects the number of projections (that is, the number of connected terminals N), and then performs the access of the first terminal, and can perform the matching by using the mirroring technology (such as mirocast technology), and then perform the second matching. At this time, a new miraccast link is established by the smart projection device. At this time, the key is to automatically re-allocate the wifi channel, distinguish the wifi channel accessed by the previous user, and then sequentially connect to complete subsequent user matching; and simultaneously project the device. The division of the screen can be completed according to the number of users (that is, the number of connected terminals), thereby achieving simultaneous projection of multiple users, sharing of resource information, and improving user experience.

For example, if N=n, the image data transmitted by the paired N terminals can be projected into the n block display area.

If N<n, the image data transmitted by the paired N terminals may be projected in any N display areas of the n display areas;

If N>n, the image data transmitted by the n terminals of the paired N terminals may be respectively projected in the n block display area of the same projection screen, and the remaining N-n terminals transmit the image. The data is projected separately in the N-n block display area of the other projection screen. The different projection screens involved may be two projection screen devices, or different pages of the same projection screen device.

It should be noted that, in normal use, it may be necessary to switch between the same screen projection mode and other modes. Therefore, the switching mode operation may be added on the basis of the above method, that is, the projection terminal switches according to the user operation. Projection mode, wherein the projection mode may include one or more of the following:

Timing projection plays a plurality of terminals, and one or more specified terminals are projected and played, and a plurality of terminals are sequentially projected and played.

Example 2

The embodiment provides a projection terminal, which can realize multiple projections on the same screen, and mainly includes the following modules:

The projection module is configured to perform the same screen projection display on the image data transmitted by the received plurality of terminals.

The control module is further configured to determine the total number N of terminals that have been paired.

The projection terminal may further include a projection distribution module, configured to divide the projection screen into n blocks of display areas (specifically, the number of divisions n may be determined in real time, may be default by the system, or may be preset by the user);

Where N and n are positive integers greater than one.

Optionally, when N=n, the projection module is configured to directly transfer the image data transmitted by the N terminals into the n block display area;

When N<n, the projection module is configured to project image data transmitted by the paired N terminals, and respectively project in N display areas of the n block display areas;

When N>n, the projection module is configured to transmit n of the N terminals that are paired and connected. The image data is respectively projected in the n-block display area of the same projection screen, and the image data transmitted by the remaining N-n terminals are respectively projected in the N-n block display area of the other projection screen.

The specific implementation of the projection terminal is further described in detail below with reference to the accompanying drawings and alternatives. The structure of the projection terminal in the alternative is as shown in FIG. 2, including a UI interaction module, a control module, a storage module, and a projection assignment. Module, a projection module. among them:

The UI interaction module is configured to be triggered by the user in the form of a friendly UI interface interaction at the projection terminal, and receives the number of access terminals selected or input by the user.

The control module is connected to the storage module and the projection distribution module. It is set to start the miraccast by calling, and establish a pairing connection with the first terminal user. When the projection terminal is successfully connected with the first terminal, the connection is recorded in the storage module, and is marked with a link such as link 1, and the counter The value is decremented by 1, the initial value of the counter is the value of the access terminal; if the counter value of the storage module is queried, if it is not 0, a new virtual MAC address is calculated, and a new wifi channel is generated, and is established. The connected wifi channel is different. Then through miracast again, establish a connection with the second user on the new wifi channel. Similarly, after the connection is successfully established, the current connection is recorded in the storage module, marked as link2, and the counter is decremented by 1. If the user only sets two terminals, then the value of the counter is 0. When the counter value of the storage module is queried again, if the query reaches 0, the process of building the chain is stopped, and then the projection allocation module is notified, and all the chain construction is completed. , initiate the allocation of screen calculations;

The storage module is connected to the control module and the UI interaction module, and includes an identification unit and a counting unit. The identification unit is configured to store the set total number of access terminals, and identify and record the connections that have been successfully established to distinguish different end users; the counting unit is configured to calculate the number of successful connection attempts.

Projection distribution module: connected to the control module and the storage module. It is set to perform the allocation calculation of the projection screen after the control module completes the access of all the terminals. For example, if four terminals are connected, the screen is divided into four equal parts. It should be noted that this is an optional embodiment. This is to reasonably utilize the screen resources to ensure that the number of display areas divided by the screen is the same as the number of connected terminals. Therefore, the projection distribution module needs to complete the access of all terminals after the control module completes the access. Then perform the allocation calculation of the projection screen to ensure N=n. However, in other solutions, the projection distribution module may not care about the number of connected terminals, so there is no need for the control module to notify the projection distribution module to operate, but the projection screen may be divided in advance.

Projection module: Set to project according to the control of the projection distribution module.

Optionally, when the number of display areas divided by the projection allocation module is n=N, the projection module is configured to directly project image data transmitted by the N terminals directly into the n-block display area.

If N<n, the projection module is configured to project the image data transmitted by the N terminals connected to each other in the N display areas of the n block display areas;

If N>n, the projection module is configured to project the image data transmitted by the n terminals of the paired N terminals in the n block display area of the same projection screen, and transfer the image data of the remaining Nn terminals. , respectively projected in the Nn block display area of another projection screen.

The process of implementing the same-screen projection of the multi-terminal user by the above-mentioned projection terminal will be described below with reference to FIG.

[S201] The projection terminal performs the setting of the total number of projected users (ie, the total number of terminals connected to each other) through the UI interaction interface, and then transfers the value to the next module for storage.

[S202] At the beginning, the storage module accepts the parameters passed by the UI interaction module, saves them, and transmits them to the counting unit of the storage module synchronously. The storage module also receives a message instruction that the connection established by the control module is successfully established. At this time, the identification unit of the storage module marks and stores the completed link, for example, link1. After the identification is successful, the instruction is passed to the counting unit, the minus operation is performed, and the value is passed to the next module.

[S203] The control module first determines whether the parameter received from the counting unit is zero. If the parameter is not zero, the control module needs to start to establish a new link of the next terminal user. If the parameter is zero, the new terminal is terminated. Establishing a link and passing instructions to the screen allocation module;

[S204] The control module first determines whether it is the first user's establishment link request, and if it is the first user, calls the miracast application according to the default MAC address, and establishes a link with the first user through the wifi technology;

[S205] If it is not the first user's establishment link request, the calculation maps out the virtual MAC address, establishes a new wifi channel, and distinguishes the wifi channel used in the previous link establishment, and then starts the miracast application again, in the new The link to the new user is established on the wifi channel.

[S206] The control module first determines whether the current link with the terminal is successful. If the establishment is unsuccessful, the link is re-established, and the connection is required to be re-established in the same manner as the current chain-building requirement. If the link is successfully established, the value of the success parameter is returned to the storage module, and the connection is stored and stored. The counting unit performs a subtraction operation.

[S207] The projection allocation module divides the display area of the screen projection according to the number of access terminals. After all the terminals are built, the command is received from the control module to calculate and allocate the projected area, and the various schemes formed by the distribution are used by the UI interaction module to allow the user to select, for example, access four terminals, and display The solution can be four parts in the vertical direction, four parts in the grid, or four parts in the horizontal direction, and then return to the value projection module according to the user's choice to complete the final projection operation.

In addition, based on the architecture of the above projection terminal, a method of freely alternate projection of multiple terminals can also be realized. At this time, a scheduling unit may be added, and the unit may be used to control a projection order of the multiple access terminals, and the scheduling unit is connected to the identifier unit, the UI interaction module, and the projection module in the storage module.

Since the connections of the completed multiple terminals have been marked and distinguished by the identification unit, the scheduling unit selects these connections as selections for the user to select through the UI interaction interface. After the user selects the completion, the scheduling unit sends an instruction to the projection module according to the user's selection to complete the projection of the terminal. For example, when the user does not want to use the same screen to project multiple terminals, multiple terminals can be played by timing projection to complete timing projection between multiple terminals; a self-selected method can also be adopted, and the user can select which terminal is currently projected, and then It can be switched at any time; increase the diversification of multiple terminal projections, increase the friendly use of terminal projection products, and enhance the user experience.

One of them uses the application scenario. For example, in the discussion of the conference, you can share the data in the respective computers at any time for discussion, or you can project the schemes of several people on the same screen, which is convenient for comparative discussion and greatly improved. The use of smart terminal projectors.

One of ordinary skill in the art will appreciate that all or a portion of the steps described above can be accomplished by a program that instructs the associated hardware, such as a read-only memory, a magnetic or optical disk, and the like. Alternatively, all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the foregoing embodiment may be implemented in the form of hardware or in the form of a software function module. This application is not limited to any specific combination of hardware and software.

The above description is only a preferred example of the present invention and is not intended to limit the protection of the present invention. Wai. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Industrial applicability

The foregoing technical solutions realize diversification and multiple terminals simultaneously access projection, which is convenient for users to use in various scenarios, thereby greatly improving the user experience.

Claims

A method for realizing multi-terminal on-screen projection by a projection terminal, the method comprising:

The projection terminal receives image data transmitted by the connected plurality of terminals;

The projection terminal displays the received image data of the plurality of terminals on the same screen.
The method of claim 1 further comprising:

Before the projection terminal receives the image data transmitted by the plurality of terminals, the projection terminal establishes a connection with the plurality of terminals;

The projection terminal determines the number N of connected terminals, and divides the projection screen into n blocks of display regions, where N and n are positive integers greater than one.
The method of claim 2, wherein the projection terminal performs on-screen projection display of the received image data transmitted by the plurality of terminals comprises:

When N=n, the projection terminal respectively projects the received image data transmitted by the N terminals in the n-block display area;

When N<n, the projection terminal respectively projects the image data transmitted by the received image data transmitted by the N terminals in any N display areas in the n block display areas;

When N>n, the projection terminal respectively projects image data transmitted by n terminals of the N terminals in the n-block display area of the same projection screen, and respectively transmits image data transmitted by the remaining Nn terminals. Projected in the Nn block display area of another projection screen.
The method of claim 2 or 3, wherein the establishing, by the projection terminal, the connection with the plurality of terminals comprises:

The projection terminal generates a plurality of different wireless network channels, and establishes connections with the plurality of terminals through the generated plurality of different wireless network channels.
The method of claim 4, wherein the process of generating a plurality of different wireless network channels by the projection terminal and establishing a connection with the plurality of terminals through the generated plurality of different wireless network channels comprises:

When the projection terminal performs pair matching with the terminal, it is determined whether the current pairing match is the first terminal;

If the current pairing matches the first terminal, then the default multimedia access control MAC The address generates a first wireless network channel and establishes a link with the terminal;

If the current pairing does not match the first terminal, a new virtual MAC address is calculated, a new wireless network channel is generated according to the calculated new virtual MAC address, and a link is established with the terminal.
The method of claim 1 further comprising:

The projection terminal switches the projection mode according to a user operation, wherein the projection manner includes one or more of the following:

The image data transmitted by the plurality of terminals is played by the timed projection, the image data transmitted by the specified one or more terminals is projected and played, and the image data transmitted by the plurality of terminals is sequentially projected and played.
A projection terminal comprising:

a control module configured to receive image data transmitted by the connected plurality of terminals;

The projection module is configured to perform on-screen projection display on the image data transmitted by the received plurality of terminals.
The projection terminal of claim 7, the terminal further comprising a projection allocation module;

The control module is further configured to determine the number N of connected terminals;

The projection distribution module is configured to divide the projection screen into n blocks of display areas;

Where N and n are positive integers greater than one.
The projection terminal of claim 8, wherein the projection module is configured to perform on-screen projection display of the image data transmitted by the received plurality of terminals by:

When N=n, the received image data transmitted by the N terminals are respectively projected and displayed in the n block display area;

When N<n, image data transmitted by the received image data transmitted by the N terminals are respectively projected into any N display areas in the n block display areas;

When N>n, the image data transmitted by the n terminals of the N terminals are respectively projected in the n-block display area of the same projection screen, and the image data transmitted by the remaining Nn terminals are respectively projected to another image. The Nn block of the projection screen is displayed in the area.
The projection terminal according to claim 8 or 9, wherein the control module is configured to establish a connection with a plurality of terminals by:

A plurality of different wireless network channels are generated, and a plurality of terminals are respectively established through a plurality of different wireless network channels generated.
The projection terminal of claim 10, further comprising a storage module;

The storage module is configured to mark a connected terminal link;

The control module is configured to generate a plurality of different wireless network channels by establishing a connection with multiple terminals by using a plurality of different wireless network channels:

When the pairing is matched with the terminal, determining whether the current pairing match is the first terminal according to the connected terminal link marked by the storage module;

If the current pairing matches the first terminal, the first wireless network channel is generated according to the default multimedia access control MAC address, and a link is established with the terminal;

If the current pairing does not match the first terminal, a new virtual MAC address is calculated, a new wireless network channel is generated according to the calculated new virtual MAC address, and a link is established with the terminal.
The projection terminal of claim 7

The control module is further configured to switch the projection mode according to a user operation, where the projection manner includes one or more of the following:

The image data transmitted by the plurality of terminals is played by the timed projection, the image data transmitted by the specified one or more terminals is projected and played, and the image data transmitted by the plurality of terminals is sequentially projected and played.
A computer storage medium having stored therein computer executable instructions for performing the method of any one of claims 1 to 6.