CN114885193A

CN114885193A - Display device, terminal device and screen projection method

Info

Publication number: CN114885193A
Application number: CN202210330493.XA
Authority: CN
Inventors: 肖成创; 庞秀娟
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-03-30
Filing date: 2022-03-30
Publication date: 2022-08-09

Abstract

The invention relates to a display device, a screen projection method and a storage medium, and relates to the technical field of display. The display device includes: a communicator configured to: receiving a screen projection search packet which is sent by a first terminal device and used for finding a screen projection device, wherein the screen projection search packet carries identification information of the first terminal device; a controller configured to: determining whether the identification information of the first terminal device belongs to a preset identification information set or not under the condition that the screen projection mode of the display device is a first mode; intercepting the screen projection search packet when the identification information of the first terminal equipment does not belong to the preset identification information set; and when the identification information of the first terminal equipment belongs to the preset identification information set, responding to the screen projection search packet so that the first terminal equipment discovers the display equipment. The embodiment of the invention is used for solving the problem of privacy disclosure caused by screen misprojection operation.

Description

Display device, terminal device and screen projection method

Technical Field

The invention relates to the technical field of display, in particular to a display device, a terminal device, a screen projection method and a storage medium.

Background

The wireless screen projection is a mode of interaction among multiple screens, and multiple screen interaction of screens of mobile phones, flat panels, televisions, computers, all-in-one machines and the like is common. In the commercial display field, especially in hotel scenes, televisions in multiple rooms run in the same local area network, and all devices of the current local area network can be searched by the screen projection function without any limitation. In the above situation, the number of devices in the device list searched by the user is large, and the user needs to carefully select the television in his/her own room, which causes inconvenience in operation. If a user mistakenly operates and screens other rooms, the problem of privacy disclosure may exist; televisions in other rooms may receive screen shots from others without the knowledge of the customer, which presents a safety problem.

However, most hotel display devices currently disable the screen projection function by default. Although the safety problem is avoided, the user cannot watch the screen in the hotel, and the user experience is poor.

Disclosure of Invention

In order to solve the technical problems or at least partially solve the technical problems, the invention provides a display device, a terminal device, a screen projection method and a storage medium, which can ensure that a user device can only interact with a specified display device under the condition that the display device is in a hotel mode, ensure that the user device can only discover and project the specified display device during screen projection operation, and avoid the safety problem and the privacy leakage problem caused by screen misprojection operation.

In order to achieve the above purpose, the technical solutions provided by the embodiments of the present invention are as follows:

in a first aspect, there is provided a display device comprising:

a communicator configured to: receiving a screen projection search packet which is sent by a first terminal device and used for finding a screen projection device, wherein the screen projection search packet carries identification information of the first terminal device;

a controller configured to: determining whether the identification information of the first terminal device belongs to a preset identification information set or not under the condition that the screen projection mode of the display device is a first mode;

intercepting the screen projection search packet when the identification information of the first terminal equipment does not belong to the preset identification information set;

and when the identification information of the first terminal equipment belongs to the preset identification information set, responding to the screen projection search packet so that the first terminal equipment discovers the display equipment.

As an optional implementation manner of the embodiment of the present invention, the display device further includes:

a display configured to: displaying an access address of a target webpage, wherein the target webpage is used for managing the preset identification information set;

the communicator further configured to: receiving an adding request sent by a second terminal device through the target webpage, wherein the adding request carries identification information of the second terminal device;

the controller further configured to: and adding the identification information of the second terminal equipment to the preset identification information set.

the controller further configured to: and when request information for requesting management of the preset identification information set is received, randomly generating an access address of the target webpage.

As an optional implementation manner of the embodiment of the present invention, the controller is further configured to: generating a two-dimensional code for accessing the target webpage according to the access address of the target webpage;

the display is specifically configured to: and displaying the two-dimensional code and the access address of the target webpage.

As an optional implementation manner of the embodiment of the present invention, the controller is further configured to: and when the display equipment meets a preset condition, clearing the identification information in the preset identification information set.

As an optional implementation manner of the embodiment of the present invention, the controller is further configured to: intercepting a screen projection notification packet sent by the display equipment under the condition that the screen projection mode of the display equipment is a first mode;

the screen projection notification package is used for enabling a receiving device of the screen projection notification package to find the display device when the screen is projected.

As an optional implementation manner of the embodiment of the present invention, the controller is further configured to: and under the condition that the screen projection mode of the display equipment is the second mode, responding to the screen projection search packet so that the first terminal equipment discovers the display equipment.

In a second aspect, a terminal device is provided, which includes:

an input interface configured to: acquiring an access address of a target webpage, wherein the target webpage is used for managing a preset identification information set;

a display configured to: displaying the target webpage according to the access address of the target webpage;

a communicator configured to: sending an adding request to display equipment through the target webpage, wherein the adding request carries identification information of the terminal equipment and is used for requesting the display equipment to add the identification information of the terminal equipment to the preset identification information set;

the communicator further configured to: and sending a screen projection search packet for finding the screen projection equipment to the display equipment, wherein the screen projection search packet carries the identification information of the terminal equipment, so that the display equipment responds to the screen projection search packet when determining that the identification information of the terminal equipment belongs to the preset identification information set.

In a third aspect, a screen projection method is provided, which is applied to a display device, and includes:

receiving a screen projection search packet which is sent by a first terminal device and used for finding a screen projection device, wherein the screen projection search packet carries identification information of the first terminal device;

determining whether the identification information of the first terminal device belongs to a preset identification information set or not under the condition that the screen projection mode of the display device is a first mode;

As an optional implementation manner of the embodiment of the present invention, the method further includes:

displaying an access address of a target webpage, wherein the target webpage is used for managing the preset identification information set;

receiving an adding request sent by a second terminal device through the target webpage, wherein the adding request carries identification information of the second terminal device;

and adding the identification information of the second terminal equipment to the preset identification information set.

and when request information for requesting management of the preset identification information set is received, randomly generating an access address of the target webpage.

generating a two-dimensional code for accessing the target webpage according to the access address of the target webpage;

and displaying the two-dimensional code and the access address of the target webpage.

and when the display equipment meets a preset condition, clearing the identification information in the preset identification information set.

intercepting a screen projection notification packet sent by the display equipment under the condition that the screen projection mode of the display equipment is a first mode;

and under the condition that the screen projection mode of the display equipment is the second mode, responding to the screen projection search packet so that the first terminal equipment discovers the display equipment.

In a fourth aspect, the present invention provides a screen projection method, which is applied to a terminal device, and the method includes:

acquiring an access address of a target webpage, wherein the target webpage is used for managing preset identification information;

displaying the target webpage according to the access address of the target webpage;

sending an adding request to display equipment through the target webpage, wherein the adding request carries identification information of the terminal equipment and is used for requesting the display equipment to add the identification information of the terminal equipment to the preset identification information set;

and sending a screen projection search packet for finding the screen projection equipment to the display equipment, wherein the screen projection search packet carries the identification information of the terminal equipment, so that the display equipment responds to the screen projection search packet when determining that the identification information of the terminal equipment belongs to the preset identification information set.

In a fifth aspect, the present invention provides a computer-readable storage medium comprising: the computer-readable storage medium stores thereon a computer program which, when executed by a processor, implements the screen projecting method as shown in the third or fourth aspect.

In a sixth aspect, the present invention provides a computer program product comprising: when the computer program product runs on a computer, the computer is caused to implement the screen projection method as shown in the third aspect or the fourth aspect.

The display device and the screen projecting method provided by the embodiment of the invention have the advantages that the display device firstly receives a screen projecting search packet which is sent by a first terminal device and used for discovering the screen projecting device, then determines whether the identification information of the first terminal device belongs to a preset identification information set or not under the condition that the screen projecting mode of the display device is a first mode, and intercepts the screen projecting search packet when the identification information of the first terminal device does not belong to the preset identification information set, so that the situation that the terminal device which does not belong to the preset representation information set is connected with the display device to project a screen can be avoided, the privacy disclosure problem is further avoided, and the screen projecting search packet is responded when the identification information of the first terminal device belongs to the preset identification information set, so that the first terminal device can discover the display device to project the screen, and the user information safety is guaranteed.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the related art, the drawings used in the description of the embodiments or the related art will be briefly described below, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.

Fig. 1 is a schematic view of an operation scenario between a display device and a control apparatus according to an embodiment of the present invention;

fig. 2 is a block diagram of a hardware configuration of the control device 100 according to an embodiment of the present invention;

fig. 3 is a block diagram of a hardware configuration of a display device 200 according to an embodiment of the present invention;

FIG. 4 is a diagram illustrating an interface of the display device 200 according to an embodiment of the present invention;

fig. 5 is a second display diagram of the interface of the display device 200 according to the embodiment of the present invention;

FIG. 6 is an illustration of an interface diagram of a screen projection method according to one or more embodiments of the invention;

fig. 7 is a second display diagram of an interface of a screen projection method according to one or more embodiments of the present invention;

fig. 8 is a schematic diagram of software configuration in a display device 200 according to one or more embodiments of the present invention;

fig. 9 is a flowchart of a method of a screen projection method applied to a display device according to an embodiment of the present invention;

fig. 10 is a second flowchart of a screen projection method applied to a display device according to an embodiment of the present invention;

fig. 11 is a third diagram of an interface of a screen projection method according to one or more embodiments of the present invention;

fig. 12 is a fourth diagram of an interface of a screen projection method according to one or more embodiments of the present invention;

fig. 13 is a fifth diagram of an interface of a screen projection method according to one or more embodiments of the present invention;

fig. 14 is a sixth diagram of an interface of a screen projection method according to one or more embodiments of the present invention;

fig. 15 is a flowchart of a screen projection method applied to a display device according to an embodiment of the present invention.

Detailed Description

In order that the above objects, features and advantages of the present invention may be more clearly understood, a solution of the present invention will be further described below. It should be noted that the embodiments of the present invention and features of the embodiments may be combined with each other without conflict.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways than those described herein; it is to be understood that the embodiments described in this specification are only some embodiments of the invention, and not all embodiments.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided by the embodiment of the present application may have various implementation forms, and for example, the display device may be a television, a smart television, a laser projection device, a display (monitor), an electronic whiteboard (electronic whiteboard), an electronic desktop (electronic table), and the like.

Exemplarily, as shown in fig. 1, fig. 1 is a schematic view of an application scenario of a display device according to an embodiment of the present invention, and in fig. 1, a user may operate a display device 200 through a control apparatus 100 or a terminal device 300.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may input a user command through a key on a remote controller, voice input, control panel input, etc. to control the display apparatus 200.

In some embodiments, the display device 200 may also be controlled using a smart device (e.g., a mobile terminal, a tablet, a computer, a laptop, etc.). For example, the display device 200 is controlled using an application running on the smart device.

In some embodiments, the terminal device 300 may install a software application with the display 200, implement connection communication through a network communication protocol, and implement the purpose of one-to-one control operation and data communication. The audio and video content displayed on the terminal device 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

In some embodiments, the display device 200 may receive the user's control by means of touch or gesture, etc., instead of receiving the instruction using the smart device 300 or the terminal device 300 described above.

In some embodiments, the display device 200 may also be controlled in a manner other than the terminal device 300 and the smart device 300, for example, a screen projection search packet for finding a screen projection device sent by the terminal device 300 may be directly received by a module configured inside the display device 200 and receiving the screen projection search packet, or the screen projection search packet may be received by a communicator provided outside the display device 200.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200. The Communication interface 130 is used for external Communication, and includes at least one of a wireless network Communication technology WIFI chip, a bluetooth module, NFC (Near Field Communication) or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a key, or an alternative module.

As shown in fig. 3, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

The tuner demodulator 210 receives a broadcast television signal through a wired or wireless reception manner, and demodulates an audio/video signal, such as an EPG (Electronic Program Guide) data signal, from a plurality of wireless or wired broadcast television signals.

The communicator 220 is a component for communicating with an external device or a server according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the external control apparatus 100 or the server 400 through the communicator 220.

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display apparatus 200.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving image display, a component for receiving an image signal from the controller output, performing display of video content, image content, and a menu manipulation interface, and a user manipulation UI interface. For example, the display may be at least one of a liquid crystal display, an OLED (Organic Light-Emitting semiconductor) display, a touch display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.

The User may enter User commands in a Graphical User Interface (GUI) displayed on display 260, and the User input Interface receives the User input commands through the GUI. Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor. A "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables the conversion of the internal form of information to a form acceptable to the user. A common presentation form of a user interface is a graphical user interface, which refers to a user interface displayed in a graphical manner and related to computer operations. For example, as shown in fig. 4 or fig. 5, it may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. A user interface for receiving a control signal of the terminal device 300 (e.g., an infrared remote controller, etc.).

In some embodiments, the screen-projection mode of the display device 200 may be: hotel mode, non-hotel mode. The hotel mode means that the screen projection function is closed; the non-hotel mode refers to that a screen projection function is turned on, and any user terminal can search screen projection equipment to project a screen. After the display device 200 is started, the hotel mode switch selection interface is directly entered, as shown in fig. 4, when the display state of the switch button on the right side of the "hotel mode enabled" is no filling, the display device 200 turns off the screen projection function. As shown in fig. 5, when the button on the right of the "hotel mode enabled" displays the status as filled, the display apparatus 200 turns on the screen projection function.

In some embodiments, the communicator 220 is configured to receive a screen projection search packet sent by the first terminal device and used for discovering the screen projection device, where the screen projection search packet carries identification information of the first terminal device. The identification information may be a UUID (universal Unique Identifier). The UUID is calculated based on the current time, a counter (counter), and hardware identification. The hardware identifier is usually a Media Access Control Address (MAC Address) of the wireless network card. According to the standard calculation established by the open software foundation, the UUID is generated by using an Ethernet address, nanosecond time, a chip ID (identification number) code and a random number, so that the UUID is ensured to be unique to all machines in the same air at the same time.

The controller 250 determines whether the identification information of the first terminal device belongs to the preset identification information set when the screen projection mode of the display device is the hotel mode, that is, the screen projection function of the display device is turned off. The preset identification information set refers to a firewall white list, namely an identification information set of equipment which cannot intercept the screen projection search packet.

In some embodiments, the controller 250 intercepts a screen projection search packet transmitted by the user terminal device when the representation information of the user terminal device is not in the firewall white list. That is, when the identification information of the first terminal device does not belong to the preset identification information set, the controller 250 is configured to intercept the screen projection search packet.

In one case, for DLNA (Digital Living Network Alliance) device screen projection, the controller 250 needs to intercept a UDP search packet transmitted from an external device of SSDP (Simple Service Discovery Protocol) to the tv 1900 port. Among them, SSDP is an application layer protocol that provides a mechanism for discovering devices within a local network.

Alternatively, for apple device screen projection, the controller 250 needs to intercept UDP packets sent by an external device of mDNS (Multicast Domain Name System) to the port of the television 5353. The mDNS is multicast DNS (multicast DNS), and the mDNS mainly realizes that hosts in a local area network can discover and communicate with each other without a conventional DNS server, uses a port 5353, complies with a DNS protocol, and uses an existing DNS information structure, name syntax, and resource record type.

In some embodiments, a second device discovery mode, i.e., a screen-cast notification packet that the display device 200 actively multicasts or broadcasts device information to the outside, is also intercepted.

In one case, for the DLNA device, it is necessary to intercept the UDP notification packet transmitted from the display device 200 to the external device terminal 1900 port.

In another case, for the apple device, it is necessary to intercept the UDP notification packet sent from the display device 200 to the external device terminal 5353 port.

In some embodiments, the controller 250 is responsive to a screen projection search packet sent by the user terminal device to cause the user terminal device to discover the display device when the identification information of the user terminal device is within the firewall white list. That is, when the identification information of the first terminal device belongs to the preset identification information set, the controller 250 is configured to respond to the screen projection search packet to cause the first terminal device to discover the display device.

Therefore, the display device 200 first determines whether the switch of the hotel mode is turned on, that is, whether screen projection needs to be performed one-to-one, and if the switch of the hotel mode is not turned on, it indicates a normal home scene, and does not need to intercept a screen projection search request packet sent by the user terminal device or intercept a screen projection notification packet sent by the display device to the user terminal device. If the switch of the hotel mode is turned on, a screen projection search request packet sent by the user terminal equipment needs to be intercepted, and a screen projection notification packet sent to the user terminal equipment by the display equipment needs to be intercepted. The mode that the firewall intercepts the screen projection search packet and the screen projection notification packet can ensure that the user equipment can only interact with the appointed display equipment under the condition that the display equipment is in a hotel mode, ensures that the user equipment can only discover and project the appointed display equipment when screen projection operation is carried out, and avoids the safety problem and the privacy leakage problem caused by screen misprojection operation.

In some embodiments, the display 260 is configured to display the access address of the target web page. The target webpage is used for managing a preset identification information set. For example, the target webpage is used for adding, deleting or modifying the preset identification information set.

The communicator 220 is further configured to receive an addition request sent by the second terminal device through the target web page. Wherein the addition request carries identification information of the second terminal device. The second terminal device may be the first terminal device, or may be another terminal device, and is not limited specifically here. For example, after scanning the two-dimensional code through the browser, the user terminal device 300 may access the URL (Uniform Resource Locator) address, open a one-to-one binding operation web page, and the page may automatically or under the operation of the user send a binding HTTP request to the display device. Correspondingly, the communicator 220 receives an HTTP request transmitted from the user terminal.

The controller 250 is further configured to add the identification information of the second terminal device to the preset identification information set.

In some embodiments, the controller 250 is further configured to randomly generate the access address of the target web page when receiving request information for requesting management of the preset identification information set. The display device opens the application bound to the screen projection, refer to application 3 in the left side column of fig. 6, where application 3 serves as the user terminal device to which the screen projection function is assigned to be opened. And the application 3 starts a Web page Server HTTP Web Server and generates a random URL address pointing to the one-to-one binding operation Web page. For example, http://192.168.1.10: xxxx/abcde, where 192.168.1.10 is the IP address of the display device, and xxxx is an optional port number, which may be 8090, for example, or another port number not intercepted by the firewall. The abcde part is randomly generated, and is different each time.

In some embodiments, the controller 250 is further configured to generate a two-dimensional code for accessing the target webpage according to the access address of the target webpage. The controller 250 generates a corresponding two-dimensional code according to the webpage access address randomly generated in the above steps, thereby facilitating access to the target webpage.

And a display 260 further configured to display the two-dimensional code generated by the controller 250. For example, referring to fig. 7, the display displays a two-dimensional code generated from a random URL.

In some embodiments, the controller 250 is further configured to clear the identification information in the preset identification information set when the display device satisfies a preset condition.

The preset condition may be screen turning, standby, power off, and the like. When the display device meets the preset condition, the identification information in the device intercepting white list is removed, namely, the identification information of all the user terminal devices in the device intercepting white list is removed.

For example, it is a case that the controller 250 clears identification information of all user terminal devices intercepting the white list only in a case where the display device 200 is powered off. Alternatively, the controller 250 removes the identification information of all the user terminal devices intercepting the white list in case that the display device is in a standby state or is turned off. In another case, under the condition that the display device is turned off, the controller 250 may remove the identification information of all the user terminal devices intercepting the white list, and the effect of removing the identification information of all the user terminal devices intercepting the white list is the same as the above two cases, that is, the privacy of the user is prevented from being revealed; the identification information of the current user terminal equipment intercepting the white list can also be reserved, so that the same user can conveniently connect the display 200 again for screen projection after leaving for a short time. The above-listed situations can be set according to actual requirements, and are not limited specifically here.

In some embodiments, the controller 250 is further configured to respond to the screen projection search package to cause the first terminal device to discover the display device if the screen projection mode of the display device is a non-hotel mode.

In this embodiment, the screen projection mode of the display device is the second mode, that is, the non-hotel mode, which indicates that the display device is in a normal home scene, as shown in fig. 4, the controller 250 does not need to perform a data packet interception operation, and normally responds to the screen projection search packet sent by the user terminal device, so that the user terminal device discovers the display device.

In some embodiments, a screen projection search packet sent by a first terminal device and used for discovering screen projection devices is received, and then, under the condition that a screen projection mode of a display device is a first mode, whether identification information of the first terminal device belongs to a preset identification information set or not is determined, when the identification information of the first terminal device does not belong to the preset identification information set, the screen projection search packet is intercepted, so that the situation that the terminal device which does not belong to the preset representation information set is connected with the display device to project a screen, and further the privacy disclosure problem is avoided, when the identification information of the first terminal device belongs to the preset identification information set, the screen projection search packet is responded, so that the first terminal device can discover the display device to project the screen, and the user information safety is guaranteed.

In some embodiments, the input interface is configured to obtain an access address of the target web page. The target webpage is used for managing a preset identification information set. For example, the target webpage is used for adding, deleting or modifying the preset identification information set.

In some embodiments, the display device 200 may directly enter a display interface of a signal source selected last time after being started, or a signal source selection interface, where the signal source may be a preset video-on-demand program, or may be at least one of an HDMI interface, a live tv interface, and the like, and after a user selects a different signal source, the display may display content obtained from the different signal source.

A display configured to display the target web page according to the access address of the target web page.

A communicator configured to transmit an addition request to the display device through the target web page. The adding request carries identification information of the terminal device, and is used for requesting to display the identification information of the terminal device added to the preset identification information set.

A communicator configured to transmit a screen projection search packet for discovering a screen projection device to the display device. The screen projection search packet carries identification information of the terminal device, so that the display device responds to the screen projection search packet when determining that the identification information of the terminal device belongs to a preset identification information set.

In some embodiments, the terminal device first obtains an access address of a target webpage, then displays the target webpage according to the access address of the target webpage, then sends an addition request to the display device through the target webpage, and finally sends a screen projection search packet for the screen projection device to the display device.

Referring to fig. 8, in some embodiments, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 8, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

To explain the present solution in more detail, the following will be described in an exemplary manner with reference to fig. 9, and it is understood that, although the steps in the flowcharts of fig. 9 and 10 are sequentially shown as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 9 and 10 may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or stages is not necessarily sequential, but may be performed alternately or alternately with other steps or at least some of the sub-steps or stages of other steps. The screen projection method provided by the embodiment of the invention can be realized.

The device discovery mode generally comprises two modes of multicast or broadcast search of user terminal devices, device information reply after a television receives a search packet, and device information multicast or broadcast actively outwards by the television, and discovery is completed after the user terminal devices receive the device information.

Fig. 9 is a flowchart of method steps of a screen projection method according to an embodiment of the present invention, and referring to fig. 9, the screen projection method according to the embodiment of the present invention is applied to a display device, and includes the following steps S901 to S904:

the first device discovery method, that is, the user terminal device performs multicast or broadcast search, and the tv replies the device information after receiving the search packet, is described below as an example.

S901, receiving a screen projection search packet which is sent by a first terminal device and used for finding a screen projection device.

And the screen projection search packet carries the identification information of the first terminal equipment.

It can be understood that the identification information may be a UUID, and may also be an IP Address (Internet Protocol Address), a MAC Address (Media Access Control Address, local area network Address), a device serial number, and the like.

S902, determining whether the identification information of the first terminal device belongs to a preset identification information set or not under the condition that the screen projection mode of the display device is a first mode.

The screen projection mode of the display device may be: hotel mode, non-hotel mode. The hotel mode refers to turning off the screen projection function; the non-hotel mode refers to the mode of opening a screen projection function, and any user terminal can search screen projection equipment to project a screen in the non-hotel mode. The first mode in this embodiment is a hotel mode.

And presetting an identification information set, namely a firewall white list, namely the identification information set of the equipment which is not intercepted by the screen projection search packet.

And S903, intercepting the screen projection search packet when the identification information of the first terminal equipment does not belong to the preset identification information set.

Exemplarily, as shown in fig. 11, the identification information of the user terminal device in the device interception white list is: 192.168.137.202. for example, when the identification information of the first terminal device is 192.168.137.200, and the representation information of the user terminal device is not in the device interception white list, the controller intercepts a screen projection search packet sent by the first terminal device.

In this embodiment, for DLNA device screen projection, a UDP (user datagram Protocol) search packet sent to a television 1900 port by an external device that needs to intercept SSDP (Simple Service Discovery Protocol) is one of the cases. In the IPv4 environment, when it is necessary to transmit related messages using a multicast manner, SSDP generally uses a multicast address 239.255.255.250 and a UDP port number 1900. SSDP may also be referred to herein as a device discovery protocol that provides a mechanism for discovering devices within a local network. For example, taking a common iptables firewall as an example, the intercepting instruction is: iptables-I INPUT-p udp-dport 1900-j DROP, that is, dropping (intercepting) a screen-shot search packet sent by an external terminal device in udp protocol through a port of 1900. The main function of the iptables is to realize control of network data packet access and forwarding. Further, UDP provides connectionless communication, suitable for transmitting small amounts of data at a time, and the reliability of UDP transmission is taken care of by the application layer. Commonly used UDP port numbers are: 53(DNS), 69(TFTP), 161(SNMP), using the UDP protocol comprising: TFTP (Simple File Transfer Protocol), SNMP (Simple Network Management Protocol), BOOTP (Bootstrap Protocol), DNS (Domain Name Server), and the like.

In another case, for the apple device to screen, the external device that needs to intercept mDNS sends UDP packets to the tv 5353 port. The mDNS protocol specifies a port of 5353 and a port of the DNS of 53. The mDNS is based on the UDP protocol. Wherein the DNS protocol is built on top of UDP or TCP protocol, and the port number 53 is used by default. The client side communicates through a UDP protocol by default, but because the wide area network is not suitable for transmitting overlarge UDP data packets, when the message length exceeds 512 bytes, the data transmission can be converted into data transmission by using a TCP protocol. mDNS services are provided on apple devices (e.g., computers, notebooks, iphones, ipads, etc.). For example, taking a common iptables firewall as an example, the intercepting instruction is: iptables-I INPUT-p udp-dport 5353-j DROP. That is, the screen shot search packet transmitted in the UDP protocol through the port of 5353 by the external terminal device is dropped (intercepted).

And S904, when the identification information of the first terminal equipment belongs to the preset identification information set, responding to the screen projection search packet so that the first terminal equipment discovers the display equipment.

Illustratively, as shown in fig. 11, when the identification information of the first terminal device is 192.168.137.202, and the representation information of the user terminal device is in the firewall white list, the controller responds to the screen projection search packet sent by the first terminal device, so that the first terminal device discovers the display device.

In some embodiments, a second device discovery mode, that is, a mode in which the television actively multicasts or broadcasts device information to the outside and a screen projection notification packet, is also intercepted.

And intercepting a screen projection notification packet sent by the display equipment under the condition that the screen projection mode of the display equipment is the first mode. The screen projection notification packet is used for enabling a receiving device of the screen projection notification packet to find the display device when the screen is projected.

In this embodiment, one case is that, for a DLNA device, it is necessary to intercept a UDP notification packet sent by a display device to an external device terminal 1900 port. For example, taking a common iptables firewall as an example, the intercepting instruction is: iptables-I OUTPUT-p udp-dport 1900-j DROP, i.e., DROP (intercept) a screen projection notification packet that the display device transmits in udp protocol to the 1900 port of the external terminal device.

In another case, for the apple device, the UDP notification packet sent from the display device to the external device terminal 5353 port needs to be intercepted. For example, taking a common iptables firewall as an example, the intercepting instruction is: iptables-I OUTPUT-p udp-dport 5353-j DROP, i.e., dropping (intercepting) a screen projection notification packet sent by the display device in udp protocol to the 5353 port of the external terminal device.

In addition, it should be noted that the present solution is also applicable to other screen projection protocols, but the types of the data packets to be processed are different, and here, the two types of screen projection protocols are merely exemplified and are not limited specifically.

In some embodiments, when the controller receives a request for managing a preset information set, the access address of the target web page is randomly generated.

In this embodiment, the display device opens the application bound to the screen projection, refer to application 3 in the left column of fig. 6, where application 3 serves as the user terminal device to which the screen projection function is assigned. And the application 3 starts a Web page Server HTTP Web Server and generates a random URL address pointing to the one-to-one binding operation Web page. For example, http://192.168.1.10: xxxx/abcde, where 192.168.1.10 is the IP address of the display device, and xxxx is an optional port number, which may be 8090, for example, or another port number not intercepted by the firewall. The abcde part is randomly generated, and is different each time.

By means of randomly generating the access address of the target webpage, the bound page can be accurately accessed only when the address is acquired, and the binding of the display equipment by user terminal equipment which does not acquire the address is avoided.

In some embodiments, the controller generates a two-dimensional code for accessing a target webpage according to an access address of the target webpage; and displaying the two-dimensional code and the access address of the target webpage by a display.

Illustratively, the controller generates the two-dimensional code according to the random URL generated in fig. 6, and the display displays the two-dimensional code generated according to the URL, as shown in fig. 7. It can be understood that the display displays the two-dimensional code and also displays the access address of the web page, so that for equipment without a camera or equipment inconvenient in shooting operation, correct access to the bound page can be realized by inputting the access address of the web page, and further, the binding of the display equipment by user terminal equipment which does not acquire the address or the two-dimensional code is avoided.

In some embodiments, after performing step S904 on the basis of fig. 9, as shown in fig. 10, the display device further performs the following steps:

and S905, displaying the access address of the target webpage.

The target webpage is used for managing a preset identification information set.

S906, receiving an adding request sent by the second terminal device through the target webpage.

Wherein the addition request carries identification information of the second terminal device.

In some embodiments, the user terminal device sends an HTTP request to the display device by inputting a URL address randomly generated by the display device or scanning a two-dimensional code, a TCP connection is established when the HTTP request is sent, and the display device acquires an IP address of the terminal device.

And S907, adding the identification information of the second terminal equipment into the preset identification information set.

In the present embodiment, the display device displays the access address of the target web page, as shown in fig. 6. The user terminal device can access the URL address after scanning the two-dimensional code through the browser, one-to-one binding operation webpage is opened, and the webpage can automatically or under the operation of the user send a binding HTTP request to the display device. And the display equipment receives an adding request sent by the user terminal equipment through the target webpage and adds the identification information of the user terminal equipment to the preset identification information set.

For example, the web server of the display device may obtain an IP address of the user terminal device from the TCP connection information, add the IP address to the device interception white list, and no longer intercept the screen projection search packet sent by the user terminal device to the display device. But still keeps intercepting the screen projection search packet of other user terminal equipment and the screen projection notification packet sent by the display equipment.

By the method, when only the terminal equipment in the equipment interception white list actively searches, the screen projection application program of the display equipment can receive the screen projection search packages of the terminal equipment and normally respond, and other terminal equipment cannot find the display equipment by searching or receiving the notification.

For example, as shown in fig. 11, taking the IP address of the user terminal device as 192.168.137.202 to be added to the device interception white list, for the user terminal device using the SSDP device discovery protocol, the adding instruction is: iptables-I INPUT-s192.168.137.202-p udp-dport 1900-j ACCEPT. For the user terminal equipment using the mDNS equipment discovery protocol, the adding instruction is: iptables-I INPUT-s192.168.137.202-p udp-dport 5353-j ACCEPT.

Furthermore, after the binding is finished, the application needs to exit, and the webpage server is closed, so that the binding can be carried out only when the user opens the application. Multiple devices can operate repeatedly, and the added or covered policy maintenance device interception white list can be selected. For example, referring to fig. 12, in order to add the device interception list of the user terminal device, the IP address of the added user terminal device 2 is: 124.128.136.160, the added IP address of the user terminal device 3 is: 192.168.137.200, respectively; referring to fig. 13, in order to delete the device interception list of the user terminal device, the IP address of the user terminal device 3 is deleted.

In some embodiments, when the display device meets a preset condition, the identification information in the preset information set is cleared.

The preset condition may be screen turning, standby, power off, and the like.

For example, as shown in fig. 14, when the display device meets the preset condition, the removal device intercepts the identification information in the white list, that is, the removal device intercepts the identification information of all the user terminal devices in the white list.

For example, one case is that only in the case where the display device is turned off, the identification information of all the user terminal devices intercepting the white list is cleared. In another case, the identification information of all the user terminal devices intercepting the white list is removed when the display device is in standby or power-off. Therefore, after the guest is replaced in the room, new user terminal equipment can be bound again, and the privacy information of the previous user is protected.

It can be understood that, under the condition that the display device displays the screen, the identification information of all the user terminal devices intercepting the white list can be removed, and the identification information of the current user terminal device intercepting the white list can also be reserved, so that the same user can conveniently connect to screen again after leaving for a short time. The above conditions can be set according to actual requirements, and are not particularly limited herein.

In some embodiments, in a case where the screen projection mode of the display device is the second mode, the screen projection search packet is responded to cause the first terminal device to discover the display device.

In this embodiment, the screen projection mode of the display device is the second mode, that is, the non-hotel mode, which indicates a normal home scene, and does not require data packet interception, and the display device responds to the screen projection search packet sent by the user terminal device, so that the user terminal device discovers the display device.

Fig. 15 is a flowchart of a method of screen projection according to an embodiment of the present invention, and referring to fig. 15, the screen projection method according to the embodiment of the present invention is applied to a terminal device, and includes the following steps S151 to S154:

and S151, the terminal equipment acquires the access address of the target webpage.

The target webpage is used for managing the preset identification information.

And S152, the terminal equipment displays the target webpage according to the access address of the target webpage.

S153, the terminal device sends an adding request to the display device through the target webpage.

The adding request carries identification information of the terminal device, and is used for requesting the display device to add the identification information of the terminal device to the preset identification information set.

S154, the terminal device sends a screen projection search packet for finding the screen projection device to the display device.

The screen projection search packet carries identification information of the terminal device, so that the display device responds to the screen projection search packet when determining that the identification information of the terminal device belongs to a preset identification information set.

An embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process executed by the screen projection method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

The present invention provides a computer program product comprising: when the computer program product runs on a computer, the computer is enabled to realize the screen projection method.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the foregoing discussion in some embodiments is not intended to be exhaustive or to limit the implementations to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

2. The display device according to claim 1, characterized in that the display device further comprises:

3. The display device according to claim 2, characterized in that the display device further comprises:

4. The display device according to claim 2,

the controller further configured to: generating a two-dimensional code for accessing the target webpage according to the access address of the target webpage;

5. The display device according to claim 1,

the controller further configured to: and when the display equipment meets a preset condition, clearing the identification information in the preset identification information set.

6. The display device according to any one of claims 1 to 5,

the controller further configured to: intercepting a screen projection notification packet sent by the display equipment under the condition that the screen projection mode of the display equipment is a first mode;

7. The display device according to any one of claims 1 to 5,

the controller further configured to: and under the condition that the screen projection mode of the display equipment is the second mode, responding to the screen projection search packet so that the first terminal equipment discovers the display equipment.

8. A terminal device, comprising:

9. A screen projection method is applied to a display device, and comprises the following steps:

10. A screen projection method is applied to terminal equipment, and comprises the following steps: