CN117615188A

CN117615188A - Display equipment, terminal and terminal control method

Info

Publication number: CN117615188A
Application number: CN202211584017.7A
Authority: CN
Inventors: 冯伟伟; 刘健; 贾亚洲; 周晓磊; 修建竹
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-12-09
Filing date: 2022-12-09
Publication date: 2024-02-27

Abstract

Some embodiments of the present application show a display device, a terminal, and a terminal control method, where the method includes: responding to a mode switching instruction input by a user, and registering the display device as a human-machine interface device; the method comprises the steps that a terminal sends a pairing request with a man-machine interface device, and the terminal is paired and connected based on the pairing request, so that control data transmission is carried out between a display device and the terminal; responding to a control instruction input by a user, and analyzing the control instruction to determine first control data; encapsulating the first control data into second control data; and sending the second control data to the terminal so that the terminal executes the operation corresponding to the second control data. According to the embodiment of the application, the display equipment is registered as the human-computer interface equipment and is connected with the terminal, and the control instruction input by the user to the display equipment can be converted into the instruction which can be identified by the terminal, so that the user can quickly control the terminal without special equipment of the terminal, and the user experience is improved.

Description

Display equipment, terminal and terminal control method

Technical Field

The application relates to the technical field of display equipment, in particular to display equipment, a terminal and a terminal control method.

Background

With the popularization of smart televisions, the demands of users on the smart televisions are more and more varied. Smart televisions are sometimes required as a large display to provide users with a better experience when using certain terminals. For example: when the user uses the game machine, the game machine can be connected with the intelligent television, so that a game interface can be displayed on a display screen of the intelligent television, and the user can watch the game interface on the display screen to control the game handle, so that better game experience is achieved. However, after the game console is connected with the smart television, the game interface can be controlled only through the game handle, even if the game console is required to control the game console through simple commands such as up-down movement and the like, the game interface is inconvenient to be controlled quickly by a user, and the user experience is poor.

Disclosure of Invention

Some embodiments of the present application provide a display device, a terminal, and a terminal control method, by registering the display device in a man-machine interface device and connecting the display device with the terminal, a control instruction input by a user to the display device can be converted into an instruction identifiable by the terminal, so that the user can quickly control the terminal without using a terminal special device, and user experience is improved.

In a first aspect, some embodiments of the present application provide a display device, including:

A display;

a controller configured to:

responding to a mode switching instruction input by a user, and registering the display device as a human-machine interface device;

receiving a pairing request sent by the terminal and connected with the man-machine interface device, and pairing and connecting the terminal based on the pairing request so as to enable the display device and the terminal to perform control data transmission;

responding to a control instruction input by a user, and analyzing the control instruction to determine first control data;

encapsulating the first control data into second control data, wherein the second control data is data in a human-machine interface device data format;

and sending the second control data to the terminal so that the terminal executes the operation corresponding to the second control data.

In some embodiments, the controller executing the control instructions responsive to user input is further configured to:

and responding to a control instruction input by a user through the control device.

In some embodiments, the controller is configured to register the display device as a human interface device, and is further configured to:

after acquiring that the parameters of the man-machine interface device are configured to be supported, acquiring the type and the descriptor of the man-machine interface device;

Registering the display device with a human interface device based on the parameters, the type, and the descriptor;

the human interface device is set to a discoverable connectable mode.

In some embodiments, the controller is configured to:

if the history pairing information is detected, the history pairing information comprises a terminal and a back connection data packet is sent, the back connection data packet comprises a first physical address and a second physical address, the first physical address is the physical address of the display equipment, and the second physical address is the physical address of the terminal;

and receiving a message of successful reconnection, wherein the message of successful reconnection is that the terminal sends the message to the controller after determining that the second physical address is the physical address of the terminal and the first physical address is the physical address of the terminal history pairing equipment.

In some embodiments, the controller is configured to:

if historical pairing information is detected, the historical pairing information comprises at least two terminals, and the terminal with the nearest connection time with the display equipment is determined;

the method comprises the steps of sending a back connection data packet, wherein the back connection data packet comprises a first physical address and a second physical address, the first physical address is a physical address of display equipment, and the second physical address is a physical address of a terminal which is nearest to the display equipment in connection time; in some embodiments, the controller is configured to:

If the history pairing information is detected, the history pairing information comprises at least two history pairing devices, and the history pairing device with the latest connection time with the display device is determined;

the method comprises the steps of sending a back connection data packet, wherein the back connection data packet comprises a first physical address and a second physical address, the first physical address is a physical address of display equipment, and the second physical address is a physical address of equipment paired with the latest history of connection time of the display equipment;

In some embodiments, the controller performs encapsulation of the first control data into second control data, further configured to:

determining a second control data attribute value corresponding to the first control data based on a control data comparison table;

and encapsulating the second control data attribute value into second control data in a human-machine interface data format.

And if the first control data is not preset control data, packaging the first control data into second control data, wherein the preset control data comprises control data executed by the display device.

In a second aspect, some embodiments of the present application provide a terminal, including:

a controller configured to:

responding to a pairing instruction input by a user, and sending a pairing request to a display device so that the display device can be paired and connected with the terminal based on the pairing request;

and responding to second control data sent by the display equipment, and executing an operation corresponding to the second control data, wherein the second control data is data of which the user inputs a control instruction to the display equipment and the display equipment encapsulates the first control data obtained by analyzing the control instruction into a data format of human-computer interface equipment.

In a third aspect, an embodiment of the present application provides a terminal control method, including:

Some embodiments of the application provide a display device, a terminal and a terminal control method. The method comprises the following steps: after a mode switching instruction input by a user is received, the display device is registered to the human-machine interface device, so that the terminal can find the human-machine interface device and be connected with the human-machine interface device in a pairing mode, and the display device and the terminal can transmit instruction data. After a user inputs a control instruction, the display device analyzes the control instruction, determines first control data corresponding to the control instruction, packages the first control data into second control data in a data format of the human-computer interface device, sends the second control data to the terminal, and the terminal can execute operations corresponding to the user input control instruction. According to the embodiment of the application, the display equipment is registered as the human-computer interface equipment and is connected with the terminal, and the control instruction input by the user to the display equipment can be converted into the instruction which can be identified by the terminal, so that the user can quickly control the terminal without special equipment of the terminal, and the user experience is improved.

Drawings

FIG. 1 illustrates an operational scenario between a display device and a control apparatus according to some embodiments;

fig. 2 shows a hardware configuration block diagram of the control device 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device 200 according to some embodiments;

FIG. 5 illustrates a flow chart of a method for a controller to perform terminal control according to some embodiments;

FIG. 6 illustrates a schematic diagram of a Bluetooth setup interface provided in accordance with some embodiments;

FIG. 7 illustrates a flow chart of a controller performing a switch of modes of a human interface device provided in accordance with some embodiments;

FIG. 8 illustrates a schematic diagram of a first hint interface provided according to some embodiments;

FIG. 9 illustrates a schematic diagram of a second prompt interface provided in accordance with some embodiments;

FIG. 10 illustrates a schematic diagram of a human interface device type selection interface provided in accordance with some embodiments;

FIG. 11 illustrates a functional block diagram of a system provided in accordance with some embodiments;

FIG. 12 illustrates a block flow diagram for a remote control to control a gaming machine, provided in accordance with some embodiments.

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first and second and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for limiting a particular order or sequence, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided in the embodiment of the application may have various implementation forms, for example, may be a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table), and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the display device may receive instructions not using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

As shown in fig. 3, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface.

The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.

The display 260 further includes a touch screen, and the touch screen is used for receiving an action input control instruction such as sliding or clicking of a finger of a user on the touch screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

Referring to FIG. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (referred to as an "application layer"), an application framework layer (Application Framework layer) (referred to as a "framework layer"), a An Zhuoyun row (Android run) and a system library layer (referred to as a "system runtime layer"), and a kernel layer, respectively.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.

As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (manager), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used to interact with all activities that are running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a Package Manager (Package Manager) for retrieving various information about an application Package currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window to display, dithering display, distorting display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In order to solve the above technical problems, the embodiments of the present application provide a display device 200, and the structure and the functions of each part of the display device 200 may refer to the above embodiments. In addition, on the basis of the display device 200 shown in the above embodiment, the present embodiment further improves some functions of the display device 200, and as shown in fig. 5, the controller 250 performs the following steps:

step S501: receiving a mode switching instruction input by a user;

in some embodiments, the step of receiving a user-entered instruction to switch modes includes: and receiving a command for switching the mode of the human-computer interface equipment, which is input by a user through the control device.

In some embodiments, the user enters the setting interface through a menu key of the control apparatus 100, and in the setting interface, the bluetooth control enters the bluetooth setting interface, where the bluetooth setting interface includes a human interface device switching control, and the user may select the human interface device switching control to input an instruction to switch the human interface device mode. Illustratively, as shown in fig. 6, the bluetooth setting interface includes a bluetooth switch control 61, a search bluetooth device control 62, a human interface device switching control 63, a type control 64, and a focus 65, and the user can move the focus 65 to the position of the human interface device switching control 63 and press a confirm key of the control apparatus 100 to input an instruction to switch the human interface device mode.

In some embodiments, the form of identification of the focal point is generally varied. For example, the position of the focus object may be achieved or identified by zooming in on the item, and also by setting the background color of the item, or may be identified by changing the border line, size, color, transparency, outline, and/or font of the text or image of the focus item.

In some embodiments, the user may press a voice key of the control apparatus 100 and speak "switch to human interface device mode" to input an instruction to switch human interface device mode.

In some embodiments, the user may input an instruction to switch to the human interface device mode by pressing a combination key of the control apparatus 100. For example: the user may input an instruction to switch to the human interface device mode by sequentially pressing the up key, the volume up key, and the volume up key of the control apparatus 100.

In some embodiments, the step of receiving a user-entered instruction to switch modes includes: and receiving a command of switching the mode of the human-computer interface device, which is input by a user to the display device.

In some embodiments, the user may initiate a voice function by speaking a far field wake word and speak "switch to human interface device mode" to input an instruction to switch human interface device mode when the display device begins to sound.

In some embodiments, the display includes a touch screen and the user can enter an instruction to switch modes of the human interface device by clicking on a human interface device switch control at the bluetooth setup interface.

Step S502: responding to a mode switching instruction input by a user, and registering the display device as a human-machine interface device;

in some embodiments, in response to a mode switching instruction input by a user, determining whether the display device is currently in a human interface device mode, i.e., determining whether the display device has been registered as a human interface device;

if the display device is not currently in the human-machine interface device mode, namely the display device is not registered as the human-machine interface device, the display device is registered as the human-machine interface device in response to a mode switching instruction input by a user;

if the display device is currently in the human interface device mode, i.e. the display device is registered to the human interface device, the display device is exited from the human interface device mode in response to a mode switching instruction entered by a user.

In some embodiments, the flow of switching the mode of the human interface device is as shown in FIG. 7.

Step S701: the receiving control device sends a control instruction; illustratively, infrared information transmitted by an infrared remote control is received.

Step S702: analyzing the control instruction; illustratively, the infrared data is parsed;

step S703: judging whether the control instruction is an instruction for switching the mode of the man-machine interface equipment;

if the infrared information is a command to switch the mode of the human interface device, step S704 is executed: judging whether the current man-machine interface device mode exists or not;

if the human interface device mode is currently in the human interface device mode, step S705 is performed: control the display to display a first prompt interface, as shown in fig. 8, where the first prompt interface includes first prompt information, a switch control and a cancel switch control, and the first prompt information includes whether the current mode is in the human interface device mode, and is the mode of the non-human interface device?

Step S706: judging whether a switching instruction input by a user is received or not;

if the user selects the switch control, that is, the switch instruction input by the user is received, step S707 is executed: disconnecting the terminal and switching the display equipment to a non-human interface equipment mode;

if the man-machine interface device mode is not currently in, step S708 is performed: control the display to display a second prompt interface, as shown in fig. 9, where the second prompt interface includes second prompt information, a switch control and a cancel switch control, and the second prompt information includes whether the current mode is in the non-human interface device mode, and is the mode of the human interface device is switched?

Step S709: judging whether a switching instruction input by a user is received or not;

if the user selects the switch control, that is, the switch instruction input by the user is received, step S710 is executed: disconnecting the Bluetooth device;

step S711: judging whether to disconnect with the Bluetooth equipment;

if the display device is disconnected from the Bluetooth device, step S712 is performed: switching the display device to a human interface device mode;

if the display device is not disconnected from the bluetooth device, step S710 is continued.

Human-computer interface devices mainly refer to devices for interaction between some people and computers, such as keyboards, mice, joysticks, and the like; the human interface device need not be the human interface device mentioned above but may be considered as a human interface device as long as it meets the requirements of the human interface device level definition specification. Thus, embodiments of the present application register a display device as a human interface device.

In some embodiments, the step of registering the display device with a human interface device comprises:

acquiring parameters of man-machine interface equipment in display equipment;

wherein the parameters of the human interface device are represented by profile. The display equipment is internally provided with a configuration file, and the configuration file comprises intelligent equipment and parameters corresponding to the intelligent equipment. Parameters corresponding to the intelligent device are expressed by true and false. And when the parameter of one intelligent device is true, the characterization display device supports Bluetooth connection as the intelligent device or supports Bluetooth connection with the intelligent device. And when the parameter of one intelligent device is false, the display device is characterized as not supporting Bluetooth connection as the intelligent device or not supporting Bluetooth connection with the intelligent device.

If the parameters of the man-machine interface equipment are configured to be supported, namely the parameters corresponding to the man-machine interface equipment are true, the type and the descriptor of the man-machine interface equipment are obtained;

in some embodiments, before the step of obtaining the type and descriptor of the human interface device, it is necessary to determine whether the human interface device service is successful;

if the service connection of the man-machine interface equipment is successful, the type and the descriptor of the man-machine interface equipment are obtained; the human interface device service is used to invoke the type and descriptor of the human interface device across processes.

In some embodiments, the types of human interface devices include handles, keyboards, mice, and the like. The descriptor is used to characterize the instruction structure. The type of human interface device corresponds to the descriptor. For example: when the type of the man-machine interface device is a handle, the descriptor of the man-machine interface device is an instruction structure corresponding to the handle.

If the current display device supports only one type of human interface device and descriptor, no user selection is required. If the current display device supports multiple human interface device types and descriptors, a user selection is required.

In some embodiments, after receiving a mode switch instruction input by a user, controlling a display to display a selection interface of a human interface device type, the selection interface including at least one type control;

And receiving an instruction of selecting the type control by a user, and registering the display equipment as man-machine interface equipment corresponding to the type control.

Illustratively, as shown in FIG. 10, the selection interface of the human interface device type includes a handle control 101, a keyboard control 102, and a mouse control 103. After the user selects the handle control 101, the display device is registered as a human interface device of the handle type in response to an instruction input by the user.

In some embodiments, in FIG. 6, upon user selection of the type control 64, the type of human interface device is modified and the human interface device is registered directly with the modified human interface device type upon user switching to human interface device mode.

in some embodiments, after registering the display device as a human interface device, a determination is made as to whether the display device is successfully registered as a human interface device;

and if the registration is successful, namely after the successful registration is determined through a callback function, setting the man-machine interface device into a discoverable connectable mode.

In some embodiments, the man-machine interface device is controlled to send a request packet for a bluetooth connection so that the request packet can be received when other bluetooth devices can search for the bluetooth device, so that the other bluetooth devices can discover the man-machine interface device and connect with the man-machine interface device.

After registering as a human interface device, the human interface device may be automatically set to a discoverable connectable mode, or the human interface device may be set to a discoverable connectable mode by user selection.

If the registration of the human interface device is unsuccessful, continuing to perform the step of registering the display device with the human interface device based on the parameter, the type and the descriptor.

Step S503: and receiving a pairing request sent by the terminal and connected with the man-machine interface device, and pairing and connecting the terminal based on the pairing request so as to enable the display device and the terminal to carry out control data transmission.

After the display device registers as the man-machine interface device, it starts to wait for the pairing connection request of other terminals, namely the bluetooth device.

In some embodiments, the terminal includes a gaming machine, computer, or the like.

In some embodiments, after the display device registers with the human interface device, detecting whether there is historical pairing information;

and if no historical pairing information is detected, receiving a pairing request sent by the terminal and matched and connected with the terminal based on the pairing request.

In some embodiments, if no historical pairing information for the human interface device is obtained, the terminal is waited for a pairing request. The user may choose to search for bluetooth devices at the interface of the terminal, at which point the display device, i.e. the man-machine interface device, is discoverable and may be displayed in the interface of the terminal. The user may select a control corresponding to the display device, so that the terminal sends a pairing request to the display device. And the display equipment is paired and connected with the terminal after receiving the pairing request.

In some embodiments, the step of receiving a pairing request sent by the terminal with the human interface device, and pairing and connecting with the terminal based on the pairing request comprises:

receiving a pairing request sent by a terminal;

starting pairing with the terminal based on the pairing request;

wherein the purpose of pairing is to authenticate, encrypt and distribute keys.

Judging whether the pairing is successful;

in some embodiments, the step of determining whether pairing is successful comprises: and judging whether a successful pairing broadcast is received.

If a successful pairing broadcast is received, the display equipment and the terminal are determined to be successfully paired; after the display equipment and the terminal are successfully paired, the pairing information is added into the pairing equipment information so as to be convenient for a user to inquire and confirm.

If the successful pairing broadcast is not received, the display device is determined to be not successfully paired with the terminal.

If the pairing is successful, starting Bluetooth connection with the terminal;

judging whether the Bluetooth connection is successful or not;

the bluetooth connection refers to protocol interaction, i.e. parameters of the two-end devices communicating with the protocol.

In some embodiments, the step of determining whether the bluetooth connection is successful comprises: and judging whether a broadcast of successful Bluetooth connection is received.

If the broadcast of the successful Bluetooth connection is received, the display equipment and the terminal are determined to be successfully connected; after the display device and the terminal are successfully connected, the connection information is added to the Bluetooth device information, so that the user can inquire and confirm the Bluetooth device information.

And if the broadcast of the successful Bluetooth connection is not received, determining that the display device is not successfully connected with the Bluetooth of the terminal.

In some embodiments, if the display device detects that there is history pairing information, the history pairing information includes a terminal (history pairing device), and sends a loopback packet, where the loopback packet includes a first physical address and a second physical address, where the first physical address is a physical address of the display device, and the second physical address is a physical address of the terminal;

when the display device has new pairing information and connection information, the new pairing information and connection information are replaced by the original pairing information and connection information, so that the history pairing information only comprises one terminal.

After receiving the reconnection packet, the terminal judges whether the second physical address is the physical address of the terminal;

if the second physical address is the physical address of the terminal, judging whether the first physical address is the physical address of the terminal history pairing equipment;

If the first physical address is the physical address of the terminal history pairing device, sending back a connection success message to a display device;

the display device can wait for control data transmission after receiving the message of successful connection.

And if the second physical address is not the physical address of the terminal or the first physical address is not the physical address of the terminal history pairing equipment, sending no message of successful connection back. The display device waits for the terminal to send a pairing request.

The physical address refers to a bluetooth physical address (bluetooth mac address).

In some embodiments, the display device determines a first terminal that has a closest connection time to the display device if it detects history pairing information, the history pairing information including at least two terminals (history pairing devices);

when the display device has new pairing information and connection information, the new pairing information and connection information are added into the Bluetooth device information, and the history pairing information comprises all devices paired and connected with the display device.

In some embodiments, the historical pairing information includes a time of pairing and connecting the terminals and corresponding terminals, and a terminal, namely a first terminal, which is closest to the connection time of the display device is determined based on the pairing and connecting time.

The method comprises the steps of sending a back connection data packet, wherein the back connection data packet comprises a first physical address and a second physical address, the first physical address is a physical address of display equipment, and the second physical address is a physical address of a first terminal;

after receiving the reconnection packet, the first terminal judges whether the second physical address is the physical address of the first terminal;

if the second physical address is the physical address of the first terminal, judging whether the first physical address is the physical address of the terminal history pairing device;

And if the second physical address is not the physical address of the terminal or the first physical address is not the physical address of the terminal history pairing equipment, sending no message of successful connection back.

After the display equipment does not receive the back connection successful message sent by the first terminal within the preset time, determining the terminal which is closest to the connection time of the display equipment except the first terminal, namely the second terminal, based on the pairing and connection time.

And sending a back connection data packet, wherein the back connection data packet comprises a first physical address and a third physical address, the first physical address is the physical address of the display equipment, and the third physical address is the physical address of the second terminal. The method sends back the connection packets sequentially according to the time sequence until a message that the connection is successful is sent back by the terminal or a pairing request is sent by a new terminal.

In some embodiments, the terminal is connected to the display device through an HDMI interface such that the display device displays a user interface provided by the terminal.

Step S504: receiving a control instruction input by a user;

in some embodiments, the step of receiving a control instruction input by a user includes: and receiving a control instruction input by a user through the control device.

In some embodiments, the user may enter control instructions by pressing a remote control key. For example: the user can input a control instruction by pressing an upper key of the infrared remote controller.

In some embodiments, the user may input control instructions by clicking or selecting a control on the smart device. The intelligent device and the display device are connected through the router, namely the intelligent device and the display device are in the same local area network. And running an application program capable of controlling the display device on the intelligent device, inputting a control instruction at the intelligent device by a user, and sending the control instruction to the display device through the local area network by the intelligent device. For example: the user may enter control instructions by clicking an up control on the smart device.

In some embodiments, the user may press a voice key of the remote control and speak "move up" to input a control instruction.

In some embodiments, the step of receiving a control instruction input by a user includes: and receiving a control instruction input by a user to the display equipment.

In some embodiments, the user may initiate a voice function by speaking a far field wake-up word and speak "move up" to input control instructions when the display device begins to sound.

In some embodiments, the display includes a touch screen on which a user can slide a finger upward to input instructions to move the focus of the game interface upward.

Step S505: responding to a control instruction input by a user, and analyzing the control instruction to determine first control data;

in some embodiments, receiving infrared data of a control instruction sent by an infrared remote controller, analyzing the infrared data to obtain a key value or a code value of a key pressed by a user, wherein the first control data is the key value or the code value of the key, for example, the code value is 4503;

in some embodiments, voice data corresponding to the voice command is received, the voice data is parsed to obtain voice information, and the first control data is the voice information, for example, the voice information is "move up".

In some embodiments, a movement track of a user's finger touch is received, and the movement track is analyzed to obtain touch information, where the first control data is touch information, for example, the touch information is "up".

Step S506: encapsulating the first control data into second control data, wherein the second control data is data in a human-machine interface device data format;

in some embodiments, the first control data is encapsulated into the second control data.

In some embodiments, determining whether the first control data is the preset control data, the preset control data including control data executed by a display device;

if the first control data is not preset control data, the first control data is packaged into second control data;

and if the first control data is preset control data, executing the operation corresponding to the first control data.

The preset control data includes a code value corresponding to a combination key for controlling the mode switching. And after receiving the control instruction input by the user, analyzing the control instruction. If the parsed first control data is a code value corresponding to a combination key for controlling mode switching, the code value is not encapsulated or converted into second control data, and the mode switching operation is performed by the display device, namely, the mode of the human-machine interface device is switched to the mode of the non-human-machine interface device. And if the parsed first control data is the code value corresponding to the key-up, packaging the first control data into second control data.

In some embodiments, the step of encapsulating the first control data into second control data comprises:

determining the type of the control instruction;

acquiring a control data comparison table corresponding to the type of the control instruction;

in some embodiments, the types of control instructions include infrared instructions, voice instructions, and touch instructions. The corresponding control data expression forms of each control instruction are also different. Different control instruction types set different control data comparison tables. The control data comparison table comprises the corresponding relation between the first control data and the second control data.

Determining a second control data attribute value corresponding to the first control data based on the control data comparison table; for example: the first control data code value 4503 corresponds to a second control data attribute value of 50.

And encapsulating the second control data attribute value into second control data in a human-machine interface data format. For example: the human interface device is of the type a handle, and encapsulates the second control data attribute value in a handle data packet format.

Step S507: and sending the second control data to the terminal so that the terminal executes the operation corresponding to the second control data.

In some embodiments, after the step of encapsulating the first control data into second control data, further comprising:

writing the second control data into a data cache;

the Bluetooth data sending thread reads the second control data from the data cache and sends the second control data to the terminal.

According to the method and the device for processing the Bluetooth data, the plurality of second control data can be stored in the list of the data cache, so that the Bluetooth data sending thread can sequentially read the data from the data cache. The next second control data can be received for processing without waiting for the completion of the processing of one second control data, and the phenomenon of blocking of instruction execution is avoided.

In some embodiments, the first control data may also be written into the data buffer, and after the first control data is read from the data buffer, the first control data is encapsulated into the second control data, and the second control data is sent to the terminal.

Taking the control device as an infrared remote controller and the terminal as a game machine as an example, a system functional block diagram is shown in fig. 11. The game machine and the display device are respectively connected with Bluetooth through an HDMI interface. The infrared controller may control the display device. The display device has the following functional modules: the system comprises a man-machine interface device initialization module, an infrared data analysis module, a man-machine interface device data transmission module, a man-machine interface device mode control module, a man-machine interface device switching module, a data processing and distributing module, a Bluetooth pairing management module, a Bluetooth connection and reconnection module and a remote controller infrared data receiving module.

Taking the control device as an infrared remote controller and the terminal as a game machine as an example, a flow chart is shown in fig. 12. The user presses a key of the infrared remote controller, and the infrared remote controller sends a control instruction to the display device through infrared rays. After receiving the control instruction through infrared, the display device analyzes the infrared data corresponding to the control instruction. If the analysis control instruction is an instruction for switching the man-machine interface device mode, starting Service, initializing the man-machine interface device, registering the display device to the man-machine interface device, and starting the Bluetooth control mode. The game machine initiates a bluetooth connection request to the display device. The display device manages bluetooth pairing and connection with the gaming machine through bluetooth pairing connection and initializes data buffering. And if the control instruction is not the instruction for switching the mode of the man-machine interface device, sending the control instruction to the data cache through the Binder connection interface. And acquiring control instructions from the data cache, generating control data of the human-computer interface device, and sending the control data (instructions) of the human-computer interface device to the game machine. The game machine receives the control data of the man-machine interface device and executes corresponding operation. The game machine displays a game interface, the game machine is connected with a display device, and the display device also displays the game interface. Some embodiments of the present application provide a scheme of controlling a bluetooth game machine by using a display device through an infrared remote controller, wherein the display device is used as a data transmission medium, i.e. the display device is simulated into a handle, so that seamless connection between the remote controller and the game machine is completed, and further, the function of controlling the bluetooth game machine by using an infrared remote controller key is realized.

Some embodiments of the present application simulate a display device to an adult machine interface device, enabling transmission of bluetooth control instructions between the display device and a terminal. The display device is converted into the human-machine interface device, so that the control data of the display device can be conveniently converted into the control data of the human-machine interface device, and the control data of the human-machine interface device can be transmitted to the terminal, so that the control of the terminal is completed. The embodiment of the application supports the control device to rapidly control the display equipment to perform the mode switching of the man-machine interface equipment, and can also be used as the display equipment of the simulation man-machine interface equipment to support the rapid reconnection with the terminal. The embodiment of the application can realize the function of controlling the terminal through the control device.

Some embodiments of the present application provide a terminal control method, which is applicable to a display device, the display device including a display and a controller configured to: responding to a mode switching instruction input by a user, and registering the display device as a human-machine interface device; receiving a pairing request sent by the terminal and connected with the man-machine interface device, and pairing and connecting the terminal based on the pairing request so as to enable the display device and the terminal to perform control data transmission; responding to a control instruction input by a user, and analyzing the control instruction to determine first control data; encapsulating the first control data into second control data, wherein the second control data is data in a human-machine interface device data format; and sending the second control data to the terminal so that the terminal executes the operation corresponding to the second control data. According to the embodiment of the application, the display device is registered as the human-computer interface device and is connected with the terminal, and the control instruction input by the user to the display device can be converted into the instruction which can be identified by the terminal, so that the user can quickly control the terminal without special equipment of the terminal, and the user experience is improved.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized by comprising:

a display;

a controller configured to:

2. The display device of claim 1, wherein the controller executing the control instructions responsive to user input is further configured to:

3. The display device of claim 1, wherein the controller, executing the registration of the display device to a human interface device, is further configured to:

the human interface device is set to a discoverable connectable mode.

4. The display device of claim 1, wherein the controller executing to receive a pairing request sent by the terminal with the human interface device, based on the pairing request paired and connected with the terminal, is further configured to:

5. The display device of claim 4, wherein the controller is configured to:

6. The display device of claim 4, wherein the controller is configured to:

the method comprises the steps of sending a back connection data packet, wherein the back connection data packet comprises a first physical address and a second physical address, the first physical address is a physical address of display equipment, and the second physical address is a physical address of a terminal which is nearest to the display equipment in connection time;

7. The display device of claim 1, wherein the controller performs encapsulation of the first control data into second control data, further configured to:

8. The display device of claim 1, wherein the controller performs encapsulation of the first control data into second control data, further configured to:

9. A terminal, comprising:

a controller configured to:

10. A terminal control method, comprising: