WO2023279887A1

WO2023279887A1 - Device control method and apparatus, control system, device, and storage medium

Info

Publication number: WO2023279887A1
Application number: PCT/CN2022/095266
Authority: WO
Inventors: 张烨
Original assignee: Oppo广东移动通信有限公司
Priority date: 2021-07-08
Filing date: 2022-05-26
Publication date: 2023-01-12
Also published as: CN115604672A

Abstract

A device control method and apparatus, a control system, a device, and a storage medium, relating to the technical field of UWB. The method comprises: receiving data frames sent by UWB tags (201); determining a target UWB tag from the UWB tags on the basis of the data frames, the target UWB tag being a UWB tag pointed to by a remote control device (202); sending a connection instruction to a terminal device on the basis of the target UWB tag, such that the terminal device establishes a data communication connection with a target IoT device represented by the target UWB tag (203); and in response to a control operation for the remote control device, sending a control instruction to the terminal device, such that the terminal device controls the target IoT device on the basis of the control instruction (206). In embodiments of the present application, a user points the remote control device to an IoT device to be controlled, and the IoT device can be controlled by means of a control operation without directly operating a terminal device, such that the device control efficiency is improved.

Description

Equipment control method, device, control system, equipment and storage medium

This application claims the priority of the Chinese patent application with the application number 202110772638.7 and the title of the invention "equipment control method, device, control system, equipment and storage medium" filed on July 8, 2021, the entire contents of which are incorporated by reference in In this application.

technical field

The embodiments of the present application relate to the field of UWB technologies, and in particular to a device control method, device, control system, device, and storage medium.

Background technique

With the continuous development of Internet of Things (IoT) technology, more and more IoT devices can be linked with terminal devices.

In related technologies, when a user needs to use a terminal device to control an IoT device at home, he can select the IoT device to be controlled in the device selection interface displayed on the terminal device, trigger the terminal device to establish a connection with the IoT device, and further connect the terminal device to the IoT device. Operate on the displayed control interface to realize the control of IoT devices.

Contents of the invention

Embodiments of the present application provide a device control method, device, control system, device, and storage medium. Described technical scheme is as follows:

On the one hand, an embodiment of the present application provides a device control method, which is applied to a remote control device, and the method includes:

Receive data frames sent by each ultra wide band (Ultra Wide Band, UWB) tag, the UWB tag is used to characterize the IoT device;

Based on the data frame, determine a target UWB tag from each of the UWB tags, where the target UWB tag is the UWB tag pointed to by the remote control device;

Based on the target UWB tag, send a connection instruction to the terminal device, so that the terminal device establishes a data communication connection with the target IoT device represented by the target UWB tag;

In response to a control operation on the remote control device, a control instruction is sent to the terminal device, so that the terminal device controls the target IoT device based on the control instruction.

On the other hand, an embodiment of the present application provides a device control method, which is applied to a terminal device, and the method includes:

receiving a connection instruction sent by the remote control device, the connection instruction is sent when the remote control device determines a target UWB tag from the UWB tags, and the target UWB tag is the UWB tag pointed to by the remote control device;

Based on the connection instruction, establish a data communication connection with the target IoT device represented by the target UWB tag;

receiving a control instruction sent by the remote control device;

The target IoT device is controlled based on the control instruction.

On the other hand, an embodiment of the present application provides an apparatus for controlling equipment, and the apparatus includes:

A receiving module, configured to receive data frames sent by each UWB tag, where the UWB tag is used to represent an IoT device;

A determining module, configured to determine a target UWB tag from each of the UWB tags based on the data frame, where the target UWB tag is the UWB tag pointed to by the remote control device;

A sending module, configured to send a connection instruction to a terminal device based on the target UWB tag, so that the terminal device establishes a data communication connection with the target IoT device represented by the target UWB tag;

The sending module is further configured to send a control instruction to the terminal device in response to a control operation on the remote control device, so that the terminal device controls the target IoT device based on the control instruction.

The first receiving module is configured to receive a connection instruction sent by the remote control device, the connection instruction is sent when the remote control device determines a target UWB tag from the UWB tags, and the target UWB tag is the UWB tag pointed to by the remote control device ;

A connection module, configured to establish a data communication connection with the target IoT device represented by the target UWB tag based on the connection instruction;

a second receiving module, configured to receive a control instruction sent by the remote control device;

A control module, configured to control the target IoT device based on the control instruction.

On the other hand, an embodiment of the present application provides a control system for an IoT device, the system includes a remote control device, a terminal device, a UWB tag, and an IoT device;

The UWB tag is used to characterize the IoT device;

The remote control device receives data frames sent by each of the UWB tags; based on the data frames, a target UWB tag is determined from each of the UWB tags, and the target UWB tag is the UWB tag pointed to by the remote control device; based on The target UWB tag sends a connection instruction to the terminal device;

The terminal device receives the connection instruction sent by the remote control device; based on the connection instruction, establishes a data communication connection with the target IoT device represented by the target UWB tag;

The remote control device sends a control instruction to the terminal device in response to a control operation on the remote control device;

The terminal device receives the control instruction sent by the remote control device; and controls the target IoT device based on the control instruction.

On the other hand, an embodiment of the present application provides a remote control device, the remote control device includes: a processor, a memory, and a UWB component; the memory stores at least one program, and the at least one program is used to be used by the processor Execute to realize the device control method described in the above aspects.

On the other hand, an embodiment of the present application provides a terminal device, the terminal device includes: a processor and a memory; the memory stores at least one program, and the at least one program is used to be executed by the processor to implement The device control method as described in the above aspects.

On the other hand, an embodiment of the present application provides a computer-readable storage medium, at least one program is stored in the computer-readable storage medium, and the at least one program is loaded and executed by a processor to implement the above-mentioned A device control method on the remote control device side, or a device control method on the terminal device side.

On the other hand, an embodiment of the present application provides a computer program product, the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium; a processor of a computer device reads the computer-readable storage medium from the computer-readable storage medium. Computer instructions, the processor executes the computer instructions, so that the computer device executes the device control method on the remote control device side, or the device control method on the terminal device side described in the above aspect.

Description of drawings

FIG. 1 shows a schematic diagram of an implementation environment of an exemplary embodiment of the present application;

FIG. 2 shows a flowchart of a device control method provided in an exemplary embodiment of the present application;

Fig. 3 is the implementation diagram of the data frame receiving process shown in an exemplary embodiment of the present application;

Fig. 4 is an interactive schematic diagram of a device control process shown in an exemplary embodiment of the present application;

FIG. 5 shows a flow chart of a device control method provided in another exemplary embodiment of the present application;

FIG. 6 shows a flowchart of a device control method provided in another exemplary embodiment of the present application;

FIG. 7 shows a flow chart of a device control method provided in another exemplary embodiment of the present application;

Fig. 8 is a schematic diagram of a remote control device shown in an exemplary embodiment of the present application;

FIG. 9 shows a flow chart of a device control method provided in another exemplary embodiment of the present application;

Fig. 10 is a schematic diagram of the implementation of the intelligent curtain remote control process shown in an exemplary embodiment of the present application;

Fig. 11 is a flow chart of a control instruction sending process shown in an exemplary embodiment of the present application;

Fig. 12 shows a structural block diagram of an equipment control device provided by an embodiment of the present application;

Fig. 13 shows a structural block diagram of an equipment control device provided by an embodiment of the present application;

Fig. 14 shows a structural block diagram of a remote control device provided by an exemplary embodiment of the present application;

Fig. 15 shows a structural block diagram of a terminal device provided by an exemplary embodiment of the present application;

Fig. 16 shows a structural block diagram of a device control system provided by an exemplary embodiment of the present application.

detailed description

In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

Please refer to FIG. 1 , which shows a schematic diagram of an implementation environment of an exemplary embodiment of the present application. The implementation environment includes a terminal device 110 , at least one IoT device 120 , a UWB tag 130 and a remote control device 140 .

The terminal device 110 is an electronic device with an IoT device control function, and the terminal device 110 may be a portable electronic device such as a smart phone, a tablet computer, a smart remote controller, or a smart watch. Optionally, the IoT device control function is implemented through an application program (or applet) installed in the terminal device 110 .

The IoT device 120 is an electronic device that can establish a data communication connection with the terminal device 110, and it may be a smart TV 122, a smart speaker 121, a smart door lock 123, a smart refrigerator, a smart air conditioner, a smart lamp, and a smart curtain. The IoT device 120 and the terminal device 110 can perform information interaction through a data communication connection, realize the control of the IoT device 120 by the terminal device 110, and/or present device data of the IoT device 120 on the terminal device 110 side. The data communication connection may be a WiFi connection, a Bluetooth connection, an infrared connection, etc., which is not limited in this embodiment of the present application.

The UWB tag 130 is an electronic tag for characterizing the IoT device 120 . In one possible design, UWB tag 130 is independent of IoT device 120 . Independence means that the UWB tag 130 is a device independent of the IoT device 120 and can be sold as a product alone, rather than being integrated in the IoT device 120 as a part of the IoT device 120 , nor is it a necessary component of the IoT device 120 . And when the binding between UWB tag 130 and IoT device 120 is completed, UWB tag 130 and IoT device 120 do not have a data communication connection relationship, but only have a binding relationship. The binding relationship refers to the IoT device 120 whose representation can be determined through the UWB tag 130 . As shown in FIG. 1 , the UWB tag 131 is used to represent the IoT device 121 , the UWB tag 132 is used to represent the IoT device 122 , and the UWB tag 132 is used to represent the IoT device 123 .

Of course, in other possible designs, the UWB tag 130 can also be integrated in the IoT device 120 as a part of the IoT device 120 , that is, the IoT device 120 has the UWB function when it leaves the factory. Optionally, data communication can be performed between the UWB tag 130 and the IoT device 120.

Regarding the power supply mode of the UWB tag 130, in a possible design, the UWB tag 130 is provided with an independent power supply, and the independent power supply may be a replaceable power supply, a non-replaceable power supply or a rechargeable power supply. In another possible design, the UWB tag 130 is powered by the IoT device 120, and the power supply mode of the IoT device 120 may include wired power supply (such as through a charging cable) or wireless power supply (such as through a wireless charging coil).

The remote control device 140 is an electronic device capable of spatial position awareness. In a possible design, the remote control device 140 is independent from the terminal device 110 , but can perform data communication with the terminal device 110 . Wherein, the data communication mode between the remote control device 140 and the terminal device 110 may include WiFi connection, Bluetooth connection, infrared connection, etc., which is not limited in this embodiment of the present application.

The spatial location awareness capability means that the remote control device 140 can perceive the spatial location relationship between it and other devices. In the embodiment of the present application, the spatial location awareness capability of the remote control device 140 is realized by means of UWB components and the UWB tag 130 representing the IoT device 120 . The remote control device 140 can perform UWB communication with the UWB tag 130 through the UWB component, that is, the remote control device 140 can receive the data frame sent by the UWB tag 130 on the target channel through the UWB component, and according to the data frame sent by the UWB tag 130, determine The spatial position relationship between itself and the UWB tag 130 .

In a possible design, the remote control device 140 is provided with a remote control, which can be a physical button, a touch panel, etc. in one form or a combination of multiple forms, and the user can realize the corresponding control by triggering the remote control Features. For example, the volume of the smart speaker 121 can be controlled by clicking a physical button, and the smart TV 122 can be controlled to switch channels by performing a sliding operation on the touch panel.

In other possible designs, the remote control device 140 is provided with a sensor, so as to recognize the user's gesture operation based on the sensor data collected by the sensor, and then realize the corresponding control function based on the gesture operation.

In a possible application scenario, as shown in FIG. 1 , the UWB tag 131 is bound to the smart speaker 121 , the UWB tag 132 is bound to the smart TV 122 , and the UWB tag 133 is bound to the smart door lock 123 . When the user uses the remote control device 140 to point to the smart TV 122, the remote control device 140 can determine the currently pointed UWB tag 132 according to the data frame sent by each IoT device corresponding to the UWB tag 130, and indicate the smart TV represented by the terminal 110 and the UWB tag 132. Television 122 establishes a data communication connection. Further, the remote control device 140 sends a control command to the terminal 110 according to the received control operation, and the terminal 110 controls the smart TV 122 based on the control command, such as controlling the smart TV 122 to switch channels, adjust the volume, and so on.

Please refer to FIG. 2, which shows a flow chart of a device control method provided by an exemplary embodiment of the present application. The embodiment of the present application takes the application of the method in the implementation environment shown in FIG. 1 as an example. The method includes:

In step 201, the remote control device receives data frames sent by each UWB tag, and the UWB tag is used to represent the IoT device.

In a possible implementation manner, after the UWB tag is bound to the characterized IoT device, the UWB tag is in a working state. Wherein, the bound UWB tag can be pasted on the represented IoT device, or, the UWB tag can be placed near the represented IoT device, or, the UWB tag can be placed far away from the represented IoT device, or, the UWB tag The tag is placed inside the represented IoT device. The embodiment of the present application does not limit the installation position of the UWB tag.

In the working state, the UWB tag sends data frames on the target channel; correspondingly, the remote control device in the working state receives the data frames sent by each UWB tag on the target channel.

In order to avoid mutual interference caused by different UWB tags sending data frames at the same time, in a possible implementation, before the UWB tag sends data frames on the target channel, it first needs to listen to the target channel to determine the channel state of the target channel . When the channel state of the target channel is idle (that is, not occupied), the UWB tag will send the data frame; when the channel state of the target channel is occupied (that is, occupied), the UWB tag will send the data frame again after a random delay. Listen to the target channel.

In step 202, the remote control device determines a target UWB tag from each UWB tag based on the data frame, and the target UWB tag is the UWB tag pointed to by the remote control device.

After receiving the data frame, the remote control device determines the spatial position relationship between each UWB tag and the remote control device, and determines the UWB tag currently pointed to by itself as the target UWB tag.

In a possible implementation manner, the remote control device determines the spatial position relationship with the UWB tag according to the phase difference when the data frame arrives at the antenna. Moreover, in order to determine the positional relationship with the UWB tag in the horizontal direction and the vertical direction, the remote control device is provided with two sets of antenna groups corresponding to different antenna directions, namely the first antenna group and the second antenna group, and each An antenna group consists of two antennas (there may or may not be a shared antenna). Wherein, the first antenna group and the second antenna group have preset included angles (such as 60 degrees, 90 degrees), which are respectively used to measure the angle in the horizontal direction and the angle in the vertical direction.

Among them, the remote control device can use the angle of arrival (Angle of Arrival, AOA) or phase difference of arrival (Phase Difference of Arrival, PDoA) technology to perform spatial positioning based on the data frame.

Optionally, the remote control device first receives data frames on the target channel through the first antenna group, and then switches to the second antenna group to receive data frames on the target channel when the data frame receiving duration of the first antenna group reaches a preset duration.

Schematically, as shown in Figure 3, the remote control device first receives the data frames sent by UWB tags 1-4 on the target channel through the first antenna group, and then switches through the second antenna group to receive the data frames sent by UWB tags 1-4 on the target channel. Data frames sent on the channel.

In some embodiments, after determining the horizontal angle and the vertical angle between each UWB tag, the remote control device determines the UWB tag whose horizontal angle is in the horizontal angle range and whose vertical angle is in the vertical angle range as Target UWB tag. For example, the horizontal angle range may be -10 degrees to 10 degrees, and the vertical angle range may be 0 degrees to 30 degrees, which are not limited in this embodiment of the present application.

Schematically, the remote control device determines the spatial position relationship with each UWB tag as follows: UWB tag A (horizontal angle -30 degrees, vertical angle 10 degrees); UWB tag B (horizontal angle -2 degrees, vertical angle angle 10 degrees); UWB tag C (horizontal angle 35 degrees, vertical angle 5 degrees); UWB tag D (horizontal angle 60 degrees, vertical angle 20 degrees). If the horizontal angle ranges from -10 degrees to 10 degrees, and the vertical angle ranges from 0 degrees to 30 degrees, since the spatial position relationship between UWB tag B and the remote control device is within this angle range, the remote control device determines UWB tag B as the target UWB tags.

Step 203, the remote control device sends a connection instruction to the terminal device based on the target UWB tag.

Since the remote control device is independent of the terminal device and does not have the ability to directly control the IoT device, after determining the target UWB tag, the remote control device needs to send a connection command to the terminal device through a communication connection with the terminal device, instructing the terminal device Establish a data communication connection with the target IoT device represented by the target UWB tag.

Optionally, a Bluetooth connection is established between the remote control device and the terminal device, and the remote control device sends a connection instruction to the terminal device through the Bluetooth connection.

In some embodiments, the connection instruction includes information indicating the target UWB tag, or includes information indicating the target IoT device represented by the target UWB tag.

Optionally, in order to reduce the probability of misoperation, the remote control device sends a connection instruction to the terminal device based on the target UWB tag when it determines that it is currently pointing to the target UWB tag and the pointing time reaches a duration threshold (such as 2s).

Step 204, the terminal device receives the connection instruction sent by the remote control device.

Optionally, the terminal device receives the connection instruction sent by the remote control device through the Bluetooth connection.

Step 205, based on the connection instruction, the terminal device establishes a data communication connection with the target IoT device represented by the target UWB tag.

Optionally, the terminal device determines the target IoT device to be controlled based on the information contained in the connection instruction, and establishes a data communication connection with the target IoT device through the connection mode corresponding to the target IoT device, so as to communicate with the target IoT device through the data communication connection. IoT devices exchange data. Wherein, the data communication connection between the terminal device and the target IoT device may be a Bluetooth connection, a WiFi connection, or an infrared connection, etc., which is not limited in this embodiment.

Step 206, in response to the control operation on the remote control device, the remote control device sends a control instruction to the terminal device.

Different from related technologies, the IoT device needs to be controlled through the control interface displayed by the terminal device. In this embodiment, the user only needs to control and operate the remote control device to achieve indirect control of the target IoT device by means of the terminal device. Wherein, the control operation on the remote control device may be a trigger operation on the remote control on the remote control device, or a gesture operation on the remote control device.

After receiving the control operation, the remote control device sends a corresponding control instruction to the terminal device based on the received operation type of the control operation. Optionally, the remote control device sends control instructions to the terminal device through the Bluetooth connection.

Step 207, the terminal device receives the control instruction sent by the remote control device.

Optionally, the terminal device receives the control instruction sent by the remote control device through the Bluetooth connection.

Step 208, the terminal device controls the target IoT device based on the control instruction.

Since different IoT devices have different functions, the terminal device needs to analyze the received control command to determine the device function controlled by the control command, and then control the target IoT device through the data communication connection with the target IoT device based on the analysis result. The device performs the corresponding device function.

In a schematic example, as shown in FIG. 4 , after the UWB tag 41 is bound to the IoT device 42 , data frames are broadcast on the target channel. When using the remote control device 43 to align the UWB tag 41, the remote control device 43 performs UWB angle measurement on the received data frame to determine that the UWB tag 41 is facing, so as to send a connection instruction through the Bluetooth connection with the terminal device 44, and the terminal The device 44 establishes a WiFi connection with the IoT device 42 based on the connection instruction. Further, the remote control device 43 sends a control command to the terminal device 44 through the Bluetooth connection according to the received control operation, and the terminal device 44 and the control command control the IoT device 42 through the WiFi connection.

To sum up, in the embodiment of this application, the remote control device determines the target UWB tag pointed to by itself based on the data frames sent by each UWB tag, and sends a connection instruction to the terminal device, indicating that the terminal device and the target UWB tag indicate After the IoT device establishes a connection, it further sends a control command to the terminal device based on the received control operation, and the terminal device controls the target IoT device based on the control command; using the solution provided in the embodiment of this application, the user points the remote control device to the IoT device that needs to be controlled. device, and control the IoT device through control operations, without directly operating the terminal device, which improves the efficiency of device control; and, for IoT devices that can establish a data communication connection with the terminal device, the remote control device can pass The solution provided by the embodiment of the present application controls it, which enriches the usage scenarios of the remote control device.

Optionally, based on the target UWB tag, send a connection instruction to the terminal device, including:

Based on the data frame sent by the target UWB tag, send a connection instruction including the target tag ID to the terminal device, so that the terminal device can determine the target IoT device from the mapping relationship between the UWB tag and the IoT device based on the target tag ID.

Optionally, based on the data frame sent by the target UWB tag, send a connection instruction including the target tag identification to the terminal device, including:

The target tag ID is obtained from the data frame sent by the target UWB tag, and a connection instruction including the target tag ID is sent to the terminal device.

Based on the data frame sent by the target UWB tag, a connection instruction including the target device ID is sent to the terminal device, so that the terminal device determines the target IoT device based on the target device ID.

Optionally, based on the data frame sent by the target UWB tag, send a connection instruction containing the target device identification to the terminal device, including:

Obtain the target tag identification from the data frame sent by the target UWB tag;

Based on the target tag identification, the target device identification is obtained from the mapping relationship between the UWB tag and the IoT device;

A connection instruction including the target device identifier is sent to the terminal device.

Optionally, the target device identifier is obtained from the mapping relationship between the UWB tag and the IoT device;

Methods also include:

Receive and store the configuration data sent by the terminal device, and the configuration data includes the mapping relationship between UWB tags and IoT devices.

Obtain the target device ID from the data frame sent by the target UWB tag, and send a connection instruction containing the target device ID to the terminal device.

Optionally, in response to the control operation on the remote control device, sending a control command to the terminal device, including:

In response to a trigger operation on the target remote control on the remote control device, a control instruction including the target control identifier is sent to the terminal device, so that the terminal device determines the target device function controlled by the target remote control control based on the target control identifier.

In response to the target gesture operation on the remote control device, a control instruction including target gesture operation information is sent to the terminal device, so that the terminal device determines the target device function controlled by the target gesture operation based on the target gesture operation information.

Optionally, in response to the control operation on the remote control device, before sending the control instruction to the terminal device, the method includes:

Receive connection feedback information sent by the terminal device, where the connection feedback information is used to indicate the establishment of a data communication connection between the terminal device and the target IoT device;

In response to the control operation on the remote control device, send control instructions to the terminal device, including:

In the case that the connection feedback information indicates that the data communication connection is established successfully, execute the step of sending a control command to the terminal device in response to a control operation on the remote control device.

Optionally, after receiving the connection feedback information sent by the terminal device, the method further includes:

When the connection feedback information indicates that the establishment of the data communication connection fails, a connection failure prompt is given, wherein the connection failure prompt includes at least one of a vibration prompt, a voice prompt, or an indicator light prompt;

Send the connection command to the terminal device again.

Optionally, receive data frames sent by each UWB tag, including:

In the dormant state, in response to a trigger operation on the control on the remote control device, the UWB component is turned on, and the data frames sent by each UWB tag are received through the UWB component.

Optionally, receive data frames sent by each UWB tag, including:

In the dormant state, when the sensor data collected by the sensor indicates that the remote control device is in motion, the UWB component is turned on, and the data frames sent by each UWB tag are received through the UWB component.

Optionally, a Bluetooth connection is established between the remote control device and the terminal device.

Optionally, based on the connection instruction, establish a data communication connection with the target IoT device represented by the target UWB tag, including:

Obtain the target tag ID contained in the link instruction;

Based on the target tag identification, the target IoT device is determined from the mapping relationship between the UWB tag and the IoT device;

Based on the target connection mode corresponding to the target IoT device, establish a data communication connection with the target IoT device.

Obtain the target device identification contained in the connection instruction;

Determining the target IoT device based on the target device identifier;

Based on the target connection mode corresponding to the target IoT device, establish a data communication connection with the target IoT device;

Wherein, the target connection mode includes at least one of Bluetooth and WiFi.

Optionally, the target device identifier contained in the connection instruction is obtained by the remote control device from the mapping relationship between the UWB tag and the IoT device;

Methods also include:

Send configuration data to the remote control device, so that the remote control device stores the configuration data, and the configuration data includes the mapping relationship between UWB tags and IoT devices.

Optionally, control the target IoT device based on the control command, including:

Obtain the target control ID contained in the control instruction, where the target control ID is the ID of the target remote control triggered on the remote control device;

Determine the target device function controlled by the target remote control based on the target control identifier;

Control the target IoT device to execute the target device function;

Methods also include:

The control setting information is obtained, and the control setting information includes the corresponding relationship between the device identifier, the device function and the control identifier.

Obtain target gesture operation information included in the control command, where the target gesture operation information is used to represent the target gesture operation received by the remote control device;

Based on the target gesture operation information, determine the target device function controlled by the target gesture operation;

Control the target IoT device to execute the target device function;

Methods also include:

Gesture setting information is acquired, and the gesture setting information includes a correspondence between device identifiers, device functions, and gesture operation information.

Optionally, based on the connection instruction, after establishing a data communication connection with the target IoT device represented by the target UWB tag, the method further includes:

Send connection feedback information to the remote control device, where the connection feedback information is used to indicate the establishment of the data communication connection between the terminal device and the target IoT device.

When the data communication connection is successfully established, the device control interface corresponding to the IoT device is displayed, and the device control interface includes the functional controls corresponding to the IoT device;

In response to the trigger operation on the function control in the device control interface, the IoT device is controlled to execute the corresponding device function.

In a possible implementation manner, the connection instruction sent by the remote control device to the terminal device includes the target tag identifier of the target UWB tag, and the terminal device determines the target IoT device represented by the target UWB tag based on the target tag identifier. On the basis of FIG. 2 , as shown in FIG. 5 , step 203 can be replaced with step 203A, and step 205 can be replaced with 205A.

Step 203A, based on the data frame sent by the target UWB tag, the remote control device sends a connection instruction including the target tag identifier to the terminal device.

Optionally, the data frame sent by each UWB tag contains its own tag identifier. After the remote control device determines the target UWB tag, it obtains the target tag identifier from the data frame sent by the target UWB tag, and sends a message containing the target tag to the terminal device. Identifies the connection directive.

Step 205A, the terminal device obtains the target tag ID included in the connection instruction; based on the target tag ID, determine the target IoT device from the binding relationship between the UWB tag and the IoT device; based on the target connection method corresponding to the target IoT device, connect with the target IoT device Establish a data communication connection.

Optionally, the terminal device stores the binding relationship between each UWB tag and the IoT device. After receiving the connection instruction, the terminal device can search for the target UWB tag from the binding relationship according to the target tag identification contained in the connection instruction. The target device ID of the target IoT device represented by the tag.

Schematically, the binding relationship between the UWB tag and the IoT device is shown in Table 1.

Table I

UWB标签UWB tags	IoT设备IoT devices
UWB AUWB A	智能冰箱smart refrigerator
UWB BUWB B	智能电视smart tv
UWB CUWBC	智能窗帘smart curtain

Since the terminal device communicates with different IoT devices in different ways, for example, the terminal device communicates with some IoT devices through a Bluetooth connection, and communicates with some IoT devices through a WiFi connection. Therefore, after the target IoT device is determined, the terminal device further Based on the target connection mode corresponding to the target IoT device, establish a data communication connection with the target IoT device.

In a possible implementation manner, when the target connection mode corresponding to the target IoT device is Bluetooth connection, the terminal device establishes a Bluetooth connection with the target IoT device based on the Bluetooth identification of the target IoT device; when the target IoT device corresponds to the target connection mode When it is a WiFi connection, the terminal device establishes a WiFi connection with the target IoT device through the routing device based on the MAC address of the target IoT device (the target IoT device and the terminal device access the same routing device).

In this embodiment, the remote control device sends a connection command containing the target tag identifier to the terminal device, and the terminal device determines the target IoT device represented by the target UWB tag based on the preset binding relationship, which simplifies the instruction sending process on the remote control device side , which helps reduce the power consumption of the remote control device.

In another possible implementation manner, the connection instruction sent by the remote control device to the terminal device includes a target device identifier of the target IoT device, and the terminal can directly determine the target IoT device based on the target device identifier. On the basis of FIG. 2 , as shown in FIG. 6 , step 203 can be replaced with step 203B, and step 205 can be replaced with 205B.

In step 203B, the remote control device sends a connection instruction including the target device identifier to the terminal device based on the data frame sent by the target UWB tag.

In a possible implementation, when the data frame sent by the UWB tag contains the device identifier of the IoT device represented (such as the data frame sent by the built-in UWB tag in the IoT device), after the target UWB tag is determined, the remote control device can Obtain the target device ID from the data frame sent by the target UWB tag, and send a connection instruction containing the target device ID to the terminal device.

In another possible implementation, the data frame sent by the UWB tag only contains the tag identifier. At this time, the remote control device needs to use the pre-stored binding relationship between the UWB tag and the IoT device to determine the target IoT device represented by the target UWB tag. .

Optionally, the remote control device obtains the target tag identifier from the data frame sent by the target UWB tag; based on the target tag identifier, obtains the target device identifier from the binding relationship between the UWB tag and the IoT device, so as to send a message containing the target device identifier to the terminal device. connection instructions.

Regarding the setting method of the binding relationship between the UWB tag and the IoT device in the remote control device, in a possible implementation, the terminal device sends configuration data to the remote control device, and the remote control device receives and stores the configuration data sent by the terminal device. The data contains the binding relationship between UWB tags and IoT devices.

Schematically, after the binding of the UWB tag and the IoT device is completed at the terminal device, the configuration data including the binding relationship is sent to the remote control device through the Bluetooth connection.

It should be noted that, in addition to the above-mentioned binding relationship, the configuration data may also include other information, such as target channel information, data frame format, receiving cycle, etc., which is not limited in this embodiment.

In some embodiments, if the binding relationship does not include the target device identifier corresponding to the target tag identifier, the remote control device determines that the target UWB tag is not bound to the IoT device (which the terminal device can control), and will not send the target UWB tag to the terminal device. Send a connection command.

In step 205B, the terminal device acquires the target device identifier contained in the connection instruction; determines the target IoT device based on the target device identifier; and establishes a data communication connection with the target IoT device based on the target connection mode corresponding to the target IoT device.

Since the target device identifier is included in the connection instruction, the terminal device can directly determine the target IoT device based on the target device identifier, and establish a data communication connection with the target IoT device.

It should be noted that, the above two manners of sending a connection instruction and establishing a data communication connection may be executed independently or in combination. For example, the remote control device first queries the target IoT device from the local binding relationship based on the target tag identifier in the data frame. If the target IoT device is found, it sends a connection command containing the target device identifier to the terminal device; The target IoT device sends a connection command containing the target tag identification to the terminal device, and the terminal device further determines whether there is an IoT device bound to the target UWB tag according to the local binding relationship (the binding relationship on the remote control device side may not be timely renew).

Regarding the manner of triggering the remote control device to send a control command to the terminal device, in a possible implementation manner, the remote control device may receive a control operation through the remote control, so as to send a corresponding control command to the terminal device based on the triggered remote control. On the basis of FIG. 2 , as shown in FIG. 7 , step 206 can be replaced with step 206A, and step 208 can be replaced with 208A.

Step 206A, in response to a trigger operation on the target remote control on the remote control device, the remote control device sends a control instruction including the target control identifier to the terminal device.

Optionally, a remote control is provided on the remote control device, and the remote control may be a physical button, a touch panel, etc. The embodiment of the present application does not limit the specific type of the remote control. For the convenience of description, the following embodiments take the target remote control as a physical button as an example for illustration.

In a possible implementation, different remote controls are used to control different functions. Schematically, as shown in FIG. 8, the first remote control 81 and the second remote control 82 are used to adjust the function parameters of the first function (such as channel switching function); the third remote control 83 and the fourth remote control 84 are used for Adjust the function parameters of the second function (such as the volume adjustment function); the fifth remote control 85 is used to control the enabling state (pause or start playing) of the third function (video playback).

In other possible implementations, different trigger operations on the same remote control are used to control different functions. For example, the single-click operation on the fifth remote control 85 is used to control the enabled state of the third function, and the long-press operation on the fifth remote control 85 is used to control the opening and closing of the device.

When the user needs to control a specific function of the target IoT device, the corresponding remote control on the remote control device can be triggered. Correspondingly, when receiving a trigger operation on the target remote control, the remote control device acquires the target control identifier of the target remote control, and sends a control instruction including the target control identifier.

Optionally, in addition to the target control identifier, the control instruction may also contain the type of trigger operation received by the target remote control, such as single-click operation, double-click operation, long-press operation, and so on.

Step 208A, the terminal device acquires the target control identifier contained in the control instruction, and the target control identifier is the identifier of the target remote control triggered on the remote control device; based on the target control identifier, determine the function of the target device controlled by the target remote control; control the target IoT The device performs the target device function.

In order to determine the device function to be controlled, the terminal device obtains the target control ID from the control instruction, so as to determine the target device function controlled by the target remote control based on the target control ID, and then control the target IoT device to execute the target device function.

Because different IoT devices have different control requirements, for example, smart speakers have volume control requirements, song switching requirements and pause requirements, smart curtains have curtain stretching requirements and light transmittance adjustment requirements, and smart door locks have opening and closing requirements, so in order to improve For the accuracy of device control, the terminal device first needs to determine the device function of the target IoT device, and then determine the target device function controlled by the target remote control from the device function based on the target control identifier.

In a possible implementation manner, the terminal device obtains control setting information, and the control setting information includes the corresponding relationship between the device identifier, device function, and control identifier. When performing device control, the terminal device bases the target control identifier and the target IoT The device identifier of the device, and the function of the target device is determined from the above correspondence. Wherein, the control setting information may be a default setting of the terminal device based on the device function and the remote control control of the remote control device, or may be customized by the user. Schematically, in combination with the remote control shown in FIG. 8 , the corresponding relationship among device identifiers, device functions, and control identifiers is shown in Table 2.

Table II

In an illustrative example, when the terminal device establishes a Bluetooth connection with the smart speaker, and receives the control instruction sent by the remote control device that includes the control identifier of the second control 82, the terminal device controls the smart speaker to play the next song through the Bluetooth connection; When the terminal device establishes a WiFi connection with the smart curtain, and receives the control command sent by the remote control device and contains the control identifier of the third control 83, the terminal device controls the smart curtain to increase light transmittance through the WiFi connection; when the terminal device establishes a WiFi connection with the smart air conditioner connection, and when the control instruction sent by the remote control device includes the control identifier of the fifth control 85, the terminal device controls the smart air conditioner to turn off through the WiFi connection.

In other possible implementation manners, when the control instruction also includes the operation type of the trigger operation received by the target remote control, the terminal device controls the target The IoT device executes corresponding device functions, which will not be repeated in this embodiment.

In this embodiment, when the remote control device receives a trigger operation on the remote control, it sends a control instruction including the control ID to the terminal device, and the terminal device determines the required control device function based on the control ID, thereby controlling the target IoT device through a data communication connection. Executing the device function realizes device control without directly operating the terminal device, improves the device control efficiency, and ensures the accuracy of the control process.

In another possible implementation manner, the user may hold the remote control device and perform a specific gesture operation to trigger the remote control device to send a corresponding control instruction to the terminal device. On the basis of FIG. 2 , as shown in FIG. 9 , step 206 can be replaced with step 206B, and step 208 can be replaced with 208B.

Step 206B, in response to the target gesture operation on the remote control device, the remote control device sends a control instruction including target gesture operation information to the terminal device.

In a possible implementation, the remote control device has built-in sensors (such as inertial sensors, accelerometers, etc.), and after determining the target UWB tag, the remote control device recognizes the target gesture to the remote control device based on the sensor data collected by the sensor. operation, and then send the control command including the gesture recognition result (that is, the target gesture operation information) to the terminal device.

Optionally, the target gesture operation may include a gesture of swiping left, a gesture of swiping right, a gesture of swiping up, a gesture of swiping down, a gesture of shaking, etc., which is not limited in this embodiment.

In a possible implementation manner, different gesture operations are used to control different functions. For example, for a smart speaker, the left/right swipe gesture is used to control song switching, and the up/down swipe gesture is used to control volume adjustment.

In other possible implementation manners, for different IoT devices, the same gesture operation is used to control different functions. For example, when the target IoT device is a smart speaker, the shaking gesture is used to control audio playback/pause; when the target IoT device is a smart door lock, the shaking gesture is used to control the opening/closing of the door lock.

Step 208B, the terminal device obtains the target gesture operation information contained in the control instruction, the target gesture operation information is used to represent the target gesture operation received by the remote control device; based on the target gesture operation information, determine the target device function controlled by the target gesture operation; control The target IoT device performs the target device function.

In order to determine the device function to be controlled, the terminal device obtains the target gesture operation information from the control instruction, thereby determining the target device function to be controlled based on the target gesture operation information, and then controls the target IoT device to execute the target device function.

Because different IoT devices have different control requirements, for example, smart speakers have volume control requirements, song switching requirements and pause requirements, smart curtains have curtain stretching requirements and light transmittance adjustment requirements, and smart door locks have opening and closing requirements, so in order to improve For the accuracy of device control, the terminal device first needs to determine the device function of the target IoT device, and then determine the target device function controlled by the target gesture operation from the device function based on the target gesture operation information.

In a possible implementation manner, the terminal device acquires gesture setting information, which includes the correspondence between the device identifier, device function, and gesture operation information. When performing device control, the terminal device bases the target gesture operation information and The device identifier of the target IoT device, and the function of the target device is determined from the above correspondence. Wherein, the gesture setting information may be a default setting of the terminal device based on device functions, or may be customized by the user. Schematically, the corresponding relationship among device identifiers, device functions, and gesture operation information is shown in Table 3.

Table three

In a schematic example, when the terminal device establishes a Bluetooth connection with the smart speaker, and receives the control instruction sent by the remote control device that includes gesture operation information indicating "swipe right", the terminal device controls the smart speaker to play the following video through the Bluetooth connection. One song; when the terminal device establishes a WiFi connection with the smart curtain, and receives the control command sent by the remote control device that contains gesture operation information indicating "swipe up", the terminal device controls the smart curtain to increase light transmittance through the WiFi connection; when the terminal device When a WiFi connection is established with the smart air conditioner, and the control command sent by the remote control device contains gesture operation information indicating "shaking", the terminal device controls the smart air conditioner to turn off through the WiFi connection.

Schematically, as shown in FIG. 10 , when the user holds the remote control device 1002 and points the remote control device 1002 at the smart curtain 1001 , the remote control device 1002 instructs the terminal device to establish a data communication connection with the smart curtain 1001 . When the user further holds the remote control device 1002 and swipes it to the left, the remote control device 1002 sends a control instruction including the gesture operation information of "swipe to the left" to the terminal device. Based on the control instruction, the terminal device determines that the device function corresponding to "swipe left" is to open the curtain, thereby controlling the smart curtain 1001 to open.

In this embodiment, the remote control device sends a control command containing gesture operation information to the terminal device based on the received gesture operation, and the terminal device controls the device function corresponding to the target IoT device based on the gesture operation information, so that the user can easily Gesture operations can realize the control of IoT devices, which further simplifies the device control process.

In some possible cases, after receiving the connection instruction, the terminal device cannot establish a data communication connection with the target IoT device represented by the target UWB tag. For example, when the terminal device has not established a connection with the target IoT device, or the communication component of the target IoT device is abnormal, the terminal device cannot establish a data communication connection with the target IoT device.

In this case, the remote control device continues to send control instructions to the terminal device and cannot realize device control, which will instead cause waste of power consumption of the remote control device. Therefore, in a possible implementation manner, after the terminal device attempts to establish a connection with the target IoT device based on the connection instruction, it feeds back the connection result to the remote control device, so that the remote control device determines whether to send a further control instruction based on the connection result. As shown in Figure 11, the process may include the following steps:

Step 1101, receiving connection feedback information sent by the terminal device, where the connection feedback information is used to indicate the establishment of the data communication connection between the terminal device and the target IoT device.

Optionally, after the terminal device attempts to establish a connection with the target IoT device based on the connection instruction, it sends connection feedback information to the remote control device based on the connection establishment situation. Correspondingly, the remote control device receives the connection feedback information, and determines whether the data communication connection between the terminal device and the target IoT device is successfully established. If the establishment is successful, perform step 1102, and if the establishment fails, perform steps 1103 to 1104.

Step 1102, if the connection feedback information indicates that the data communication connection is established successfully, send a control instruction to the terminal device in response to the control operation on the remote control device.

When the data communication connection is successfully established, the remote control device responds to the control operation and sends a control command. For the process of sending the control instruction based on the received control operation, reference may be made to the above embodiment, and details will not be repeated in this embodiment.

Step 1103, if the connection feedback information indicates that the establishment of the data communication connection fails, a connection failure prompt is given, wherein the connection failure prompt includes at least one of a vibration prompt, a voice prompt, or an indicator light prompt.

When the establishment of the data communication connection fails, in order to inform the user in time and prevent the user from continuing to perform the control operation, the remote control device prompts the connection failure. Correspondingly, the remote control device will not send control instructions to the terminal device.

In some embodiments, when the connection fails to be established, the remote control device vibrates, or plays a prompt voice through a speaker, or turns on an indicator light. It should be noted that, when the connection is successfully established, the remote control device may also prompt the connection success, prompting the user to perform further control operations. Wherein, the manner of prompting for successful connection is different from prompting for connection failure, which is not limited in this embodiment.

Step 1104, resend the connection instruction to the terminal device.

In a possible implementation manner, when the connection feedback information indicates that the connection establishment fails, the connection feedback information may also include a failure cause identifier, and if the failure cause indicator indicates that the corresponding target IoT device has not been found, the remote control device does not The connection command is resent. If the failure cause indicator indicates that the corresponding target IoT device has been found, but the connection fails, the remote control device will resend the connection command.

In this embodiment, the terminal device sends connection feedback information to the remote control device based on the connection establishment status, so that the remote control device determines whether to continue sending control instructions to the terminal device based on the connection feedback information, and avoids failures caused by sending control instructions when the connection fails. Wasted power.

In the above-mentioned embodiments, the remote control device indirectly controls the IoT device through the terminal device as an example. In other possible implementation manners, when the data communication connection is successfully established, the terminal device may display the device control interface corresponding to the target IoT device. The device control interface includes functional controls corresponding to the target IoT device.

For example, when the target IoT device is a smart TV, the terminal device displays the TV remote control interface; when the target IoT device is a smart air conditioner, the terminal device displays the air conditioner remote control interface; when the target IoT device is a smart curtain, the terminal device displays the curtain control interface. Panel interface.

Further, in response to a trigger operation on the function control in the device control interface, the terminal device controls the target IoT device to execute the corresponding device function.

In this way, even if the terminal device does not have the UWB function, the target IoT device that needs to be controlled can be selected by the remote control device, thereby triggering the display of the corresponding control interface, preventing the user from manually selecting among the applications corresponding to different IoT devices, and improving the user experience. Equipment control efficiency.

Since the remote control device is usually in a non-stationary state when the user uses the remote control device to control the IoT device, in order to further reduce the power consumption of the remote control device, the remote control device receives data frames when it detects that it is in a motion state. When it is detected that it is in a prohibited state, it will remain in a dormant state, wherein, in the dormant state, the UWB component in the remote control device does not send and receive data frames.

In a possible implementation manner, in the dormant state, when the sensor data collected by the sensor indicates that the remote control device is in a motion state, the remote control device turns on the UWB component, and receives data frames sent by each UWB tag through the UWB component.

Wherein, the sensor may be an inertial sensor, an acceleration sensor, etc., which is not limited in this embodiment.

In other possible implementations, when the remote control device is provided with an opening control, in the dormant state, in response to the trigger operation of the opening control on the remote control device, the remote control device starts the UWB component, and the UWB component receives the data sent by each UWB tag frame.

For example, the remote control device is provided with a start button, and when the click operation of the start button is received, the remote control device turns on the UWB component; when the click operation of the start button is received again, the remote control device turns off the UWB component and enters a dormant state .

It should be noted that, in the above embodiments, the steps with the terminal device as the execution subject can be independently implemented as a device control method on the terminal device side, and the steps with the remote control device as the execution subject can be independently implemented as a device control method on the remote control device side. The embodiment of the present application will not be described in detail here.

The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

Please refer to FIG. 12 , which shows a structural block diagram of a device control apparatus provided by an embodiment of the present application. The device is capable of implementing the functions performed by the remote control device in the above method embodiments, and the functions may be implemented by hardware, or may be implemented by hardware executing corresponding software. As shown in Figure 12, the device may include:

The first receiving module 1201 is configured to receive data frames sent by each UWB tag, and the UWB tag is used to represent an IoT device;

A determining module 1202, configured to determine a target UWB tag from each of the UWB tags based on the data frame, where the target UWB tag is the UWB tag pointed to by the remote control device;

The first sending module 1203 is configured to send a connection instruction to the terminal device based on the target UWB tag, so that the terminal device establishes a data communication connection with the target IoT device represented by the target UWB tag;

The second sending module 1204 is configured to send a control instruction to the terminal device in response to a control operation on the remote control device, so that the terminal device controls the target IoT device based on the control instruction.

Optionally, the first sending module 1203 includes:

The first sending unit is configured to send the connection instruction including the target tag identification to the terminal device based on the data frame sent by the target UWB tag, so that the terminal device can transfer from the UWB to the terminal device based on the target tag ID. The target IoT device is determined in the binding relationship between the tag and the IoT device;

or,

The second sending unit is configured to send the connection instruction including the target device identifier to the terminal device based on the data frame sent by the target UWB tag, so that the terminal device determines the Target IoT device.

Optionally, the first sending unit is configured to obtain the target tag identifier from the data frame sent by the target UWB tag, and send the connection including the target tag identifier to the terminal device instruction.

Optionally, the second sending unit is configured to:

Obtain the target tag identifier from the data frame sent by the target UWB tag; based on the target tag identifier, obtain the target device identifier from the binding relationship between the UWB tag and the IoT device; send the terminal device sending the connection instruction including the target device identifier;

or,

Obtain the target device identifier from the data frame sent by the target UWB tag, and send the connection instruction including the target device identifier to the terminal device.

Optionally, the target device identifier is obtained from the binding relationship between the UWB tag and the IoT device;

The device also includes:

The storage module is configured to receive and store the configuration data sent by the terminal device, the configuration data includes the binding relationship between the UWB tag and the IoT device.

Optionally, the second sending module 1204 includes:

A third sending unit, configured to send the control instruction including the target control identifier to the terminal device in response to a trigger operation on the target remote control on the remote control device, so that the terminal device can control the target control based on the target control identify and determine the target device function controlled by the target remote control;

or,

A fourth sending unit, configured to send the control instruction including target gesture operation information to the terminal device in response to a target gesture operation on the remote control device, so that the terminal device determines the target gesture operation information based on the target gesture operation information. The target device function controlled by the target gesture action described above.

Optionally, the device includes:

A second receiving module, configured to receive connection feedback information sent by the terminal device, where the connection feedback information is used to indicate the establishment of a data communication connection between the terminal device and the target IoT device;

The second sending module 1204 is configured to: when the connection feedback information indicates that the data communication connection is established successfully, perform the step of sending a control command to the terminal device in response to a control operation on the remote control device step.

Optionally, the device also includes:

A prompt module, configured to prompt a connection failure when the connection feedback information indicates that the data communication connection has failed to be established, wherein the connection failure prompt includes at least one of a vibration prompt, a voice prompt, or an indicator light prompt;

The first sending module 1203 is further configured to resend the connection instruction to the terminal device.

Optionally, the first receiving module 1201 includes:

The first receiving unit is configured to, in a dormant state, respond to a trigger operation for opening a control on the remote control device, open the UWB component, and receive the data frame sent by each of the UWB tags through the UWB component;

or,

The second receiving unit is configured to turn on the UWB component in a dormant state when the sensor data collected by the sensor indicates that the remote control device is in a motion state, and receive all the UWB tags sent by each of the UWB tags through the UWB component. The data frame described above.

Please refer to FIG. 13 , which shows a structural block diagram of a device control apparatus provided by an embodiment of the present application. The apparatus is capable of realizing the functions executed by the terminal device side in the foregoing method embodiments, and the functions may be implemented by hardware, or may be implemented by hardware executing corresponding software. As shown in Figure 13, the device may include:

The third receiving module 1301 is configured to receive the connection instruction sent by the remote control device, the connection instruction is sent when the remote control device determines the target UWB tag from the UWB tags, and the target UWB tag is the UWB pointed to by the remote control device Label;

A connection module 1302, configured to establish a data communication connection with the target IoT device represented by the target UWB tag based on the connection instruction;

A fourth receiving module 1303, configured to receive the control instruction sent by the remote control device;

A control module 1304, configured to control the target IoT device based on the control instruction.

Optionally, the connection module 1302 includes:

The first connection unit is configured to obtain the target tag identifier contained in the connection instruction; based on the target tag identifier, determine the target IoT device from the binding relationship between the UWB tag and the IoT device; based on the target IoT device A corresponding target connection mode, establishing a data communication connection with the target IoT device;

or,

The second connection unit is configured to acquire the target device identifier included in the connection instruction; determine the target IoT device based on the target device identifier; and connect to the target IoT device based on the target connection mode corresponding to the target IoT device establish a data communication connection;

Optionally, the target device identifier contained in the connection instruction is obtained by the remote control device from the binding relationship between the UWB tag and the IoT device;

The device also includes:

The third sending module is configured to send configuration data to the remote control device, so that the remote control device can store the configuration data, and the configuration data includes the binding relationship between the UWB tag and the IoT device.

Optionally, the control module 1304 includes:

The first control unit is configured to acquire a target control identifier included in the control instruction, where the target control identifier is an identifier of a triggered target remote control on the remote control device; based on the target control identifier, determine the target The target device function controlled by the remote control; controlling the target IoT device to execute the target device function;

or,

The second control unit is configured to acquire target gesture operation information included in the control instruction, where the target gesture operation information is used to characterize the target gesture operation received by the remote control device; determine the target gesture operation information based on the target gesture operation information The target device function is controlled by the target gesture operation; and the target IoT device is controlled to execute the target device function.

Optionally, the device also includes:

The first obtaining module is used to obtain control setting information, and the control setting information includes a corresponding relationship between device identifiers, device functions, and control identifiers;

or,

The second acquiring module is configured to acquire gesture setting information, where the gesture setting information includes correspondence between device identifiers, device functions, and gesture operation information.

Optionally, the device also includes:

A fourth sending module, configured to send connection feedback information to the remote control device, where the connection feedback information is used to indicate the establishment of a data communication connection between the terminal device and the target IoT device.

Optionally, the device also includes:

A display module, configured to display a device control interface corresponding to the target IoT device when the data communication connection is successfully established, and the device control interface includes functional controls corresponding to the target IoT device;

The control module 1304 is further configured to control the target IoT device to execute a corresponding device function in response to a trigger operation on a function control in the device control interface.

It should be noted that: when the device provided by the above-mentioned embodiment realizes its function, the division of the above-mentioned functional modules is used as an example for illustration. The internal structure of the system is divided into different functional modules to complete all or part of the functions described above. In addition, the device and the method embodiment provided by the above embodiment belong to the same idea, and the specific implementation process thereof is detailed in the method embodiment, and will not be repeated here.

Please refer to FIG. 14 , which shows a structural block diagram of a remote control device 1400 provided by an exemplary embodiment of the present application. The remote control device 1400 in this application may include one or more of the following components: a processor 1410, a memory 1420, and a UWB component 1430, wherein the processor 1510 is electrically connected to the memory 1420 and the UWB component 1430, respectively.

Processor 1410 may include one or more processing cores. The processor 1410 uses various interfaces and lines to connect various parts of the entire remote control device 1400, and executes or executes instructions, programs, code sets or instruction sets stored in the memory 1420, and calls data stored in the memory 1420 to execute Various functions of the remote control device 1400 and processing data. Optionally, the processor 1510 may adopt at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). implemented in the form of hardware.

The memory 1420 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory, ROM). Optionally, the memory 1420 includes a non-transitory computer-readable storage medium. The memory 1420 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 1420 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.) , instructions for implementing the foregoing method embodiments, and the like. In this embodiment of the present application, at least one instruction is stored in the memory 1420, and the at least one instruction is used to be executed by the processor 1410 to execute the device control method as shown in the foregoing embodiments.

The UWB component 1430 is used to receive the data frame broadcast by the external UWB component, so that the remote control device 1400 can process the data frame through the processor 1410 to achieve the purpose of determining the spatial position of the IoT device according to the data frame.

Optionally, the remote control device 1400 is also provided with a communication component, so as to perform data interaction with the terminal device through the communication component, and the communication component may be a Bluetooth component.

In addition, those skilled in the art can understand that the structure of the remote control device 1400 shown in the above drawings does not constitute a limitation on the remote control device 1400, and the remote control device may include more or less components than those shown in the illustration, or Combining certain parts, or different arrangements of parts. For example, the remote control device 1400 also includes components such as a vibration motor, a sensor (such as an accelerometer, an inertial sensor), an audio circuit, a power supply, and a physical button, which will not be repeated here.

Please refer to FIG. 15 , which shows a structural block diagram of a terminal device 1500 provided by an exemplary embodiment of the present application. The terminal device 1500 in this application may include one or more of the following components: a processor 1510 , a memory 1520 and a UWB component 1530 , where the processor 1510 is connected to the memory 1520 .

Processor 1510 may include one or more processing cores. The processor 1510 uses various interfaces and lines to connect various parts of the entire terminal device 1500, and by running or executing instructions, programs, code sets or instruction sets stored in the memory 1520, and calling data stored in the memory 1520, executes Various functions and processing data of the terminal device 1500. Optionally, the processor 1510 may adopt at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). implemented in the form of hardware. The processor 1510 may integrate one or a combination of a CPU, a Graphics Processing Unit (GPU), a modem, and the like. Among them, the CPU mainly processes the operating system, user interface and application programs, etc.; the GPU is used to render and draw the content that needs to be displayed on the touch screen; the modem is used to process wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 1510, but may be realized by a communication chip alone.

The memory 1520 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory, ROM). Optionally, the memory 1520 includes a non-transitory computer-readable storage medium. The memory 1520 may be used to store instructions, programs, codes, sets of codes or sets of instructions. The memory 1520 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system and instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.) , the instruction etc. that are used to realize above-mentioned each method embodiment, this operating system can be Andrews (Android) system (comprising the system based on the depth development of Android system), the IOS system developed by Apple Inc. (comprising the system based on the depth development of IOS system) or other systems. The storage data area can also store data created by the terminal device 1300 during use (such as phonebook, audio and video data, chat record data) and the like. In this embodiment of the present application, at least one instruction is stored in the memory 1520, and the at least one instruction is used to be executed by the processor 1510 to execute the device control method as shown in the foregoing embodiments.

Optionally, the terminal device 1500 is also provided with a communication component 1530, through which the terminal device 1500 can perform data interaction with external devices (such as remote control devices and IoT devices), and the communication component 1530 can include Bluetooth components and WiFi components .

Optionally, the terminal device 1500 may also include a touch display screen, which may be a capacitive touch display screen, and the capacitive touch screen screen is used to receive a user's touch on or near it using any suitable object such as a finger or a touch pen. operation, and display the user interface of each application. The touch screen is usually set on the front panel of the terminal device 1500 . Touch screens can be designed as full screens, curved screens or special-shaped screens. The touch display screen can also be designed as a combination of a full screen and a curved screen, or a combination of a special-shaped screen and a curved screen, which is not limited in this embodiment of the present application.

In addition, those skilled in the art can understand that the structure of the terminal device 1500 shown in the above drawings does not constitute a limitation on the terminal device 1500, and the terminal device may include more or less components than those shown in the figure, or Combining certain parts, or different arrangements of parts. For example, the terminal device 1500 also includes components such as a radio frequency circuit, a camera component, a sensor, an audio circuit, and a power supply, which will not be repeated here.

Please refer to FIG. 16 , which shows a structural block diagram of a device control system 1600 provided by an exemplary embodiment of the present application. The device control system includes a remote control device 1601 , a terminal device 1602 , a UWB tag 1603 and an IoT device 1604 .

In the embodiment of the present application, the remote control device 1601 is independent of the terminal device 1602 and establishes a communication connection with the terminal device 1602. The remote control device 1601 establishes UWB communication with the UWB tag 1603. The UWB tag 1603 is used to represent the IoT device 1604. The terminal device 1602 communicates with the The IoT device 1604 has established a data communication connection.

The remote control device 1601 receives the data frame sent by each UWB tag 1603; based on the data frame, determines the target UWB tag from each UWB tag 1603, and the target UWB tag is the UWB tag pointed to by the remote control device 1601; Send connection command;

The terminal device 1602 receives the connection instruction sent by the remote control device 1601; based on the connection instruction, establishes a data communication connection with the target IoT device 1604 represented by the target UWB tag;

The remote control device 1601 sends a control instruction to the terminal device 1602 in response to the control operation on the remote control device;

The terminal device 1602 receives the control instruction sent by the remote control device 1601; and controls the target IoT device 1604 based on the control instruction.

The embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores at least one program code, and the program code is loaded and executed by a processor to implement the device control method described in each of the above embodiments .

According to an aspect of the present application there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the device control method provided in various optional implementation manners of the above aspect.

It should be understood that the "plurality" mentioned herein refers to two or more than two. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character "/" generally indicates that the contextual objects are an "or" relationship. In addition, the numbering of the steps described herein only exemplarily shows a possible sequence of execution among the steps. In some other embodiments, the above-mentioned steps may not be executed according to the order of the numbers, such as two different numbers The steps are executed at the same time, or two steps with different numbers are executed in the reverse order as shown in the illustration, which is not limited in this embodiment of the present application.

The above are only optional embodiments of the application, and are not intended to limit the application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the application shall be included in the protection of the application. within range.

Claims

A device control method applied to a remote control device, the method comprising:

Receive data frames sent by each UWB tag, the UWB tag is used to represent the IoT device;

Based on the data frame, determine a target UWB tag from each of the UWB tags, where the target UWB tag is the UWB tag pointed to by the remote control device;

Based on the target UWB tag, send a connection instruction to the terminal device, so that the terminal device establishes a data communication connection with the target IoT device represented by the target UWB tag;

In response to a control operation on the remote control device, a control instruction is sent to the terminal device, so that the terminal device controls the target IoT device based on the control instruction.
The method according to claim 1, wherein said sending a connection instruction to a terminal device based on said target UWB tag comprises:

Based on the data frame sent by the target UWB tag, send the connection instruction including the target tag identifier to the terminal device, so that the terminal device can learn from the mapping relationship between the UWB tag and the IoT device based on the target tag identifier Determine the target IoT device in .
The method according to claim 2, wherein, sending the connection instruction including the target tag identification to the terminal device based on the data frame sent by the target UWB tag includes:

Obtain the target tag identifier from the data frame sent by the target UWB tag, and send the connection instruction including the target tag identifier to the terminal device.
The method according to claim 1, wherein said sending a connection instruction to a terminal device based on said target UWB tag comprises:

Sending the connection instruction including the target device identifier to the terminal device based on the data frame sent by the target UWB tag, so that the terminal device determines the target IoT device based on the target device identifier.
The method according to claim 4, wherein the sending of the connection instruction including the target device identification to the terminal device based on the data frame sent by the target UWB tag includes:

Obtain the target tag identifier from the data frame sent by the target UWB tag;

Based on the target tag identifier, the target device identifier is obtained from the mapping relationship between the UWB tag and the IoT device;

sending the connection instruction including the target device identifier to the terminal device.
The method according to claim 4, wherein the sending of the connection instruction including the target device identification to the terminal device based on the data frame sent by the target UWB tag includes:

Obtain the target device identifier from the data frame sent by the target UWB tag, and send the connection instruction including the target device identifier to the terminal device.
The method according to any one of claims 1 to 6, wherein the sending a control command to the terminal device in response to the control operation on the remote control device includes:

In response to a trigger operation on the target remote control on the remote control device, sending the control instruction including the target control identifier to the terminal device, so that the terminal device determines the target remote control control based on the target control identifier The target device functionality being controlled.
The method according to any one of claims 1 to 6, wherein the sending a control command to the terminal device in response to the control operation on the remote control device includes:

In response to the target gesture operation on the remote control device, sending the control instruction including target gesture operation information to the terminal device, so that the terminal device determines the target gesture operation controlled by the target gesture operation information based on the target gesture operation information. Target device capabilities.
The method according to any one of claims 1 to 6, wherein, before sending a control command to the terminal device in response to the control operation on the remote control device, the method includes:

receiving connection feedback information sent by the terminal device, where the connection feedback information is used to indicate the establishment of a data communication connection between the terminal device and the target IoT device;

The sending a control instruction to the terminal device in response to the control operation on the remote control device includes:

In a case where the connection feedback information indicates that the data communication connection is established successfully, the step of sending a control instruction to the terminal device in response to a control operation on the remote control device is performed.
A device control method applied to a terminal device, the method comprising:

receiving a connection instruction sent by the remote control device, the connection instruction is sent when the remote control device determines a target UWB tag from the UWB tags, and the target UWB tag is the UWB tag pointed to by the remote control device;

Based on the connection instruction, establish a data communication connection with the target IoT device represented by the target UWB tag;

receiving a control instruction sent by the remote control device;

The target IoT device is controlled based on the control instruction.
The method according to claim 10, wherein said establishing a data communication connection with the target IoT device represented by the target UWB tag based on the connection instruction comprises:

Obtain the target tag identifier contained in the connection instruction;

Based on the target tag identification, determine the target IoT device from the mapping relationship between the UWB tag and the IoT device;

Establish a data communication connection with the target IoT device based on the target connection mode corresponding to the target IoT device.
The method according to claim 10, wherein said establishing a data communication connection with the target IoT device represented by the target UWB tag based on the connection instruction comprises:

Obtain the target device identifier included in the connection instruction;

determining the target IoT device based on the target device identifier;

Establishing a data communication connection with the target IoT device based on the target connection mode corresponding to the target IoT device;

Wherein, the target connection mode includes at least one of Bluetooth and WiFi.
The method according to any one of claims 10 to 12, wherein the controlling the target IoT device based on the control instruction comprises:

Acquiring a target control ID included in the control instruction, where the target control ID is an ID of a triggered target remote control on the remote control device;

determining a target device function controlled by the target remote control based on the target control identifier;

controlling the target IoT device to execute the target device function;

The method also includes:

The control setting information is acquired, and the control setting information includes the corresponding relationship between the device identifier, the device function and the control identifier.
The method according to any one of claims 10 to 12, wherein the controlling the target IoT device based on the control instruction comprises:

Acquiring target gesture operation information contained in the control instruction, where the target gesture operation information is used to characterize the target gesture operation received by the remote control device;

Based on the target gesture operation information, determine a target device function controlled by the target gesture operation;

controlling the target IoT device to execute the target device function;

The method also includes:

Gesture setting information is acquired, and the gesture setting information includes a correspondence between device identifiers, device functions, and gesture operation information.
An equipment control device, the device comprising:

A receiving module, configured to receive data frames sent by each UWB tag, where the UWB tag is used to represent an IoT device;

A determining module, configured to determine a target UWB tag from each of the UWB tags based on the data frame, where the target UWB tag is the UWB tag pointed to by the remote control device;

A sending module, configured to send a connection instruction to a terminal device based on the target UWB tag, so that the terminal device establishes a data communication connection with the target IoT device represented by the target UWB tag;

The sending module is further configured to send a control instruction to the terminal device in response to a control operation on the remote control device, so that the terminal device controls the target IoT device based on the control instruction.
An equipment control device, the device comprising:

The first receiving module is configured to receive a connection instruction sent by the remote control device, the connection instruction is sent when the remote control device determines a target UWB tag from the UWB tags, and the target UWB tag is the UWB tag pointed to by the remote control device ;

A connection module, configured to establish a data communication connection with the target IoT device represented by the target UWB tag based on the connection instruction;

a second receiving module, configured to receive a control instruction sent by the remote control device;

A control module, configured to control the target IoT device based on the control instruction.
A control system for an IoT device, the system includes a remote control device, a terminal device, a UWB tag and an IoT device;

The UWB tag is used to characterize the IoT device;

The remote control device receives data frames sent by each of the UWB tags; based on the data frames, a target UWB tag is determined from each of the UWB tags, and the target UWB tag is the UWB tag pointed to by the remote control device; based on The target UWB tag sends a connection instruction to the terminal device;

The terminal device receives the connection instruction sent by the remote control device; based on the connection instruction, establishes a data communication connection with the target IoT device represented by the target UWB tag;

The remote control device sends a control instruction to the terminal device in response to a control operation on the remote control device;

The terminal device receives the control instruction sent by the remote control device, and controls the target IoT device based on the control instruction.
A remote control device, the remote control device includes: a processor, a memory and a UWB component; the memory stores at least one program, and the at least one program is used to be executed by the processor to implement any of claims 1 to 9. A device control method described above.
A terminal device, the terminal device comprising: a processor and a memory; the memory stores at least one program, and the at least one program is used to be executed by the processor to implement any one of claims 10 to 14 device control method.
A computer-readable storage medium, at least one program is stored in the computer-readable storage medium, and the at least one program is loaded and executed by a processor to implement the device control method according to any one of claims 1 to 9, Or, implement the device control method according to any one of claims 10 to 14.