WO2021000791A1 - Method and apparatus for controlling smart home appliance, control device and storage medium - Google Patents

Abstract

A method and an apparatus for controlling a smart home appliance, a control device, and a storage medium, used for solving the problem that the controlled smart home appliance cannot be accurately determined when a clear control object is not provided in voice information input by a user. The method comprises: obtaining voice information input by a user (301); determining a first area where the user is currently located (302); determining, according to the voice information input by the user, keywords related to a smart home appliance (303); determining, according to the keywords and the first area, from a preset knowledge graph at least one smart home appliance that matches the keywords and is located in the first area (304); determining, according to a preset selection policy, from at least one smart home appliance a first target smart home appliance that satisfies the preset selection policy, and generating a control command according to the keywords (305); executing the control command to control the first target smart home appliance (306).

Description

Method, device, control device and storage medium for controlling smart home equipment

This disclosure claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 201910586380.4, and the invention title is "Methods, devices, control equipment and storage media for controlling smart home equipment" on July 1, 2019, and its entire contents Incorporated in this disclosure by reference.

Technical field

The present disclosure relates to the field of intelligent control technology, and in particular to a method, device, control device, and storage medium for controlling smart home equipment.

Background technique

With the rapid development of smart homes, various smart home devices appear in people's lives, such as smart air conditioners, smart audio, and smart lighting equipment. At present, when there are multiple smart home devices of the same type, if the user wants to control a smart home device in this type of smart home device, the user needs to clearly indicate which one is controlled in the input voice information If the user does not specify which smart home device to run, multiple smart home devices of the same type will be run, resulting in waste of power. From this, it can be seen that there is a problem in the related technology that when the voice information input by the user lacks a clear control object, the smart home to be controlled cannot be accurately determined.

Summary of the invention

The present disclosure provides a method, device, control device and storage medium for controlling smart home equipment, which are used to solve the problem that the controlled smart home cannot be accurately determined when the voice information input by the user lacks a clear control object. Improve the accuracy of smart home control.

In a first aspect, a method for controlling a smart home device is provided, and the method for controlling a smart home device includes:

Obtain the voice information input by the user and determine the first area where the user is currently located;

According to the voice information input by the user, keywords related to smart home equipment are determined;

According to the keyword and the first area, at least one smart home device matching the keyword and located in the first area is determined from a preset knowledge graph, wherein the knowledge graph includes smart home Correspondence between the functions of the device and the smart home device and the area where the smart home device is located;

According to a preset selection strategy, determine a first target smart home device that meets the preset selection strategy from the at least one smart home device, and generate a control command according to the keyword;

The control command is executed to control the first target smart home device.

In some embodiments, the keywords related to the smart home device are determined according to the voice information input by the user, including:

Converting the voice information into sentences to be recognized through voice recognition technology;

Perform semantic analysis on the sentence to be recognized to obtain keywords related to smart home devices.

In some embodiments, if the knowledge graph further includes the correspondence between user characteristics and multiple smart home devices, the method further includes:

Perform voiceprint recognition on the voice information to determine the user characteristics of the user;

According to the user characteristics, the keywords, and the first area, determine from the knowledge graph at least one smart home that matches the user characteristics and the keywords and is located in the first area equipment.

In some embodiments, the preset selection strategy includes:

Determine that any one of the at least one smart home device is the first target smart home device; or,

It is determined that the at least one smart home device with the smallest energy consumption is the first target smart home device; or,

Determine that the at least one smart home device closest to the user is the first target smart home device; or,

It is determined that all smart home devices in the at least one smart furniture device are the first target smart home devices.

In some implementations, if the preset selection strategy is to determine that the at least one smart home device closest to the user is the first target smart home device;

After executing the control command to control the first target smart home device, the method further includes:

If it is detected that the distance between the user and the first target smart home device exceeds a preset threshold, the smart home device that is the same and the closest to the user’s current location from the at least one smart home is the first 2. Target smart home equipment;

And stop the operation of the first target smart home device, and control the operation of the second target smart home device.

In a second aspect, a device for controlling smart home equipment is provided, and the device for controlling smart home includes:

The obtaining module is configured to obtain the voice information input by the user and determine the first area where the user is currently located;

The first determining module is configured to determine keywords related to the smart home device according to the voice information input by the user;

The second determining module is configured to determine at least one smart home device matching the keyword and located in the first area from a preset knowledge graph according to the keyword and the first area, wherein , The knowledge graph includes the correspondence between the functions of the smart home device and the smart home device and the area where the smart home device is located;

The third determining module is configured to determine a first target smart home device that meets the preset selection strategy from the at least one smart home device according to a preset selection strategy, and generate a control command according to the keyword;

The control module is configured to execute control commands to control the first target smart home device.

In some embodiments, the first determining module is further configured to:

Converting the voice information into sentences to be recognized through voice recognition technology;

Perform semantic analysis on the sentence to be recognized to obtain keywords related to smart home devices.

In some embodiments, the second determining module is further configured to:

When the knowledge graph also includes the correspondence between user characteristics and multiple smart home devices, performing voiceprint recognition on the voice information to determine the user characteristics of the user;

According to the user characteristics, the keywords, and the first area, determine from the knowledge graph at least one smart home device that matches the user characteristics and the keywords and is located in the first area .

In some embodiments, the preset selection strategy includes:

Determine that any one of the at least one smart home device is the first target smart home device; or,

It is determined that the at least one smart home device with the smallest energy consumption is the first target smart home device; or,

Determine that the at least one smart home device closest to the user is the first target smart home device; or,

It is determined that all smart home devices in the at least one smart furniture device are the first target smart home devices.

In some embodiments, the device for controlling the smart home further includes a detection module, and the detection module is configured to:

When the preset selection strategy is to determine that the one of the at least one smart home device closest to the user is the first target smart home device, if a problem between the user and the first target smart home device is detected If the distance exceeds the preset threshold, the smart home device from the at least one smart home that is the same as the user's current location and has the closest distance is the second target smart home device;

And stop the operation of the first target smart home device, and control the operation of the second target smart home device.

In a third aspect, a control device is provided, and the control device includes:

The memory is set to store program instructions;

The processor is configured to call the program instructions stored in the memory, and execute the steps included in any method in the first aspect according to the obtained program instructions.

In a fourth aspect, a storage medium is provided, and the storage medium stores computer-executable instructions, and the computer-executable instructions are configured to cause a computer to execute the steps included in any method in the first aspect.

In the embodiments of the present disclosure, after the voice information input by the user is obtained, the first area where the user is currently located can be determined, so that the voice information input by the user can be processed and analyzed to determine keywords related to smart home devices. After the keywords are determined, at least one smart home device matching the keywords and located in the first area can be determined from the preset knowledge graph according to the keywords and the first area where the user is currently located, where the knowledge graph Including multiple smart home devices, the functions of each smart home device, and the corresponding relationship between the areas where each smart home device is located; then according to the preset selection strategy, determine the first one that satisfies the preset selection strategy from the at least one smart home device A target smart home device, and control the first target smart home device according to the control command generated by the keyword, so as to avoid the unclear semantics in the voice information input by the user and the inaccurate determination of the controlled smart home The problem of equipment, and it can also avoid the waste of resources caused by simultaneously controlling the operation of multiple smart homes that conform to the semantics, so the accuracy of smart home control is improved and energy is saved. At the same time, since the controlled smart home device is determined from the preset knowledge graph, there is no need to install a microphone and voice recognition device for each smart home device, and it does not require the user to stay near the smart home device, so voice is also added The flexibility of controlling smart home devices improves the user experience.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present disclosure or related technologies, the following will briefly introduce the drawings needed in the description of the embodiments. Obviously, the drawings in the following description are only some of the present disclosure. Examples.

FIG. 1 is a schematic diagram of an application scenario provided by an embodiment of the disclosure;

2 is a schematic diagram of a knowledge graph of some smart home devices provided by embodiments of the disclosure;

FIG. 3 is a flowchart of a method for controlling a smart home device according to an embodiment of the disclosure;

4 is a structural block diagram of an apparatus for controlling smart home equipment provided by an embodiment of the disclosure;

FIG. 5 is another schematic structural diagram of an apparatus for controlling a smart home device according to an embodiment of the disclosure.

Detailed ways

In order to make the objectives, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions of the present disclosure will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are the present disclosure. Part of the embodiments of the technical solution, but not all of the embodiments. Based on the embodiments described in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the technical solutions of the present disclosure. In the case of no conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other arbitrarily. And, although a logical sequence is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than here.

The terms "first" and "second" in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific sequence. In addition, the term "including" and any variations of them are intended to cover non-exclusive protection. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes unlisted steps or units, or optionally also includes Other steps or units inherent to these processes, methods, products or equipment. The "plurality" in the present disclosure may mean at least two, for example, it may be two, three or more, and the embodiment of the present disclosure does not limit it.

In addition, the term "and/or" in this article is only an association relationship describing associated objects, which means that there can be three types of relationships, for example, A and/or B, which can mean: A alone exists, and both A and B exist. There are three cases of B alone. In addition, the character "/" in this text, unless otherwise specified, generally indicates that the associated objects before and after are in an "or" relationship.

To facilitate understanding, the technical background of the embodiments of the present disclosure will be introduced below.

As mentioned above, when there are multiple smart home devices of the same type in the related technology, if the voice information input by the user lacks a clear control object, the problem of the controlled smart home cannot be accurately determined, for example, When there are 5 air conditioners in the home, if the voice input by the user is "Turn on the air conditioner", the main control device cannot determine which of the 5 air conditioners to turn on, and thus controls all the 5 air conditioners to turn on, resulting in unnecessary power waste.

In view of this, the inventor of the present disclosure provides a solution for controlling smart home devices. In this solution, a knowledge graph is preset, and the knowledge graph includes smart home devices and their corresponding functions, specific areas, and user characteristics. According to the analysis result of the voice information input by the user, the control device can find from the knowledge graph at least one smart home device that is the same as the user’s current area and is consistent with the voice information analysis result, and further A target smart home device is determined from the at least one smart home device, and then the target smart home device is controlled. thereby. It can avoid the problem of unclear semantics in the voice information input by the user that cannot accurately determine the controlled smart home device, and it can also avoid the waste of resources caused by simultaneously controlling the operation of multiple smart homes that conform to the semantics. Improve the accuracy of smart home control and save energy. At the same time, since the controlled smart home device is determined from the preset knowledge graph, there is no need to install a microphone and voice recognition device for each smart home device, and it does not require the user to stay near the smart home device, so voice is also added The flexibility of controlling smart home devices improves the user experience.

After introducing the design ideas of the embodiments of the present disclosure, the following briefly introduces the application scenarios to which the technical solutions of the embodiments of the present disclosure can be applied. It should be noted that the application scenarios introduced below are only used to illustrate the embodiments of the present disclosure and not limited. In specific implementation, the technical solutions provided by the embodiments of the present disclosure can be flexibly applied according to actual needs.

Please refer to a schematic diagram of an application scenario shown in Figure 1. The application scenario is a user’s residence, the residence includes a control device 10, multiple smart home devices, multiple voice collection devices, multiple smart home devices and multiple The voice collection devices are respectively located in the first area, such as the living room, the second area, such as the master bedroom, and the third area, such as the second bedroom, in these three areas. The control device can communicate with all smart home devices in the residence through the network, so that the smart home in the residence can be controlled to operate or shut down through the control device, for example, a smart gateway.

The control device stores a knowledge map related to all smart home devices in the user's residence, which includes all the smart home devices in the user's residence and the functions, models, and operating status of the smart home devices in all the smart home devices, and The corresponding relationship between the areas where each smart home device, specific function, operating state, and area are all regarded as a node. If there is an association relationship between the two nodes, the connection between the two nodes For edge connection, please refer to Figure 2. Figure 2 shows a schematic diagram of the connection relationship of some smart home devices in the knowledge graph corresponding to the user's residence.

Further, referring to Fig. 2, the knowledge graph may also include user characteristic tags such as the user’s usage habits and preferences for smart home devices, user age, etc., so that the smart home devices determined according to the user’s voice information are more in line with the user’s personalization Demand, for example, when the weather is very hot, over-aged users, such as grandpa and grandma, like to use electric fans, middle-aged users and young users, such as fathers and sons, like to turn on the air conditioner, so when the control device gets the information about good weather After the hot voice information, it is possible to analyze who the user corresponding to the voice information is, if it is grandma, control the operation of the smart electric fan, if it is the father, control the operation of the smart air conditioner.

The technical solutions provided by the embodiments of the present disclosure are described below in conjunction with the drawings in the specification.

Please refer to FIG. 3, which is a method for controlling a smart home device according to an embodiment of the present disclosure. The method can be executed by the control device in the application scenario shown in FIG. 1. In the specific implementation process, the control device It can be, for example, a smart gateway, a personal computer, a large and medium-sized computer, a computer cluster, etc. The flow description of the method for controlling smart home equipment in Figure 3 is as follows:

Step 301: Obtain the voice information input by the user.

In the embodiments of the present disclosure, the obtained voice information can be collected by a set voice collection device, or collected by a terminal device. For example, a user can use a smart home device management application in a smart phone to send a smart home device The control device sends voice information, and then the control device can obtain the voice information input by the user through the smart phone.

In the specific implementation process, if the voice information input by the user is collected through a voice collection device, the voice collection device can be set in any location in the user's residence that can collect the voice uttered by the user, such as on a wall, or as a A separate device is placed in the residence, so that the user can make a voice anywhere in the home and can be collected, and the voice information input method is flexible, which is more convenient for the user to operate. The voice collection device can also be integrated with the smart home device, that is, the voice collection device is set in the smart home device, which can avoid unnecessary space waste and affect the indoor beauty, and save indoor space.

Step 302: Determine the first area where the user is currently located.

In the embodiments of the present disclosure, the area where the user is currently located can be determined through the collected indoor images, that is, a camera device is set at the user's residence to collect images in the user's residence, so as to determine the area where the current user is based on the collected image information Among them, the camera device can be set in the user's residence to facilitate the collection of indoor images. For example, the living room camera device does not need to be set in every area of the user's residence, and it can be set in a location that is convenient for capturing images, for example, The entrance to each area.

Step 303: Determine keywords related to the smart home device according to the voice information input by the user.

In the embodiments of the present disclosure, in order to facilitate user operations, the voice information input by the user is flexible and diverse, in which the name of the smart home device that the user wants to control can be clearly indicated, for example, the smart air conditioner is turned on; the smart home may not be clearly indicated. The name of the device is a language that describes the functionality of the smart home device or the description of the current environmental state, for example, cooling down or the home is too hot. Therefore, users can use more random voice messages to control smart home devices and improve user experience.

Furthermore, when the control device obtains the voice information input by the user, it needs to analyze and process the obtained voice information, first convert the voice information into a sentence to be recognized, and then perform semantic analysis on the sentence to be recognized, and obtain it from the smart home. Device-related keywords. For example, if the sentence to be recognized corresponding to the voice message is "too hot", you can use "hot" as a morpheme to determine the keyword, and determine the keyword corresponding to "hot" from the preset correspondence between morphemes and keywords , Assuming that "hot" corresponds to "cooling", then "cooling" can be used as a keyword based on the voice message of "too hot".

Step 304: According to the keyword and the first region, determine at least one smart home device matching the keyword and located in the first region from a preset knowledge graph.

Among them, the knowledge graph includes the correspondence between the functions of the smart home device and the smart home device and the corresponding relationship between the area where the smart home device is located.

In the embodiments of the present disclosure, users generally want to control smart home devices in their vicinity through voice. If the user makes a voice and wants to control a smart home device near him, the final control is not in the same area as the user. Another smart home device that is not in the same area as the user will not bring a better user experience to the user, so it reduces the user’s sense of experience and may also cause unnecessary power waste. Therefore, after obtaining the keywords, when determining the smart home device from the knowledge graph, the keywords and the first area where the user is currently located can be combined to jointly determine from the knowledge graph at least those that match the keywords and are located in the same area as the user. A smart home device to make the final smart home device more in line with the actual needs of users.

Moreover, there may be only one smart home device determined from the knowledge graph, or there may be more than one, depending on the smart home devices included in the user's residence. For example, continue to take the above-mentioned voice information input by the user as "too hot" as an example. Assume that the user is currently in the first area. In the first area, there are five smart air conditioners, smart speakers, smart lights, smart TVs, and smart fans. Home appliances, in which smart air conditioners and smart fans can be used for cooling, then there are two smart home appliances that match the keyword "cooling", namely smart air conditioners and smart fans.

As an implementation in some embodiments, in the embodiments of the present disclosure, as described in the foregoing, the knowledge graph may also include user feature tags that characterize user habits, preferences, user age and other information. Therefore, in order to make It is determined from the knowledge graph that the smart home device is more in line with the individual needs of the user. When the smart home device is determined from the knowledge graph, it can also be comprehensively determined by combining the obtained voice information corresponding to the user characteristics of the user. Then, when the control device analyzes and processes the voice information input by the user, it should also include confirmation of user characteristics, such as determining the user’s age, gender, and usage habits, and then combining the determined keywords, user characteristics and user characteristics of the user. The user’s current first location, at least one smart home device that matches the acquired keywords and user characteristics and is located in the same area as the user is determined from the knowledge graph, so that the determined at least one smart home device is more suitable for the user , Which makes users more satisfied and enhances user experience.

Step 305: According to the preset selection strategy, determine the first target smart home device that meets the preset selection strategy from at least one smart home device, and generate a control command according to the keyword.

In the embodiment of the present disclosure, after at least one smart home device is determined from the knowledge graph, if the at least one smart home device includes only one, it can be directly determined that the one smart home device is the target smart home device, if the If at least one smart home device includes two or more smart home devices, the first target smart home device can be determined from the at least one smart home device according to a preset selection strategy. Among them, the preset selection strategy includes the following strategies:

The first method: Determine any one of the at least one smart home device as the first target smart home device.

That is, one smart home device can be arbitrarily determined as the first target smart home device from at least one smart home device. For example, if at least one smart home device includes two smart home devices, a smart air conditioner and a smart fan, then the smart air conditioner can be determined As the first target smart home device, the smart fan can also be determined as the first target smart home device. Therefore, the method of determining the target smart home device is simple and fast, which improves the efficiency of determining the target smart device.

The second type: Determine the first target smart home device with the smallest energy consumption among at least one smart home device.

In the embodiments of the present disclosure, since the energy consumption of different smart home devices is not the same, in order to save the power consumed by the smart home devices, the energy consumption of each smart home device in the at least one smart home device can be compared, Therefore, the determined smart home device with lower energy consumption is determined as the first target smart home device.

The third type: determine the first target smart home device among at least one smart home device that is closest to the user.

In the embodiments of the present disclosure, the different distances between the smart home device and the user may bring different user experience, for example, a smart electric fan. If the distance from the user is too far, the user will not feel the blow of the smart electric fan. Wind, then it cannot meet the needs of users, and the experience is poor. Therefore, in order to make the efficacy of smart home devices bring a better sense of experience to users, when at least one smart home device is determined to include two or more smart home devices, the smart home device closest to the user can be selected. Device as the first target smart home device.

Specifically, a distance sensor can be set in each smart home device, and the distance between the user and each smart home device can be detected by the distance sensor, and the detected distance can be stored as a tag in the knowledge graph, and when it is determined from the knowledge graph After at least one smart home device is obtained, the distance between each smart home device in the at least one smart home device and the user’s current location can be obtained from the knowledge graph, and the smart home device closest to the user can be determined as the first Target smart home device.

Fourth: Determine all smart home devices in at least one smart furniture device as the first target smart home devices.

That is, the at least one smart home device is used as the target home device, so that the user can get a better experience. For example, assuming that the current indoor air quality is very poor and the air is urgently needed to be purified, the intelligence that can be used to purify the air is determined from the knowledge map Home appliances include smart air purifiers and smart air conditioners, so you can control smart air via Ahu device and smart air conditioners at the same time as the target smart home devices, so that indoor air quality can be improved quickly and indoor air quality.

The fifth type: determining that the at least one smart home device that matches the user characteristics of the user is the first target smart home device.

In the embodiments of the present disclosure, if at least one smart home device is determined from the knowledge graph without considering the user characteristics of the user, then after the at least one smart home device is determined, the at least one smart home device can be determined according to the user characteristics of the user. The target smart home is determined from a smart home device.

Or, in the current indoor environment, in addition to the user corresponding to the voice information, there may also be other users. Assuming that the user corresponding to the voice information is user a, and the current user a is located in the first area, then at least one smart home is determined from the knowledge graph After the device, if user b appears in the first area, and user b is a user with special care, a smart home device matching the user characteristics of user b can be determined from at least one smart home based on the user characteristics of user b , Regard it as the first target smart home device.

It should be noted that the first target smart home device determined according to the above-mentioned several selection strategies may be one or two, and there is no restriction here, as long as it meets the preset selection strategy.

In the embodiment of the present disclosure, after the first target smart home device is determined, the control device can generate a control command for the first target smart home device according to the keywords determined in the foregoing steps.

Step 306: Execute a control command to control the first target smart home device.

In the embodiment of the present disclosure, the control command generated according to the keyword can be used to control the first target smart home device. Specifically, when controlling the first target smart home device, if the first target smart home device is currently in the off state, the control command may be an on control command, and then the first target smart home device is turned on according to the on control command; If the first target smart home device is currently in the on state, the control command may be a command to adjust the operating state of the first target smart home device, and then the operating state of the first target smart home device may be controlled and adjusted according to the operating state adjustment command, For example, if the first target smart home device is a smart electric fan, you can increase or decrease the current wind speed of the smart electric fan; for another example, if the first target smart home device is a smart air conditioner, you can increase or decrease the smart The current temperature of the air conditioner. Or the control command may also be a shutdown command of the first target smart home device, so that the first target smart home device can turn off the target smart home device after receiving the shutdown command.

As an optional implementation manner, in the embodiments of the present disclosure, as described above, the user is not fixed in his residence, and the difference in the distance between the smart home device and the user may bring a difference to the user For example, smart electric light, the closer you are to the smart electric light, the stronger the surrounding light. Assuming that the first target smart home device identified above is the smart electric light L1, if the user's position in the first area changes so that the smart electric light L1 and the user's current location exceed the range illuminated by the smart electric light L1, at this time, if Continuing to use the photos of the smart light L1 will cause damage to the user's eyes, so it is necessary to re-determine the current smart light L2 in the first area, and then turn on the smart light L2 and turn off the smart light L1.

That is to say, if it is detected that the distance between the user and the first target smart home device exceeds the preset threshold, so that the user's perception of the efficacy of the operation of the first target smart home device is reduced, it can be determined from the knowledge map again In at least one smart home device in, determine the second target smart home device closest to the user after the user updates the location, stop running the first target smart home device, and control the operation of the second target smart home device so that the user gets better Sense of experience.

As an optional implementation manner, in the embodiments of the present disclosure, since the user can walk around at will when indoors, the area where the user is located may change. Then, according to the voice information input by the user, control in the first area After the first target smart home device is running, the user moves to the second area, and the efficacy of the first target smart home device can only cover the first area, so the effect of running the first target smart home device may not be great, resulting in Necessary energy waste.

Therefore, when it is detected that the user’s area has changed and the area is not changed again within a predetermined period of time, the first target smart home device can be stopped, and the changed area can be re-determined from the knowledge map and the aforementioned key At least one smart home device that matches the word and is located in the changed area, and then determines a new target smart home device from the re-determined at least one smart home device according to a preset selection strategy, thereby controlling the new target smart home device run. Therefore, after the user's area changes, the user does not need to re-enter the voice information to redefine the new target smart home device in the user's current area, and control the operation of the new smart home device, which improves the switching of the target smart home device The speed of operation improves the user experience.

Based on the same inventive concept, the embodiments of the present disclosure provide a device for controlling a smart home device, and the device for controlling a smart home device can implement functions corresponding to the aforementioned method for controlling a smart home device. The device for controlling smart home equipment can be a hardware structure, a software module, or a hardware structure plus a software module. The device for controlling smart home equipment can be implemented by a chip system, and the chip system can be composed of a chip, or can include a chip and other discrete devices. As shown in FIG. 4, the device for controlling smart home equipment includes an obtaining module 401, a first determining module 402, a second determining module 403, a third determining module 404, and a control module 405. among them:

The obtaining module 401 is configured to obtain the voice information input by the user and determine the first area where the user is currently located;

The first determining module 402 is configured to determine keywords related to the smart home device according to the voice information input by the user;

The second determining module 403 is configured to determine at least one smart home device matching the keyword and located in the first area from a preset knowledge graph according to the keyword and the first area, where the knowledge graph includes smart home devices Correspondence with the function of the smart home device and the area where the smart home device is located;

The third determining module 404 is configured to determine the first target smart home device that meets the preset selection strategy from at least one smart home device according to the preset selection strategy, and generate a control command according to the keyword;

The control module 405 is configured to execute control commands to control the first target smart home device.

In a possible implementation manner, the first determining module 402 is further configured to: convert voice information into sentences to be recognized through voice recognition technology; perform semantic analysis on the sentences to be recognized to obtain keywords related to smart home devices.

In a possible implementation manner, the second determining module 403 is further configured to: when the knowledge graph also includes the correspondence between user characteristics and multiple smart home devices, perform voiceprint recognition on the obtained voice information to determine the user’s User characteristics; according to user characteristics, keywords, and the first area, determine from the knowledge graph at least one smart home device that matches the user characteristics and keywords and is located in the first area.

In a possible implementation manner, the preset selection strategy includes:

Determine any one of at least one smart home device as the first target smart home device; or,

Determine the smart home device with the smallest energy consumption among at least one smart home device as the first target smart home device; or,

Determine that at least one smart home device closest to the user is the first target smart home device; or,

It is determined that all smart home devices in at least one smart furniture device are the first target smart home devices.

In a possible implementation manner, the device for controlling a smart home shown in FIG. 4 further includes a detection module 406 configured to determine that at least one smart home device is closest to the user in the preset selection strategy When is the first target smart home device, if it is detected that the distance between the user and the first target smart home device exceeds the preset threshold, then from at least one smart home, the smart home device that is the same as the user’s current area and is the closest to Smart home equipment as the second target;

And stop running the first target smart home device, and control the second target smart home device to run.

Based on the same inventive concept, an embodiment of the present disclosure provides a control device. As shown in FIG. 5, the control device includes at least one processor 501 and a memory 502 connected to the at least one processor. The embodiment of the present disclosure does not limit The specific connection medium between the processor 501 and the memory 502. In FIG. 5, the connection between the processor 501 and the memory 502 through the bus 500 is taken as an example. The bus 500 is represented by thick lines in FIG. 5, and the connections between other components The method is only for schematic illustration and is not meant to be limiting. The bus 500 can be divided into an address bus, a data bus, a control bus, etc. For ease of presentation, only a thick line is used in FIG. 5 to represent it, but it does not mean that there is only one bus or one type of bus.

In the embodiment of the present disclosure, the memory 502 stores instructions that can be executed by at least one processor 501. By executing the instructions stored in the memory 502, the at least one processor 501 can execute the steps included in the aforementioned method for controlling smart home devices. .

Among them, the processor 501 is the control center of the control device, which can use various interfaces and lines to connect various parts of the entire control device, and control the device by running or executing instructions stored in the memory 502 and calling data stored in the memory 502 The various functions and processing data of the control device can be used for overall monitoring of the control equipment. In some embodiments, the processor 501 may include one or more processing units, and the processor 501 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, and application programs, etc. The modem processor mainly deals with wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 501. In some embodiments, the processor 501 and the memory 502 may be implemented on the same chip, and in some embodiments, they may also be implemented on separate chips.

The processor 501 may be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, Implement or execute the methods, steps, and logical block diagrams disclosed in the embodiments of the present disclosure. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the method for controlling smart home devices disclosed in conjunction with the embodiments of the present disclosure may be directly embodied as executed by a hardware processor, or executed by a combination of hardware and software modules in the processor.

As a non-volatile computer-readable storage medium, the memory 502 can be configured to store non-volatile software programs, non-volatile computer-executable programs, and modules. The memory 502 may include at least one type of storage medium, for example, it may include flash memory, hard disk, multimedia card, card-type memory, random access memory (Random Access Memory, RAM), static random access memory (Static Random Access Memory, SRAM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), magnetic memory, disk , CD, etc. The memory 502 is any other medium that can be configured to carry or store desired program codes in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto. The memory 502 in the embodiment of the present disclosure may also be a circuit or any other device capable of realizing a storage function for storing program instructions and/or data.

By designing and programming the processor 501, the code corresponding to the method for controlling smart home devices introduced in the foregoing embodiment can be solidified into the chip, so that the chip can execute the steps of the foregoing method for controlling smart home devices during operation. How to design and program the processor 501 is a technology well known to those skilled in the art, and will not be repeated here.

Based on the same inventive concept, the embodiments of the present disclosure also provide a storage medium that stores computer instructions, and when the computer instructions run on the computer, the computer executes the steps of the aforementioned method for controlling smart home devices.

In some possible implementation manners, various aspects of the method for controlling smart home devices provided in the present disclosure can also be implemented in the form of a program product, which includes program code. When the program product runs on the control device, the program code uses In this way, the device for controlling the smart home device executes the steps in the method for controlling the smart home device according to various exemplary embodiments of the present disclosure described above in this specification.

Those skilled in the art should understand that the embodiments of the present disclosure can be provided as methods, systems, or computer program products. Therefore, the present disclosure may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present disclosure may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) containing computer-usable program codes.

The present disclosure is described with reference to flowcharts and/or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present disclosure. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are generated It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment. The instructions provide steps for implementing functions specified in a flow or multiple flows in the flowchart and/or a block or multiple blocks in the block diagram.

Obviously, those skilled in the art can make various changes and modifications to the present disclosure without departing from the spirit and scope of the present disclosure. In this way, if these modifications and variations of the present disclosure fall within the scope of the claims of the present disclosure and equivalent technologies, the present disclosure also intends to include these modifications and variations.

Claims (10)

1. A method for controlling smart home equipment includes:

   Obtain the voice information input by the user and determine the first area where the user is currently located;

   According to the voice information input by the user, keywords related to smart home equipment are determined;

   According to the keyword and the first area, at least one smart home device matching the keyword and located in the first area is determined from a preset knowledge graph, wherein the knowledge graph includes smart home Correspondence between the functions of the device and the smart home device and the area where the smart home device is located;

   According to a preset selection strategy, determine a first target smart home device that meets the preset selection strategy from the at least one smart home device, and generate a control command according to the keyword;

   The control command is executed to control the first target smart home device.
2. The method of claim 1, wherein, according to the voice information input by the user, determining the keywords related to the smart home device includes:

   Converting the voice information into sentences to be recognized through voice recognition technology;

   Perform semantic analysis on the sentence to be recognized to obtain keywords related to smart home devices.
3. The method according to claim 1, wherein if the knowledge graph further includes the correspondence between user characteristics and multiple smart home devices, the method further comprises:

   Perform voiceprint recognition on the voice information to determine the user characteristics of the user;

   According to the user characteristics, the keywords, and the first area, determine from the knowledge graph at least one smart home that matches the user characteristics and the keywords and is located in the first area equipment.
4. The method of claim 1, wherein the preset selection strategy comprises:

   Determine that any one of the at least one smart home device is the first target smart home device; or,

   It is determined that the at least one smart home device with the smallest energy consumption is the first target smart home device; or,

   Determine that the at least one smart home device closest to the user is the first target smart home device; or,

   It is determined that all smart home devices in the at least one smart furniture device are the first target smart home devices.
5. The method of claim 4, wherein if the preset selection strategy is to determine that the at least one smart home device closest to the user is the first target smart home device;

   After executing the control command to control the first target smart home device, the method further includes:

   If it is detected that the distance between the user and the first target smart home device exceeds a preset threshold, the smart home device that is the same and the closest to the user’s current location from the at least one smart home is the first 2. Target smart home equipment;

   And stop the operation of the first target smart home device, and control the operation of the second target smart home device.
6. A device for controlling smart home equipment, including:

   The obtaining module is configured to obtain the voice information input by the user and determine the first area where the user is currently located;

   The first determining module is configured to determine keywords related to the smart home device according to the voice information input by the user;

   The second determining module is configured to determine at least one smart home device matching the keyword and located in the first area from a preset knowledge graph according to the keyword and the first area, wherein , The knowledge graph includes the correspondence between the functions of the smart home device and the smart home device and the area where the smart home device is located;

   The third determining module is configured to determine a first target smart home device that meets the preset selection strategy from the at least one smart home device according to a preset selection strategy, and generate a control command according to the keyword;

   The control module is configured to execute control commands to control the first target smart home device.
7. 7. The apparatus of claim 6, wherein the first determining module is further configured to:

   Converting the voice information into sentences to be recognized through voice recognition technology;

   Perform semantic analysis on the sentence to be recognized to obtain keywords related to smart home devices.
8. 7. The device of claim 6, wherein the second determining module is further configured to:

   When the knowledge graph also includes the correspondence between user characteristics and multiple smart home devices, performing voiceprint recognition on the voice information to determine the user characteristics of the user;

   According to the user characteristics, the keywords, and the first area, determine from the knowledge graph at least one smart home device that matches the user characteristics and the keywords and is located in the first area .
9. A control device, the control device includes:

   The memory is set to store program instructions;

   The processor is configured to call the program instructions stored in the memory, and execute the steps included in the method according to any one of claims 1-5 according to the obtained program instructions.
10. A storage medium storing computer-executable instructions, and the computer-executable instructions are configured to make a computer execute the steps included in the method of any one of claims 1-5.

Images