WO2019015421A1 - Computer-based platform for quality management of home devices, including knowledge extraction - Google Patents
Computer-based platform for quality management of home devices, including knowledge extraction Download PDFInfo
- Publication number
- WO2019015421A1 WO2019015421A1 PCT/CN2018/091302 CN2018091302W WO2019015421A1 WO 2019015421 A1 WO2019015421 A1 WO 2019015421A1 CN 2018091302 W CN2018091302 W CN 2018091302W WO 2019015421 A1 WO2019015421 A1 WO 2019015421A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- platform
- home devices
- knowledge
- faults
- nodes
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2823—Reporting information sensed by appliance or service execution status of appliance services in a home automation network
- H04L12/2825—Reporting to a device located outside the home and the home network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/02—Knowledge representation; Symbolic representation
- G06N5/022—Knowledge engineering; Knowledge acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/02—Knowledge representation; Symbolic representation
- G06N5/022—Knowledge engineering; Knowledge acquisition
- G06N5/025—Extracting rules from data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/04—Inference or reasoning models
- G06N5/045—Explanation of inference; Explainable artificial intelligence [XAI]; Interpretable artificial intelligence
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2807—Exchanging configuration information on appliance services in a home automation network
- H04L12/2809—Exchanging configuration information on appliance services in a home automation network indicating that an appliance service is present in a home automation network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2823—Reporting information sensed by appliance or service execution status of appliance services in a home automation network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
- H04L43/55—Testing of service level quality, e.g. simulating service usage
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Definitions
- This disclosure relates generally to quality management of home devices.
- the present disclosure overcomes the limitations of the prior art by providing a computer-based platform for quality management of home devices.
- the quality management platform includes a knowledge repository and a query engine.
- the knowledge repository includes a knowledge graph of nodes connected by edges.
- the nodes represent concepts relating to home devices and their operation and faults, and the edges represent relations between the concepts.
- the query engine receives requests relating to home devices, queries the knowledge graph based on the requests, and returns responses based on the query results.
- the knowledge repository includes information extracted from a broad base of sources: user manuals, repair manuals, service manuals, and other manuals generated by the manufacturer or others; social media, product reviews, product comparisons, product ratings, and Internet-based sources such as Wikipedia and blogs; knowledge from human domain experts; customer service records, repair and warranty records, manufacturing and testing records, and other more structured data; and error codes, user discovery data, incident reports, and other data collected by home devices in the field.
- the quality management platform can include modules to extract relevant knowledge from these sources and code them as nodes and edges in the knowledge graph. Information can also be stored in a content repository, with references between the knowledge graph and the content repository.
- the quality management platform preferably is useful to a wide variety of users: end users of the devices, service staff (e.g., repairmen) , post-sales support such as call centers, and entities in the supply chain.
- Supply chain entities can include the design team, manufacturer and its suppliers, the distribution channel and QC/QA teams.
- the user interface preferably includes a mobile interface so that users of the platform can interact with the quality management platform via their mobile phones or other mobile devices.
- FIG. 1 is a diagram of a system including a quality management platform, in accordance with the invention.
- FIG. 2 is a block diagram of an example implementation of a quality management platform, in accordance with the invention.
- FIG. 3 illustrates some of the concepts that preferably are captured in a knowledge repository, in accordance with the invention.
- FIGS. 4A-4C show example excerpts from a knowledge graph, in accordance with the invention.
- FIGS. 5A-5C show example requests from users and the query results, in accordance with the invention.
- FIG. 6 is an excerpt from a table of contents of an operations manual.
- FIG. 1 is a diagram of a system including a quality management platform 150, in accordance with the invention.
- the quality management platform 150 is used to manage and enhance the quality of home devices 135A-N.
- home devices 135 include HVAC devices (e.g., air conditioner, heater, air venting) , lighting, powered window and door treatments (e.g., door locks, power blinds and shades) , powered furniture or furnishings (e.g., standing desk, recliner chair) , audio devices (e.g., music player) , video device (e.g., television, home theater) , environmental controls (e.g., air filter, air freshener) , kitchen appliances (e.g., rice cooker, oven, coffee machine, refrigerator) , bathroom appliances, and household robotic devices (e.g., vacuum robot, robot butler) .
- the home devices 135 can include other types of devices that can be used in a household.
- the end user 130 is using home devices 135 in a residential environment, such as a house, a condo, an apartment, or a dormitory.
- Other end users may use home devices in a non-residential environment, including for example a work environment (e.g., an office) or a business environment (e.g., a store, a clinic) .
- a work environment e.g., an office
- a business environment e.g., a store, a clinic
- the end user’s residential environment also includes a home network 137 connecting the home devices 135.
- the term “network” is intended to be interpreted broadly. It can include formal networks with standard defined protocols, such as Ethernet and InfiniBand.
- the network 137 is a local area network that has its network equipment and interconnects managed within the residential environment.
- the network 137 can also combine different types of connectivity. It may include a combination of local area and/or wide area networks, using both wired and/or wireless links. Data exchanged between the components on the network may be represented using any suitable format. In some embodiments, all or some of the data and communications may be encrypted.
- the home network 137 may simply be a communications network, including connection to external networks 140 and external devices, such as cloud-based services and the quality management platform 150.
- the home network 137 may also include intelligence, such as a hub that controls or configures the home devices 135.
- the system of FIG. 1 also includes a supply chain 110 and field service staff 120 for the home devices.
- the term “supply chain” is intended to be interpreted broadly. It generally includes entities that are involved in producing, delivering and/or servicing the home devices 135. Some examples include the design team 111 that designs and improves the home devices 135, the manufacturer 112A of the home devices and the suppliers 112B of components and services used in the manufacturing, the distribution channel 113 which may include distributors and retail shops, post-sales support 115 such as a call center, and quality control (QC) /quality assurance (QA) team 117. Various entities may play more than one role. For example, a large home appliance manufacturer may perform design 111, manufacturing 112A, some support 115 and QC/QA 117. Also, the entities playing these roles may be different for different home devices.
- the field service staff 120 is responsible for providing service to home devices in the field. They may be independent repairmen or the local service office for the device manufacturer.
- Network 140 may also be implemented in different ways. If the network 140 includes the Internet, then it also provides access to Internet resources, such as product reviews, blogs, and social media.
- the quality management platform 150 is implemented on a computer system. It collects, organizes and provides information relating to the quality and operation of the home devices. It typically provides fault identification and remediation, and operation and maintenance instructions. It may also collect information and statistics on these subjects as feedback to the supply chain.
- FIG. 2 is a block diagram of an example implementation of a quality management platform 150.
- the platform 150 includes a knowledge repository 250 and a query engine 230.
- the knowledge repository 250 stores the information about the home devices 135.
- the query engine 230 receives requests relating to the home devices, queries the knowledge repository 250, and returns responses based on the query results.
- the knowledge repository 250 includes a knowledge graph 252 and a content repository 254.
- the knowledge graph 252 is a graph of nodes connected by edges.
- the nodes represent concepts relating to the home devices and their operation and faults (i.e., errors) .
- the edges represent relations between the concepts.
- the query engine 230 includes a query extraction module 232 and a query compositor 234.
- the compositor 234 composes queries in the correct syntax for the knowledge graph 252.
- the extraction module 232 bridges the gap between the user’s requests and the query compositor 234.
- the user’s request may be a natural language question.
- Module 232 extracts the relevant information from the natural language question, and compositor 234 assembles this information into a correct syntax for querying the knowledge graph 252.
- the query results are used to identify information from the content repository 254 to be returned to the user. For example, certain nodes in the knowledge graph 252 may point to corresponding content in the content repository 254. Further details and examples are given below.
- the platform 150 optionally also includes a knowledge extraction module 210.
- This module 210 extracts knowledge from different source information and adds the extracted knowledge to the knowledge repository. For example, based on the source information, it may add or modify nodes and edges to the knowledge graph 252 and also add or modify information stored in the content repository 254.
- the knowledge extraction module 210 extracts information from a variety of different sources, including unstructured text, structured data, and sensor data and other information collected from home devices in the field.
- the platform 150 also includes interfaces to users of the platform and to staff operating and maintaining the platform. In FIG. 2, these are shown as a separate user interface 260 and maintenance interface 262, but they are not required to be separate.
- the users generally could be any of the entities shown in FIG. 1: end users (customers) , service staff, design team, manufacturer, post-sales support, QC/QA, etc.
- the user interface 260 preferably includes a mobile interface, so that users can send requests and receive responses via their mobile phone or other mobile device.
- the maintenance interface 242 allows staff to maintain the quality management platform 150, including the knowledge repository. For example, staff might review, test, edit and otherwise manage the information stored in the knowledge graph 252 and content repository 254. They may also implement and oversee knowledge extraction 210 from various sources.
- the approach described herein can be used to support use cases for any of the entities shown in FIG. 1 (although support of all of these entities is not required) .
- end users of the home devices might make requests regarding the operation of the home devices or simple faults.
- the platform 150 might return descriptions of the device operation, typical or recommended operating parameters, correction of faults that can be performed by the end user, device self-fixes and/or recommended maintenance schedules.
- the platform might return procedures to diagnosis the fault, identification of the fault based on symptoms or a ranking of possible faults, remediation instructions for correcting the fault, safety instructions for working with the device, and procedure for restarting the device after fault correction.
- the platform may also return supporting information, such as a list of replacements parts, tools used to fix the device, and a description of the operating principles.
- the platform might return information related to installation and initial setup/configuration of the home devices, if the service staff (or end user) is performing installation services. Similar support can also be provided to other types of post-sales support, for example a call center that provides remote support for the home devices.
- the platform receives information from home devices in the field, then it can be queried to provide feedback to the supply chain, including QC/QA teams and other types of post-sales analysis.
- Many home devices will self-report various events and sensor data, such as faults or values of certain parameters during operation. Examples of information that would be useful to analyze, either statistically or otherwise, include service recommendations, service cost, quality, occurrence of defects, occurrence of faults, root causes, customer feedback, and any correlations or other patterns.
- Information collected over time can be used to improve the design, manufacture and servicing of the home devices. Reports can be generated for the supply chain and for other users.
- FIG. 3 is a diagram that conceptually illustrates some of the concepts that preferably are captured in the knowledge repository 250. This example is focused on faults 310. In addition to the faults 310 themselves, the knowledge repository 250 may also capture related concepts, which in this example is divided into fault-related concepts 320 and device-related concepts 330. Examples of fault-related concepts 320 include what are the symptoms 322 of the fault, and what causes 324 the symptoms or the fault and what are other resulting effects 325. Diagnosis and remediation 326 of the fault preferably are also captured, including what tools 340 may be needed for diagnosis or remediation.
- Device-related concepts 330 may include which parts 332 are affected, and what is their function 334, operating principle 335 and normal operating parameters 336.
- the arrows show associations. For example, the arrows from 332 to 334, 335, 336 indicate that parts 332 are associated with corresponding function 334, operating principles 335 and parameters 336.
- this listing is provided solely to illustrate what concepts might be included in the nodes of the knowledge graph. It is not a complete listing, and even the part shown is not complete. For example, many of the “Faults of air conditioner” are shown, but the “Faults of refrigerator” and “Faults of electrical fan” are now shown (i.e., those categories have not been expanded in the listing) , to save space. Even for air conditioner, not every fault is shown and there can also be further hierarchy. For example, there can be multiple types of “Fault of compressor, ” which are not shown above. Many of the later headings are shown with abbreviated or no listings, for the purpose of illustration.
- FIGS. 4A-4C show example excerpts from a knowledge graph.
- the nodes are represented by boxes and the edges are represented by arrows.
- FIG. 4A shows a larger section of the knowledge graph.
- the node labels in FIG. 4A respectively refer to:
- Machine unit has no power and stops
- FIGS. 4B and 4C show more detailed sections of the knowledge graph.
- FIG. 4B shows hierarchical navigation from Node “a1: Symptom” .
- the next layer down in the hierarchy includes the nodes:
- Node “b2: Symptom of air conditioner” can be partially expanded as
- Touch screen has no display in welcome interface
- Machine unit has some fault
- the relations are all hierarchical subsets.
- Node “a1: Symptom” has the subsets b1-b3.
- Node “b2: Symptom of air conditioner” has the subsets c1-c3, and so on.
- FIG. 4C shows navigation from Node “a1: Parts” .
- a subset of Node “a1: Parts” is Node “a2: Parts of air conditioner. ”
- This example shows relations beyond just the parent-child hierarchical relation.
- the left column includes the following nodes, with the following relations:
- Node a2 hasParameter Node b1.
- Node a2 hasPrinciple Node b2.
- FIGS. 5A-5C show example requests and the corresponding query results. Each of these figures show the natural language request from the user, the resulting query for the knowledge repository, and the query results from the knowledge repository.
- the user is a repairman and makes a request “Why is there no display on the touch screen in the welcome interface? How to solve this fault? ”
- the query extraction module 232 extracts the relevant information and the query compositor 234 creates the query shown in FIG. 5A, where “some” is the class being sought.
- the “Execute” button causes execution of the query.
- Querying the knowledge graph 252 returns the two subclasses and eleven instances shown.
- the first six instances, numbered 1-6, are instances of diagnosis steps. The remaining five instances are possible causes. More information can be retrieved by clicking each instance.
- the quality management platform 150 can be used by many different users for many different purposes: repair staff, customer service, end users, QC/QA and even other machines such as an artificial intelligence (AI) home assistant. Another possible advantage is that the quality management platform 150 can acquire knowledge from many different information sources, and that knowledge can be accumulated over time.
- AI artificial intelligence
- sources of information can include unstructured text, structured data, and sensor data and other information collected from home devices in the field. Examples include user manuals, repair manuals, service manuals, and other manuals generated by the manufacturer or others. Other examples of unstructured content include social media, product reviews, product comparison, product ratings, and Internet-based sources such as Wikipedia and blogs. Unstructured text can be processed, for example using natural language processing 212, and then incorporated into the quality management platform.
- FIG. 6 is a table of contents for Chapter 5 from an operations manual for an air conditioner.
- Chapter 5 is “Electrical Control Maintenance Operation Guidelines Manual for Water Cooling Threaded Shaft” .
- This chapter concerns faults of the compressor.
- the table of contents and the manual are processed using deep natural language parsing, semantic analysis and entity-relation extraction techniques. This yields concepts and relations that are coded in the knowledge graph 252.
- Relevant text and pictures can also be stored in the content repository 254.
- Section 5.8 is “Treatment for fault of electrical power supply protection. ”
- This concept can be incorporated into the knowledge graph 252, with the actual text and figures stored in the content repository 254.
- the representation in the knowledge graph can be used to respond to user queries, and the actual text and figures can then be provided to users making relevant queries.
- knowledge from domain experts may also be incorporated into the quality management platform.
- Experienced repairmen may notice certain patterns or develop better remediation approaches, which may be captured in the quality management platform.
- knowledge from domain expert is expressed as rules 216, which are then encoded as concepts and relations in the knowledge graph.
- Other sources of information can include customer service records, repair and warranty records, manufacturing and testing records, and other more structured data.
- structured data can be incorporated into the quality management platform more directly because it is already structured.
- Fields may be mapped 213 to nodes and edges of the knowledge graph.
- the data may be analyzed using machine learning 214 or statistical analysis 215 to determine relevant concepts and relations (e.g., symptoms and causality of faults) .
- Sensor data generated in the field may also be analyzed to determine relevant concepts and relations.
- sensors in home devices in the field may collect data, both during normal operation and for faults. This data can include error codes, user discovery data and incident reports. Based on user activity records, user profile or usage patterns might be extracted.
- This data can then be analyzed 214, 215 to improve the quality management platform.
- data is automatically reported by the home devices via the Internet or other networks.
- Alternate embodiments are implemented in computer hardware, firmware, software, and/or combinations thereof. Implementations can be implemented in a computer program product tangibly embodied in a machine-readable storage device for execution by a programmable processor; and method steps can be performed by a programmable processor executing a program of instructions to perform functions by operating on input data and generating output. Embodiments can be implemented advantageously in one or more computer programs that are executable on a programmable system including at least one programmable processor coupled to receive data and instructions from, and to transmit data and instructions to, a data storage system, at least one input device, and at least one output device.
- Each computer program can be implemented in a high-level procedural or object-oriented programming language, or in assembly or machine language if desired; and in any case, the language can be a compiled or interpreted language.
- Suitable processors include, by way of example, both general and special purpose microprocessors.
- a processor will receive instructions and data from a read-only memory and/or a random access memory.
- a computer will include one or more mass storage devices for storing data files; such devices include magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and optical disks.
- Storage devices suitable for tangibly embodying computer program instructions and data include all forms of non-volatile memory, including by way of example semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM disks. Any of the foregoing can be supplemented by, or incorporated in, ASICs (application-specific integrated circuits) and other forms of hardware.
- ASICs application-specific integrated circuits
- module is not meant to be limited to a specific physical form. Depending on the specific application, modules can be implemented as hardware, firmware, software, and/or combinations of these. Furthermore, different modules can share common components or even be implemented by the same components. There may or may not be a clear boundary between different modules, even if drawn as separate elements in the figures.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Automation & Control Theory (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Artificial Intelligence (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Evolutionary Computation (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Medical Informatics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
A quality management platform for home devices is implemented on a computer system and comprises a knowledge repository and a query engine. The knowledge repository includes a knowledge graph of nodes connected by edges. The nodes represent concepts relating to home devices and their operation and faults, and the edges represent relations between the concepts. The query engine receives requests relating to home devices, queries the knowledge graph based on the requests, and returns responses based on the query results.
Description
CROSS-REFERENCE TO RELATED APPLICATION (S)
This application claims priority to and the benefit of the date of U.S. Patent Application Serial No. 15/652,190, filed July 17, 2017 and 15/655,159, filed July 20, 2017, which are hereby incorporated by reference in their entireties.
1.
Technical Field
This disclosure relates generally to quality management of home devices.
2.
Description of Related Art
As technology progresses, more types of home devices and more capable home devices are available to end users to improve their lives and to meet various needs. Every year new home devices are created to perform new tasks, including tasks that previously were available only in restaurant or commercial settings. In addition, existing home devices are improved to provide better or more functions. This progress in home devices is also accelerating over time and is becoming more worldwide. New devices are introduced more frequently and are distributed more quickly over a wider geography of customers. This pace will only accelerate as home devices become Internet-enabled or obtain other communications capability, allowing remote upgrades and reporting from home devices in the field.
However, one disadvantage is that the distribution of information relating to these devices must also keep pace with the accelerating progress of new devices. As new home devices are introduced, end users must be provided instructions on their operation and maintenance, new procedures for troubleshooting and remediation must be developed and distributed, and service staff in the field must be provided with up-to-date information for new devices and new models of existing devices. Meanwhile, information for existing devices and existing models cannot be discarded as many of those home devices will remain in operation for many years.
Thus, there is a need for improved approaches to the overall quality management of home devices.
SUMMARY
The present disclosure overcomes the limitations of the prior art by providing a computer-based platform for quality management of home devices. The quality management platform includes a knowledge repository and a query engine. The knowledge repository includes a knowledge graph of nodes connected by edges. The nodes represent concepts relating to home devices and their operation and faults, and the edges represent relations between the concepts. The query engine receives requests relating to home devices, queries the knowledge graph based on the requests, and returns responses based on the query results.
Preferably, the knowledge repository includes information extracted from a broad base of sources: user manuals, repair manuals, service manuals, and other manuals generated by the manufacturer or others; social media, product reviews, product comparisons, product ratings, and Internet-based sources such as Wikipedia and blogs; knowledge from human domain experts; customer service records, repair and warranty records, manufacturing and testing records, and other more structured data; and error codes, user discovery data, incident reports, and other data collected by home devices in the field. The quality management platform can include modules to extract relevant knowledge from these sources and code them as nodes and edges in the knowledge graph. Information can also be stored in a content repository, with references between the knowledge graph and the content repository.
The quality management platform preferably is useful to a wide variety of users: end users of the devices, service staff (e.g., repairmen) , post-sales support such as call centers, and entities in the supply chain. Supply chain entities can include the design team, manufacturer and its suppliers, the distribution channel and QC/QA teams. The user interface preferably includes a mobile interface so that users of the platform can interact with the quality management platform via their mobile phones or other mobile devices.
Other aspects include components, devices, systems, improvements, methods, processes, applications, computer readable mediums, and other technologies related to any of the above.
The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing (s) will be provided by the Office upon request and payment of the necessary fee.
Embodiments of the disclosure have other advantages and features which will be more readily apparent from the following detailed description and the appended claims, when taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a diagram of a system including a quality management platform, in accordance with the invention.
FIG. 2 is a block diagram of an example implementation of a quality management platform, in accordance with the invention.
FIG. 3 illustrates some of the concepts that preferably are captured in a knowledge repository, in accordance with the invention.
FIGS. 4A-4C show example excerpts from a knowledge graph, in accordance with the invention.
FIGS. 5A-5C show example requests from users and the query results, in accordance with the invention.
FIG. 6 is an excerpt from a table of contents of an operations manual.
The figures depict various embodiments for purposes of illustration only. One skilled in the art will readily recognize from the following discussion that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles described herein.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
The figures and the following description relate to preferred embodiments by way of illustration only. It should be noted that from the following discussion, alternative embodiments of the structures and methods disclosed herein will be readily recognized as viable alternatives that may be employed without departing from the principles of what is claimed.
FIG. 1 is a diagram of a system including a quality management platform 150, in accordance with the invention. The quality management platform 150 is used to manage and enhance the quality of home devices 135A-N. Examples of home devices 135 include HVAC devices (e.g., air conditioner, heater, air venting) , lighting, powered window and door treatments (e.g., door locks, power blinds and shades) , powered furniture or furnishings (e.g., standing desk, recliner chair) , audio devices (e.g., music player) , video device (e.g., television, home theater) , environmental controls (e.g., air filter, air freshener) , kitchen appliances (e.g., rice cooker, oven, coffee machine, refrigerator) , bathroom appliances, and household robotic devices (e.g., vacuum robot, robot butler) . The home devices 135 can include other types of devices that can be used in a household.
In the example of FIG. 1, the end user 130 is using home devices 135 in a residential environment, such as a house, a condo, an apartment, or a dormitory. Other end users may use home devices in a non-residential environment, including for example a work environment (e.g., an office) or a business environment (e.g., a store, a clinic) . For convenience, only one end user is shown in FIG. 1.
In FIG. 1, the end user’s residential environment also includes a home network 137 connecting the home devices 135. The term “network” is intended to be interpreted broadly. It can include formal networks with standard defined protocols, such as Ethernet and InfiniBand. In one embodiment, the network 137 is a local area network that has its network equipment and interconnects managed within the residential environment. The network 137 can also combine different types of connectivity. It may include a combination of local area and/or wide area networks, using both wired and/or wireless links. Data exchanged between the components on the network may be represented using any suitable format. In some embodiments, all or some of the data and communications may be encrypted. The home network 137 may simply be a communications network, including connection to external networks 140 and external devices, such as cloud-based services and the quality management platform 150. In some embodiments, the home network 137 may also include intelligence, such as a hub that controls or configures the home devices 135.
The system of FIG. 1 also includes a supply chain 110 and field service staff 120 for the home devices. The term “supply chain” is intended to be interpreted broadly. It generally includes entities that are involved in producing, delivering and/or servicing the home devices 135. Some examples include the design team 111 that designs and improves the home devices 135, the manufacturer 112A of the home devices and the suppliers 112B of components and services used in the manufacturing, the distribution channel 113 which may include distributors and retail shops, post-sales support 115 such as a call center, and quality control (QC) /quality assurance (QA) team 117. Various entities may play more than one role. For example, a large home appliance manufacturer may perform design 111, manufacturing 112A, some support 115 and QC/QA 117. Also, the entities playing these roles may be different for different home devices.
The field service staff 120 is responsible for providing service to home devices in the field. They may be independent repairmen or the local service office for the device manufacturer.
The quality management platform 150 is implemented on a computer system. It collects, organizes and provides information relating to the quality and operation of the home devices. It typically provides fault identification and remediation, and operation and maintenance instructions. It may also collect information and statistics on these subjects as feedback to the supply chain.
FIG. 2 is a block diagram of an example implementation of a quality management platform 150. The platform 150 includes a knowledge repository 250 and a query engine 230. The knowledge repository 250 stores the information about the home devices 135. The query engine 230 receives requests relating to the home devices, queries the knowledge repository 250, and returns responses based on the query results.
In the example of FIG. 2, the knowledge repository 250 includes a knowledge graph 252 and a content repository 254. The knowledge graph 252 is a graph of nodes connected by edges. The nodes represent concepts relating to the home devices and their operation and faults (i.e., errors) . The edges represent relations between the concepts. In this example, the query engine 230 includes a query extraction module 232 and a query compositor 234. The compositor 234 composes queries in the correct syntax for the knowledge graph 252. The extraction module 232 bridges the gap between the user’s requests and the query compositor 234. For example, the user’s request may be a natural language question. Module 232 extracts the relevant information from the natural language question, and compositor 234 assembles this information into a correct syntax for querying the knowledge graph 252. The query results are used to identify information from the content repository 254 to be returned to the user. For example, certain nodes in the knowledge graph 252 may point to corresponding content in the content repository 254. Further details and examples are given below.
The platform 150 optionally also includes a knowledge extraction module 210. This module 210 extracts knowledge from different source information and adds the extracted knowledge to the knowledge repository. For example, based on the source information, it may add or modify nodes and edges to the knowledge graph 252 and also add or modify information stored in the content repository 254. The knowledge extraction module 210 extracts information from a variety of different sources, including unstructured text, structured data, and sensor data and other information collected from home devices in the field.
The platform 150 also includes interfaces to users of the platform and to staff operating and maintaining the platform. In FIG. 2, these are shown as a separate user interface 260 and maintenance interface 262, but they are not required to be separate. The users generally could be any of the entities shown in FIG. 1: end users (customers) , service staff, design team, manufacturer, post-sales support, QC/QA, etc. The user interface 260 preferably includes a mobile interface, so that users can send requests and receive responses via their mobile phone or other mobile device. The maintenance interface 242 allows staff to maintain the quality management platform 150, including the knowledge repository. For example, staff might review, test, edit and otherwise manage the information stored in the knowledge graph 252 and content repository 254. They may also implement and oversee knowledge extraction 210 from various sources.
Before describing further details of the platform 150, it is useful to consider some use cases for the platform 150. As mentioned previously, the approach described herein can be used to support use cases for any of the entities shown in FIG. 1 (although support of all of these entities is not required) . For example, end users of the home devices might make requests regarding the operation of the home devices or simple faults. The platform 150 might return descriptions of the device operation, typical or recommended operating parameters, correction of faults that can be performed by the end user, device self-fixes and/or recommended maintenance schedules.
Service staff in the field typically will make requests regarding faults or symptoms. The platform might return procedures to diagnosis the fault, identification of the fault based on symptoms or a ranking of possible faults, remediation instructions for correcting the fault, safety instructions for working with the device, and procedure for restarting the device after fault correction. The platform may also return supporting information, such as a list of replacements parts, tools used to fix the device, and a description of the operating principles. In another scenario, the platform might return information related to installation and initial setup/configuration of the home devices, if the service staff (or end user) is performing installation services. Similar support can also be provided to other types of post-sales support, for example a call center that provides remote support for the home devices.
If the platform receives information from home devices in the field, then it can be queried to provide feedback to the supply chain, including QC/QA teams and other types of post-sales analysis. Many home devices will self-report various events and sensor data, such as faults or values of certain parameters during operation. Examples of information that would be useful to analyze, either statistically or otherwise, include service recommendations, service cost, quality, occurrence of defects, occurrence of faults, root causes, customer feedback, and any correlations or other patterns. Information collected over time can be used to improve the design, manufacture and servicing of the home devices. Reports can be generated for the supply chain and for other users.
In order to return meaningful results to users, the knowledge repository 250 captures sufficient information and represents it in a manner that it can be meaningfully queried by users. FIG. 3 is a diagram that conceptually illustrates some of the concepts that preferably are captured in the knowledge repository 250. This example is focused on faults 310. In addition to the faults 310 themselves, the knowledge repository 250 may also capture related concepts, which in this example is divided into fault-related concepts 320 and device-related concepts 330. Examples of fault-related concepts 320 include what are the symptoms 322 of the fault, and what causes 324 the symptoms or the fault and what are other resulting effects 325. Diagnosis and remediation 326 of the fault preferably are also captured, including what tools 340 may be needed for diagnosis or remediation. Device-related concepts 330 may include which parts 332 are affected, and what is their function 334, operating principle 335 and normal operating parameters 336. The arrows show associations. For example, the arrows from 332 to 334, 335, 336 indicate that parts 332 are associated with corresponding function 334, operating principles 335 and parameters 336.
In the example platform of FIG. 2, these concepts are captured in the nodes (concepts) and edges (relations) of the knowledge graph 252. Below is a partial hierarchical listing of concepts taken from an implementation of a quality management platform:
● Faults
○ Faults of refrigerator
○ Faults of electrical fan
○ Faults of air conditioner
■ Low voltage related fault
■ Fault of compressor
■ Fault of molded-case circuit breaker tripping
■ Fault of miniature circuit breaker
■ Fault of contactor
■ Machine unit touch fault
■ Fault of water flow
■ Fault of temperature sensor
■ Voltage fault
■ Fault of electronic expansion valve
■ Fault of electrical current
■ Fault of electrical current projection
● Causes of faults
○ Causes of fault of refrigerator
○ Causes of fault of electrical fan
○ Causes of fault of air conditioner
■ Cause of low voltage related fault
■ Cause of fault of compressor
■ Cause of fault of molded-case circuit breaker tripping
■ Cause of fault of miniature circuit breaker
■ Cause of fault of contactor
■ Cause of machine unit touch fault
■ Cause of fault of water flow
■ Cause of fault of temperature sensor
■ Cause of voltage fault
■ Cause of fault of electronic expansion valve
■ Cause of fault of electrical current protection
■ Cause of fault of electrical current
■ Cause of high voltage related fault
● Function
○ Cut off electrical power supply for machine unit
○ Short protection
○ Overload projection
● Operating principles
● Operation
○ Wiring
● Tools
○ Multimeter
○ Thermometer
○ Current clamp
Note that this listing is provided solely to illustrate what concepts might be included in the nodes of the knowledge graph. It is not a complete listing, and even the part shown is not complete. For example, many of the “Faults of air conditioner” are shown, but the “Faults of refrigerator” and “Faults of electrical fan” are now shown (i.e., those categories have not been expanded in the listing) , to save space. Even for air conditioner, not every fault is shown and there can also be further hierarchy. For example, there can be multiple types of “Fault of compressor, ” which are not shown above. Many of the later headings are shown with abbreviated or no listings, for the purpose of illustration. For example, there will be many concepts under “Operating principle” and many more concepts than shown under “Function” “Operation” and “Tools” . Even the listing of main concepts is not complete. For example, “Symptoms” “Diagnosis” and “Remediation” typically would also be included, as could be any of the other concepts shown in FIG. 3. This example is organized hierarchically and some of the edges in the knowledge graph will capture the hierarchical relationship. However, concepts are not required to be organized in this manner.
Below is a partial listing of relations taken from an implementation of a quality management platform:
● causeOf
● componentOf
● conditionOf
● detailOf
● faultOf
● functionOf
● methodOf
● parameterOf
● principleOf
● resultOf
● solutionOf
● symptomOf
● hasCause
● hasComponent
● hasCondition
● hasDetail
● hasFault
● hasFunction
● hasMethod
● hasParameter
● hasPrinciple
● hasResult
● hasSolution
● hasSymptom
● inCondition
● measure
● measuredBy
● next
● referTo
● resultIn
● series
● useMethod
This is also just an excerpt provided to illustrate what relations might be represented by the edges of the knowledge graph. It is not a complete listing, and even the part shown is not complete. For convenience, the relations can be grouped into three categories and are listed in this order in the above excerpt: xxxOf, hasXxx, and other. xxxOf and hasXxx are counterparts. If Node A hasCause Node B, then Node B is causeOf Node A. In this implementation of the knowledge graph, both directions are labelled. In an alternate approach, only one direction is labelled and the other relation can be inferred. If Node A hasCause Node B, then it can be inferred that Node B is a cause of Node A.
FIGS. 4A-4C show example excerpts from a knowledge graph. In these examples, the nodes are represented by boxes and the edges are represented by arrows. FIG. 4A shows a larger section of the knowledge graph. The node labels in FIG. 4A respectively refer to:
a2. Fault of air conditioner
a3. Solution for air conditioner
a4. Touch fault of machine unit
b1. Fault
b2. Voltage
b3. Machine unit has no power and stops
b4. Air conditioner
b5. Parts
b6. Concepts in the field of electrical devices
c1. Function
c2. Cause
c3. Parts of air conditioner
c4. Operation
c5. Physical parameter
c6. Operating principle
c7. Solution
c8. Symptom
d1. Symptom of air conditioner
d2. Fault of water flow
d3. Iron core of contactor
d4. Mechanical structure
d5. Component
d6. Compressor
d7. Voltage fault
d8. Cause for air conditioner fault
d9. Wiring
d10. Time relay
d11. Machine unit
e1. Cause for touch fault of machine unit
e2. Plan for fault of water flow
e3. Cause for fault of miniature circuit breaker
e4. Cause for fault of contactor
e5. Cause for low voltage related fault
e6. Cause for fault of compressor
e7. Plan for fault of electrical resistor
e8. Cause for fault of electrical current protection
e9. Cause for fault of temperature sensor
e10. Plan for miniature circuit breaker tripping
e11. Solution for molded-case circuit breaker tripping
e12. Cause for fault of electronic failure valve
e13. Cause for fault of electrical current
FIGS. 4B and 4C show more detailed sections of the knowledge graph. FIG. 4B shows hierarchical navigation from Node “a1: Symptom” . The next layer down in the hierarchy includes the nodes:
b1. Symptom of electrical fan
b2. Symptom of air conditioner
b3. Symptom of refrigerator
For the next layer down, Node “b2: Symptom of air conditioner” can be partially expanded as
c1. Any normal open contacts KM11 or KM 12 is not closed
c2. Touch screen has no display in welcome interface
c3. Machine unit has some fault
In this example, the relations are all hierarchical subsets. Node “a1: Symptom” has the subsets b1-b3. Node “b2: Symptom of air conditioner” has the subsets c1-c3, and so on.
FIG. 4C shows navigation from Node “a1: Parts” . A subset of Node “a1: Parts” is Node “a2: Parts of air conditioner. ” This example shows relations beyond just the parent-child hierarchical relation. The left column includes the following nodes, with the following relations:
b1. Physical parameters. Node a2 hasParameter Node b1.
b2. Operating principle. Node a2 hasPrinciple Node b2.
b3. Air conditioner. Node a2 componentOf Node b3.
Nodes cx in the right column list different parts:
c1. Master switch
c2. Coil
c3. Contactor
c4. Power supply
c5. Thermal relay
c6. Temperature sensor
c7. Iron core of contactor
c8. Mechanical structure
c9. Components
FIGS. 5A-5C show example requests and the corresponding query results. Each of these figures show the natural language request from the user, the resulting query for the knowledge repository, and the query results from the knowledge repository. In FIG. 5A, the user is a repairman and makes a request “Why is there no display on the touch screen in the welcome interface? How to solve this fault? ” The query extraction module 232 extracts the relevant information and the query compositor 234 creates the query shown in FIG. 5A, where “some” is the class being sought. The “Execute” button causes execution of the query.
Querying the knowledge graph 252 returns the two subclasses and eleven instances shown. The first six instances, numbered 1-6, are instances of diagnosis steps. The remaining five instances are possible causes. More information can be retrieved by clicking each instance.
One potential advantage of the quality management platform 150 is that it can be used by many different users for many different purposes: repair staff, customer service, end users, QC/QA and even other machines such as an artificial intelligence (AI) home assistant. Another possible advantage is that the quality management platform 150 can acquire knowledge from many different information sources, and that knowledge can be accumulated over time.
Referring again to FIG. 2, sources of information can include unstructured text, structured data, and sensor data and other information collected from home devices in the field. Examples include user manuals, repair manuals, service manuals, and other manuals generated by the manufacturer or others. Other examples of unstructured content include social media, product reviews, product comparison, product ratings, and Internet-based sources such as Wikipedia and blogs. Unstructured text can be processed, for example using natural language processing 212, and then incorporated into the quality management platform.
FIG. 6 is a table of contents for Chapter 5 from an operations manual for an air conditioner. Chapter 5 is “Electrical Control Maintenance Operation Guidelines Manual for Water Cooling Threaded Shaft” . This chapter concerns faults of the compressor. In one approach, the table of contents and the manual are processed using deep natural language parsing, semantic analysis and entity-relation extraction techniques. This yields concepts and relations that are coded in the knowledge graph 252. Relevant text and pictures can also be stored in the content repository 254. For example, Section 5.8 is “Treatment for fault of electrical power supply protection. ” This concept can be incorporated into the knowledge graph 252, with the actual text and figures stored in the content repository 254. The representation in the knowledge graph can be used to respond to user queries, and the actual text and figures can then be provided to users making relevant queries.
Returning to FIG. 2, knowledge from domain experts may also be incorporated into the quality management platform. Experienced repairmen may notice certain patterns or develop better remediation approaches, which may be captured in the quality management platform. In one approach, knowledge from domain expert is expressed as rules 216, which are then encoded as concepts and relations in the knowledge graph.
Other sources of information can include customer service records, repair and warranty records, manufacturing and testing records, and other more structured data. In some cases, structured data can be incorporated into the quality management platform more directly because it is already structured. Fields may be mapped 213 to nodes and edges of the knowledge graph. In other cases, the data may be analyzed using machine learning 214 or statistical analysis 215 to determine relevant concepts and relations (e.g., symptoms and causality of faults) . Sensor data generated in the field may also be analyzed to determine relevant concepts and relations. For example, sensors in home devices in the field may collect data, both during normal operation and for faults. This data can include error codes, user discovery data and incident reports. Based on user activity records, user profile or usage patterns might be extracted. This data can then be analyzed 214, 215 to improve the quality management platform. In some cases, data is automatically reported by the home devices via the Internet or other networks.
Although the detailed description contains many specifics, these should not be construed as limiting the scope of the invention but merely as illustrating different examples and aspects of the invention. It should be appreciated that the scope of the invention includes other embodiments not discussed in detail above. Various other modifications, changes and variations which will be apparent to those skilled in the art may be made in the arrangement, operation and details of the method and apparatus of the present invention disclosed herein without departing from the spirit and scope of the invention as defined in the appended claims. Therefore, the scope of the invention should be determined by the appended claims and their legal equivalents.
Alternate embodiments are implemented in computer hardware, firmware, software, and/or combinations thereof. Implementations can be implemented in a computer program product tangibly embodied in a machine-readable storage device for execution by a programmable processor; and method steps can be performed by a programmable processor executing a program of instructions to perform functions by operating on input data and generating output. Embodiments can be implemented advantageously in one or more computer programs that are executable on a programmable system including at least one programmable processor coupled to receive data and instructions from, and to transmit data and instructions to, a data storage system, at least one input device, and at least one output device. Each computer program can be implemented in a high-level procedural or object-oriented programming language, or in assembly or machine language if desired; and in any case, the language can be a compiled or interpreted language. Suitable processors include, by way of example, both general and special purpose microprocessors. Generally, a processor will receive instructions and data from a read-only memory and/or a random access memory. Generally, a computer will include one or more mass storage devices for storing data files; such devices include magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and optical disks. Storage devices suitable for tangibly embodying computer program instructions and data include all forms of non-volatile memory, including by way of example semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM disks. Any of the foregoing can be supplemented by, or incorporated in, ASICs (application-specific integrated circuits) and other forms of hardware.
The term “module” is not meant to be limited to a specific physical form. Depending on the specific application, modules can be implemented as hardware, firmware, software, and/or combinations of these. Furthermore, different modules can share common components or even be implemented by the same components. There may or may not be a clear boundary between different modules, even if drawn as separate elements in the figures.
Claims (39)
- A platform for quality management of home devices, the platform implemented on a computer system and comprising:a knowledge repository comprising a knowledge graph, the knowledge graph comprising nodes connected by edges, the nodes representing concepts relating to home devices and their operation and faults, the edges representing relations between the concepts; anda query engine that receives requests relating to home devices, queries the knowledge graph based on the received requests, and returns responses based on the query results.
- The platform of claim 1 wherein the knowledge repository further comprises a content repository that stores information about home devices and their operation and faults, and the query engine returns information from the content repository selected based on the query results.
- The platform of claim 1 wherein the query engine comprises a query compositor that composes queries for the knowledge repository based on the received requests.
- The platform of claim 1 wherein at least some nodes represent faults of home devices.
- The platform of claim 4 wherein at least some other nodes represent at least one of symptoms of faults of home devices, causes of faults of home devices, diagnosis of faults of home devices, or solutions for faults of home devices.
- The platform of claim 1 wherein at least some nodes represent components of home devices, functions of home devices or their components, or operation or operating principles of home devices or their components.
- The platform of claim 1 wherein at least some nodes represent operating parameters of home devices or their components.
- The platform of claim 1 wherein some edges between pairs of nodes represent at least one of a relation that one of the nodes has a characteristic of the other node, a relation that one of the nodes is a subset of the other node, a relation of cause and effect, a relation of effect and remediation.
- The platform of claim 1 wherein some edges between pairs of nodes represent a physical relation between the two nodes.
- The platform of claim 1 wherein some edges between pairs of nodes represent a functional relation between the two nodes.
- The platform of claim 1 further comprising:a user interface, whereby users can make requests relating to home devices.
- The platform of claim 11 wherein the query engine returns responses for servicing home devices in the field in response to requests by service staff.
- The platform of claim 12 wherein the returned responses include at least one of ranked possible faults, suggested replacement parts to bring, remediation instructions, and safety instructions.
- The platform of claim 11 wherein the query engine returns responses for post sales analysis of home devices.
- The platform of claim 11 wherein the query engine returns responses for quality control and/or quality assurance analysis of home devices.
- The platform of claim 15 wherein the returned responses include at least one of statistics on service cost, service recommendations, quality, occurrence of faults, occurrence of defects, and customer feedback.
- The platform of claim 11 wherein the query engine returns responses for operation of the home devices in response to requests by end users of the home devices.
- The platform of claim 17 wherein the returned responses include at least one of operation information, user error correction, self-fixes, and recommended maintenance schedules.
- The platform of claim 11 wherein the user interface includes a mobile interface for receiving user requests and for returning responses to the user requests.
- The platform of claim 1 further comprising:a maintenance interface for reviewing, testing and/or editing the knowledge repository.
- The platform of claim 1 further comprising:a knowledge extraction module that extracts knowledge from source information and adds the extracted knowledge to the knowledge repository.
- The platform of claim 21 wherein the source information includes both unstructured text and data collected by sensors in home devices in the field, the knowledge extraction module processes the sensor data to extract relations between the sensor data and faults for the home devices, and the knowledge extraction module also processes the unstructured text to extract relations between faults and their diagnosis or remediation.
- The platform of claim 21 wherein the source information includes user manuals for the home devices, service manuals for the home devices, or other manuals for the home devices generated by the manufacturers of the home devices.
- The platform of claim 21 wherein the source information includes information collected for home devices in the field.
- The platform of claim 24 wherein the information collected for home devices in the field includes error codes experienced by the home devices in the field, user discovery data, incident reports for the home devices in the field, and data collected by sensors in the home devices in the field.
- The platform of claim 24 wherein the information collected for home devices in the field is automatically reported to the platform via the Internet.
- The platform of claim 21 wherein the source information includes product reviews, product comparisons, product ratings or other information from the Internet about the home devices.
- The platform of claim 21 wherein the source information includes product reviews, product comparisons, product ratings or other information from social media networks about the home devices.
- The platform of claim 21 wherein the source information includes information provided by human domain experts.
- The platform of claim 21 wherein the source information includes unstructured text, and the knowledge extraction module uses natural language processing to extract knowledge from the unstructured text.
- The platform of claim 21 wherein source information includes unstructured text, and the knowledge extraction module uses semantic analysis to extract knowledge from the unstructured text.
- The platform of claim 21 wherein the source information includes structured information.
- The platform of claim 21 wherein the source information includes data collected by sensors in home devices in the field, and the knowledge extraction module uses machine learning to extract knowledge from the sensor data.
- The platform of claim 21 wherein the source information includes data collected by sensors in home devices in the field, and the knowledge extraction module uses statistical analysis to extract knowledge from the sensor data.
- The platform of claim 21 wherein the nodes in the knowledge graph include faults for home devices.
- The platform of claim 35 wherein the nodes and edges in the knowledge graph contain information about symptoms of the faults, causes of the faults, consequences of the faults, diagnostic plans for the faults, or remediations for the faults.
- The platform of claim 35 wherein the nodes and edges in the knowledge graph contain information about tools for diagnosing and/or remediating the faults.
- The platform of claim 21 wherein the nodes and edges in the knowledge graph contain information about home devices.
- The platform of claim 38 wherein the nodes and edges in the knowledge graph contain information about components of the home devices, functioning of the home devices or their components, operating principles of the home devices or their components, or physical parameters for the home devices or their components.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201880039981.7A CN110753915B (en) | 2017-07-17 | 2018-06-14 | Computer-based home device quality management platform including knowledge extraction |
EP18834496.4A EP3655839B1 (en) | 2017-07-17 | 2018-06-14 | Computer-based platform for quality management of home devices, including knowledge extraction |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/652,190 | 2017-07-17 | ||
US15/652,190 US10536294B2 (en) | 2017-07-17 | 2017-07-17 | Computer-based platform for quality management of home devices |
US15/655,159 US10554438B2 (en) | 2017-07-17 | 2017-07-20 | Computer-based platform for quality management of home devices, including knowledge extraction |
US15/655,159 | 2017-07-20 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019015421A1 true WO2019015421A1 (en) | 2019-01-24 |
Family
ID=64999287
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2018/091302 WO2019015421A1 (en) | 2017-07-17 | 2018-06-14 | Computer-based platform for quality management of home devices, including knowledge extraction |
Country Status (4)
Country | Link |
---|---|
US (2) | US10536294B2 (en) |
EP (1) | EP3655839B1 (en) |
CN (1) | CN110753915B (en) |
WO (1) | WO2019015421A1 (en) |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10601640B1 (en) * | 2019-05-23 | 2020-03-24 | Accenture Global Solutions Limited | Enriched self-healing for cloud platforms |
CN110457489A (en) * | 2019-08-12 | 2019-11-15 | 珠海格力电器股份有限公司 | Resource scheduling method and system, and computer readable storage medium |
CN112448836B (en) * | 2019-09-04 | 2023-09-15 | 中兴通讯股份有限公司 | Fault root cause determination method, device, server and computer readable medium |
CN110989370B (en) * | 2019-11-06 | 2021-12-14 | 珠海格力电器股份有限公司 | Intelligent household interaction control method and system |
CN110825885B (en) * | 2019-11-13 | 2022-06-17 | 南方电网科学研究院有限责任公司 | Power equipment knowledge graph application system |
CN110941725A (en) * | 2019-11-29 | 2020-03-31 | 国网湖南省电力有限公司 | Knowledge graph-based hydroelectric generating set fault diagnosis method and system |
CN111472754B (en) * | 2019-12-23 | 2021-01-22 | 北京国双科技有限公司 | Fault processing method and device for oil pumping well, storage medium and electronic equipment |
US11684316B2 (en) | 2020-03-20 | 2023-06-27 | Kpn Innovations, Llc. | Artificial intelligence systems and methods for generating land responses from biological extractions |
CN111625659B (en) * | 2020-08-03 | 2020-11-13 | 腾讯科技(深圳)有限公司 | Knowledge graph processing method, device, server and storage medium |
US11651262B2 (en) * | 2020-09-22 | 2023-05-16 | International Business Machines Corporation | Interactive diagnostics of connected appliance devices |
CN113656647B (en) * | 2021-06-02 | 2022-05-03 | 韦东庆 | Intelligent operation and maintenance oriented engineering archive data management platform, method and system |
CN113610236A (en) * | 2021-08-05 | 2021-11-05 | 南京业恒达智能系统股份有限公司 | Mine electromechanical equipment fault diagnosis support system based on crowd sensing |
CN113742625B (en) * | 2021-09-07 | 2024-10-15 | 北京百度网讯科技有限公司 | Page data processing method, device, equipment and medium |
US20230231764A1 (en) * | 2021-12-30 | 2023-07-20 | Assurant, Inc. | Apparatuses, computer-implemented methods, and computer program products for improved selection and provision of operational support data objects |
US20230214244A1 (en) * | 2021-12-30 | 2023-07-06 | Assurant, Inc. | Apparatuses, computer-implemented methods, and computer program products for improved selection and provision of operational support data objects |
CN115953146B (en) * | 2022-12-07 | 2024-02-13 | 国家电网有限公司 | Auxiliary decision-making system for fault treatment of power distribution network |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070185814A1 (en) | 2005-10-18 | 2007-08-09 | Intertrust Technologies Corporation | Digital rights management engine systems and methods |
CN101217763A (en) * | 2008-01-15 | 2008-07-09 | 中兴通讯股份有限公司 | An expanding device and method from logic tree to physical tree in fault analysis |
CN102819600A (en) * | 2012-08-15 | 2012-12-12 | 中国电力科学研究院 | Keyword searching method facing to relational database of power production management system |
CN103023028A (en) * | 2012-12-17 | 2013-04-03 | 江苏省电力公司 | Rapid grid failure positioning method based on dependency graph of entities |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102004040795A1 (en) * | 2004-08-23 | 2006-03-02 | BSH Bosch und Siemens Hausgeräte GmbH | Method, device and software module for the software-technical mapping of the device behavior of a real home appliance in a model |
US9866697B2 (en) * | 2005-08-19 | 2018-01-09 | Nexstep, Inc. | Consumer electronic registration, control and support concierge device and method |
KR100976443B1 (en) * | 2008-09-04 | 2010-08-18 | 한국전자통신연구원 | Home-network error prediction system and home-network fault estimation method |
US8606554B2 (en) * | 2009-10-19 | 2013-12-10 | Siemens Aktiengesellschaft | Heat flow model for building fault detection and diagnosis |
US9684683B2 (en) * | 2010-02-09 | 2017-06-20 | Siemens Aktiengesellschaft | Semantic search tool for document tagging, indexing and search |
US9092802B1 (en) * | 2011-08-15 | 2015-07-28 | Ramakrishna Akella | Statistical machine learning and business process models systems and methods |
US20130297689A1 (en) * | 2012-05-03 | 2013-11-07 | Cisco Technology, Inc. | Activity Stream Tuning Using Multichannel Communication Analysis |
JP2014033300A (en) * | 2012-08-02 | 2014-02-20 | Toshiba Lighting & Technology Corp | Household electric appliance controller, household electric appliance control system, and household electric appliance control method |
EP3026609A1 (en) * | 2014-11-28 | 2016-06-01 | Siemens Aktiengesellschaft | A common plant model for modelling of physical plant items of a production plant |
US9344751B1 (en) * | 2015-05-08 | 2016-05-17 | Istreamplanet Co. | Coordination of fault-tolerant video stream processing in cloud-based video streaming system |
CN110447025A (en) * | 2016-09-29 | 2019-11-12 | 康维达无线有限责任公司 | It is enabled in Internet of Things semantic mashed up |
CN106713083B (en) * | 2016-11-24 | 2020-06-26 | 海信集团有限公司 | Intelligent household equipment control method, device and system based on knowledge graph |
-
2017
- 2017-07-17 US US15/652,190 patent/US10536294B2/en not_active Expired - Fee Related
- 2017-07-20 US US15/655,159 patent/US10554438B2/en not_active Expired - Fee Related
-
2018
- 2018-06-14 WO PCT/CN2018/091302 patent/WO2019015421A1/en unknown
- 2018-06-14 EP EP18834496.4A patent/EP3655839B1/en active Active
- 2018-06-14 CN CN201880039981.7A patent/CN110753915B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070185814A1 (en) | 2005-10-18 | 2007-08-09 | Intertrust Technologies Corporation | Digital rights management engine systems and methods |
CN101217763A (en) * | 2008-01-15 | 2008-07-09 | 中兴通讯股份有限公司 | An expanding device and method from logic tree to physical tree in fault analysis |
CN102819600A (en) * | 2012-08-15 | 2012-12-12 | 中国电力科学研究院 | Keyword searching method facing to relational database of power production management system |
CN103023028A (en) * | 2012-12-17 | 2013-04-03 | 江苏省电力公司 | Rapid grid failure positioning method based on dependency graph of entities |
Also Published As
Publication number | Publication date |
---|---|
US10536294B2 (en) | 2020-01-14 |
US20190018883A1 (en) | 2019-01-17 |
EP3655839A4 (en) | 2021-04-07 |
US20190020497A1 (en) | 2019-01-17 |
EP3655839A1 (en) | 2020-05-27 |
EP3655839B1 (en) | 2023-11-01 |
CN110753915A (en) | 2020-02-04 |
US10554438B2 (en) | 2020-02-04 |
CN110753915B (en) | 2022-11-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3655839B1 (en) | Computer-based platform for quality management of home devices, including knowledge extraction | |
CN110069051A (en) | Household electrical appliances fault handling method and device | |
JP6401614B2 (en) | Information presentation method, information presentation system, program, and recording medium | |
CN108090648B (en) | Method and device for diagnosing working state of electric equipment and display device | |
CA2939510C (en) | Systems and methods for component failure-mode surveillance | |
US12131625B2 (en) | Systems and methods for reducing alarm nuisance behaviors in an electrical system | |
US20120023058A1 (en) | Systems and methods for monitoring automation systems | |
US20190086452A1 (en) | Systems and methods for managing resource consumption | |
JP2015032152A (en) | Information processing system | |
CN106403188A (en) | Air conditioner maintenance method and maintenance device thereof | |
CN113654186B (en) | Air conditioner detection method and device, electronic equipment and storage medium | |
CN111340256A (en) | Household appliance fault maintenance method, household appliance fault maintenance terminal and storage medium | |
CN108870640B (en) | Air conditioner data query device and method and air conditioner | |
US7778719B2 (en) | Method, system, apparatus, and computer-readable medium for providing configure to service for a semiconductor manufacturing service guide system | |
JP2019114897A (en) | Data refining method, data refining device and data refining program | |
KR20150043169A (en) | Energy Management System Based on Platform and Method for Managing Energy Using That Energy Management System | |
Chao et al. | A profile based energy management system for domestic electrical appliances | |
CN102819253B (en) | 3G (the third generation telecommunication) network based remote dental air circuit diagnosing and monitoring system | |
JP2006050651A (en) | Home electronic appliance maintenance repair service system | |
WO2022132958A1 (en) | Risk assessment at power substations | |
Al-Adaileh et al. | Reduction of energy consumption using smart home techniques in the household sector | |
Kučera et al. | Semantic Web Technology for Building Information Model | |
Goncharenko et al. | On-line monitoring of the emergent behavior and characteristics of a product to improve product design | |
CN117461013A (en) | System and method for analyzing alarms to characterize electrical system problems | |
Constantin et al. | Agent Based Control |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18834496 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2018834496 Country of ref document: EP Effective date: 20200217 |