WO2017071420A1 - 一种智能设备语音交流方法、装置和系统 - Google Patents
一种智能设备语音交流方法、装置和系统 Download PDFInfo
- Publication number
- WO2017071420A1 WO2017071420A1 PCT/CN2016/099097 CN2016099097W WO2017071420A1 WO 2017071420 A1 WO2017071420 A1 WO 2017071420A1 CN 2016099097 W CN2016099097 W CN 2016099097W WO 2017071420 A1 WO2017071420 A1 WO 2017071420A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- smart device
- voice
- command
- smart
- string
- Prior art date
Links
- 238000004891 communication Methods 0.000 title claims abstract description 40
- 238000000034 method Methods 0.000 title claims abstract description 22
- 238000013507 mapping Methods 0.000 claims abstract description 20
- 230000003993 interaction Effects 0.000 abstract description 5
- 238000005516 engineering process Methods 0.000 description 6
- 230000014509 gene expression Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 238000004378 air conditioning Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000000717 retained effect Effects 0.000 description 2
- 241000238558 Eucarida Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/26—Devices for calling a subscriber
- H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
- H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
- H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/26—Devices for calling a subscriber
- H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
- H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
- H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
- H04M1/27453—Directories allowing storage of additional subscriber data, e.g. metadata
- H04M1/27457—Management thereof, e.g. manual editing of data
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/26—Devices for calling a subscriber
- H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
- H04M1/271—Devices whereby a plurality of signals may be stored simultaneously controlled by voice recognition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72418—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting emergency services
- H04M1/72421—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting emergency services with automatic activation of emergency service functions, e.g. upon sensing an alarm
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72484—User interfaces specially adapted for cordless or mobile telephones wherein functions are triggered by incoming communication events
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/725—Cordless telephones
- H04M1/72502—Cordless telephones with one base station connected to a single line
- H04M1/72505—Radio link set-up procedures
- H04M1/72511—Searching for available channels
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/26—Devices for calling a subscriber
- H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
- H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
- H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
- H04M1/2753—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips providing data content
Definitions
- the present invention relates to the field of smart home communication, and in particular, to a method, device and system for voice communication of a smart device.
- the voice interaction between human and intelligent hardware and smart home is basically one-way, that is, the control of people on the device. Two ways:
- the person controls the device by voice through the mobile terminal and the wearable device.
- the embodiment of the invention provides a method, a device and a system for voice communication of a smart device, so that voice communication can be realized between a person and an intelligent hardware.
- a smart device voice communication method includes:
- the method includes:
- binding the smart device comprises:
- establishing a voice connection with the smart device includes:
- the embodiment of the present invention further provides a method for voice communication of a smart device, including:
- an embodiment of the present invention further provides a smart device voice communication device, including:
- a first voice switching module configured to establish a voice connection with the smart device
- a first language mapping module configured to receive a voice input of the user, and map the voice input to a command or a character string corresponding to the smart device;
- the first communication module is configured to send the command or string to the smart device.
- the device further comprises:
- the address book management module is configured to search for and bind the smart device.
- the address book management module is further configured to:
- establishing a voice connection between the voice switching module and the smart device means:
- an embodiment of the present invention further provides a smart device voice communication device, including:
- a second communication module configured to receive a notification request sent by the smart device
- a second voice switching module configured to establish a voice connection with the smart device
- the second language mapping module is configured to receive a command or a string sent by the smart device, and map the command or string into a natural language.
- an embodiment of the present invention further provides a smart device voice communication system, including the above-mentioned smart device voice communication device and smart device.
- the embodiment of the present invention has the following beneficial effects:
- the solution provided by the embodiment of the present invention uses natural language interaction between the user and the mobile phone when the user talks with the smart device; and provides a mapping mechanism between the mobile phone and the smart device to complete the "command/string" and the "natural” in real time.
- the remote communication mode of people and devices can be changed from the centralized control mode of the APP to the voice communication dialogue mode before the ordinary person and the person.
- the design of the existing smart device is retained, and there is no need to add additional components such as SIM card, voice input and output, etc., which saves cost and is easily accepted by home appliance manufacturers.
- FIG. 1 is a flowchart of a method for voice communication of a smart device according to an embodiment of the present invention
- FIG. 2 is a flowchart of another method for voice communication of a smart device according to an embodiment of the present invention.
- FIG. 3 is a schematic structural diagram of a voice communication device of a smart device according to an embodiment of the present invention.
- FIG. 4 is a schematic structural diagram of another smart device voice communication device according to an embodiment of the present invention.
- FIG. 5 is a flowchart of adding a device contact according to Embodiment 1 of the present invention.
- FIG. 6 is a schematic diagram of a call link according to Embodiment 1 of the present invention.
- FIG. 7 is a schematic diagram of a language mapping engine according to Embodiment 1 of the present invention.
- an embodiment of the present invention provides a method for voice communication of a smart device, including:
- the method Before establishing a voice connection with the smart device, the method includes:
- the binding the smart device includes:
- the establishing a voice connection with the smart device includes:
- the embodiment of the present invention provides a method for voice communication of a smart device, including:
- the smart device can appear as an independent individual in the mobile phone's address book; the person calls the smart device, establishes the call link, asks the status of the intelligent hardware, requires the intelligent hardware to do certain things; the intelligent hardware caller establishes the call link, tells the person Whether or not the inquirer is going to take certain actions in his current state and requirements.
- the mobile phone After the mobile phone first scans to the smart device and establishes a connection with the smart device, the mobile phone prompts the user whether to add a device contact in the address book. Once added, the user can learn about the device details in the contact entry and learn about the device's features and supported features.
- the user can find the device in the contact list and use a normal call to establish a connection with the device. After the call, the user uses the natural language to query the current state of the device, and asks the device to perform a certain job.
- the smart device When the smart device generates some alarm events or reaches a certain condition preset by the user, the smart device will initiate a call and a contact call occurs on the user's mobile phone. After the user answers, you can hear the device notification described by the natural language mode, and you can use the technology in 2 to talk to the smart device.
- Smart devices such as smart homes and smart hardware are mostly limited in software and hardware resources, and cannot handle language processing and voice signal transmission.
- the smart device described in the embodiments of the present invention refers to a device that is limited in resources and cannot directly perform voice transmission and language processing.
- the smart device when the smart device and the user make a call, the smart device does not actually send and receive the voice signal, and does not need to perform language processing.
- the embodiment of the present invention provides a voice communication device for a smart device, including:
- a first voice switching module configured to establish a voice connection with the smart device
- a first language mapping module configured to receive a voice input of the user, and map the voice input to a command or a character string corresponding to the smart device;
- the first communication module is configured to send the command or string to the smart device.
- the device further includes:
- the address book management module is configured to search for and bind the smart device.
- the address book management module is also set to:
- the voice switching module establishes a voice connection with the smart device, which means:
- an embodiment of the present invention further provides a smart device voice communication device, including:
- a second communication module configured to receive a notification request sent by the smart device
- a second voice switching module configured to establish a voice connection with the smart device
- the second language mapping module is configured to receive a command or a string sent by the smart device, and map the command or string into a natural language.
- the premise of the call between the person and the smart device is to add the smart device as a contact in the mobile phone address book.
- the embodiment of the present invention generalizes the concept of "person", and in the address book, in addition to the real natural person, the smart device is allowed to be a virtual person.
- the contact presets two attribute selections, a person and a device, and the default attribute is a person.
- the contact's information such as a phone number
- adding a device contact select the attribute "Device" and after confirming that it is created, the phone starts searching for nearby smart devices.
- Mobile search smart devices can use a variety of wireless technologies such as wlan and bt, or use point-to-point direct connection and bridge through routers. Once the smart device is discovered, the phone can bind to the device and establish a connection with it. In addition, information broadcasted by the device, including functions supported by the device, can be obtained.
- wireless technologies such as wlan and bt, or use point-to-point direct connection and bridge through routers.
- the mobile phone After the mobile phone obtains the information of the device, such as the function and the name, the user determines to save the contact of the device, and the smart device is included in the address book management, and the device contact is created.
- a remote call between a person and a smart device is a call link for voice transmission.
- Figure 6 shows the call link architecture between a person and a smart device. The comparison also lists the call link between people.
- the calling call module When the user is calling.
- the calling call module first checks the contact to be called, and if it is a real person with a telephone number, the communication link is established by using a protocol specified by the wireless voice service; if it is a device contact without a phone number, the calling call module performs the call request. Device voice transfer processing.
- the device voice transfer process establishes a wireless data link with the smart device according to the address information stored in the device contact, such as a local area network address, a cloud address, and the like.
- the establishment of the link may be divided into three types: a short-range wireless direct connection, a short-range router connection, and a remote cloud connection. The specific process has been implemented by a mature technology, and will not be repeated in the embodiment of the present invention.
- the detection signal is sent to the smart device, and after the heartbeat signal returned by the device is obtained, the calling call module prompts both parties to be in the call.
- the device When the user is called, that is, the smart device is called, the device sends a notification message to the bound mobile phone.
- the mobile phone receives a notification request from the device, the router, and the cloud, the device voice transfer process is a virtual triggering of a contact call event, causing the call call module to work, and prompting the user device to contact the call. Call after the user is connected The link is established.
- the smart device described in the embodiment of the present invention does not directly send and recognize a natural language, and the interface language with the outside world is a string form such as a command/message.
- a two-way mapping mechanism is established between the "natural language and the command/message", so that the effect of the ordinary call conversation can also be generated between the user and the smart device.
- This mapping mechanism is referred to below as the language mapping engine.
- the language mapping engine and the connections to other modules are described in detail in FIG.
- TTS voice "The current temperature is 25 degrees"
- TTS voice "Someone asks for access, what do I need to do?"
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Library & Information Science (AREA)
- General Business, Economics & Management (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Telephonic Communication Services (AREA)
- Telephone Function (AREA)
Abstract
本申请提出一种智能设备语音交流方法、装置和系统,涉及智能家居通信领域。包括:与智能设备建立语音连接;接收用户的语音输入,并将所述语音输入映射成所述智能设备对应的命令或者字符串;将所述命令或者字符串发送至智能设备。当用户和智能设备通话时,人和手机之间采用自然语言交互。
Description
本发明涉及智能家居通信领域,具体涉及一种智能设备语音交流方法、装置和系统。
通过手机、PC(Personal Computer,个人计算机)和互联网,目前已经普及了人和人的即时互联和交流。随着物联网、智能硬件、智能家居的兴起,技术和产业的演进重点,已经转向了人和物、物和物之间的互联和交流。同时,作为最重要的一种交流方式,语音人机交流近年来也开始广泛商用,比如苹果的Siri、中兴的语音手机。
目前人和智能硬件、智能家居间的语音交互,基本都是单向的,即人对设备的控制。方式两种:
一.人对设备本身直接语音命令控制;
二.人通过移动终端、可穿戴类设备,用语音对设备进行控制。
在从设备到人的方向上,少数高端的智能家居产品支持语音告警或提示的方式,来通知在它附近的人。而绝大部分智能硬件,都无法内置语音处理系统。同时,目前的智能设备也都还不支持远程和人进行通话和交互。
发明内容
本发明实施例提供一种智能设备语音交流方法、装置和系统,使人和智能硬件之间,可以实现语音通话交流。
为了实现上述发明目的,本发明实施例采取的技术方案如下:
一种智能设备语音交流方法,包括:
与智能设备建立语音连接;
接收用户的语音输入,并将所述语音输入映射成所述智能设备对应的命令或者字符串;
将所述命令或者字符串发送至智能设备。
优选地,与所述智能设备建立语音连接之前包括:
搜索并绑定所述智能设备。
优选地,绑定所述智能设备包括:
将所述智能设备添加至通讯录中。
优选地,与所述智能设备建立语音连接包括:
向所述智能设备发出语音请求;
接收到所述智能设备返回的心跳信号。
为解决上述技术问题,本发明实施例还提供一种智能设备语音交流方法,包括:
接收智能设备发送的通知请求;
与所述智能设备建立语音连接;
接收智能设备发送的命令或者字符串,并将所述命令或者字符串映射称自然语言。
为解决上述技术问题,本发明实施例还提供一种智能设备语音交流装置,包括:
第一语音转接模块,设置为与智能设备建立语音连接;
第一语言映射模块,设置为接收用户的语音输入,并将所述语音输入映射成所述智能设备对应的命令或者字符串;
第一通讯模块,设置为将所述命令或者字符串发送至智能设备。
优选地,所述的装置还包括:
通信录管理模块,设置为搜索并绑定所述智能设备。
优选地,通信录管理模块还设置为:
将所述智能设备添加至通讯录中。
优选地,语音转接模块与所述智能设备建立语音连接是指:
向所述智能设备发出语音请求;
接收到所述智能设备返回的心跳信号。
为解决上述技术问题,本发明实施例还提供一种智能设备语音交流装置,包括:
第二通讯模块,设置为接收智能设备发送的通知请求;
第二语音转接模块,设置为与所述智能设备建立语音连接;
第二语言映射模块,设置为接收智能设备发送的命令或者字符串,并将所述命令或者字符串映射称自然语言。
为解决上述技术问题,本发明实施例还提供一种智能设备语音交流系统,包括上述的智能设备语音交流装置和智能设备。
本发明实施例和相关技术相比,具有如下有益效果:
本发明实施例提供的方案当用户和智能设备通话时,人和手机之间采用自然语言交互;手机和智能设备之间,则提供一个映射机制,来实时完成“命令/字符串”与“自然语言”的转化。可以将人和设备的远程交流模式,从APP的集中控制模式,改变成普通人和人之前的语音交流对话模式。同时,还保留了现有智能设备的设计,不需要额外再增加SIM卡、语音输入输出等部件,节约成本,容易被家电厂家接受。
图1是本发明实施例的一种智能设备语音交流方法的流程图;
图2是本发明实施例的另一种智能设备语音交流方法的流程图;
图3是本发明实施例的一种智能设备语音交流装置的结构示意图;
图4是本发明实施例的另一种智能设备语音交流装置的结构示意图;
图5是本发明实施例1的添加设备联系人的流程图;
图6是本发明实施例1的通话链路示意图;
图7是本发明实施例1的语言映射引擎示意图。
为使本发明的发明目的、技术方案和有益效果更加清楚明了,下面结合附图对本
发明的实施例进行说明,需要说明的是,在不冲突的情况下,本申请中的实施例和实施例中的特征可以相互任意组合。
如图1所示,本发明实施例提供一种智能设备语音交流方法,包括:
与智能设备建立语音连接;
接收用户的语音输入,并将所述语音输入映射成所述智能设备对应的命令或者字符串;
将所述命令或者字符串发送至智能设备。
与所述智能设备建立语音连接之前包括:
搜索并绑定所述智能设备。
其中,绑定所述智能设备包括:
将所述智能设备添加至通讯录中。
其中,与所述智能设备建立语音连接包括:
向所述智能设备发出语音请求;
接收到所述智能设备返回的心跳信号。
如图2所示,本发明实施例提还供一种智能设备语音交流方法,包括:
接收智能设备发送的通知请求;
与所述智能设备建立语音连接;
接收智能设备发送的命令或者字符串,并将所述命令或者字符串映射称自然语言。
智能设备可以作为独立的个体出现在手机的通信录中;人呼叫智能设备,建立通话链接,问询智能硬件的状态,要求智能硬件做某些事情;智能硬件呼叫人,建立通话链接,告诉人自己现在的状态和要求,问询人是否要采取某些行动。
支撑本发明实施例的技术要点有:
将智能设备作为手机的普通联系人来管理
在手机首次扫描到智能设备、并和智能设备建立连接后,手机提示用户是否在通信录添加设备联系人。添加后,用户可以在联系人条目中了解设备详情,知悉该设备的特性和支持的功能。
手机→智能设备的语音通话技术
当需要了解智能设备的状态或安排某项工作时,用户可以在联系人列表中找到该设备,采用普通通话呼叫的方式,来和设备建立连接。呼通后,用户采用与人对话的方式,用自然语言来问询设备的当前状态,要求设备执行某项工作。
智能设备→手机的语音通话技术
当智能设备发生一些告警事件或达到用户预设的某个条件时,智能设备会主动发起呼叫,并在用户的手机上发生联系人来电的情景。用户接听后,可以听到自然语言方式描述的设备通知,并可以采用2中的技术,与智能设备进行对话。
“命令/字符串”<——>自然语言之间的转化
智能家居、智能硬件等智能设备,大多软硬件资源很有限,本身不能进行语言处理和语音信号传输。本发明实施例中所述的智能设备,除非特指,都是指这类资源受限、无法直接进行语音传输和语言处理的设备。在本发明实施例中,当智能设备和用户进行通话时,智能设备并不真实的发送和接收语音信号,也不需要进行语言处理。
如图3所示,本发明实施例提还供一种智能设备语音交流装置,包括:
第一语音转接模块,设置为与智能设备建立语音连接;
第一语言映射模块,设置为接收用户的语音输入,并将所述语音输入映射成所述智能设备对应的命令或者字符串;
第一通讯模块,设置为将所述命令或者字符串发送至智能设备。
所述的装置还包括:
通信录管理模块,设置为搜索并绑定所述智能设备。
通信录管理模块还设置为:
将所述智能设备添加至通讯录中。
语音转接模块与所述智能设备建立语音连接是指:
向所述智能设备发出语音请求;
接收到所述智能设备返回的心跳信号。
如图4所示,本发明实施例还提供一种智能设备语音交流装置,包括:
第二通讯模块,设置为接收智能设备发送的通知请求;
第二语音转接模块,设置为与所述智能设备建立语音连接;
第二语言映射模块,设置为接收智能设备发送的命令或者字符串,并将所述命令或者字符串映射称自然语言。
实施例1
人和智能设备间通话的前提,是在手机通信录中,将智能设备添加为联系人。本发明实施例泛化了联系“人”的概念,在通信录中,除了真实的自然人,还允许智能设备作为虚拟的人。
如图5所示,在本发明实施例的通信录中,联系人预置两种属性选择——人和设备,可以默认属性为人。添加真实的自然联系人时,因为用户已经掌握了该联系人的信息,如电话号码,直接输入即可创建。在添加设备联系人时,选择属性为“设备”,确定创建后,手机开始搜索附近的智能设备。
手机搜索智能设备,可以通过wlan和bt等多种无线技术,也可以采用点对点直连和通过路由器桥接的方式。发现智能设备后,手机可以绑定该设备,并与之建立连接。进而还可以获取设备广播出来的信息,包括该设备支持的功能等。
手机获得设备的信息,如功能、名称后,用户确定保存该设备联系人,将此智能设备纳入通信录管理,创建设备联系人完成。
本发明实施例中人与智能设备的远程通话,关键是语音传输的通话链路。图6给出了人和智能设备间的通话链路架构,作为对比也列出了人和人之间的通话链路。
用户主叫时。呼叫通话模块先检查要呼叫的联系人,如果是带电话号码的真人,则采用无线语音业务规定的协议来建立通信链接;如果是无电话号码的设备联系人,则呼叫通话模块对呼叫请求进行设备语音转接处理。
设备语音转接流程是根据设备联系人中保存的地址信息,如局域网地址、云地址等,建立与智能设备之间的无线数据链接。建立链接的情况,可分为近距无线直连、近距路由器连接、远程云端连接3种,具体过程已有成熟技术实现了,本发明实施例不做重述。链接建立后,向智能设备端发送检测信号,得到设备端返回的心跳信号后,呼叫通话模块提示双方处在通话中。
用户被叫,即智能设备主叫时,设备向绑定的手机发送通知消息。手机收到来自设备、路由器和云端传来的通知请求时,由设备语音转接流程是虚拟触发有联系人来电事件,使呼叫通话模块工作,并提示用户设备联系人来电。用户接通后,呼叫通话
链路即建立。
在呼叫通话链路建立后,用户和智能设备即进入语音通话状态。本发明实施例所述的智能设备,本身并不直接发送和识别自然语言,与外界的接口语言是命令/消息等字符串形式。本发明实施例在“自然语言和命令/消息”之间,建立双向映射机制,使得用户和智能设备之间,也可以产生普通呼叫通话的效果。以下把这种映射机制,称为语言映射引擎,图7中详细描述了语言映射引擎,以及和其它模块间的联系。
以人呼叫空调,和空调通话为例,来阐述图7中的主叫方向:
人——>空调:
自然语言 :"现在多少度?"
正则表达式 :目前的温度是__度
命令映射 :temperature=?
命令接口 :getTemperature()
空调——>人
通知消息 :“temperature==25”
消息映射 :temperature=25
正则表达式 :目前的温度是25度
TTS语音 :“目前的温度是25度”
以智能门锁系统呼叫人,和人通话为例,阐述图3中的被叫方向:
智能门锁系统——>人
通知消息 :“Request Entering”
消息映射 :RequestEntering=yes
正则表达式 :有人请求进入,我需要怎么做?
TTS语音 :“有人请求进入,我需要怎么做?”
人——>红外感应器
情况1:指纹识别通过,或图像识别通过
自然语言 :"好的,允许进入"
正则表达式 :允许进入
命令映射 :EnteringPermission=yes
命令接口 :SetEnteringPer(True)
情况2:验证不通过
自然语言 :"不允许进入"
正则表达式 :不允许进入
命令映射 :EnteringPermission=no
命令接口 :SetEnteringPer(False)
虽然本发明所揭示的实施方式如上,但其内容只是为了便于理解本发明的技术方案而采用的实施方式,并非用于限定本发明。任何本发明所属技术领域内的技术人员,在不脱离本发明所揭示的核心技术方案的前提下,可以在实施的形式和细节上做任何修改与变化,但本发明所限定的保护范围,仍须以所附的权利要求书限定的范围为准。
通过上述实施例及优选实施方式,当用户和智能设备通话时,人和手机之间采用自然语言交互;手机和智能设备之间,则提供一个映射机制,来实时完成“命令/字符串”与“自然语言”的转化。可以将人和设备的远程交流模式,从APP的集中控制模式,改变成普通人和人之前的语音交流对话模式。同时,还保留了现有智能设备的设计,不需要额外再增加SIM卡、语音输入输出等部件,节约成本,容易被家电厂家接受。
Claims (11)
- 一种智能设备语音交流方法,包括:与智能设备建立语音连接;接收用户的语音输入,并将所述语音输入映射成所述智能设备对应的命令或者字符串;将所述命令或者字符串发送至智能设备。
- 如权利要求1所述的方法,其中:与所述智能设备建立语音连接之前包括:搜索并绑定所述智能设备。
- 如权利要求2所述的方法,其中:绑定所述智能设备包括:将所述智能设备添加至通讯录中。
- 如权利要求1所述的方法,其中:与所述智能设备建立语音连接包括:向所述智能设备发出语音请求;接收到所述智能设备返回的心跳信号。
- 一种智能设备语音交流方法,包括:接收智能设备发送的通知请求;与所述智能设备建立语音连接;接收智能设备发送的命令或者字符串,并将所述命令或者字符串映射称自然语言。
- 一种智能设备语音交流装置,包括:第一语音转接模块,设置为与智能设备建立语音连接;第一语言映射模块,设置为接收用户的语音输入,并将所述语音输入映射成所述智能设备对应的命令或者字符串;第一通讯模块,设置为将所述命令或者字符串发送至智能设备。
- 如权利要求6所述的装置,其中:还包括:通信录管理模块,设置为搜索并绑定所述智能设备。
- 如权利要求7所述的装置,其中:通信录管理模块还设置为:将所述智能设备添加至通讯录中。
- 如权利要求6所述的装置,其中:语音转接模块与所述智能设备建立语音连接是指:向所述智能设备发出语音请求;接收到所述智能设备返回的心跳信号。
- 一种智能设备语音交流装置,包括:第二通讯模块,设置为接收智能设备发送的通知请求;第二语音转接模块,设置为与所述智能设备建立语音连接;第二语言映射模块,设置为接收智能设备发送的命令或者字符串,并将所述命令或者字符串映射称自然语言。
- 一种智能设备语音交流系统,包括权利要求6至10任一所述的智能设备语音交流装置和智能设备。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510728451.1 | 2015-10-30 | ||
CN201510728451.1A CN106657521A (zh) | 2015-10-30 | 2015-10-30 | 一种智能设备语音交流方法、装置和系统 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017071420A1 true WO2017071420A1 (zh) | 2017-05-04 |
Family
ID=58629816
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2016/099097 WO2017071420A1 (zh) | 2015-10-30 | 2016-09-14 | 一种智能设备语音交流方法、装置和系统 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN106657521A (zh) |
WO (1) | WO2017071420A1 (zh) |
Cited By (63)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110097883A (zh) * | 2018-06-01 | 2019-08-06 | 苹果公司 | 用于在主设备处访问配套设备的呼叫功能的语音交互 |
US10720160B2 (en) | 2018-06-01 | 2020-07-21 | Apple Inc. | Voice interaction at a primary device to access call functionality of a companion device |
US10878809B2 (en) | 2014-05-30 | 2020-12-29 | Apple Inc. | Multi-command single utterance input method |
CN112528004A (zh) * | 2020-12-24 | 2021-03-19 | 北京百度网讯科技有限公司 | 语音交互方法、装置、电子设备、介质和计算机程序产品 |
US10978090B2 (en) | 2013-02-07 | 2021-04-13 | Apple Inc. | Voice trigger for a digital assistant |
US11009970B2 (en) | 2018-06-01 | 2021-05-18 | Apple Inc. | Attention aware virtual assistant dismissal |
US11037565B2 (en) | 2016-06-10 | 2021-06-15 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
US11070949B2 (en) | 2015-05-27 | 2021-07-20 | Apple Inc. | Systems and methods for proactively identifying and surfacing relevant content on an electronic device with a touch-sensitive display |
US11087759B2 (en) | 2015-03-08 | 2021-08-10 | Apple Inc. | Virtual assistant activation |
US11120372B2 (en) | 2011-06-03 | 2021-09-14 | Apple Inc. | Performing actions associated with task items that represent tasks to perform |
US11126400B2 (en) | 2015-09-08 | 2021-09-21 | Apple Inc. | Zero latency digital assistant |
US11133008B2 (en) | 2014-05-30 | 2021-09-28 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US11152002B2 (en) | 2016-06-11 | 2021-10-19 | Apple Inc. | Application integration with a digital assistant |
CN113535987A (zh) * | 2021-09-13 | 2021-10-22 | 杭州涂鸦信息技术有限公司 | 联动规则匹配方法以及相关装置 |
US11169616B2 (en) | 2018-05-07 | 2021-11-09 | Apple Inc. | Raise to speak |
US11237797B2 (en) | 2019-05-31 | 2022-02-01 | Apple Inc. | User activity shortcut suggestions |
US11257504B2 (en) | 2014-05-30 | 2022-02-22 | Apple Inc. | Intelligent assistant for home automation |
US11321116B2 (en) | 2012-05-15 | 2022-05-03 | Apple Inc. | Systems and methods for integrating third party services with a digital assistant |
US11348582B2 (en) | 2008-10-02 | 2022-05-31 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US11380310B2 (en) | 2017-05-12 | 2022-07-05 | Apple Inc. | Low-latency intelligent automated assistant |
US11388291B2 (en) | 2013-03-14 | 2022-07-12 | Apple Inc. | System and method for processing voicemail |
US11405466B2 (en) | 2017-05-12 | 2022-08-02 | Apple Inc. | Synchronization and task delegation of a digital assistant |
US11423886B2 (en) | 2010-01-18 | 2022-08-23 | Apple Inc. | Task flow identification based on user intent |
US11431642B2 (en) | 2018-06-01 | 2022-08-30 | Apple Inc. | Variable latency device coordination |
US11468282B2 (en) | 2015-05-15 | 2022-10-11 | Apple Inc. | Virtual assistant in a communication session |
US11467802B2 (en) | 2017-05-11 | 2022-10-11 | Apple Inc. | Maintaining privacy of personal information |
US11488406B2 (en) | 2019-09-25 | 2022-11-01 | Apple Inc. | Text detection using global geometry estimators |
US11500672B2 (en) | 2015-09-08 | 2022-11-15 | Apple Inc. | Distributed personal assistant |
US11516537B2 (en) | 2014-06-30 | 2022-11-29 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US11526368B2 (en) | 2015-11-06 | 2022-12-13 | Apple Inc. | Intelligent automated assistant in a messaging environment |
US11532306B2 (en) | 2017-05-16 | 2022-12-20 | Apple Inc. | Detecting a trigger of a digital assistant |
US11580990B2 (en) | 2017-05-12 | 2023-02-14 | Apple Inc. | User-specific acoustic models |
US11599331B2 (en) | 2017-05-11 | 2023-03-07 | Apple Inc. | Maintaining privacy of personal information |
US11657813B2 (en) | 2019-05-31 | 2023-05-23 | Apple Inc. | Voice identification in digital assistant systems |
US11671920B2 (en) | 2007-04-03 | 2023-06-06 | Apple Inc. | Method and system for operating a multifunction portable electronic device using voice-activation |
US11675491B2 (en) | 2019-05-06 | 2023-06-13 | Apple Inc. | User configurable task triggers |
US11675829B2 (en) | 2017-05-16 | 2023-06-13 | Apple Inc. | Intelligent automated assistant for media exploration |
US11696060B2 (en) | 2020-07-21 | 2023-07-04 | Apple Inc. | User identification using headphones |
US11705130B2 (en) | 2019-05-06 | 2023-07-18 | Apple Inc. | Spoken notifications |
US11710482B2 (en) | 2018-03-26 | 2023-07-25 | Apple Inc. | Natural assistant interaction |
US11727219B2 (en) | 2013-06-09 | 2023-08-15 | Apple Inc. | System and method for inferring user intent from speech inputs |
US11755276B2 (en) | 2020-05-12 | 2023-09-12 | Apple Inc. | Reducing description length based on confidence |
US11765209B2 (en) | 2020-05-11 | 2023-09-19 | Apple Inc. | Digital assistant hardware abstraction |
US11783815B2 (en) | 2019-03-18 | 2023-10-10 | Apple Inc. | Multimodality in digital assistant systems |
US11790914B2 (en) | 2019-06-01 | 2023-10-17 | Apple Inc. | Methods and user interfaces for voice-based control of electronic devices |
US11798547B2 (en) | 2013-03-15 | 2023-10-24 | Apple Inc. | Voice activated device for use with a voice-based digital assistant |
US11809783B2 (en) | 2016-06-11 | 2023-11-07 | Apple Inc. | Intelligent device arbitration and control |
US11809483B2 (en) | 2015-09-08 | 2023-11-07 | Apple Inc. | Intelligent automated assistant for media search and playback |
US11838734B2 (en) | 2020-07-20 | 2023-12-05 | Apple Inc. | Multi-device audio adjustment coordination |
US11853647B2 (en) | 2015-12-23 | 2023-12-26 | Apple Inc. | Proactive assistance based on dialog communication between devices |
US11853536B2 (en) | 2015-09-08 | 2023-12-26 | Apple Inc. | Intelligent automated assistant in a media environment |
US11854539B2 (en) | 2018-05-07 | 2023-12-26 | Apple Inc. | Intelligent automated assistant for delivering content from user experiences |
US11886805B2 (en) | 2015-11-09 | 2024-01-30 | Apple Inc. | Unconventional virtual assistant interactions |
US11888791B2 (en) | 2019-05-21 | 2024-01-30 | Apple Inc. | Providing message response suggestions |
US11893992B2 (en) | 2018-09-28 | 2024-02-06 | Apple Inc. | Multi-modal inputs for voice commands |
US11914848B2 (en) | 2020-05-11 | 2024-02-27 | Apple Inc. | Providing relevant data items based on context |
US11947873B2 (en) | 2015-06-29 | 2024-04-02 | Apple Inc. | Virtual assistant for media playback |
US12010262B2 (en) | 2013-08-06 | 2024-06-11 | Apple Inc. | Auto-activating smart responses based on activities from remote devices |
US12014118B2 (en) | 2017-05-15 | 2024-06-18 | Apple Inc. | Multi-modal interfaces having selection disambiguation and text modification capability |
US12051413B2 (en) | 2015-09-30 | 2024-07-30 | Apple Inc. | Intelligent device identification |
US12067985B2 (en) | 2018-06-01 | 2024-08-20 | Apple Inc. | Virtual assistant operations in multi-device environments |
US12073147B2 (en) | 2013-06-09 | 2024-08-27 | Apple Inc. | Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant |
US12087308B2 (en) | 2010-01-18 | 2024-09-10 | Apple Inc. | Intelligent automated assistant |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108390859B (zh) * | 2018-01-22 | 2021-03-23 | 深圳慧安康科技有限公司 | 一种对讲分机智能机器人装置 |
WO2019205134A1 (zh) * | 2018-04-28 | 2019-10-31 | 深圳魔耳智能声学科技有限公司 | 智能家居语音控制方法、装置、设备和系统 |
CN108566322A (zh) * | 2018-07-24 | 2018-09-21 | 珠海格力电器股份有限公司 | 通话方法及装置、存储介质、电子装置 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2011001370A1 (en) * | 2009-06-29 | 2011-01-06 | Avraham Ben-David | Intelligent home automation |
CN102332204A (zh) * | 2011-06-15 | 2012-01-25 | 上海理工大学 | 无线语音居家无障碍环境控制系统 |
CN102855872A (zh) * | 2012-09-07 | 2013-01-02 | 深圳市信利康电子有限公司 | 基于终端及互联网语音交互的家电控制方法及系统 |
CN103730116A (zh) * | 2014-01-07 | 2014-04-16 | 苏州思必驰信息科技有限公司 | 在智能手表上实现智能家居设备控制的系统及其方法 |
-
2015
- 2015-10-30 CN CN201510728451.1A patent/CN106657521A/zh active Pending
-
2016
- 2016-09-14 WO PCT/CN2016/099097 patent/WO2017071420A1/zh active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2011001370A1 (en) * | 2009-06-29 | 2011-01-06 | Avraham Ben-David | Intelligent home automation |
CN102332204A (zh) * | 2011-06-15 | 2012-01-25 | 上海理工大学 | 无线语音居家无障碍环境控制系统 |
CN102855872A (zh) * | 2012-09-07 | 2013-01-02 | 深圳市信利康电子有限公司 | 基于终端及互联网语音交互的家电控制方法及系统 |
CN103730116A (zh) * | 2014-01-07 | 2014-04-16 | 苏州思必驰信息科技有限公司 | 在智能手表上实现智能家居设备控制的系统及其方法 |
Cited By (98)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11979836B2 (en) | 2007-04-03 | 2024-05-07 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
US11671920B2 (en) | 2007-04-03 | 2023-06-06 | Apple Inc. | Method and system for operating a multifunction portable electronic device using voice-activation |
US11900936B2 (en) | 2008-10-02 | 2024-02-13 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US11348582B2 (en) | 2008-10-02 | 2022-05-31 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US11423886B2 (en) | 2010-01-18 | 2022-08-23 | Apple Inc. | Task flow identification based on user intent |
US12087308B2 (en) | 2010-01-18 | 2024-09-10 | Apple Inc. | Intelligent automated assistant |
US11120372B2 (en) | 2011-06-03 | 2021-09-14 | Apple Inc. | Performing actions associated with task items that represent tasks to perform |
US11321116B2 (en) | 2012-05-15 | 2022-05-03 | Apple Inc. | Systems and methods for integrating third party services with a digital assistant |
US12009007B2 (en) | 2013-02-07 | 2024-06-11 | Apple Inc. | Voice trigger for a digital assistant |
US11636869B2 (en) | 2013-02-07 | 2023-04-25 | Apple Inc. | Voice trigger for a digital assistant |
US11862186B2 (en) | 2013-02-07 | 2024-01-02 | Apple Inc. | Voice trigger for a digital assistant |
US11557310B2 (en) | 2013-02-07 | 2023-01-17 | Apple Inc. | Voice trigger for a digital assistant |
US10978090B2 (en) | 2013-02-07 | 2021-04-13 | Apple Inc. | Voice trigger for a digital assistant |
US11388291B2 (en) | 2013-03-14 | 2022-07-12 | Apple Inc. | System and method for processing voicemail |
US11798547B2 (en) | 2013-03-15 | 2023-10-24 | Apple Inc. | Voice activated device for use with a voice-based digital assistant |
US12073147B2 (en) | 2013-06-09 | 2024-08-27 | Apple Inc. | Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant |
US11727219B2 (en) | 2013-06-09 | 2023-08-15 | Apple Inc. | System and method for inferring user intent from speech inputs |
US12010262B2 (en) | 2013-08-06 | 2024-06-11 | Apple Inc. | Auto-activating smart responses based on activities from remote devices |
US11699448B2 (en) | 2014-05-30 | 2023-07-11 | Apple Inc. | Intelligent assistant for home automation |
US11133008B2 (en) | 2014-05-30 | 2021-09-28 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US11257504B2 (en) | 2014-05-30 | 2022-02-22 | Apple Inc. | Intelligent assistant for home automation |
US10878809B2 (en) | 2014-05-30 | 2020-12-29 | Apple Inc. | Multi-command single utterance input method |
US12067990B2 (en) | 2014-05-30 | 2024-08-20 | Apple Inc. | Intelligent assistant for home automation |
US11670289B2 (en) | 2014-05-30 | 2023-06-06 | Apple Inc. | Multi-command single utterance input method |
US12118999B2 (en) | 2014-05-30 | 2024-10-15 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US11810562B2 (en) | 2014-05-30 | 2023-11-07 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US11838579B2 (en) | 2014-06-30 | 2023-12-05 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US11516537B2 (en) | 2014-06-30 | 2022-11-29 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US11087759B2 (en) | 2015-03-08 | 2021-08-10 | Apple Inc. | Virtual assistant activation |
US11842734B2 (en) | 2015-03-08 | 2023-12-12 | Apple Inc. | Virtual assistant activation |
US12001933B2 (en) | 2015-05-15 | 2024-06-04 | Apple Inc. | Virtual assistant in a communication session |
US11468282B2 (en) | 2015-05-15 | 2022-10-11 | Apple Inc. | Virtual assistant in a communication session |
US11070949B2 (en) | 2015-05-27 | 2021-07-20 | Apple Inc. | Systems and methods for proactively identifying and surfacing relevant content on an electronic device with a touch-sensitive display |
US11947873B2 (en) | 2015-06-29 | 2024-04-02 | Apple Inc. | Virtual assistant for media playback |
US11853536B2 (en) | 2015-09-08 | 2023-12-26 | Apple Inc. | Intelligent automated assistant in a media environment |
US11550542B2 (en) | 2015-09-08 | 2023-01-10 | Apple Inc. | Zero latency digital assistant |
US11954405B2 (en) | 2015-09-08 | 2024-04-09 | Apple Inc. | Zero latency digital assistant |
US11500672B2 (en) | 2015-09-08 | 2022-11-15 | Apple Inc. | Distributed personal assistant |
US11126400B2 (en) | 2015-09-08 | 2021-09-21 | Apple Inc. | Zero latency digital assistant |
US11809483B2 (en) | 2015-09-08 | 2023-11-07 | Apple Inc. | Intelligent automated assistant for media search and playback |
US12051413B2 (en) | 2015-09-30 | 2024-07-30 | Apple Inc. | Intelligent device identification |
US11809886B2 (en) | 2015-11-06 | 2023-11-07 | Apple Inc. | Intelligent automated assistant in a messaging environment |
US11526368B2 (en) | 2015-11-06 | 2022-12-13 | Apple Inc. | Intelligent automated assistant in a messaging environment |
US11886805B2 (en) | 2015-11-09 | 2024-01-30 | Apple Inc. | Unconventional virtual assistant interactions |
US11853647B2 (en) | 2015-12-23 | 2023-12-26 | Apple Inc. | Proactive assistance based on dialog communication between devices |
US11657820B2 (en) | 2016-06-10 | 2023-05-23 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
US11037565B2 (en) | 2016-06-10 | 2021-06-15 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
US11152002B2 (en) | 2016-06-11 | 2021-10-19 | Apple Inc. | Application integration with a digital assistant |
US11809783B2 (en) | 2016-06-11 | 2023-11-07 | Apple Inc. | Intelligent device arbitration and control |
US11749275B2 (en) | 2016-06-11 | 2023-09-05 | Apple Inc. | Application integration with a digital assistant |
US11599331B2 (en) | 2017-05-11 | 2023-03-07 | Apple Inc. | Maintaining privacy of personal information |
US11467802B2 (en) | 2017-05-11 | 2022-10-11 | Apple Inc. | Maintaining privacy of personal information |
US11380310B2 (en) | 2017-05-12 | 2022-07-05 | Apple Inc. | Low-latency intelligent automated assistant |
US11862151B2 (en) | 2017-05-12 | 2024-01-02 | Apple Inc. | Low-latency intelligent automated assistant |
US11837237B2 (en) | 2017-05-12 | 2023-12-05 | Apple Inc. | User-specific acoustic models |
US11538469B2 (en) | 2017-05-12 | 2022-12-27 | Apple Inc. | Low-latency intelligent automated assistant |
US11580990B2 (en) | 2017-05-12 | 2023-02-14 | Apple Inc. | User-specific acoustic models |
US11405466B2 (en) | 2017-05-12 | 2022-08-02 | Apple Inc. | Synchronization and task delegation of a digital assistant |
US12014118B2 (en) | 2017-05-15 | 2024-06-18 | Apple Inc. | Multi-modal interfaces having selection disambiguation and text modification capability |
US12026197B2 (en) | 2017-05-16 | 2024-07-02 | Apple Inc. | Intelligent automated assistant for media exploration |
US11532306B2 (en) | 2017-05-16 | 2022-12-20 | Apple Inc. | Detecting a trigger of a digital assistant |
US11675829B2 (en) | 2017-05-16 | 2023-06-13 | Apple Inc. | Intelligent automated assistant for media exploration |
US11710482B2 (en) | 2018-03-26 | 2023-07-25 | Apple Inc. | Natural assistant interaction |
US11900923B2 (en) | 2018-05-07 | 2024-02-13 | Apple Inc. | Intelligent automated assistant for delivering content from user experiences |
US11907436B2 (en) | 2018-05-07 | 2024-02-20 | Apple Inc. | Raise to speak |
US11487364B2 (en) | 2018-05-07 | 2022-11-01 | Apple Inc. | Raise to speak |
US11169616B2 (en) | 2018-05-07 | 2021-11-09 | Apple Inc. | Raise to speak |
US11854539B2 (en) | 2018-05-07 | 2023-12-26 | Apple Inc. | Intelligent automated assistant for delivering content from user experiences |
US12067985B2 (en) | 2018-06-01 | 2024-08-20 | Apple Inc. | Virtual assistant operations in multi-device environments |
US10720160B2 (en) | 2018-06-01 | 2020-07-21 | Apple Inc. | Voice interaction at a primary device to access call functionality of a companion device |
US12061752B2 (en) | 2018-06-01 | 2024-08-13 | Apple Inc. | Attention aware virtual assistant dismissal |
US10984798B2 (en) | 2018-06-01 | 2021-04-20 | Apple Inc. | Voice interaction at a primary device to access call functionality of a companion device |
US11630525B2 (en) | 2018-06-01 | 2023-04-18 | Apple Inc. | Attention aware virtual assistant dismissal |
CN110097883A (zh) * | 2018-06-01 | 2019-08-06 | 苹果公司 | 用于在主设备处访问配套设备的呼叫功能的语音交互 |
US11360577B2 (en) | 2018-06-01 | 2022-06-14 | Apple Inc. | Attention aware virtual assistant dismissal |
US11009970B2 (en) | 2018-06-01 | 2021-05-18 | Apple Inc. | Attention aware virtual assistant dismissal |
US12080287B2 (en) | 2018-06-01 | 2024-09-03 | Apple Inc. | Voice interaction at a primary device to access call functionality of a companion device |
US11431642B2 (en) | 2018-06-01 | 2022-08-30 | Apple Inc. | Variable latency device coordination |
CN110097883B (zh) * | 2018-06-01 | 2020-04-28 | 苹果公司 | 用于在主设备处访问配套设备的呼叫功能的语音交互 |
US11893992B2 (en) | 2018-09-28 | 2024-02-06 | Apple Inc. | Multi-modal inputs for voice commands |
US11783815B2 (en) | 2019-03-18 | 2023-10-10 | Apple Inc. | Multimodality in digital assistant systems |
US12136419B2 (en) | 2019-03-18 | 2024-11-05 | Apple Inc. | Multimodality in digital assistant systems |
US11705130B2 (en) | 2019-05-06 | 2023-07-18 | Apple Inc. | Spoken notifications |
US11675491B2 (en) | 2019-05-06 | 2023-06-13 | Apple Inc. | User configurable task triggers |
US11888791B2 (en) | 2019-05-21 | 2024-01-30 | Apple Inc. | Providing message response suggestions |
US11237797B2 (en) | 2019-05-31 | 2022-02-01 | Apple Inc. | User activity shortcut suggestions |
US11657813B2 (en) | 2019-05-31 | 2023-05-23 | Apple Inc. | Voice identification in digital assistant systems |
US11790914B2 (en) | 2019-06-01 | 2023-10-17 | Apple Inc. | Methods and user interfaces for voice-based control of electronic devices |
US11488406B2 (en) | 2019-09-25 | 2022-11-01 | Apple Inc. | Text detection using global geometry estimators |
US11924254B2 (en) | 2020-05-11 | 2024-03-05 | Apple Inc. | Digital assistant hardware abstraction |
US11914848B2 (en) | 2020-05-11 | 2024-02-27 | Apple Inc. | Providing relevant data items based on context |
US11765209B2 (en) | 2020-05-11 | 2023-09-19 | Apple Inc. | Digital assistant hardware abstraction |
US11755276B2 (en) | 2020-05-12 | 2023-09-12 | Apple Inc. | Reducing description length based on confidence |
US11838734B2 (en) | 2020-07-20 | 2023-12-05 | Apple Inc. | Multi-device audio adjustment coordination |
US11750962B2 (en) | 2020-07-21 | 2023-09-05 | Apple Inc. | User identification using headphones |
US11696060B2 (en) | 2020-07-21 | 2023-07-04 | Apple Inc. | User identification using headphones |
CN112528004A (zh) * | 2020-12-24 | 2021-03-19 | 北京百度网讯科技有限公司 | 语音交互方法、装置、电子设备、介质和计算机程序产品 |
CN113535987A (zh) * | 2021-09-13 | 2021-10-22 | 杭州涂鸦信息技术有限公司 | 联动规则匹配方法以及相关装置 |
Also Published As
Publication number | Publication date |
---|---|
CN106657521A (zh) | 2017-05-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017071420A1 (zh) | 一种智能设备语音交流方法、装置和系统 | |
KR101597177B1 (ko) | 무선 통신 접속의 콘텍스트 인식 근접도 기반 설정 | |
US7027774B2 (en) | Method for direct voice telephone call using bluetooth terminal | |
JP7144479B2 (ja) | 端末機及びそれの動作方法(mobile and operating method thereof) | |
WO2015074600A1 (zh) | 一种来电转接方法及终端 | |
WO2015043198A1 (zh) | 一种控制访问路由器的方法、装置及系统 | |
CN102572584A (zh) | 对移动电话进行扩展的智能电视系统及方法 | |
WO2008148222A1 (en) | A host controlling an interfaced pda's applications directly | |
WO2016127795A1 (zh) | 业务处理方法、服务器及终端 | |
CN104205998A (zh) | 用于在蓝牙网络中中继数据通信的方法和装置 | |
US9258672B2 (en) | Short-range wireless communication device | |
WO2018095235A1 (zh) | 呼叫转移方法与系统 | |
US20230138804A1 (en) | Enhanced video call method and system, and electronic device | |
US20160173820A1 (en) | Video Communication Method and Device | |
US7580704B2 (en) | Communication systems and methods for switching communication services | |
CN104581665A (zh) | 一种通话转移的方法及装置 | |
WO2021239032A1 (zh) | 蓝牙协议连接方法、装置、存储介质及相关设备 | |
US20100291913A1 (en) | Remote control method between mobile phones | |
US12034561B2 (en) | Processing method, device and storage medium | |
US20120002570A1 (en) | Coordinating and Establishing Communication Networks Between Communication Devices | |
KR20210008415A (ko) | 액세스 제어 방법, 메시지 브로드캐스트 방법 및 관련 기기 | |
CN111935849A (zh) | 信息处理方法、设备及存储介质 | |
CN111787496B (zh) | 一种手机间转接电话的方法及设备 | |
CN101919184A (zh) | 监控主机的方法、监控装置及主机 | |
CN107635272A (zh) | 电子设备控制方法及装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16858856 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16858856 Country of ref document: EP Kind code of ref document: A1 |