CN114627850A - Vehicle-mounted voice interaction method and system - Google Patents
Vehicle-mounted voice interaction method and system Download PDFInfo
- Publication number
- CN114627850A CN114627850A CN202210304923.0A CN202210304923A CN114627850A CN 114627850 A CN114627850 A CN 114627850A CN 202210304923 A CN202210304923 A CN 202210304923A CN 114627850 A CN114627850 A CN 114627850A
- Authority
- CN
- China
- Prior art keywords
- voice
- vehicle
- information
- mobile terminal
- text
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 47
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000008030 elimination Effects 0.000 claims abstract description 15
- 238000003379 elimination reaction Methods 0.000 claims abstract description 15
- 230000004044 response Effects 0.000 claims description 24
- 238000012545 processing Methods 0.000 claims description 9
- 230000009471 action Effects 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 4
- 230000000875 corresponding effect Effects 0.000 description 11
- 230000006870 function Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 230000003213 activating effect Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000004072 lung Anatomy 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3329—Natural language query formulation or dialogue systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/02—Methods for producing synthetic speech; Speech synthesisers
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Artificial Intelligence (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Telephone Function (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application provides a vehicle-mounted voice interaction method and system, relates to the technical field of voice interaction, and specifically comprises the following steps: uploading the voice data and the vehicle information subjected to noise elimination to the mobile terminal by the vehicle-mounted information entertainment controller; the mobile terminal uploads the voice data, the vehicle information and the user information after noise elimination to a cloud server; the cloud server identifies voice data to obtain a voice data text, when the voice data text comprises text information of a voice instruction, the voice data text is sent to the mobile terminal, when the voice data text comprises text information of a voice question, reply voice is matched from a preset reply voice database based on vehicle information, user information and the text information of the voice question, and the reply voice is sent to the mobile terminal; and the vehicle-mounted infotainment controller executes corresponding operation according to the received data sent by the mobile terminal. The method and the device can perform operation interaction in a mode of seeing the voice command in the vehicle, and improve user experience.
Description
Technical Field
The application relates to the technical field of voice interaction, in particular to a vehicle-mounted voice interaction method and system.
Background
The rapid development of information technology and internet technology has promoted the beginning of the transformation of numerous industry fields to digitization and intelligence. Automobile navigation systems in the intelligent era have also been revolutionized, functions in automobiles are increasing, and man-machine interaction operations of vehicle navigation are becoming more and more complex, so that users operate functions quickly and efficiently with higher and higher costs.
With the development and application of voice technology, more and more voice interaction products appear in people's daily life, and meanwhile, more and more researches are conducted on the field of voice interaction. The driving habit of people is greatly changed by the vehicle-mounted voice system, a driver can achieve the same efficiency as touching the vehicle-mounted screen only through full voice interaction, meanwhile, the distraction of the attention of the driver can be avoided, and the travel safety of the driver is effectively guaranteed.
The mobile phone interconnection technology is that the smart mobile phone is connected with the vehicle-mounted navigation system in a wired mode or a wireless mode, so that the communication between the smart mobile phone and the vehicle-mounted navigation system is realized, the intellectualization of the vehicle-mounted navigation system is greatly improved, and the mobile phone interconnection technology has an important effect on the expansion of the functions of the vehicle-mounted system.
At present, some basic voice instruction interaction is performed in the vehicle-mounted navigation system, and all functions which can be seen by a driver and have no potential safety hazard in the navigation system can not be realized in a visible and readable mode, so that the voice interaction in the current vehicle-mounted navigation system can not meet the requirements of users.
Disclosure of Invention
In view of this, the present application provides a vehicle-mounted voice interaction method and system, so as to solve the technical problem that in the prior art, all functions that can satisfy the requirements seen by a driver and have no potential safety hazard cannot be realized in a visible manner.
In a first aspect, an embodiment of the present application provides a vehicle-mounted voice interaction method, which is applied to a vehicle-mounted voice interaction system, where the vehicle-mounted voice interaction system includes: the vehicle-mounted infotainment controller, the mobile terminal and the cloud server, wherein the method comprises the following steps:
the vehicle-mounted information entertainment controller acquires voice data and vehicle information, performs noise elimination processing on the voice data, and uploads the noise-eliminated voice data and the vehicle information to the mobile terminal;
the mobile terminal acquires user information and uploads the voice data, the vehicle information and the user information after noise elimination to the cloud server;
the cloud server identifies voice data to obtain a voice data text, when the voice data text comprises text information of a voice instruction, the voice data text is sent to the mobile terminal, when the voice data text comprises text information of a voice question, reply voice is matched from a preset reply voice database based on vehicle information, user information and the text information of the voice question, and the reply voice is sent to the mobile terminal;
the mobile terminal sends the voice data text or the reply voice to the vehicle-mounted information entertainment controller;
and the vehicle-mounted infotainment controller executes corresponding operation according to the received data.
Further, the vehicle information includes: brand and model of vehicle.
Further, the user information includes: user gender, user age, user driving age, and user preferences.
Further, the preset response voice database comprises a matching item and a matching result; the matching items include: the vehicle type, the user gender, the user age, the driving age of the user and the text information of the voice question, wherein the matching result is a response voice;
when the text information of the voice question is included in the voice data text, matching out a response voice from a preset response voice database based on the vehicle information, the user information and the text information of the voice question, wherein the matching comprises the following steps:
acquiring a vehicle type from vehicle information;
acquiring the gender, the age and the driving age of the user from the user information;
and matching the vehicle type, the user gender, the user age, the driving age and the text information of the voice question as matching items from a preset response voice database to obtain response voice.
Further, the vehicle-mounted infotainment controller executes corresponding operation according to the received data; the method comprises the following steps:
the vehicle-mounted information entertainment controller receives data of the mobile terminal;
when the received data is a voice data text, judging whether a voice instruction in the voice data text is a local instruction or not, and if so, executing an action corresponding to the voice instruction; otherwise, sending the voice instruction to the vehicle controller;
and when the received data is the reply voice, playing the reply voice by using the voice player.
Further, the method further comprises: the mobile terminal is connected with the vehicle-mounted information entertainment controller in a wireless mode or a wired mode.
Furthermore, when the mobile terminal is in wired interconnection with the vehicle-mounted information entertainment controller through a USB cable, a USB data transmission channel is established between the mobile terminal and the vehicle-mounted information entertainment controller; when the mobile terminal is wirelessly interconnected with the vehicle-mounted information entertainment controller through WIFI, a WIFI data transmission channel is established between the mobile terminal and the vehicle-mounted information entertainment controller.
Further, the vehicle-mounted information entertainment controller stores WIFI information in the two-dimensional code, and the mobile terminal is connected with the vehicle-mounted information entertainment controller in a wireless WIFI mode by scanning the two-dimensional code on the vehicle-mounted information entertainment controller.
In a second aspect, an embodiment of the present application provides a vehicle-mounted voice interaction system, including: the system comprises a vehicle-mounted information entertainment controller, a mobile terminal and a cloud server;
the vehicle-mounted information entertainment controller is used for acquiring voice data and vehicle information, denoising the voice data and uploading the denoised voice data and vehicle information to the mobile terminal; the mobile terminal is also used for executing corresponding operation according to the received data sent by the mobile terminal;
the mobile terminal is used for acquiring user information and uploading the voice data, the vehicle information and the user information after noise elimination to the cloud server; the vehicle-mounted information entertainment controller is also used for sending the voice data text or the reply voice to the vehicle-mounted information entertainment controller;
the cloud server is used for identifying voice data to obtain a voice data text, sending the voice data text to the mobile terminal when the voice data text comprises text information of a voice instruction, matching reply voice from a preset reply voice database based on vehicle information, user information and text information of a voice question when the voice data text comprises the text information of the voice question, and sending the reply voice to the mobile terminal.
The method and the device utilize the vehicle-mounted information entertainment controller, the mobile terminal and the cloud server to operate and interact in a visible and readable voice instruction mode, so that the user experience is improved, the intelligent degree of a vehicle-mounted system is improved, the safety in the whole operation process is guaranteed, and perfect, comfortable, convenient and safe driving experience is brought to a driver.
Drawings
In order to more clearly illustrate the detailed description of the present application or the technical solutions in the prior art, the drawings needed to be used in the detailed description of the present application or the prior art description will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic diagram of information interaction provided in an embodiment of the present application;
FIG. 2 is a flowchart of a vehicle-mounted voice interaction method according to an embodiment of the present application;
fig. 3 is a flowchart of vehicle-mounted speech recognition and processing provided in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
First, the design idea of the embodiment of the present application is briefly introduced.
At present, some basic voice instruction interaction is performed in the vehicle-mounted navigation system, and all functions which can be seen by a driver and have no potential safety hazard in the navigation system can not be realized in a visible and readable mode, so that the voice interaction in the current vehicle-mounted navigation system can not meet the requirements of users.
In order to solve the technical problem, as shown in fig. 1, the present application provides a vehicle-mounted voice interaction method, wherein a visible and readable voice command of a speaker is collected by a vehicle-mounted microphone and transmitted to a vehicle-mounted infotainment controller; because the voice instruction data can have noise interference in the vehicle, the vehicle-mounted infotainment controller carries out noise elimination processing on the acquired voice instruction data; then, the data after noise elimination processing is transmitted to a mobile phone interconnected with the vehicle-mounted information entertainment controller, and the mobile phone uploads a visible and readable voice command to a voice platform of a cloud server by using a network for recognition and processing; and finally, the voice platform feeds the successful recognition result back to the mobile phone, and the mobile phone further transmits the successful recognition result to the vehicle-mounted information entertainment controller, so that the execution of the visible and audible voice command is finished. If the command is related to automobile control, such as voice commands of 'opening an air conditioner', 'opening a skylight', and the like, the vehicle-mounted infotainment controller can further interact with the automobile after receiving the recognition result, and the operations of opening the air conditioner, opening the skylight, opening windows, and the like of the automobile are correspondingly performed through the automobile control command. If visible, it can be said that the instructions are related to an in-vehicle navigation system, for example: "open setting", "screen brightness increase/decrease", "theme wallpaper change", "media volume increase/decrease", the car navigation system performs the corresponding action.
The method and the device utilize the vehicle-mounted information entertainment controller, the mobile phone and the cloud server to carry out operation interaction in a visible and speech instruction mode, so that the user experience is improved, the intelligent degree of a vehicle-mounted system is improved, the safety in the whole operation process is guaranteed, and perfect, comfortable, convenient and safe driving experience is brought to a driver.
After introducing the application scenario and the design concept of the embodiment of the present application, the following describes a technical solution provided by the embodiment of the present application.
As shown in fig. 2, a vehicle-mounted voice interaction method provided in the embodiment of the present application includes the following steps:
step 101: the vehicle-mounted information entertainment controller acquires voice data and vehicle information, performs noise elimination on the voice data, and uploads the voice data and the vehicle information subjected to noise elimination to the mobile terminal;
wherein, on-vehicle infotainment controller includes: ARM treater, MCU treater, CAN module, USB, bluetooth and WIFI module, display screen, storage module and microphone. ARM treater operation one or more procedure, MCU treater and CAN module realize with the communication of vehicle, USB module CAN connect USB flash disk equipment on the one hand, and on the other hand CAN realize wired connection with cell-phone interconnection APP, and bluetooth module is connected with the cell-phone, and the WIFI module realizes noninductive the connection with cell-phone interconnection APP.
The mobile phone interconnection APP on the mobile phone is a navigation assistant developed specially for driving, and integrates navigation, music and telephone functions; the interconnection of the mobile phone and the vehicle-mounted information entertainment controller is supported, and the whole-course voice interaction can be supported. For example, the user can speak the visible voice command "call 10086", and after voice recognition and processing, the action of dialing 10086 is finally executed on the mobile phone. The mobile phone interconnection APP application is combined with the vehicle-mounted information entertainment controller, and visible and readable voice instructions in vehicle-mounted voice interaction are enriched.
The mobile phone interconnection APP on the mobile phone is connected with the vehicle-mounted information entertainment controller of the Linux system in a wireless or wired mode. The mobile phone interconnection APP is software capable of being connected with the automobile navigation equipment and the mobile phone, the content of the mobile phone side of a user can be displayed and controlled through the automobile navigation equipment, and the safe and convenient operation navigation, telephone, music and other applications of a driver are assisted. Specifically, the mobile phone interconnection APP is interconnected with a Linux vehicle-mounted information entertainment controller, namely navigation equipment, in a wired mode through a USB data line, and data communication between the mobile phone and the vehicle-mounted equipment is achieved through a USB channel. Specifically, the mobile phone interconnection APP is interconnected with the Linux vehicle-mounted information entertainment controller, namely the navigation device, in a WIFI wireless mode, and data communication between the mobile phone and the vehicle-mounted device is achieved through a WIFI channel.
In particular, the visible-to-speak voice commands are based on the visible functions presented to the user on the navigation device, while these voice commands do not affect the safety of driving. Such as "open setting", "screen brightness increase/decrease", "theme wallpaper change", "media volume increase/decrease", "open/close skylight", "open/close air conditioner", and the like. The user can speak the command voice interaction through a plurality of visible devices to realize quick, convenient and efficient functional interaction of the vehicle navigation equipment.
And collecting sound source signals in the vehicle through a microphone. The vehicle-mounted infotainment controller acquires visible and readable voice instruction data, and because the environment in the vehicle has the influence of noise data, the visible and readable voice instruction needs to be subjected to noise elimination processing, so that voice recognition is more accurate.
The mobile phone and the vehicle-mounted information entertainment controller are interconnected through Bluetooth, and the purpose of connecting the Bluetooth is to communicate the data related to the media of the mobile phone with the vehicle-mounted device through a Bluetooth mode, for example, a user can speak a visible voice command 'I want to listen to Zhou Jie Lung', and at the moment, a Bluetooth channel is used for transmitting the information of the music media player on the mobile phone and the vehicle-mounted device.
Before the mobile phone and the vehicle-mounted information entertainment controller are interconnected, related permissions on the mobile phone need to be opened, for example, when the APP application for interconnecting the mobile phone is used for the first time, the permission for positioning the mobile phone needs to be opened, and the permission for accessing a contact person needs to be opened.
Step 102: the mobile terminal acquires user information and uploads the voice data, the vehicle information and the user information after noise elimination to the cloud server;
wherein the vehicle information includes: brand and model of vehicle. The user information includes: user gender, user age, user driving age, and user preferences.
Step 103: the cloud server identifies voice data, when the voice data is a control operation instruction, a control operation instruction text is sent to the mobile terminal, when the voice data is a voice question, a voice response text of the voice question is obtained based on vehicle information and user information, and the voice response text is sent to the mobile terminal;
in this embodiment, the cloud server identifies voice data through a semantic platform, wherein the semantic platform comprises an autonomous learning module, a supervised learning module, a multi-turn dialogue module and a personalized semantic module;
and the autonomous learning module is used for learning the real intention of the user by utilizing a clustering and feedback analysis method. If the user says that the user wants to buy the objects, the intention of the user cannot be understood at first, then a large number of users select to go to the supermarket, whether the user wants to go to the supermarket is inquired through advanced learning, and after the user selects to go to the supermarket, the user intention of buying the objects is determined to be going to the supermarket, and an autonomous learning process of the semantic platform can be completed.
And the supervised learning module is used for carrying out clustering summary analysis based on the collected data in an unsupervised state, manually marking the clustering result, and retraining the model on the marking result so that the machine can recognize new intention capacity.
Multi-turn dialogue processing modules for user voice interaction "air internal circulation is dry, and" how to open "second annual ring voice interaction, here, how to open the car air internal circulation, for example. The visible instructions which need to be executed by the user are finished through multiple rounds of conversations. The multi-turn dialog enables the Linux system vehicle-mounted infotainment controller or the vehicle to execute the target action in the form of the multi-turn dialog according to the visible and namely speaking voice command input by the user.
The personalized semantic module is used for acquiring a voice response text of the voice question based on the vehicle information and the user information when the voice data is the voice question; the method is specifically used for:
acquiring a vehicle type from vehicle information;
acquiring the gender, the age and the driving age of the user from the user information;
and matching out the voice response text from the preset response voice database based on the vehicle type, the user gender, the user age, the driving age and the voice question in the voice text.
The preset response voice database comprises: vehicle type, user gender, user age, driving age, voice question and voice response;
different responses can thus be given to groups of users of different characteristics, e.g. different responses given by male and female drivers and different responses given by old and new drivers, depending on the user customization.
Speech recognition includes a variety of speech recognition approaches. The awakening-free identification can identify the voice command without fixing an awakening word so as to execute the action corresponding to the command; and awakening identification, namely activating a voice identification process by fixing an awakening word, and then performing voice instruction identification and execution of corresponding actions.
As shown in fig. 3, first, a visible-to-speak voice command is monitored; preprocessing when a visible and speech-to-speak instruction is received; then judging whether awakening words exist or not in awakening identification, if not, performing semantic analysis, broadcasting semantic identification result information, and finally executing instructions; if awakening words are generated during awakening recognition, voice broadcasting is carried out, then semantic analysis is carried out, a visible instruction can be understood in a multi-turn conversation mode, and finally semantic recognition result information playing and instruction execution are carried out.
Step 104: the mobile terminal sends a control operation instruction text or a voice reply text to the vehicle-mounted information entertainment controller;
step 105: and the vehicle-mounted infotainment controller executes corresponding operation according to the type of the received data.
Specifically, the vehicle-mounted infotainment controller receives data of a mobile terminal; when the received data type is a control operation instruction, judging whether the control operation instruction is a local instruction or not, and if so, executing an action corresponding to the control operation instruction; otherwise, sending the control operation instruction to the vehicle controller; and when the received data is the voice response text, playing the voice response text by using a voice player.
The embodiment of the application provides a vehicle-mounted voice interaction system, which comprises: the system comprises a vehicle-mounted information entertainment controller, a mobile terminal and a cloud server;
the vehicle-mounted information entertainment controller is used for acquiring voice data and vehicle information, denoising the voice data and uploading the denoised voice data and vehicle information to the mobile terminal; the mobile terminal is also used for executing corresponding operation according to the received data sent by the mobile terminal;
the mobile terminal is used for acquiring user information and uploading the voice data, the vehicle information and the user information after noise elimination to the cloud server; the vehicle-mounted information entertainment controller is also used for sending the voice data text or the reply voice to the vehicle-mounted information entertainment controller;
the cloud server is used for identifying voice data to obtain a voice data text, sending the voice data text to the mobile terminal when the voice data text comprises text information of a voice instruction, matching reply voice from a preset reply voice database based on vehicle information, user information and text information of a voice question when the voice data text comprises the text information of the voice question, and sending the reply voice to the mobile terminal.
It should be noted that the principle for solving the technical problem of the vehicle-mounted voice interaction system provided in the embodiment of the present application is similar to that of the vehicle-mounted voice interaction method provided in the embodiment of the present application, and therefore, reference may be made to implementation of the vehicle-mounted voice interaction method provided in the embodiment of the present application for implementation of the vehicle-mounted voice interaction system provided in the embodiment of the present application, and repeated details are not described herein.
Further, while the operations of the methods of the present application are depicted in the drawings in a particular order, this does not require or imply that these operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.
Claims (9)
1. A vehicle-mounted voice interaction method is characterized by being applied to a vehicle-mounted voice interaction system, and the vehicle-mounted voice interaction system comprises: the vehicle-mounted infotainment controller, the mobile terminal and the cloud server, wherein the method comprises the following steps:
the vehicle-mounted information entertainment controller acquires voice data and vehicle information, performs noise elimination processing on the voice data, and uploads the noise-eliminated voice data and the vehicle information to the mobile terminal;
the mobile terminal acquires user information and uploads the voice data, the vehicle information and the user information after noise elimination to the cloud server;
the cloud server identifies voice data to obtain a voice data text, when the voice data text comprises text information of a voice instruction, the voice data text is sent to the mobile terminal, when the voice data text comprises text information of a voice question, reply voice is matched from a preset reply voice database based on vehicle information, user information and the text information of the voice question, and the reply voice is sent to the mobile terminal;
the mobile terminal sends the voice data text or the reply voice to the vehicle-mounted information entertainment controller;
and the vehicle-mounted infotainment controller executes corresponding operation according to the received data.
2. The vehicle-mounted voice interaction method according to claim 1, wherein the vehicle information comprises: brand and model of vehicle.
3. The vehicle-mounted voice interaction method according to claim 2, wherein the user information comprises: user gender, user age, user driving age, and user preferences.
4. The vehicle-mounted voice interaction method according to claim 3, wherein the preset response voice database comprises matching items and matching results; the matching items include: the vehicle type, the user gender, the user age, the driving age of the user and the text information of the voice question, wherein the matching result is a response voice;
when the text information of the voice question is included in the voice data text, matching out a response voice from a preset response voice database based on the vehicle information, the user information and the text information of the voice question, wherein the matching comprises the following steps:
acquiring a vehicle type from vehicle information;
acquiring the gender, the age and the driving age of the user from the user information;
and matching the vehicle type, the user gender, the user age, the driving age and the text information of the voice question as matching items from a preset response voice database to obtain response voice.
5. The vehicle-mounted voice interaction method according to claim 1, wherein the vehicle-mounted infotainment controller executes corresponding operations according to the received data; the method comprises the following steps:
the vehicle-mounted information entertainment controller receives data of the mobile terminal;
when the received data is a voice data text, judging whether a voice instruction in the voice data text is a local instruction or not, and if so, executing an action corresponding to the voice instruction; otherwise, sending the voice instruction to the vehicle controller;
and when the received data is the reply voice, playing the reply voice by using the voice player.
6. The vehicle-mounted voice interaction method according to claim 1, further comprising: the mobile terminal is connected with the vehicle-mounted information entertainment controller in a wireless mode or a wired mode.
7. The vehicle-mounted voice interaction method according to claim 6, wherein when the mobile terminal is wired-interconnected with the vehicle-mounted infotainment controller through a USB cable, a USB data transmission channel is established between the mobile terminal and the vehicle-mounted infotainment controller; when the mobile terminal is wirelessly interconnected with the vehicle-mounted information entertainment controller through WIFI, a WIFI data transmission channel is established between the mobile terminal and the vehicle-mounted information entertainment controller.
8. The vehicle-mounted voice interaction method according to claim 7, wherein the vehicle-mounted infotainment controller stores WIFI information in the two-dimensional code, and the mobile terminal is interconnected with the vehicle-mounted infotainment controller in a wireless WIFI manner by scanning the two-dimensional code on the vehicle-mounted infotainment controller.
9. An in-vehicle voice interaction system, comprising: the system comprises a vehicle-mounted information entertainment controller, a mobile terminal and a cloud server;
the vehicle-mounted information entertainment controller is used for acquiring voice data and vehicle information, denoising the voice data and uploading the denoised voice data and vehicle information to the mobile terminal; the mobile terminal is also used for executing corresponding operation according to the received data sent by the mobile terminal;
the mobile terminal is used for acquiring user information and uploading the voice data, the vehicle information and the user information after noise elimination to the cloud server; the vehicle-mounted information entertainment controller is also used for sending the voice data text or the reply voice to the vehicle-mounted information entertainment controller;
the cloud server is used for identifying voice data to obtain a voice data text, sending the voice data text to the mobile terminal when the voice data text comprises text information of voice instructions, matching reply voice from a preset reply voice database based on vehicle information, user information and text information of voice questions when the voice data text comprises the text information of the voice questions, and sending the reply voice to the mobile terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210304923.0A CN114627850A (en) | 2022-03-25 | 2022-03-25 | Vehicle-mounted voice interaction method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210304923.0A CN114627850A (en) | 2022-03-25 | 2022-03-25 | Vehicle-mounted voice interaction method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114627850A true CN114627850A (en) | 2022-06-14 |
Family
ID=81904951
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210304923.0A Pending CN114627850A (en) | 2022-03-25 | 2022-03-25 | Vehicle-mounted voice interaction method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114627850A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103118176A (en) * | 2013-01-16 | 2013-05-22 | 广东好帮手电子科技股份有限公司 | Method and system for achieving mobile phone voice control function through on-board host computer |
| CN103617795A (en) * | 2013-10-31 | 2014-03-05 | 广东好帮手电子科技股份有限公司 | A vehicle-mounted voice recognition control method and a vehicle-mounted voice recognition control system |
| DE102016004287A1 (en) * | 2016-04-07 | 2017-02-09 | Daimler Ag | Method for speech recognition in a motor vehicle |
| CN106782527A (en) * | 2016-12-16 | 2017-05-31 | 福建省汽车工业集团云度新能源汽车股份有限公司 | A kind of intelligent electric automobile speech control system and method |
| CN110544478A (en) * | 2019-11-04 | 2019-12-06 | 南京创维信息技术研究院有限公司 | System and method for intelligent far-field voice interaction of cockpit |
| CN112298080A (en) * | 2019-07-26 | 2021-02-02 | 上海博泰悦臻电子设备制造有限公司 | Vehicle control method and system |
| KR20210126922A (en) * | 2020-04-13 | 2021-10-21 | 하재인 | Apparatus for retro game with voice recognition and driving method thereof |
| WO2022052776A1 (en) * | 2020-09-10 | 2022-03-17 | 华为技术有限公司 | Human-computer interaction method, and electronic device and system |
-
2022
- 2022-03-25 CN CN202210304923.0A patent/CN114627850A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103118176A (en) * | 2013-01-16 | 2013-05-22 | 广东好帮手电子科技股份有限公司 | Method and system for achieving mobile phone voice control function through on-board host computer |
| CN103617795A (en) * | 2013-10-31 | 2014-03-05 | 广东好帮手电子科技股份有限公司 | A vehicle-mounted voice recognition control method and a vehicle-mounted voice recognition control system |
| DE102016004287A1 (en) * | 2016-04-07 | 2017-02-09 | Daimler Ag | Method for speech recognition in a motor vehicle |
| CN106782527A (en) * | 2016-12-16 | 2017-05-31 | 福建省汽车工业集团云度新能源汽车股份有限公司 | A kind of intelligent electric automobile speech control system and method |
| CN112298080A (en) * | 2019-07-26 | 2021-02-02 | 上海博泰悦臻电子设备制造有限公司 | Vehicle control method and system |
| CN110544478A (en) * | 2019-11-04 | 2019-12-06 | 南京创维信息技术研究院有限公司 | System and method for intelligent far-field voice interaction of cockpit |
| KR20210126922A (en) * | 2020-04-13 | 2021-10-21 | 하재인 | Apparatus for retro game with voice recognition and driving method thereof |
| WO2022052776A1 (en) * | 2020-09-10 | 2022-03-17 | 华为技术有限公司 | Human-computer interaction method, and electronic device and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7254763B2 (en) | Selection system and selection method | |
| CN105022777B (en) | Vehicle application based on driving behavior is recommended | |
| CN103677799B (en) | The method and apparatus of subjective order control for Vehicular system | |
| CN109671421B (en) | Off-line navigation customizing and implementing method and device | |
| CN105989841B (en) | Vehicle-mounted voice control method and device | |
| CN109243432A (en) | Speech processing method and the electronic equipment for supporting the speech processing method | |
| CN103617795A (en) | A vehicle-mounted voice recognition control method and a vehicle-mounted voice recognition control system | |
| JP2019057273A (en) | Method and apparatus for pushing information | |
| US20220234593A1 (en) | Interaction method and apparatus for intelligent cockpit, device, and medium | |
| CN104036778A (en) | Equipment control method, device and system | |
| CN110232912A (en) | Speech recognition arbitrated logic | |
| KR102170088B1 (en) | Method and system for auto response based on artificial intelligence | |
| CN110619878B (en) | Voice interaction method and device for office system | |
| CN109961786A (en) | Products Show method, apparatus, equipment and storage medium based on speech analysis | |
| CN110503948A (en) | Conversational system and dialog process method | |
| CN111681658A (en) | Voice control method and device for vehicle-mounted APP | |
| CN110232924A (en) | Vehicle-mounted voice management method, device, vehicle and storage medium | |
| KR20140067687A (en) | Car system for interactive voice recognition | |
| US20220270617A1 (en) | Electronic device for supporting artificial intelligence agent services to talk to users | |
| CN109887490A (en) | The method and apparatus of voice for identification | |
| KR102389602B1 (en) | Terminal devices running voice recognition-based AI agent programs and how they work | |
| CN114627850A (en) | Vehicle-mounted voice interaction method and system | |
| US11518398B2 (en) | Agent system, agent server, method of controlling agent server, and storage medium | |
| CN108766429B (en) | Voice interaction method and device | |
| EP4369185A1 (en) | Execution instruction determination method and apparatus, device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |