KR20230050111A - Electronic apparatus and control method thereof - Google Patents

Abstract

An electronic device for obtaining a correction value for a sound measurement value by reflecting the installation environment is disclosed. The electronic device comprises: a communication interface; a microphone; and a processor connected to the communication interface and microphone to control the electronic device. The processor may acquire a first expected value for a first sound output from a first other electronic device and a second expected value for a second sound output from a second another electronic device, control the communication interface to transmit a first sound output request signal to the first another electronic device, and obtain a first measurement value for the first sound through a microphone based on the first sound output request signal when the first sound is output from the first another electronic device. The processor may control the communication interface to transmit a second sound output request signal to the second another electronic device, and obtain a second measurement value for the second sound through the microphone based on the second sound output request signal; when the second sound is output from the second other electronic device, and obtain a correction value for the sound measured through the microphone based on the first measurement value, the second measurement value, the first expected value, and the second expected value.

Description

Electronic device and its control method { ELECTRONIC APPARATUS AND CONTROL METHOD THEREOF }

The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device performing voice recognition and a control method thereof.

Thanks to the development of electronic technology, various types of devices are being developed and spread, and various interactions between a plurality of electronic devices are being performed.

In particular, with the recent development of voice recognition technology, a plurality of electronic devices can control voices, but which electronic device among the plurality of electronic devices will process a user's wake-up command has become a problem.

In the case of the same platform, one electronic device among a plurality of electronic devices can be specified through Multi Device Wakeup (MDW) technology. In the case of Multi Device Wakeup technology, it is assumed that the device closest to the ignition location wakes up.

For example, as shown in FIG. 1 , even if the user issues a wake-up command in the direction of the TV from position 2, the speaker must wake up according to the Multi Device Wakeup technology.

Here, since each of the plurality of electronic devices has different hardware characteristics, measurement values such as loudness (amplitude, sound level, etc.), signal to noise ratio (SNR), clarity, etc. are not compared by themselves, The corrected values are compared using various parameters. In this case, the parameters used for correction are secured in a limited environment, and for example, the limited environment may mean a state such as one space, the same environmental noise, limited obstacles, and limited arrangement.

Therefore, an error may occur due to the actual installation environment and arrangement, and the value obtained in the limited environment remains fixed, and it is difficult to correct after actual installation.

The present disclosure has been made in accordance with the above-described needs, and an object of the present disclosure is to provide an electronic device and a control method thereof for obtaining a correction value for a sound measurement value by reflecting an installation environment.

According to one embodiment of the present disclosure for achieving the above object, an electronic device includes a communication interface, a microphone, and a processor connected to the communication interface and the microphone to control the electronic device. A first expected value for a first sound output from another electronic device and a second expected value for a second sound output from a second other electronic device are obtained, and a first sound output request signal is obtained to the first other electronic device. and, based on the first sound output request signal, when the first sound is output from the first other electronic device, a first measurement value for the first sound is obtained through the microphone. obtain and control the communication interface to transmit a second sound output request signal to the second other electronic device, and output the second sound from the second other electronic device based on the second sound output request signal; , a second measurement value for the second sound is obtained through the microphone, and obtained through the microphone based on the first measurement value, the second measurement value, the first expected value, and the second expected value. obtains a correction value for a measured value of the sound that is the first sound, wherein the first expected value is an expected measured value of the first sound by the electronic device based on first location information of the first other electronic device; The second expected value may be an expected measurement value of the second sound by the electronic device based on the second location information of the second other electronic device.

In addition, the processor obtains a negative correction value for the measured value of the sound acquired through the microphone when the first measured value is greater than the first expected value and the second measured value is greater than the second expected value. And, if the first measured value is smaller than the first expected value and the second measured value is smaller than the second expected value, a positive correction value for the measured value of the sound obtained through the microphone may be obtained. there is.

The processor wakes up when the first measurement value does not fall within a first threshold range based on the first expected value and the second measurement value does not fall within a second threshold range based on the second expected value. A correction value for a measurement value of a sound output at a location within a threshold range based on a location corresponding to the first location information may be obtained based on whether a device operating according to the command is changed.

In addition, the processor acquires the correction value so that the operating device is restored when the device operating according to the wake-up command is changed, and sets the correction value to 0 when the device operating according to the wake-up command is not changed. The correction value may be obtained within a range in which the device or the operating device is not changed.

And, the processor determines the second sound by the first other electronic device based on a third measurement value of the second sound measured by the first other electronic device and the second location information through the communication interface. A third expected value, which is an expected measured value of sound, is received from the first other electronic device, and the first measured value, the second measured value, the third measured value, the first expected value, and the second expected value are received. A correction value for a measurement value of sound obtained through the microphone may be obtained based on the value and the third expected value.

In addition, the processor determines that the first measurement value does not fall within a first threshold range based on the first expected value and the second measurement value does not fall within a second threshold range based on the second expected value, and If the third measurement value is within a third threshold range based on the third expected value, a correction value for the measurement value of the sound obtained through the microphone may be obtained.

The processor determines that the first measurement value does not fall within a first threshold range based on the first expected value and the second measurement value falls within a second threshold range based on the second expected value, and 3 If the measurement value is within the third threshold range based on the third expected value, based on whether the device operating according to the wake-up command is changed, at a position within the threshold range based on the position corresponding to the first location information. A correction value for the measured value of the output sound may be obtained.

In addition, the processor acquires the correction value so that the operating device is restored when the device operating according to the wake-up command is changed, and sets the correction value to 0 when the device operating according to the wake-up command is not changed. The correction value may be obtained within a range in which the device or the operating device is not changed.

The processor may control the communication interface to transmit a signal requesting the third measured value and the third expected value based on the hardware performance of the first other electronic device to the first other electronic device.

In addition, the processor controls the communication interface to transmit expected value request signals for the first other electronic device and the second other electronic device to an external server, and through the communication interface, the first expected value and the second expected value. A second expected value may be received from the external server.

And, first information on the first expected value based on the distance between the electronic device and the first other electronic device and second information on the second expected value based on the distance between the electronic device and the second other electronic device. The processor further includes a memory in which information is stored, and the processor controls the communication interface to transmit a request signal for the first location information and the second location information to an external server, and the processor controls the communication interface to transmit the request signal from the external server through the communication interface. receiving first location information and second location information, and receiving the first expected value corresponding to the first location information based on the first information and corresponding to the second location information based on the second information; The second expected value may be obtained.

Also, the processor obtains a plurality of fourth expected values for third sounds output from third other electronic devices at a plurality of locations, and requests the third other electronic device to output a third sound at the plurality of locations. Controls the communication interface to transmit a signal, and when the third other electronic device outputs the third sound at each of the plurality of positions based on the third sound output request signal, the third sound is output through the microphone at the plurality of positions. obtaining a plurality of fourth measurement values for the third sound in each, the first measurement value, the second measurement value, the plurality of fourth measurement values, the first expected value, and the second expected value; and obtaining a correction value for sound measured through the microphone based on the plurality of fourth expected values, wherein the third other electronic device is a movable device, and the plurality of fourth expected values correspond to the plurality of locations. may be an expected measurement value of the third sound by the electronic device.

And, when the wake-up command is received, the processor obtains a measurement value of the electronic device for the wake-up command through the microphone, corrects the measurement value based on the correction value, and through the communication interface, A corrected measurement value of the first other electronic device in response to the wake-up command is received from the first other electronic device, and a corrected measurement value of the second other electronic device in response to the wake-up command is received from the second other electronic device. A measurement value is received, and if the corrected measurement value is greater than the corrected measurement value of the first other electronic device and the corrected measurement value of the second other electronic device, wake the electronic device based on the wake-up command. can up

Meanwhile, according to an embodiment of the present disclosure, a control method of an electronic device provides a first expected value for a first sound output from a first other electronic device and a second expected value for a second sound output from a second other electronic device. Obtaining an expected value, Transmitting a first sound output request signal to the first other electronic device, When the first sound is output from the first other electronic device based on the first sound output request signal Acquiring a first measurement value for the first sound through a microphone provided in the electronic device, transmitting a second sound output request signal to the second other electronic device, responding to the second sound output request signal based on the second electronic device, obtaining a second measurement value for the second sound through the microphone when the second sound is output from the second other electronic device; obtaining a correction value for a measured value of sound acquired through the microphone based on a first expected value and the second expected value, wherein the first expected value is a first position of the first other electronic device an expected measurement value of the first sound by the electronic device based on information, and the second expected value is an expected measurement value of the second sound by the electronic device based on the second location information of the second other electronic device. can be a measurement.

In addition, in the obtaining of the correction value, when the first measured value is greater than the first expected value and the second measured value is greater than the second expected value, the sound for the measured value of the sound obtained through the microphone Acquire a correction value of , and if the first measurement value is smaller than the first expected value and the second measurement value is smaller than the second expected value, a positive correction for the measurement value of the sound acquired through the microphone value can be obtained.

And, the obtaining of the correction value may include the first measurement value not belonging to a first threshold range based on the first expected value, and the second measurement value being a second threshold range based on the second expected value. If it is within the threshold range, based on the position corresponding to the first position information, a correction value for a measured value of sound output in a position within a threshold range may be obtained based on whether a device operating according to the wake-up command is changed.

In addition, the obtaining of the correction value may include acquiring the correction value so that the operating device is restored when the device operating according to the wake-up command is changed, and when the device operating according to the wake-up command is not changed. The correction value may be obtained as 0 or within a range in which the operating device is not changed.

A third expectation, which is an expected measurement value of the second sound by the first other electronic device based on the third measurement value of the second sound measured by the first other electronic device and the second location information The method further includes receiving a value from the first other electronic device, and obtaining the correction value includes the first measurement value, the second measurement value, the third measurement value, the first expected value, A correction value for a measurement value of sound obtained through the microphone may be obtained based on the second expected value and the third expected value.

In addition, the obtaining of the correction value may include the first measurement value not belonging to a first threshold range based on the first expected value, and the second measurement value being within a second threshold range based on the second expected value. If it does not fall within the range and the third measurement value is within a third threshold range based on the third expected value, a correction value for the measurement value of the sound obtained through the microphone may be obtained.

And, the obtaining of the correction value may include the first measurement value not belonging to a first threshold range based on the first expected value, and the second measurement value being a second threshold range based on the second expected value. and if the third measurement value is within a third threshold range based on the third expected value, based on the location corresponding to the first location information based on whether a device operating according to a wake-up command has changed. A correction value for a measurement value of a sound output at a position within a threshold range may be obtained.

According to various embodiments of the present disclosure as described above, the electronic device corrects the measured value of sound acquired by the electronic device by reflecting the measured value of sound between the installation environment and a plurality of peripheral devices, and based on the corrected measured value It is possible to determine whether to operate or not to improve the accuracy of the operation.

In addition, the electronic device may periodically increase the accuracy of the operation by performing a correction operation according to an event such as a new peripheral device being added.

1 is a diagram for explaining Multi Device Wakeup according to an embodiment of the present disclosure.
2 is a block diagram illustrating a hardware configuration of an electronic device according to an embodiment of the present disclosure.
3 is a flowchart illustrating a method for obtaining a correction value according to an embodiment of the present disclosure.
4 is a diagram for explaining a restricted environment according to an embodiment of the present disclosure.
5 is a diagram for explaining a real environment according to various embodiments of the present disclosure.
6 is a flowchart illustrating a tuning operation according to an exemplary embodiment of the present disclosure.
7 is a diagram illustrating information of a plurality of other electronic devices according to an embodiment of the present disclosure.
8 is a flowchart illustrating a method of obtaining location information according to an embodiment of the present disclosure.
9 is a flowchart for explaining a method of obtaining a correction value according to an embodiment of the present disclosure.
10 is a diagram for explaining a method of obtaining a correction value according to an embodiment of the present disclosure.
11 is a diagram for explaining an operation of additionally considering data between other devices according to an embodiment of the present disclosure.
12 is a diagram for explaining an operation of additionally considering data between other devices according to another embodiment of the present disclosure.
13 is a diagram for explaining a case in which an obstacle exists in one direction according to an embodiment of the present disclosure.
14 is a diagram for explaining a method of identifying a direction according to an embodiment of the present disclosure.
15 is a diagram for explaining tuning using a movable device according to another embodiment of the present disclosure.
16 is a flowchart illustrating tuning using a movable device according to an embodiment of the present disclosure.
17 is a flowchart illustrating a method for an electronic device to acquire correction values of a plurality of other electronic devices according to an embodiment of the present disclosure.
18 is a diagram for explaining a specific method for an electronic device to acquire correction values of a plurality of other electronic devices according to an embodiment of the present disclosure.
19 is a flowchart for explaining a control method of an electronic device according to an embodiment of the present disclosure.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

The terms used in the embodiments of the present disclosure have been selected from general terms that are currently widely used as much as possible while considering the functions in the present disclosure, but they may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technologies, and the like. . In addition, in a specific case, there is also a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the disclosure. Therefore, terms used in the present disclosure should be defined based on the meaning of the term and the general content of the present disclosure, not simply the name of the term.

In this specification, expressions such as “has,” “can have,” “includes,” or “can include” indicate the existence of a corresponding feature (eg, numerical value, function, operation, or component such as a part). , which does not preclude the existence of additional features.

The expression at least one of A and/or B should be understood to denote either "A" or "B" or "A and B".

Expressions such as "first," "second," "first," or "second," as used herein, may modify various components regardless of order and/or importance, and may refer to one component It is used only to distinguish it from other components and does not limit the corresponding components.

Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "comprise" or "consist of" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other It should be understood that the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof is not precluded.

In this specification, the term user may refer to a person using an electronic device or a device (eg, an artificial intelligence electronic device) using an electronic device.

Hereinafter, an embodiment of the present disclosure will be described in more detail with reference to the accompanying drawings.

2 is a block diagram for explaining a hardware configuration of an electronic device 100 according to an embodiment of the present disclosure.

The electronic device 100 is a device that performs voice recognition and natural language understanding for a user's voice signal, and uses a microphone such as a smartphone, tablet PC, desktop PC, laptop, smart watch, set-top box (STB), speaker, computer body, etc. It may be a device for performing voice recognition and natural language understanding on a user's voice signal received through a microphone.

Alternatively, the electronic device 100 may include a TV, a video wall, a large format display (LFD), a digital signage, a digital information display (DID), a projector display, a digital video disk (DVD) player, and a monitor. It may be a device without a microphone, such as smart glasses, that receives a user voice signal through wired/wireless communication from another electronic device, such as a remote control device, and performs voice recognition and natural language understanding on the user voice signal. .

Alternatively, the electronic device 100 may be a device that receives a user voice signal through a microphone, transmits the received user voice signal to a server, and receives a result of voice recognition and natural language understanding of the user voice signal from the server.

However, it is not limited thereto, and the electronic device 100 may be any device as long as it can receive a user voice signal.

According to FIG. 2 , the electronic device 100 includes a communication interface 110 , a microphone 120 and a processor 130 . However, it is not limited thereto, and the electronic device 100 may be implemented in a form in which some components are excluded.

The communication interface 110 is a component that performs communication with various types of external devices according to various types of communication methods. For example, the display device 100 may receive a sound measurement value or the like from an external device through the communication interface 110 .

The communication interface 110 may include a WiFi module, a Bluetooth module, an infrared communication module, and a wireless communication module. Here, each communication module may be implemented in the form of at least one hardware chip.

The Wi-Fi module and the Bluetooth module perform communication using the Wi-Fi method and the Bluetooth method, respectively. In the case of using a Wi-Fi module or a Bluetooth module, various types of connection information such as an SSID and a session key are first transmitted and received, and various types of information can be transmitted and received after a communication connection is established using the same. The infrared communication module performs communication according to infrared data association (IrDA) technology that transmits data wirelessly over a short distance using infrared rays between visible rays and millimeter waves.

In addition to the above-mentioned communication method, the wireless communication module can use Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), LTE Advanced (LTE-A), 4th Generation (4G), 5G (5th Generation) may include at least one communication chip that performs communication according to various wireless communication standards.

Alternatively, the communication interface 110 may include a wired communication interface such as HDMI, DP, Thunderbolt, USB, RGB, D-SUB, DVI, and the like.

In addition, the communication interface 110 may include at least one of a local area network (LAN) module, an Ethernet module, or a wired communication module that performs communication using a pair cable, a coaxial cable, or an optical fiber cable.

The microphone 120 is a component for receiving sound and converting it into an audio signal. The microphone 120 is electrically connected to the processor 130 and can receive sound under the control of the processor 130 . Here, the sound may include sound generated from at least one of the electronic device 100 and other electronic devices around the electronic device 100 and noise around the electronic device 100 .

For example, the microphone 120 may be formed integrally with the electronic device 100 in an upper, front, or side direction. Alternatively, the microphone 120 may be provided in a separate remote control from the electronic device 100 . In this case, the remote controller may receive sound through the microphone 120 and provide the received sound to the electronic device 100 .

The microphone 120 includes a microphone for collecting analog sound, an amplifier circuit for amplifying the collected sound, an A/D conversion circuit for sampling the amplified sound and converting it into a digital signal, and a noise component removal from the converted digital signal. It may include various configurations such as filter circuits and the like.

Also, a plurality of microphones 120 may be provided. In this case, the processor 130 may analyze the sound input from the plurality of microphones to identify the sound output location.

Meanwhile, the microphone 120 may be implemented in the form of a sound sensor, and any method may be used as long as it is configured to collect sound.

The processor 130 generally controls the operation of the electronic device 100 . Specifically, the processor 130 may be connected to each component of the electronic device 100 to control the overall operation of the electronic device 100 . For example, the processor 130 may be connected to components such as the communication interface 110, the microphone 120, a memory (not shown), and a display (not shown) to control the operation of the electronic device 100.

According to an embodiment, the processor 130 may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON). However, it is not limited thereto, and the central processing unit ( central processing unit (CPU)), micro controller unit (MCU), micro processing unit (MPU), controller, application processor (AP), or communication processor (CP), ARM processor In addition, the processor 130 may be implemented as a system on chip (SoC) having a built-in processing algorithm, a large scale integration (LSI), or an FPGA ( It may be implemented in the form of a field programmable gate array).

The location of a plurality of modules inside the processor 130 in FIG. 2 is to indicate a state in which the plurality of modules are loaded (or executed) by the processor 130 and operated in the processor 130, and the plurality of modules are It may be in a pre-stored state in memory.

Also, the processor 130 may control the overall operation of the electronic device 100 by executing modules or instructions stored in memory. Specifically, the processor 130 may read and interpret modules or instructions and determine a sequence for data processing, and accordingly, by transmitting a control signal for controlling the operation of other components such as a memory, it may control the operation of other components. .

The processor 130 acquires a first expected value for a first sound output from a first other electronic device and a second expected value for a second sound output from a second other electronic device by executing the expected value obtaining module. can do. Here, the first expected value is an expected measurement value of the first sound by the electronic device 100 based on the first location information of the first other electronic device, and the second expected value is the second location of the second other electronic device. This is an expected measurement value of the second sound by the electronic device 100 based on the information, and may be a preset value in a limited environment.

The processor 130 controls the communication interface 110 to transmit an expected value request signal for the first other electronic device and the second other electronic device to an external server, and through the communication interface 110, the first expected value and The second expected value may be received from an external server.

In this case, location information of each of the electronic device 100, the first other electronic device, and the second other electronic device may be stored in the external server. In addition, the external server has information about a first expected value according to a distance between the electronic device 100 and the first other electronic device and information about a second expected value according to a distance between the electronic device 100 and the second other electronic device. can be stored. For example, the information on the first expected value is the first expected value 1 when the distance between the electronic device 100 and the first other electronic device is 1 m, and the distance between the electronic device 100 and the first other electronic device is Information such as the first expected value 2 in case of 2m may be included. Information on the second expected value may also include information in a form similar to that of the information on the first expected value. However, it is not limited thereto, and the information on the first expected value may be information in the form of a function in which the distance between the electronic device 100 and the first other electronic device is used as a variable. The information on the second expected value may also be information in the form of a function in which the distance between the electronic device 100 and the second other electronic device is used as a variable.

The external server identifies a first expected value corresponding to the distance between the electronic device 100 and the first other electronic device and a second expected value corresponding to the distance between the electronic device 100 and the second other electronic device, and The first expected value and the identified second expected value may be provided to the electronic device 100 .

Alternatively, the electronic device 100 obtains first information about a first expected value based on the distance between the electronic device 100 and the first other electronic device and second information based on the distance between the electronic device 100 and the second other electronic device. It may further include a memory in which second information about the expected value is stored. Here, the memory may refer to hardware that stores information such as data in an electrical or magnetic form so that the processor 130 or the like can access it. To this end, the memory may be implemented as at least one hardware among nonvolatile memory, volatile memory, flash memory, hard disk drive (HDD) or solid state drive (SSD), RAM, ROM, and the like.

In this case, the processor 130 controls the communication interface 110 to transmit a request signal for the first location information and the second location information to the external server, and receives the first location information from the external server through the communication interface 110. and receiving the second location information, and obtaining a first expected value corresponding to the first location information based on the first information and a second expected value corresponding to the second location information based on the second information.

The processor 130 may control the communication interface 110 to transmit the first sound output request signal to the first other electronic device by executing the sound output request module. Here, the first sound output request signal may include a signal for controlling the first other electronic device. For example, the first sound output request signal may include a signal for controlling the first other electronic device to immediately output the first sound upon receiving the first sound output request signal.

In addition, the processor 130 transmits the first sound output request signal, and when a first measurement value for the first sound output from the first other electronic device is obtained, the processor 130 executes the sound output request module to obtain the second sound output request module. The communication interface 110 may be controlled to transmit the second sound output request signal to the electronic device. Here, the second sound output request signal may include a signal for controlling the second other electronic device. For example, the second sound output request signal may include a signal for controlling the second electronic device to immediately output the second sound upon receiving the second sound output request signal.

However, it is not limited thereto, and the processor 130 may control the communication interface 110 to transmit one sound output request signal to the first other electronic device and the second other electronic device. Here, the sound output request signal may include a signal for differently controlling the first other electronic device and the second other electronic device. For example, the sound output request signal is a first signal for controlling a first other electronic device to output a first sound immediately after receiving the first sound output request signal and a sound 3 seconds after receiving the first sound output request signal. It may include a second signal for controlling the second other electronic device to output.

Alternatively, the sound output request signal may be implemented in any number of ways. For example, the sound output request signal is the first signal for controlling the first other electronic device to output sound immediately after receiving the first sound output request signal and the first other electronic device after receiving the first sound output request signal. A second signal for controlling a second electronic device to output a second sound when the first sound output from the electronic device is received may be included.

When the first sound is output from the first other electronic device based on the first sound output request signal, the processor 130 executes the measurement value acquisition module to obtain a first measurement value for the first sound through the microphone 120. is obtained, and when the second sound is output from the second other electronic device, a second measurement value for the second sound may be obtained through the microphone 120 . As described above, the timing at which the first sound and the second sound are output may be different.

The processor 130 corrects the measured value of the sound acquired through the microphone 120 based on the first measured value, the second measured value, the first expected value, and the second expected value by executing the correction value acquisition module. value can be obtained.

When the first measurement value is greater than the first expected value and the second measurement value is greater than the second expected value, the processor 130 may obtain a negative correction value for the measurement value of the sound obtained through the microphone 120. there is. For example, when the electronic device 100 is installed in a narrow space, wallpaper, flooring, etc. are materials that reflect sound well, or the ceiling is low and the sound is reflected, the first measurement value and the second measurement value are the first expectation value, respectively. value and the second expected value. In this case, the processor 130 may obtain a negative correction value for lowering the measured value of the sound acquired through the microphone 120 .

Alternatively, if the first measurement value is smaller than the first expected value and the second measurement value is smaller than the second expected value, the processor 130 determines a positive correction value for the measurement value of the sound acquired through the microphone 120. can be obtained For example, when the electronic device 100 is installed in a large space or has many sound absorbing elements such as curtains, the first measurement value and the second measurement value may be smaller than the first expected value and the second expected value, respectively, in this case The processor 130 may obtain a positive correction value for increasing a measurement value of sound obtained through the microphone 120 .

Meanwhile, if the first measurement value does not fall within a first threshold range based on the first expected value and the second measurement value does not fall within a second threshold range based on the second expected value, the processor 130 issues a wake-up command. A correction value for a measurement value of a sound output at a position within a threshold range based on a position corresponding to the first position information may be obtained based on whether a device operating according to the present invention is changed.

For example, when there is an obstacle between the electronic device 100 and the first other electronic device, the first measurement value is lower than the first expected value, but there is no obstacle between the electronic device 100 and the second other electronic device. The second measurement value may be within a second threshold range based on the second expected value. In this case, the processor 130 may obtain a correction value for a measurement value of sound output at a location within a threshold range from the location of the first other electronic device.

Here, the processor 130 acquires a correction value so that the operating device is restored when the device operating according to the wake-up command is changed, and acquires the correction value as 0 or operates when the device operating according to the wake-up command is not changed. The correction value can be obtained within the range in which the device used is not changed.

For example, when the electronic device 100 is closer to the first other electronic device than to the second other electronic device, the measured value of the electronic device 100 for the first sound output from the first other electronic device is the first other electronic device. It should be greater than the measured value of the second electronic device for sound, and the electronic device 100 should wake up. In this case, the measured value of the electronic device 100 for the first sound output from the first other electronic device due to the obstacle may be smaller than the measured value of the second other electronic device for the first sound. In this case, the electronic device ( 100), the second other electronic device may be woken up. Accordingly, the processor 130 may obtain a correction value so that the electronic device 100 wakes up. Alternatively, even if there is an obstacle, the measured value of the electronic device 100 for the first sound output from the first other electronic device may be greater than the measured value of the second other electronic device for the first sound. In this case, the electronic device ( 100) is woken up, the processor 130 may obtain a correction value of 0 or obtain a correction value within a range in which the wake-up device does not change.

Meanwhile, the processor 130 generates the second sound by the first other electronic device based on the third measurement value of the second sound measured by the first other electronic device and the second location information through the communication interface 110. A third expected value, which is an expected measured value of , may be received from the first other electronic device.

For example, each of the electronic device 100, the first other electronic device, and the second other electronic device may share the measured value and the expected value. In this case, each of the electronic device 100, the first other electronic device, and the second other electronic device may obtain a correction value for a sound measurement value obtained through a microphone.

Alternatively, the processor 130 controls the communication interface 110 to transmit a signal requesting a third measured value and a third expected value based on the hardware performance of the first other electronic device to the first other electronic device, and the communication interface Through (110), a third expected value that is an expected measurement value of the second sound by the first other electronic device based on the third measurement value of the second sound measured by the first other electronic device and the second location information may be received from the first other electronic device. In this case, the processor 130 obtains a correction value for the measured value of sound obtained not only from the electronic device 100 but also from the first other electronic device and the second other electronic device, respectively, and converts the obtained correction value to the corresponding other electronic device. The communication interface 110 may be controlled to be transmitted to an electronic device.

The processor 130 determines the measured value of the sound acquired through the microphone 120 based on the first measured value, the second measured value, the third measured value, the first expected value, the second expected value, and the third expected value. It is also possible to obtain a correction value for

The processor 130 determines that the first measurement value does not fall within the first threshold range based on the first expected value, the second measurement value does not fall within the second threshold range based on the second expected value, and the third measurement value does not fall within the second threshold range based on the second expected value. If it is within the third threshold range based on the third expected value, a correction value for a measurement value of sound obtained through the microphone 120 may be obtained.

In this case, the processor 130 identifies a hardware problem of the electronic device 100 itself or an environmental problem in which the electronic device 100 is placed, and sets a correction value for a sound measurement value obtained through the microphone 120. can be obtained

Alternatively, the processor 130 determines that the first measurement value does not fall within a first threshold range based on the first expected value, the second measurement value falls within a second threshold range based on the second expected value, and the third measurement value If it is within the third threshold range based on the third expected value, sound output at a position within the threshold range based on the position corresponding to the first location information is measured based on whether the device operating in response to the wake-up command is changed. A correction value for the value may be obtained.

For example, when there is an obstacle only between the electronic device 100 and the first other electronic device, the first measured value is lower than the first expected value, but the second measured value is within a second threshold range based on the second expected value. , and the third measurement value may be within a third threshold range based on the third expected value. In this case, the processor 130 may obtain a correction value for a measurement value of sound output at a location within a threshold range from the location of the first other electronic device.

Here, the processor 130 acquires a correction value so that the operating device is restored when the device operating according to the wake-up command is changed, and acquires the correction value as 0 or operates when the device operating according to the wake-up command is not changed. The correction value can be obtained within the range in which the device used is not changed.

Alternatively, the processor 130 may, if the first measured value is greater than the first expected value, the second measured value is greater than the second expected value, and the third measured value is greater than the third expected value, the electronic device 100, the second expected value It can be identified that the space where the first other electronic device and the second other electronic device are disposed is very narrow. In this case, since there is a high possibility that a device operating according to the wake-up command will not be changed, the processor 130 may not obtain a correction value.

However, it is not limited thereto, and the processor 130 obtains a correction value for the measured value of the sound obtained through the microphone 120, and the first other electronic device and the second other electronic device also use their respective microphones. A correction value for the measured value of the acquired sound may be obtained. That is, all devices may obtain the correction value in a state in which devices operating according to the wake-up command do not change.

As described above, the processor 130 may acquire the correction value by further considering the third measured value and the third expected value, and the accuracy of the correction value through a more accurate analysis of the surrounding environment of the electronic device 100. can improve

Meanwhile, in the above, a configuration for obtaining a correction value based on the first measured value, the second measured value, the third measured value, the first expected value, the second expected value, and the third expected value has been described, but is not limited thereto. no. For example, the processor 130 may obtain a correction value based on the first measurement value, the third measurement value, the first expected value, and the third expected value. For example, if the first measurement value is less than a first threshold range based on the first expected value and the third measurement value is within a third threshold range based on the third expected value, the processor 130 may select the microphone. It is also possible to obtain a positive correction value for the measured value of the sound obtained through

Meanwhile, the processor 130 obtains a plurality of fourth expected values for third sounds output from third other electronic devices at a plurality of locations, and requests the third other electronic devices to output third sounds at a plurality of locations. The communication interface 110 may be controlled to transmit a signal. Here, the third other electronic device may be a movable device, and the plurality of fourth expected values may be expected measurement values of third sounds by the electronic device at a plurality of locations.

For example, the processor 130 obtains a plurality of fourth expected values for third sounds output from a robot cleaner capable of moving in a plurality of positions, and a third sound output request signal at a plurality of positions to the robot cleaner. It is possible to control the communication interface 110 to transmit.

When a third electronic device outputs a third sound at each of a plurality of positions based on the third sound output request signal, the processor 130 outputs a plurality of third sounds at each of the plurality of positions through the microphone 120. A fourth measured value of can be obtained.

The processor 130 determines the sound measured through the microphone 120 based on the first measurement value, the second measurement value, the plurality of fourth measurement values, the first expected value, the second expected value, and the plurality of fourth expected values. A correction value for can be obtained.

That is, the processor 130 may acquire a correction value by further receiving a sound output from an arbitrary location, not just a sound output from a fixed location such as the first other electronic device or the second other electronic device. A more accurate analysis of the space where the device 100 is placed is possible.

However, the present invention is not limited thereto, and the processor 130 may obtain a correction value using only a plurality of fourth measured values and a plurality of fourth expected values. In this case, the processor 130 does not perform any communication with the first other electronic device and the second other electronic device, and the plurality of fourth expected values for the third sound output from the third other electronic device at a plurality of positions. Obtaining a third electronic device, controlling the communication interface 110 to transmit a second sound output request signal at a plurality of locations to a third other electronic device, and a third third party at each of the plurality of locations based on the second sound output request signal. When the electronic device outputs the third sound, a plurality of fourth measurement values of the third sound at each of the plurality of positions are obtained through the microphone 120, and the plurality of fourth measurement values and the plurality of fourth expected values are obtained. A correction value for the sound measured through the microphone 120 may be obtained based on . Here, the third other electronic device may be a movable device, and the plurality of fourth expected values may be expected measurement values of the third sound by the electronic device 100 at a plurality of locations.

After the correction value is obtained as described above, when the wake-up command is received, the processor 130 acquires a measurement value of the electronic device 100 in response to the wake-up command through the microphone 120, and converts the measurement value to the correction value. receives a measurement value of the first other electronic device in response to the wake-up command from the first other electronic device through the communication interface 110, and receives a measurement value of the second other electronic device in response to the wake-up command from the second other electronic device When the measured value of the electronic device is received and the corrected measured value is greater than the measured value of the first other electronic device and the measured value of the second other electronic device, the electronic device 100 may be woken up based on a wakeup command. there is.

As described above, the processor 130 can obtain a correction value according to the surrounding environment of the electronic device 100 and determine whether to operate based on the corrected measurement value for the wake-up command, so that even when placed in an arbitrary environment, the processor 130 has high accuracy. High action is possible.

Meanwhile, the above correction value acquisition module may be implemented as a rule-based model. However, it is not limited thereto, and the correction value acquisition module may be implemented as a neural network model. For example, the electronic device 100 may further include a memory in which a neural network model for obtaining a correction value is stored, and the processor 130 may obtain a correction value of each device by inputting measurement values to the neural network model. Here, the neural network model for obtaining the correction value may be a model obtained by learning the relationship between expected values and measured values.

The above artificial intelligence-related functions are operated through the processor 130 and memory.

Processor 130 may be composed of one or a plurality of processors. In this case, the one or more processors may be a general-purpose processor such as a CPU, an AP, or a digital signal processor (DSP), a graphics-only processor such as a GPU, or a vision processing unit (VPU), or an artificial intelligence-only processor such as an NPU.

One or more processors control input data to be processed according to predefined operating rules or artificial intelligence models stored in a memory. Alternatively, when one or more processors are processors dedicated to artificial intelligence, the processors dedicated to artificial intelligence may be designed as a hardware structure specialized for processing a specific artificial intelligence model. A predefined action rule or artificial intelligence model is characterized in that it is created through learning.

Here, being created through learning means that a basic artificial intelligence model is learned using a plurality of learning data by a learning algorithm, so that a predefined action rule or artificial intelligence model set to perform a desired characteristic (or purpose) is created. means burden. Such learning may be performed in the device itself in which artificial intelligence according to the present disclosure is performed, or may be performed through a separate server and/or system. Examples of the learning algorithm include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the above examples.

An artificial intelligence model may be composed of a plurality of neural network layers. Each of the plurality of neural network layers has a plurality of weight values, and a neural network operation is performed through an operation between an operation result of a previous layer and a plurality of weight values. A plurality of weights possessed by a plurality of neural network layers may be optimized by a learning result of an artificial intelligence model. For example, a plurality of weights may be updated to reduce or minimize a loss value or a cost value obtained from an artificial intelligence model during a learning process.

The artificial neural network may include a deep neural network (DNN), for example, a Convolutional Neural Network (CNN), a Deep Neural Network (DNN), a Recurrent Neural Network (RNN), a Restricted Boltzmann Machine (RBM), A deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or deep Q-networks, but is not limited to the above examples.

Meanwhile, only the electronic device 100, the first other electronic device, and the second other electronic device have been described, but the number of other electronic devices may vary as much as desired. However, in the following, for convenience of description, it is assumed that only the electronic device 100, the first other electronic device, and the second other electronic device are disposed.

3 is a flowchart illustrating a method for obtaining a correction value according to an embodiment of the present disclosure.

First, the processor 130 may obtain a first expected value for a first sound output from a first other electronic device and a second expected value for a second sound output from a second other electronic device (S310). . Alternatively, the processor 130 may perform a third expected value that is an expected measurement value of the second sound by the first other electronic device based on the first location information of the first other electronic device and the second location information of the second other electronic device. can also be obtained.

The processor 130 may calculate a first expected value, a second expected value, and a third expected value based on the first location information of the first other electronic device and the second location information of the second other electronic device. In this case, a formula for obtaining an expected value based on location information may be stored in the memory.

Alternatively, the processor 130 may receive the first expected value, the second expected value, and the third expected value from the server.

Alternatively, the first expected value, the second expected value, and the third expected value may be pre-stored in the electronic device 100 .

The processor 130 may transmit a sound output request signal to the first other electronic device and the second other electronic device (S320). For example, if there is a user's tuning command, the processor 130 may transmit a sound output request signal to the first other electronic device and the second other electronic device. Here, the tuning command is a command instructing to acquire a correction value for the measured value of the sound acquired through the microphone 120, and if it is determined that there is an error in the process of giving a voice recognition command by the user, the tuning command is sent to the electronic device ( 100) can be entered.

Alternatively, the processor 130 may determine whether the device woken up according to the user's wake-up command is not the closest device to the user and if the number of times the command can be executed by a device other than the wake-up device exceeds a predetermined number of times, the first other electronic device and A sound output request signal may be transmitted to the second electronic device.

Alternatively, the processor 130 sends a sound output request signal to the first other electronic device and the second other electronic device when the wake up command is repeatedly input even if the device closest to the user is woken up according to the user's wake up command. can also be transmitted.

Alternatively, when a new other electronic device is identified, the processor 130 may transmit a sound output request signal to the first other electronic device, the second other electronic device, and the new other electronic device.

Meanwhile, the electronic device 100, the first other electronic device, and the second other electronic device may periodically obtain a measurement value of sound using an inaudible frequency, and the processor 130 determines that the previously stored measurement value is greater than or equal to a threshold value. A sound output request signal may be transmitted to the first other electronic device and the second other electronic device based on the number of changes. This operation is an operation for periodically obtaining a measurement value of sound without a user's knowledge and for recognizing a change in an arrangement environment.

Based on the sound output request signal, when the first sound is output from the first other electronic device, the processor 130 obtains a first measurement value for the first sound through the microphone 120, and in the second other electronic device When the second sound is output, a second measurement value for the second sound may be obtained through the microphone 120 (S330). Also, the processor 130 may receive a third measurement value for the second sound measured by the first other electronic device from the first other electronic device through the communication interface 110 .

The processor 130 determines the measured value of the sound acquired through the microphone 120 based on the first measured value, the second measured value, the third measured value, the first expected value, the second expected value, and the third expected value. It is possible to obtain a correction value for (S340).

An operation of obtaining a correction value will be described in detail through drawings.

Hereinafter, the operation of the electronic device 100 will be described in more detail with reference to FIGS. 4 to 18 . 4 to 18 describe individual embodiments for convenience of description. However, the individual embodiments of FIGS. 4 to 18 may be implemented in any combination.

4 is a diagram for explaining a restricted environment according to an embodiment of the present disclosure.

As shown in FIG. 4 , each of a plurality of electronic devices may measure sound at a position of the other electronic devices. Alternatively, the plurality of electronic devices may measure sound at, for example, positions 1, 2, 3, 4, and 5 by other movable electronic devices. In addition, each of the plurality of electronic devices is tuned in consideration of differences in hardware, etc., and an expected value for sound at an arbitrary position may be obtained.

However, an actual use environment may be different from that of FIG. 4 , for example, arrangement states of a plurality of electronic devices may be changed and obstacles may be disposed between the plurality of electronic devices.

5 is a diagram for explaining a real environment according to various embodiments of the present disclosure.

As shown in the left side (5-1) of FIG. 5, an obstacle such as a high shelf or a wine cellar may be placed in front of the speaker, and even if the user 510 fires toward the speaker, the speaker does not receive the measurement value due to the obstacle. is lowered, and a refrigerator with a relatively larger measured value than the speaker can be woken up. That is, a device that does not meet the intention of the user 510 may operate due to an obstacle.

In addition, as shown in the right side 5-2 of FIG. 5, the washing machine may be placed in a narrow space, and even if the user 520 fires toward a refrigerator that is relatively closer than the washing machine, the washing machine may be damaged by the narrow space. Measurements may be higher. That is, a washing machine other than a refrigerator that is close to the user may be woken up. That is, a device that does not meet the intention of the user 520 may operate due to the arrangement space.

As described above, each of the plurality of electronic devices may malfunction depending on the arrangement state, etc., and needs to be operated by reflecting the arrangement state or the like.

6 is a flowchart illustrating a tuning operation according to an exemplary embodiment of the present disclosure.

First, the processor 130 may receive a user's tuning command (S610). However, it is not limited thereto, and as described above, an operation after a tuning command may be performed for reasons such as addition of a new device. Alternatively, a neural network model for identifying whether or not a tuning operation has been performed may be stored in the memory of the electronic device 100, and the processor 130 inputs information about the electronic device 100 and a plurality of other electronic devices into the neural network model. Whether or not a tuning operation is performed may be identified.

The processor 130 may measure the surrounding characteristics of the electronic device 100 (S620). For example, the processor 130 may measure reverberation at the installation location by reproducing variable frequency pink noise. However, it is not limited thereto, and the processor 130 may further reproduce non-audible sound, white noise, and the like as well as pink noise.

The processor 130 may turn off the wake-up mode and change to the tuning mode (S630). When the electronic device 100 is in a wakeup mode, the processor 130 wakes up when a user's wakeup command is received and the measured value is the largest among the electronic device 100 and a plurality of other electronic devices. When the electronic device 100 is in the tuning mode, the processor 130 may not wake up even if a user's wake-up command is received and the measured value is the largest among the electronic device 100 and a plurality of other electronic devices. . That is, the tuning mode may be a mode for performing a tuning operation such as sound output, acquisition, measurement value, and correction value acquisition/calculation.

The processor 130 may update information on a plurality of other electronic devices (S640). For example, as shown in FIG. 7 , the processor 130 provides a list of a plurality of other electronic devices, locations of a plurality of other electronic devices, device characteristics, device peripheral characteristics, and each of a plurality of other electronic devices. Information on signal strength for each type of noise may be updated.

The processor 130 may receive information on each of the plurality of other electronic devices from each of the plurality of other electronic devices and update information on the plurality of other electronic devices. Alternatively, the processor 130 may receive information of a plurality of other electronic devices through a server and update information of a plurality of other electronic devices.

The processor 130 may update information of a plurality of other electronic devices through an external server. Alternatively, the processor 130 may update information of a plurality of other electronic devices by receiving data from each of the plurality of other electronic devices.

This operation can be equally performed by all other electronic devices.

The processor 130 may estimate distances/positions of a plurality of other electronic devices (S650). This operation can be equally performed by all other electronic devices connected to the network. However, it is not limited thereto, and the electronic device 100 and a plurality of other electronic devices may be in a state in which location information for all electronic devices is stored, and in this case, step S650 may be omitted.

A detailed method of estimating location information will be described with reference to FIG. 8 . First, the processor 130 may reproduce variable frequency pink noise (S810). However, it is not limited thereto, and the processor 130 may further reproduce non-audible sound, white noise, and the like as well as pink noise.

The processor 130 may record the sound pressure for each frequency band of the sound output from the other electronic device and measure the distance between the devices (S820). Here, if the measurement value is 0, the processor 130 may identify the location or structure as unreachable by sound (S840). Alternatively, the processor 130 may measure the distance if the measured value is not 0 (S850). For example, the processor 130 may measure the distance based on a Wi-Fi signal, etc., and there is no limitation on how to measure the distance. This operation may be equally performed by a plurality of other electronic devices.

Referring back to FIG. 6 , the processor 130 may acquire location information on a plurality of other electronic devices and then correct tuning parameters (S660). This operation can be equally performed by all other electronic devices connected to the network.

A detailed method of correcting the tuning parameters will be described with reference to FIG. 9 . First, the processor 130 may measure installation location environment information (S910). For example, at the time of tuning, measurement values may be distorted due to ambient noise such as external sound and human noise, and the processor 130 may minimize distortion by measuring installation location environment information.

Then, the processor 130 may reflect environment information (S920). For example, the processor 130 may reflect environmental information such as ambient noise to the size of a measurement value or a signal to noise ratio (SNR).

Then, the processor 130 may change the setting to a speaker volume for tuning (S930) and reproduce the wake-up trigger audio (S940). This operation is equally performed in other electronic devices, and in this case, the processor 130 may obtain sound output from other electronic devices as a measurement value.

Then, the processor 130 may record a score between devices (S950). For example, the processor 130 obtains the loudness of sound output from another electronic device as a measurement value, and updates the measurement value based on speaker characteristics of the other electronic device, microphone characteristics of the electronic device 100, environmental information, and the like. You can get points by doing this. For convenience of explanation, it is assumed that only the speaker characteristics differ between the devices, and all other elements are the same. For example, if the speaker of the other electronic device is smaller than the average output of the devices, the processor 130 may obtain a score by correcting the measured value of the sound output from the other electronic device to be higher.

The processor 130 may share the score with a plurality of other electronic devices (S960) and obtain a correction value based on the relative distance/relative position of each device (S970). For example, the processor 130 obtains a first expected value for a first sound output from a first other electronic device based on location information of the first other electronic device, and obtains the first expected value for the first sound as a first output value for the first sound. can be compared with The processor 130 may perform this operation for each of a plurality of other electronic devices, determine the existence of an obstacle, the installation environment of the electronic device 100, and the like, and obtain a correction value according to the determination result. A more specific embodiment will be described later through the following drawings.

The processor 130 may end the tuning mode, change to the wakeup mode, and restore the volume (S980). This operation can be equally performed by all other electronic devices connected to the network.

10 is a diagram for explaining a method of obtaining a correction value according to an embodiment of the present disclosure.

The upper part 10-1 of FIG. 10 is a view showing a case where the installation position of device C is a location where the reverberation is large, and the measured value of device C is greater than the expected value. In the upper part (10-1) of FIG. 10, it is assumed that the expected value for the sound output from device A is 0.7 but the measured value is 0.85, and the expected value for the sound output from device B is 0.8 but the measured value is 0.95. did This is due to the low ceiling height or reverberation, and the C device can obtain -0.15 as a correction value. That is, the device C may lower the measured value of the sound obtained thereafter by 0.15.

In particular, device C can identify that an operating device is changed as the measured value increases. For example, although device A should have higher operation priority than device C according to the sound at location B, device C may have higher priority than device A in the case of the upper part 10-1 of FIG. 10 . That is, in this case, correction of the measured value of device C may be an essential operation.

The lower part 10-2 of FIG. 10 is a diagram showing a case where the measured value of device C is smaller than the expected value. The expected value for the sound output from device A is 0.7 but the measured value is 0.6, and the output from device B is 0.7. It was assumed that the expected value for sound was 0.8 but the measured value was 0.65. This is due to the sound absorbing element, and the C device can obtain +0.1 to +0.15 as a correction value. That is, the device C may increase the measured value of the sound obtained thereafter by 0.15.

However, it is not limited thereto, and in the case of the lower part 10-2 of FIG. 10, correction may not be performed. Unlike the upper part 10-1 of FIG. 10, the lower part 10-2 of FIG. 10 does not change the priority of the operating device.

11 is a diagram for explaining an operation of additionally considering data between other devices according to an embodiment of the present disclosure.

The upper part 11-1 of FIG. 11 represents the expected value, the lower part 11-2 of FIG. 11 represents the measured value, the measured value between the A device and the C device increased by 0.1 from the expected value, and the B device and The measured value between C devices increased by 0.1 from the expected value.

However, the measured value between device A and device B decreased by 0.2 from the expected value, indicating that there may be an obstacle between device A and device B. In addition, according to the expected value, device B should have higher operation priority than device C depending on the sound at location A, but according to the measured value, device C has higher priority than device B depending on the sound at location A. That is, as the priority changes, the measured value between A and B requires correction, the other measured value increases by 0.1, and the measured value between A and B decreases by 0.2, so a correction value of 0.3 is obtained. It can be. Here, the obtained correction value is not applied to all sound measurement values. For example, device A may increase the measured value of sound output at a location within a threshold range relative to the location of device B by 0.3. In addition, the B device may increase the measured value of the output sound by 0.3 at a location within a threshold range based on the location of the A device.

Here, the critical range may be a preset angular range. In the above example, device B may correct sound input from a position within a range of 30 degrees to the left and right of device A, and may not correct sound input from a position within the remaining range.

However, it is not limited thereto, and the threshold range may be determined by further considering the location of device C. In the above example, device B may determine the threshold range by equally dividing an angle formed by a straight line from device B to device A and a straight line from device B to device C. That is, device B may correct only sounds input from positions within a range of 45 degrees in a clockwise direction and 45 degrees in a counterclockwise direction from a straight line from device B to device A.

12 is a diagram for explaining an operation of additionally considering data between other devices according to another embodiment of the present disclosure.

The upper part of FIG. 12 shows the expected value, the lower part of FIG. 12 shows the measured value, the measured value between device A and device B increased by 0.1 from the expected value, and the measured value between device A and device C exceeded the expected value. increased by 0.1.

However, the measured value between device B and device C increased by 0.15 from the expected value. However, according to the expected value, device B has higher operation priority than device A according to the sound at position C, and even according to the measured value, device B has higher priority than device A according to the sound at position C. That is, the priority is not changed, and the measured value between device B and device C does not require correction. However, it is okay to correct it like other measured values, and since the other measured values increased by 0.1 and the measured values between the B device and the C device increased by 0.15, a correction value of -0.05 can be obtained. Here, the obtained correction value is not applied to all sound measurement values. For example, device B may lower the measured value of sound output at a location within a threshold range relative to the location of device C by 0.05. In addition, device C may lower the measured value of sound output at a location within a threshold range based on the location of device B by 0.05. However, it is not limited thereto, and as the correction value, not only -0.05 but also values between -0.05 and 0 may be used.

13 is a diagram for explaining a case in which an obstacle exists in one direction according to an embodiment of the present disclosure.

As shown in FIG. 13 , an obstacle may exist between device B and device A. At this time, device B can identify 45 degrees as one range, and device A direction can be identified as range ①. Thereafter, device B may perform correction on the sound output from a position within the range of ①.

In FIG. 13, 45 degrees is described as one range for convenience of explanation, but this range may be set differently. For example, device B may further consider device C as well as device A and determine 90 degrees as one range.

14 is a diagram for explaining a method of identifying a direction according to an embodiment of the present disclosure.

The electronic device 100 may include a plurality of microphones. For example, as shown in FIG. 14 , the electronic device 100 may include at least two microphones on the same horizontal line.

In this case, the processor 130 may identify the output direction of the sound based on the frequency of the sound received from the two microphones, a reception time difference, and the like.

However, it is not limited thereto, and the electronic device 100 may include three or more microphones.

15 is a diagram for explaining tuning using a movable device according to another embodiment of the present disclosure.

The processor 130 may obtain a correction value based on the sound output from the robot cleaner RVC. For example, as shown in FIG. 15 , the processor 130 may transmit sound output request signals for a plurality of locations represented by dots between grids to the robot cleaner. The robot cleaner may output sound at a plurality of positions while moving in space.

However, it is not limited thereto, and the robot cleaner may store information on a plurality of locations and transmit the stored information to a plurality of other electronic devices as well as the electronic device 100 . In addition, although it has been described that the movable device is a robot cleaner, this is only an example, and any device may be used as long as it is movable in space.

16 is a flowchart illustrating tuning using a movable device according to an embodiment of the present disclosure. In FIG. 16 , for convenience of description, operations of the electronic device 100 overlapping some operations of FIG. 6 are omitted, and the movable device is described as a robot cleaner.

The robot cleaner may receive a sound output request signal for a plurality of locations from the electronic device 100 (S1610). For example, when the electronic device 100 changes to the tuning mode, it may transmit a sound output request signal for a plurality of locations to the robot cleaner.

When the sound output request signal is received, the robot cleaner may turn off the wake-up mode and change to the tuning mode (S1620). This mode change may be the same as the operation S630 of FIG. 6 .

The robot cleaner may reproduce pink noise at each of a plurality of positions while moving around the space (S1630). However, it is not limited thereto, and the robot cleaner may reproduce not only pink noise but also white noise, voice (wakeup command, etc.) or non-audible sound at each of a plurality of positions.

In this case, the robot cleaner may measure reverberation before outputting sound at each of a plurality of positions and transmit the measured reverberation to the electronic device 100 .

Alternatively, the robot cleaner measures reverberation by outputting at least one of a sweep signal of which frequency is changed, pink noise, white noise, or inaudible sound, and among the sound corresponding to the wake-up command, the sound in the voice band, or the inaudible sound. Tuning may be performed by outputting at least one. Here, when a plurality of sounds are output, the plurality of sounds may be sequentially output for each type. However, it is not limited thereto, and the robot cleaner may perform tuning by outputting pink noise or white noise.

The electronic device 100 may obtain a correction value based on information received from the robot cleaner.

17 is a flowchart illustrating a method for an electronic device to acquire correction values of a plurality of other electronic devices according to an embodiment of the present disclosure. Steps S1740 and S1770 in FIG. 17 are the same as those described in FIG. 6, so steps S1750 to S1760 will be described.

A plurality of other electronic devices may transmit scores to the electronic device (main system, 100) (S1750).

The processor 130 may collect data, calculate a correction value based on the relative distance/relative location of each device, and transmit the data to a corresponding device. A plurality of other electronic devices may receive and reflect the correction value (S1760).

The processor 130 may perform the above operation when hardware performance among a plurality of other electronic devices is low.

FIG. 18 is a diagram for explaining a specific method for the electronic device 100 to obtain correction values of a plurality of other electronic devices according to an embodiment of the present disclosure. 18 illustrates that the electronic device 100 is a refrigerator.

Expected values of each of the speaker, washing machine, TV, and air conditioner may be stored in the electronic device 100 . For example, as shown in the upper part 18-1 of FIG. 18, with respect to the sound output from the electronic device 100, the expected value of the speaker is 0.7, the expected value of the washing machine is 0.85, and the expected value of the TV. is 0.5, and the expected value of the air conditioner may be 0.4.

Then, when sound is output from the electronic device 100, each of the speaker, washing machine, TV, and air conditioner may acquire a measurement value for the sound and transmit the obtained measurement value to the electronic device 100. For example, as shown in the middle 18-2 of FIG. 18, the measured value of the speaker is 0.7, the measured value of the washing machine is 0.9, the measured value of the TV is 0.46, and the measured value of the air conditioner is 0.46. can

Here, as shown in the lower part 18-3 of FIG. 18, the processor 130 may determine that there is a possibility that the operation priorities of the TV and the air conditioner may change, and may transmit a correction value of +0.05 to the TV. Specifically, the processor 130 may correct the TV measurement value to be larger than the air conditioner measurement value having a smaller expected value than the TV, and correct the TV measurement value to be smaller than the speaker measurement value having a higher expected value than the TV. there is.

19 is a flowchart for explaining a control method of an electronic device according to an embodiment of the present disclosure.

First, a first expected value for a first sound output from a first other electronic device and a second expected value for a second sound output from a second other electronic device are acquired (S1910). Then, the first sound output request signal is transmitted to the first other electronic device (S1920). Then, when the first sound is output from the first other electronic device based on the first sound output request signal, a first measurement value for the first sound is obtained through a microphone provided in the electronic device (S1930). Then, the second sound output request signal is transmitted to the second other electronic device (S1940). Then, when the second sound is output from the second electronic device based on the second sound output request signal, a second measurement value for the second sound is obtained through a microphone provided in the electronic device (S1950). Then, a correction value for the measured value of the sound obtained through the microphone is obtained based on the first measured value, the second measured value, the first expected value, and the second expected value (S1960). Here, the first expected value is an expected measurement value of the first sound by the electronic device based on the first location information of the first other electronic device, and the second expected value is based on the second location information of the second other electronic device. Thus, it may be an expected measurement value of the second sound by the electronic device.

In addition, in the step of obtaining a correction value (S1960), if the first measurement value is greater than the first expected value and the second measurement value is greater than the second expected value, a negative correction value for the measurement value of the sound obtained through the microphone is obtained, and if the first measured value is smaller than the first expected value and the second measured value is smaller than the second expected value, a positive correction value for the measured value of the sound obtained through the microphone may be obtained.

In the step of obtaining a correction value (S1960), if the first measurement value does not fall within a first threshold range based on the first expected value and the second measurement value falls within a second threshold range based on the second expected value, , A correction value for a measurement value of a sound output at a location within a threshold range based on a location corresponding to the first location information may be obtained based on whether a device operating according to the wakeup command is changed.

Here, the step of acquiring the correction values (S1960) is to acquire the correction values so that the device operating according to the wake-up command is changed so that the operating device is restored, and if the device operating according to the wake-up command is not changed, the correction values are obtained. A correction value may be obtained as 0 or within a range in which an operating device is not changed.

Meanwhile, based on the third measurement value of the second sound measured by the first other electronic device and the second location information, a third expected value, which is an expected measurement value of the second sound by the first other electronic device, is determined as the first The step of receiving the correction value from another electronic device is further included, and the step of obtaining the correction value (S1960) includes the first measured value, the second measured value, the third measured value, the first expected value, the second expected value, and the third expected value. Based on the value, a correction value for a measurement value of sound obtained through a microphone may be obtained.

Here, in the obtaining of the correction value (S1960), the first measurement value does not fall within the first threshold range based on the first expected value and the second measurement value does not fall within the second threshold range based on the second expected value. and the third measurement value is within the third threshold range based on the third expected value, a correction value for the measurement value of the sound obtained through the microphone may be obtained.

In addition, in the obtaining of the correction value (S1960), the first measurement value does not fall within a first threshold range based on the first expected value, and the second measurement value does not fall within a second threshold range based on the second expected value. , If the third measurement value is within the third threshold range based on the third expected value, at a position within the threshold range based on the position corresponding to the first location information based on whether the device operating according to the wake-up command is changed. A correction value for the measured value of the output sound may be obtained.

According to various embodiments of the present disclosure as described above, the electronic device corrects the measured value of sound acquired by the electronic device by reflecting the measured value of sound between the installation environment and a plurality of peripheral devices, and based on the corrected measured value It is possible to determine whether to operate or not to improve the accuracy of the operation.

In addition, the electronic device may periodically increase the accuracy of the operation by performing a correction operation according to an event such as a new peripheral device being added.

Meanwhile, in the foregoing, it has been described that the electronic device transmits a sound output request signal to a plurality of other electronic devices and measures the sound output from the plurality of other electronic devices, but is not limited thereto. For example, the electronic device may obtain a correction value by transmitting a sound measurement request signal to a plurality of other electronic devices and receiving sound measured by the plurality of other electronic devices according to sound output. In this case, the electronic device may provide correction values for a plurality of other electronic devices.

Meanwhile, according to an exemplary embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage media (eg, a computer). can A device is a device capable of calling a stored command from a storage medium and operating according to the called command, and may include an electronic device (eg, the electronic device A) according to the disclosed embodiments. When a command is executed by a processor, the processor may perform a function corresponding to the command directly or by using other components under the control of the processor. An instruction may include code generated or executed by a compiler or interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium does not contain a signal and is tangible, but does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

Also, according to an embodiment of the present disclosure, the method according to the various embodiments described above may be included in a computer program product and provided. Computer program products may be traded between sellers and buyers as commodities. The computer program product may be distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)) or online through an application store (eg Play Store™). In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

In addition, according to one embodiment of the present disclosure, the various embodiments described above use software, hardware, or a combination thereof in a recording medium readable by a computer or similar device. can be implemented in In some cases, the embodiments described herein may be implemented in a processor itself. According to software implementation, embodiments such as procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

Meanwhile, computer instructions for performing the processing operation of the device according to various embodiments described above may be stored in a non-transitory computer-readable medium. Computer instructions stored in such a non-transitory computer readable medium, when executed by a processor of a specific device, cause a specific device to perform a processing operation in the device according to various embodiments described above. A non-transitory computer readable medium is a medium that stores data semi-permanently and is readable by a device, not a medium that stores data for a short moment, such as a register, cache, or memory. Specific examples of the non-transitory computer readable media may include CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, each of the components (eg, modules or programs) according to various embodiments described above may be composed of a single object or a plurality of entities, and some sub-components among the aforementioned sub-components may be omitted, or other sub-components may be used. Components may be further included in various embodiments. Alternatively or additionally, some components (eg, modules or programs) may be integrated into one entity and perform the same or similar functions performed by each corresponding component prior to integration. According to various embodiments, operations performed by modules, programs, or other components are executed sequentially, in parallel, iteratively, or heuristically, or at least some operations are executed in a different order, are omitted, or other operations are added. It can be.

Although the preferred embodiments of the present disclosure have been shown and described above, the present disclosure is not limited to the specific embodiments described above, and is common in the technical field belonging to the present disclosure without departing from the gist of the present disclosure claimed in the claims. Of course, various modifications and implementations are possible by those with knowledge of, and these modifications should not be individually understood from the technical spirit or perspective of the present disclosure.

Claims (20)

In electronic devices,
communication interface;
mike; and
A processor connected to the communication interface and the microphone to control the electronic device;
the processor,
obtaining a first expected value for a first sound output from a first other electronic device and a second expected value for a second sound output from a second other electronic device;
Controls the communication interface to transmit a first sound output request signal to the first other electronic device, and when the first sound is output from the first other electronic device based on the first sound output request signal, the microphone Obtaining a first measurement value for the first sound through
Controls the communication interface to transmit a second sound output request signal to the second other electronic device, and when the second sound is output from the second other electronic device based on the second sound output request signal, the microphone Obtaining a second measurement value for the second sound through
Acquiring a correction value for a measurement value of sound obtained through the microphone based on the first measurement value, the second measurement value, the first expected value, and the second expected value. According to claim 1,
the processor,
If the first measured value is greater than the first expected value and the second measured value is greater than the second expected value, a negative correction value for the measured value of sound obtained through the microphone is obtained;
If the first measured value is smaller than the first expected value and the second measured value is smaller than the second expected value, obtaining a positive correction value for the measured value of the sound obtained through the microphone, the electronic device . According to claim 1,
the processor,
Operating according to a wakeup command when the first measurement value does not fall within a first threshold range based on the first expected value and the second measurement value does not fall within a second threshold range based on the second expected value An electronic device that obtains a correction value for a measurement value of a sound output at a location within a threshold range based on a location corresponding to the first location information based on whether the device has changed. According to claim 3,
the processor,
Acquiring the correction value so that the operating device is restored when the device operating according to the wake-up command is changed;
The electronic device that obtains the correction value as 0 when a device operating according to the wake-up command is not changed or obtains the correction value within a range in which the operating device is not changed. According to claim 1,
the processor,
Through the communication interface, a third measurement value of the second sound measured by the first other electronic device and an expected measurement value of the second sound by the first other electronic device based on the second location information Receiving a third expected value of , from the first other electronic device;
For the measured value of the sound acquired through the microphone based on the first measured value, the second measured value, the third measured value, the first expected value, the second expected value, and the third expected value An electronic device that obtains a correction value. According to claim 5,
the processor,
The first measured value does not fall within a first threshold range based on the first expected value, the second measured value does not fall within a second critical range based on the second expected value, and the third measured value Acquiring a correction value for a measurement value of sound obtained through the microphone when the third threshold range is within a third threshold range based on the third expected value. According to claim 5,
the processor,
The first measurement value does not fall within a first threshold range based on the first expected value, the second measurement value falls within a second threshold range based on the second expected value, and the third measurement value If it is within a third threshold range based on the third expected value, measurement of sound output at a position within the threshold range based on a position corresponding to the first location information based on whether a device operating in response to a wake-up command is changed An electronic device that obtains a correction value for a value. According to claim 7,
the processor,
Acquiring the correction value so that the operating device is restored when the device operating according to the wake-up command is changed;
The electronic device that obtains the correction value as 0 when a device operating according to the wake-up command is not changed or obtains the correction value within a range in which the operating device is not changed. According to claim 5,
the processor,
and controlling the communication interface to transmit a signal requesting the third measured value and the third expected value based on the hardware performance of the first other electronic device to the first other electronic device. According to claim 1,
the processor,
Control the communication interface to transmit an expected value request signal for the first other electronic device and the second other electronic device to an external server;
The electronic device receives the first expected value and the second expected value from the external server through the communication interface. According to claim 1,
First information on the first expected value based on the distance between the electronic device and the first other electronic device and second information on the second expected value based on the distance between the electronic device and the second other electronic device Stored memory; further comprising,
the processor,
Controlling the communication interface to transmit a request signal for the first location information and the second location information to an external server;
Receiving the first location information and the second location information from the external server through the communication interface;
and obtaining the first expected value corresponding to the first location information based on the first information and the second expected value corresponding to the second location information based on the second information. According to claim 1,
the processor,
obtaining a plurality of fourth expected values for third sounds output from third other electronic devices at a plurality of positions;
Controlling the communication interface to transmit a third sound output request signal at the plurality of locations to the third other electronic device;
When the third other electronic device outputs the third sound at each of the plurality of positions based on the third sound output request signal, a plurality of sounds for the third sound at each of the plurality of positions are transmitted through the microphone. Obtaining a fourth measurement value;
The sound measured through the microphone based on the first measured value, the second measured value, the plurality of fourth measured values, the first expected value, the second expected value, and the plurality of fourth expected values Obtain a correction value for
The third other electronic device,
It is a movable device,
The plurality of fourth expected values,
An expected measurement of the third sound by the electronic device at the plurality of locations. According to claim 1,
the processor,
When a wake-up command is received, obtain a measurement value of the electronic device for the wake-up command through the microphone;
Correcting the measured value based on the correction value;
Through the communication interface, a corrected measurement value of the first other electronic device in response to the wake-up command is received from the first other electronic device, and the second electronic device in response to the wake-up command from the second other electronic device is received. Receive calibrated measurement values of other electronic devices;
and wakes up the electronic device based on the wake-up command when the corrected measurement value is greater than the corrected measurement value of the first other electronic device and the corrected measurement value of the second other electronic device. According to claim 1,
The first expected value is,
An expected measurement value of the first sound by the electronic device based on first location information of the first other electronic device;
The second expected value is,
The electronic device is an expected measurement value of the second sound by the electronic device based on the second location information of the second other electronic device. In the control method of an electronic device,
obtaining a first expected value for a first sound output from a first other electronic device and a second expected value for a second sound output from a second other electronic device;
transmitting a first sound output request signal to the first other electronic device;
obtaining a first measurement value for the first sound through a microphone provided in the electronic device when the first sound is output from the first other electronic device based on the first sound output request signal;
transmitting a second sound output request signal to the second other electronic device;
obtaining a second measurement value for the second sound through the microphone when the second sound is output from the second other electronic device based on the second sound output request signal; and
Acquiring a correction value for a measured value of sound obtained through the microphone based on the first measured value, the second measured value, the first expected value, and the second expected value; method. According to claim 15,
The step of obtaining the correction value is,
If the first measured value is greater than the first expected value and the second measured value is greater than the second expected value, a negative correction value for the measured value of sound obtained through the microphone is obtained;
If the first measured value is smaller than the first expected value and the second measured value is smaller than the second expected value, obtaining a positive correction value for the measured value of the sound obtained through the microphone, the control method . According to claim 15,
The step of obtaining the correction value is,
Operating according to a wakeup command when the first measurement value does not fall within a first threshold range based on the first expected value and the second measurement value does not fall within a second threshold range based on the second expected value Acquiring a correction value for a measurement value of a sound output at a position within a threshold range based on a position corresponding to the first position information based on whether a device has been changed. According to claim 17,
The step of obtaining the correction value is,
Acquiring the correction value so that the operating device is restored when the device operating according to the wake-up command is changed;
Acquiring the correction value as 0 when a device operating according to the wake-up command is not changed or obtaining the correction value within a range in which the operating device is not changed. According to claim 15,
A third expected value, which is an expected measurement value of the second sound by the first other electronic device, based on the third measurement value of the second sound measured by the first other electronic device and the second location information , receiving from the first other electronic device; further including,
The step of obtaining the correction value is,
For the measured value of the sound acquired through the microphone based on the first measured value, the second measured value, the third measured value, the first expected value, the second expected value, and the third expected value A control method for obtaining a correction value. According to claim 19,
The step of obtaining the correction value is,
The first measured value does not fall within a first threshold range based on the first expected value, the second measured value does not fall within a second critical range based on the second expected value, and the third measured value If it is within a third threshold range based on the third expected value, a correction value for a measurement value of sound obtained through the microphone is obtained.

Images