EP3993452B1 - Pairing a home appliance with a mobile device - Google Patents

Description

The invention relates to a household appliance. In particular, the invention relates to a wireless coupling of a household appliance with a mobile device.

EN 10 2017 109935 A1 discloses a household appliance which is designed to automatically adjust display settings of a display, such as the font size, and/or automatically adjust the volume of an acoustic reproduction by the household appliance depending on the distance of a user from the household appliance.

A household appliance includes a graphic display on which the status of the appliance can be shown. For example, the display on a refrigerator can show an internal temperature, a filling level, a current energy consumption or an operating mode. The household appliance is usually operated using a locally attached input device, for example a switch or rotary knob. The input device can be integrated with the output device, for example in the form of a touch-sensitive screen (touchscreen).

The graphic display can be used to provide a user with an additional function that can go beyond controlling the household appliance. For example, a cooking recipe can be shown on the display. However, it has been shown that providing the additional function, in the given example the provision of a collection of cooking recipes, can be complex to implement. The function usually has to be regularly updated on a functional level and on a data level. The service life of the household appliance can exceed the service life of a conventional platform with which the function can traditionally be provided by several times. The household appliance may therefore no longer be able to reliably perform the additional function in its current form long before the end of its service life.

Equipping a household appliance with a powerful processing device can be costly; in addition, it is usually not known what specific requirements will be placed on the provision of the function in the future, so that the processing device may still be undersized in a required aspect.

An object underlying the present invention is to provide an improved technique for controlling an output of a household appliance that is equipped with is coupled to a mobile device. The invention solves this problem by means of the subject matter of the independent claims. Subclaims give preferred embodiments.

A first aspect of the present invention comprises a household appliance according to claim 1.

A user can carry the mobile device with them and move freely within the range of the household appliance. An output from the mobile device on the household appliance can be provided in such a way that the perception of the output is adapted to the user's distance from the household appliance. The user can better perceive the output and, if necessary, respond to it better. For example, if the output includes information relating to a function of the household appliance, the user can control the function better.

A particular advantage of the approach proposed here is that a mobile device can be used on a household appliance. For example, it is not currently possible to run the Android operating system on household appliances because Google does not provide for Android certification for such a form factor. The proposed coupling of mobile device and household appliance, however, makes it possible to use the Android operating system of a commercially available mobile device on the household appliance.

The device for determining the distance can comprise a dedicated sensor such as an ultrasonic sensor, a radar sensor or a LiDAR sensor. In a preferred embodiment, the device for determining the distance is integrated with the communication device. For example, a distance between the mobile device and the household appliance can be determined on the basis of information that a conventional communication device already determines. For example, when communicating via WLAN or Bluetooth, such information can arise or be determined specifically. Another conceivable Device for determining the distance based on UWB (Ultra WideBand, e.g. IEEE 802.15.3a).

The communication device can be set up to determine the distance based on the strength or freedom from interference of a wireless signal received by the mobile device. The strength of the received signal is also called RSS ("received signal strength") and can allow the distance to be determined knowing the strength of the transmitted signal. Freedom from interference can be specified as a signal-to-noise ratio (SNR). An error rate in the transmission of information between the household appliance and the mobile device can also be considered to determine freedom from interference.

In one embodiment, a distance between the devices is determined using a technology known as a beacon. One of the devices sends out wireless signals containing a message. The message may include information regarding the strength of the transmitted signal, a position of the transmitter, an identification of the transmitter, or other information. This allows the distance to be determined in a range that may be up to about 20 meters. The shorter the distance, the more accurate the determination can be. A receiver can better determine its position relative to a distance to a beacon. An accuracy of the determined position may be less than about one meter.

The output device can comprise a display device, wherein a size, a level of detail or a color selection of the output is controlled depending on the distance. The output provided can be adapted to the capabilities of the display device, for example with regard to a display size, an orientation or arrangement of individual pieces of information. If a display device is too small to completely display predetermined information in a desired size, the information can be provided one after the other in the manner of a ticker or in a predetermined sequence.

The output device may comprise a controllable sound source, wherein a volume of the output is controlled depending on the distance. For example, an audio data stream can be output in such a way that it is is always perceived to be equally loud, even if it changes its position in a room with the household appliance.

A second aspect of the present invention comprises a system comprising a household appliance according to the first aspect and a mobile device with a communication device for wireless coupling with a household appliance, wherein the mobile device is configured to transmit an output to be provided to the household appliance.

The mobile device can be set up in particular to pair with a household appliance according to a predetermined policy. The policy can, for example, control which function or application that the mobile device executes should be assigned to a predetermined household appliance or a function executed by the household appliance. Communication between predetermined communication partners on the part of the household appliance and the mobile device can thus be established more easily. A function that is assigned to a household appliance can, for example, be started automatically on the mobile device when the household appliance comes within a predetermined distance. For example, a recipe app can be started on the mobile device when the user approaches their stove, oven or other cooking appliance with the mobile device.

The directive can also control which household appliance the mobile device is paired with. In particular, the directive can control that the mobile device only pairs with a predetermined household appliance out of several, e.g. a hob with an integrated screen, such as a TFT or LCD screen. Alternatively, pairing can only take place with the closest household appliance, i.e. a household appliance that is the shortest distance from the mobile device. This determination can be made for a predetermined group of household appliances that are assigned to a predetermined household, for example. The directive can also provide that a connection is always made with the household appliance that is closest and has certain capabilities. For example, the directive can state that the closest household appliance with a loudspeaker should always be paired with the mobile device, so that a user who runs a music streaming service on their mobile device while walking around their home can also listen to the music on the closest household appliance with a loudspeaker.

In one embodiment, the policy can include information about under which circumstances which app installed on the mobile device is to be started and/or under which circumstances which app installed on the mobile device is to be displayed on the output device of the household appliance. For example, the policy can specify that the recipe app is to be started when the mobile device approaches a hob with a TFT screen. The recipe app then formally runs on the mobile device, but is also mirrored on this TFT screen of the hob. If a call comes in while cooking, the policy can stipulate that this call has a higher priority than the recipe app and thus the call is displayed primarily on the TFT screen of the hob. In this way, the policy can define optimized interaction patterns for the user.

The mobile device may be configured to obtain the policy from a central location, using a wired or wireless communication facility. The central location may control or manage aspects of household appliances associated with a user or household.

The mobile device can be set up to receive wireless signals from the household appliance, to determine an indication of its distance from the household appliance based on received signals; and to transmit the distance to the household appliance. By determining the distance on the part of the mobile device, a technology available there can easily be used. The household appliance or the control device can in particular be designed as a beacon to which the mobile device can easily determine its distance.

As already explained above, the output device of the household appliance can comprise a display device and/or a controllable sound source, wherein the output provided can be adapted to the capabilities of the display device or to the distance and/or a volume of the output can be controlled depending on the distance. In a particularly preferred embodiment, it is provided that a parallel output on the mobile device is also adapted to the output on the household appliance. This can mean in particular that the change in size, level of detail or color selection of the output on the household appliance can also be seen in this form on the mobile device. The mobile device can therefore be set up to output the output on the household appliance also on the mobile device, whereby an output on the mobile device corresponds to the output on the household appliance, in particular with regard to size, level of detail, choice of colour and/or volume.

If the mobile device is configured to apply a policy, the system may further include a central location for providing a policy to the mobile device.

It is preferred that the mobile device is configured to determine its position on the basis of the received wireless signals and to transmit them to the household appliance; and the household appliance is configured to determine the distance on the basis of its position and the position of the mobile device. The mobile device can determine its position on the basis of one or more sensors, for example by means of a satellite-based radio navigation system or an inertial platform. The position can alternatively or additionally be determined by determining a distance to one or more beacons, one of which can comprise the household appliance.

In yet another aspect, the present invention comprises a method according to claim 14.

The distance can be determined on the basis of a wireless communication signal transmitted between the household appliance and the mobile device. The communication signal can in particular comprise WLAN or Bluetooth (BT or BLE). Information transmitted by means of the communication signal can support the determination of the distance.

The method can be carried out by means of a control device described herein, a household appliance described herein, a mobile device described herein or a mobile device described herein An executing device may comprise a programmable microcomputer or microcontroller and the method may be in the form of a computer program product with program code means. The computer program product may also be stored on a computer-readable data carrier. Features or advantages of the household appliance, the mobile device or the system may be transferred to one another or to the method or vice versa.

Figur 1

ein System mit einem Haushaltsgerät und einem Mobilgerät; und

Figur 2

ein Verfahren zum Steuern eines Haushaltsgeräts

darstellt.The invention will now be described in more detail with reference to the accompanying figures, in which:

Figure 1

a system comprising a household appliance and a mobile device; and

Figure 2

a method for controlling a household appliance

represents.

Figure 1 shows a system 100 with at least one household appliance 105, a mobile device 110 and an optional central location 112. A first exemplary household appliance 105 is shown as an oven, a second as a refrigerator; however, other devices can also be used, for example a stove, an extractor hood or a mixer. The household appliance 105 can in particular comprise a kitchen appliance that is set up for operation in a kitchen of a household. The household appliances 105 are preferably located close to one another, for example in the shared household or a shared room such as a kitchen.

The mobile device 110 preferably comprises a smartphone, a tablet computer or a fitness watch and is usually assigned to a predetermined user 115 who can carry the mobile device 110 with him. A predetermined function can be provided on the mobile device 110, which can be provided in particular by an assigned program or application. Example functions include the management of a collection of recipes, acoustic or textual communication with another, remote user or the output of music. For this purpose, the function can provide an output to the user 115 by means of a local output device on the mobile device 110, in particular in optical, acoustic or haptic form. Furthermore, the function can receive an input from the user 115 at a local Input device of the mobile device 110, which the latter provides manually, for example. For this purpose, corresponding input and/or output devices can be provided on the mobile device 110. The mobile device 110 can also be set up to evaluate further inputs or environmental parameters that can be indirectly controlled by the user 115, such as a position, an acceleration or an ambient brightness.

The mobile device 110 is usually set up to be connected to a wireless network, in particular a wide area network such as the Internet. The mobile device 110 can also communicate with the central location 112 via this connection. The mobile device 110 can use WLAN or mobile radio for this purpose. Furthermore, the mobile device 110 preferably comprises a wireless communication device 120 which is set up to establish a wireless data connection with a local device, for example with the household appliance 105.

The household appliance 105 comprises a control device 125, which is preferably set up to control a function of the household appliance 105. In one embodiment, the control device 125 is set up to control several household appliances 105. A control device 125 can also be designed independently and not as part of a household appliance 105. In this case, communication between the control device 125 and an associated household appliance 105 is preferably wireless, for example using a technology known as Home Connect. A household can also have several control devices 125, each of which is set up to control at least one household appliance 105. The control devices 125 can also be connected to one another via data technology.

The control device 125 comprises a processing device 130, an input device 135, an output device 140 and a wireless communication device 145. The input device 135 and the output device 140 are here, for example, integrated with one another as a touch-sensitive screen. An input from the user 115 can be provided by touching an area of the input device 135, wherein a visual indication of the input can be displayed in the area on the output device 140. In this way, different inputs can be enabled in a context-sensitive manner.

It is proposed to wirelessly couple the mobile device 110 with the household appliance 105. An input from the user 115 on the input device 135 of the household appliance 105 can then be transmitted to the mobile device 110 and used there to control the function. In a corresponding manner, an output of a function running on the mobile device 110 can be transmitted to the household appliance 105 and made available to the user 115 there by means of the output device 140.

In one embodiment, inputs and outputs may be transmitted over a single data connection. In another embodiment, a first data connection 150 may be established for transmitting the input and a second data connection 155 may be established for transmitting the output. The data connections 150, 155 may be independent of each other and use different protocols or technologies, or may be implemented as only one bidirectional connection.

Via the first data connection 150, the control device 125 can present itself as a user interface (UI) that is configured to capture and provide inputs from the user 115. WLAN or Bluetooth, for example, can be used as the underlying protocol for the data connection 150.

Via the second data connection 155, the control device 125 can present itself to the mobile device 110 as a UI streaming server, i.e. as a device that accepts a stream of output data that can be directed to a user 115. Miracast or AirPlay, for example, can be used as the underlying protocol, which in turn can be based on WLAN or Bluetooth.

A distance between the household appliance 105 and the mobile device 110 can be determined on the basis of one of the data connections 150, 155. In particular, the communication device 145 can be set up to estimate the distance and optionally also a direction of the mobile device 110 on the basis of transmission parameters. In particular, a signal strength, a signal-to-noise ratio or an error rate can be used to determine the distance. If several antennas are available, parameters corresponding to one another can be used to Distance determination can be put into context. The distance can be determined by the control device 120 or by the mobile device 110. A distance determined by the mobile device 110 can be transmitted to the household appliance 105.

The mobile device 110 can also determine its geographical position, for example based on determinations from a receiver of a satellite-based navigation system, an inertial system and/or a distance to one of the household appliances 105. For this purpose, a household appliance 105 can implement a beacon that provides its own position by means of wireless signals. This technology can be easily used, in particular, on the basis of Bluetooth Low Energy (BTLE). The position of the mobile device 110 can then be determined based on the transmitted position and a distance to the household appliance 105, which can be determined based on transmission parameters of the wireless signal. The determined position of the mobile device 110 can be transmitted to the household appliance 115, which can then determine the distance to the mobile device 110 based on its own position.

Preferably, the processing device 130 is configured to adapt properties of the output device 140 and requirements of a received output of the mobile device 110 to one another. For example, an orientation (portrait or landscape format), a color capability, a graphic resolution or a size of an available display area of the output device 140 can be provided as a property to the mobile device 110. If the mobile device 110 provides an output that does not follow these specifications, the processing device 130 can perform a corresponding transformation of the output. For example, display sizes or resolutions can be converted into one another or a color palette can be reduced or assigned differently.

In some embodiments, a display area on the output device 140 can be dynamically made available for a function of the mobile device 110. In this case, the conversion can be carried out transparently or changed properties of the output device 140 can be reported to the mobile device 110.

In a preferred embodiment, the mobile device can find out what capabilities the output device of the household appliance has. Based on this information and/or the specific distance between the mobile device and the household appliance, the mobile device can scale the display accordingly and transmit it to the household appliance in scaled form. In this way, the household appliance can be relieved of potentially complex computing operations.

In one embodiment, a storage device 160 is provided which is connected to the processing device 130 of the control device 125. The storage device 160 is preferably designed to work as a cache and to temporarily store information which cannot be transmitted to the mobile device 110 due to a disruption in the data connection 150. In particular, if necessary, an input recorded on the input device 135 can be temporarily stored until the data connection 150 is re-established. A corresponding storage device can be provided on the part of the mobile device 110 in order to temporarily store an output which temporarily cannot be transmitted to the household appliance 105 due to an interrupted data connection 155. A corresponding cache can be provided on the part of the mobile device 110 in order to store a possibly undeliverable output until the data connection 155 is re-established.

It is preferred that the household appliance 105 comprises a first software component and the mobile device 110 comprises a second software component, which exchange inputs and/or outputs with one another. The components can each build on an underlying functionality of the household appliance 105 or the mobile device 110, which provides transmission via the data connections 150, 155. If one of the data connections 150, 155 is temporarily disconnected, for example because the devices 105, 110 are outside of a maximum bridgeable range, because antennas are unfavorably aligned with one another or because an object, such as a person 115, is in a Fresnel zone of the antennas, information to be transmitted can be stored by the household appliance 105 in the storage device 160 and/or by the mobile device 110 in a corresponding storage device. If the data connection 150, 155 becomes available again within a predetermined time, for example approx. 10, approx. 5 or approx. 2 seconds, the stored contents transmitted and the storage devices emptied. The software components do not have to be notified of the interrupted or faulty data connection 150, 155. For example, continuous output of acoustic information provided by the mobile device can be ensured by the household appliance 105. If a data connection 150, 155 is interrupted or faulty for longer than the predetermined time, both data connections 150, 155 or only the affected data connection 150, 155 can be terminated. Reestablishing a data connection 150, 155 can require new authentication of one of the devices 105, 110.

An output on the output device 140 of the household appliance 105 preferably takes place depending on a certain distance from the mobile device. For example, an acoustic data stream can be output at an increased volume when the user 115 with the mobile device 110 moves away from the outputting household appliance 105. A visual representation can be enlarged as the distance increases.

The central location 112 is set up to provide a guideline to a household appliance 105 that can control two functions. A first possible function consists in assigning a household appliance 105 or a function running on it to a function running on the mobile device 110. In other words, an assigned application ("app") can be started on the mobile device 110 as soon as communication with a predetermined household appliance 105 has taken place. Which application this is can be determined on the basis of the guideline and, if necessary, a boundary condition. The boundary condition can, for example, relate to a functional state or a capability of the household appliance 105. A personal preference of the user 115 of the mobile device 110 can also be taken into account. For example, a recipe app can be started on the mobile device when the mobile device approaches a cooking device, such as an oven or stove. The policy can be updated by the central location 112 if necessary, for example because a new household appliance 105 has been added to the same household, because a new user 115 belongs to the household or because the control device 125 has been updated. The control device 125 can, for example, be replaced or updated via a software update.

A second possible function of the policy is a selection of which of several household appliances 105 the mobile device 110 is coupled to. For example, it can be specified that a first application only communicates with the household appliance 105 that is the closest to the mobile device 110. A second application can be limited to communication with household appliances 110 that include an acoustic output device 140. Other specifications or combinations are also possible.

The policy can also determine which output has priority over which other output. For example, if several functions or apps are active in a paired mobile device 110, it can be predetermined which output has priority over which other. Individual messages or information can also be prioritized differently. For example, a notification about the end of a cooking time can have priority over the output of a video data stream. Such a distinction can also be made if several mobile devices 110 are paired with a household appliance 105 or can communicate. In a continuation, priorities between individual mobile devices 110 or users 115 assigned to them can also be taken into account.

Figure 2 shows a flow chart of a method 200. The method 200 can be carried out in a distributed manner on various components, in particular a household appliance 105 and a mobile device 110. By way of example, steps usually assigned to the mobile device 110 are shown in a left-hand area, and steps usually assigned to the household appliance 105 are shown in a right-hand area.

In a step 205, the mobile device 110 can transmit wireless signals, in particular electromagnetic signals, which can be received by the household appliance 105 in a step 210. The steps can also be carried out in reverse, so that the household appliance 105 transmits signals that the mobile device 110 receives. The transmitting device 105, 110 can transmit the signals in the manner of a beacon, so that the receiving device 105, 110 can better determine its distance from the transmitter. The distance can also be determined on the basis of parameters of a physical transmission or a bit transmission between the mobile device 110 and the household appliance 105.

In a step 215, the mobile device 110 can identify the household appliance 105 and decide based on a policy whether it should communicate with it. The policy can be predefined or downloaded from an external location 112. If communication is to take place, the policy can be used to determine which function or app is intended for communication with the household appliance 105 in question. The specific function or app can be started or notified of received information.

In a step 220, the mobile device 110 couples with the household appliance 105, which carries out the coupling in a corresponding step 225. The coupling can include an exchange of transmission parameters, an authentication or a certification of the communication partner. Following a coupling, information can preferably be easily exchanged in both directions.

In a step 230, the mobile device 110 can determine its distance from the household appliance 105. This determination can be made in particular on the basis of parameters that form the basis of the communication, for example an RSS or an SNR. In a further embodiment, the mobile device 110 can also determine its geographical position, whereby it may or may not rely on parameters of the communication. In a step 235, the determined distance and/or the determined position can be transmitted to the household appliance 105.

In a step 240, the household appliance 105 determines its distance from the mobile device 110. To do this, it can use a previously received distance determined by the mobile device 110 as a basis. In one variant, the household appliance 105 can determine the distance with respect to its own position and a position of the mobile device 110, which it may have previously received from the mobile device 110. Alternatively, the household appliance 105 can determine the distance based on parameters that form the basis of the communication, as described above, for example an RSS or an SNR. In a further embodiment, a dedicated sensor is provided for determining the distance. Several information sources can also be combined with one another to determine the distance.

In a step 245, the mobile device 105 can transmit an output to the household appliance 105 via the established data connection 150, 155. The latter can receive the output in a step 250 and process it depending on the specific distance. For example, the size, frequency, color or orientation of an optical output can be determined depending on the distance. The greater the distance, the clearer or more conspicuous the output can be. An acoustic output can be adjusted in terms of its volume or a frequency spectrum used depending on the distance. The processed output can then be output using the output device 140.

Reference symbols

100

system

105

Household appliance

110

Mobile device

112

central location

115

user

120

Communication facility

125

Control device

130

Processing facility

135

Input device

140

Output device

145

wireless communication device

150

first data connection (input)

155

second data connection (output)

160

Storage device

200

Proceedings

205

Sending / receiving wireless signals

210

Sending / receiving wireless signals

215

Check policy, start app

220

Couple

225

Couple

230

Determine position / distance

235

Submit position / distance

240

Determine distance

245

Submit Issue

250

Provide Issue

Claims (15)

1. Household appliance (105), comprising:

   - a communications facility (145) for wireless communication;

   - an output apparatus (140);

   - a facility (145) for determining a distance with respect to a mobile device (110); and

   - a processing facility (130),

   characterised in that the processing facility (130) is configured so as to wirelessly couple the mobile device (110) to the household appliance (105), and that the processing facility (130) is further configured so as to provide

   - an output that is transmitted from the mobile device (110) to the household appliance (105),

   - a function which runs on the mobile device (110) and

   • goes beyond controlling the household appliance (105),

   • in dependence upon the determined distance

   • on the output apparatus (140) of the household appliance (105).
2. Household appliance (105) according to claim 1, wherein the facility (145) for determining the distance is embodied as integrated with the communications facility (145).
3. Household appliance (105) according to claim 2, wherein the communications facility (145) is configured so as to determine the distance on the basis of a strength or a freedom from interference of a wireless signal that is received from the mobile device (110)
4. Household appliance (105) according to one of the preceding claims, wherein the output apparatus (140) comprises a display facility and a size, a richness of detail or a colour selection of the output is controlled in dependence upon the distance that is determined.
5. Household appliance (105) according to one of the preceding claims, wherein the output apparatus (140) comprises a controllable sound source and a volume of the output is controlled in dependence upon the determined distance.
6. System (100), comprising

   - a household appliance (105) according to one of claims 1 to 5 and

   - a mobile device (110) having a communications facility (120) for wirelessly coupling to the household appliance (105),

   wherein the mobile device (110) is configured so as to transmit the output, which is to be provided, to the household appliance (105).
7. System (100) according to claim 6, wherein the mobile device (110) is configured so as to couple to a household appliance (105) according to a predetermined guideline.
8. System (100) according to claim 7, wherein the guideline comprises that the mobile device (110) only couples to a predetermined household appliance (105) of multiple household appliances (105).
9. System (100) according to claim 7 or 8, wherein the guideline comprises information regarding

   - under which circumstances which function that is installed on the mobile device (110) is to be started and/or

   - under which circumstances the output of which function that is installed on the mobile device (110) is to be transmitted to the household appliance (105) and is to be output on the output apparatus (140) of the household appliance (105).
10. System (100) according to one of claims 6 to 9, wherein the mobile device (110) is configured so as to

    - receive wireless signals (155) from the household appliance (105),

    - determine an indication of the distance of the mobile device with respect to the household appliance (105) on the basis of signals that are received; and

    - transmit the distance to the household appliance (105).
11. System (100) according to one of claims 6 to 10, wherein the mobile device (110) is configured so as to also output the output on the household appliance (105) on the mobile device (110), wherein an output on the mobile device (110) corresponds to the output on the household appliance (105), in particular with regard to size, a richness of detail, colour selection and/or volume.
12. System (100) according to one of claims 7 to 11, further comprising a central point (112) that is configured so as to provide and/or to update the predetermined guideline.
13. System (100) according to one of claims 10 to 12,

    - wherein the mobile device (110) is configured so as to determine its position on the basis of the wireless signals that are received and so as to transmit to the household appliance (105); and

    - wherein the household appliance (105) is configured so as to determine the distance from the mobile device (110) on the basis of the position of the household appliance and the position of the mobile device (110).
14. Method (200) comprising the following steps:

    - determining (240) a distance between a household appliance (105) and a mobile device (110);

    - wirelessly coupling (220, 225) the household appliance (105) to the mobile device (110);

    - transmitting (245) an output of the mobile device (110) to the household appliance (105); and

    - providing (250) the output on the household appliance (105) in dependence upon the determined distance.

    characterised in that

    in the steps of transmitting (245) and providing (250)

    - an output of a function that is running on the mobile device (110), which

    - goes beyond controlling the household appliance (105),

    is transmitted from the mobile device (110) to the household appliance (105) and is provided in dependence upon the determined distance on the output apparatus (140) of the household appliance (105).
15. Method (200) according to claim 14, wherein the distance is determined (240) on the basis of a wireless communication signal (150, 155) that is transmitted between the household appliance (105) and the mobile device (110).

Images