KR102538976B1 - Feedback device and method for providing thermal feedback using the same - Google Patents

Abstract

The present invention relates to a feedback device that outputs thermal feedback and a method for providing thermal feedback using the same, wherein an electronic device for providing thermal feedback includes content including thermal feedback data for providing thermal feedback linked to a specific scene. A memory storing at least a portion thereof, a thermoelectric element performing a thermoelectric operation to provide the thermal feedback, and a controller controlling the thermoelectric element, wherein the controller provides first thermal feedback corresponding to the thermal feedback data. apply power to the thermoelectric element at a first time point to do so, and obtain a first user input indicating a first felt time point at which the first thermal feedback corresponding to the power applied at the first time point is sensed from a user; A first correction time is calculated based on the first time point and the first felt time point, and based on the calculated first correction time, a first thermoelectric current prior to a reproduction time point of the specific scene linked with the first thermal feedback It is set to apply power at an operation start time, and the first thermoelectric operation start time may be determined based on a reproduction time of the specific scene and the first correction time.

Description

Feedback device and thermal feedback providing method using the same {FEEDBACK DEVICE AND METHOD FOR PROVIDING THERMAL FEEDBACK USING THE SAME}

The present invention relates to a feedback device outputting thermal feedback and a thermal feedback providing method using the same.

In recent years, as technology for virtual reality (VR) or augmented reality (AR) develops, there is an increasing demand for providing feedback through various senses in order to increase user immersion in content. In particular, at the Consumer Electronics Show (CES) in 2016, virtual reality technology was cited as one of the promising future technologies. In line with this trend, research is being actively conducted to provide user experiences for all human senses, including smell and touch, in the future, away from user experience (UX: User eXperience), which is currently mainly limited to sight and hearing.

A thermoelectric element (TE: ThermoElement) is an element that causes an exothermic or endothermic reaction by receiving electrical energy by the Peltier effect, and has been expected to be used to provide thermal feedback to users. The application of the thermoelectric element has been limited because it is difficult to adhere to a user's body part.

However, as the development of a flexible thermoelectric element (FTE) has recently reached a successful stage, it is expected to overcome the problems of conventional thermoelectric elements and effectively deliver thermal feedback to users.

One object of the present invention is to provide a feedback device for providing thermal feedback to a user and a method for providing thermal feedback using the feedback device.

Another object of the present invention is to provide a method for calibrating the intensity of hot and cold feedback to suit the characteristics of a user or a feedback device.

Another object of the present invention is to provide a method for calibrating the strength of thermal grill feedback to suit the characteristics of a user or characteristics of a feedback device.

Another object of the present invention is to provide a calibration method for preventing user's body damage in a thermal feedback calibration process.

The problem to be solved by the present invention is not limited to the above-mentioned problems, and problems not mentioned will be clearly understood by those skilled in the art from this specification and the accompanying drawings. .

According to an aspect of the present invention, an electronic device for providing thermal feedback includes: a memory storing at least a part of content including thermal feedback data for providing thermal feedback linked to a specific scene; a thermoelectric element that performs a thermoelectric operation for a thermoelectric element and a controller that controls the thermoelectric element, wherein the controller applies power to the thermoelectric element at a first time to provide a first thermal feedback corresponding to the thermal feedback data; , Obtaining a first user input indicating a first felt time point at which the user feels the first thermal feedback corresponding to the power applied at the first time point from the user, and based on the first time point and the first felt time point, A first correction time is calculated, and power is applied at a first thermoelectric operation start time prior to a playback time of the specific scene linked with the first thermal feedback based on the calculated first correction time, and The start time of the 1 thermoelectric operation may be determined based on the reproduction time of the specific scene and the first correction time.

The solutions to the problems of the present invention are not limited to the above-described solutions, and solutions not mentioned will be clearly understood by those skilled in the art from this specification and the accompanying drawings. You will be able to.

According to the present invention, thermal feedback can be provided to the user.

In addition, according to the present invention, it is possible to provide a feeling of pain in addition to a feeling of heat by providing a feeling of heat pain using a feeling of warmth and a feeling of coolness.

In addition, according to the present invention, user experience can be improved by outputting warmth feedback, cold feedback, and heat grill feedback with intensities suitable for the user's characteristics or the characteristics of the feedback device.

In addition, according to the present invention, the user's safety can be ensured by preventing damage to the user's skin due to thermal feedback.

Effects of the present invention are not limited to the above-mentioned effects, and effects not mentioned will be clearly understood by those skilled in the art from this specification and the accompanying drawings.

1 is a block diagram of a configuration of a thermal experience providing system 1000 according to an embodiment of the present invention.
2 is a block diagram of a configuration of a content reproducing device 1200 according to an embodiment of the present invention.
3 is a block diagram of the configuration of an audio-visual device 1400 according to an embodiment of the present invention.
4 is a block diagram of a configuration of a feedback device 1600 according to an embodiment of the present invention.
5 is a block diagram of a configuration of a heat output module 1640 according to an embodiment of the present invention.
6 is a diagram of one form of thermal output module 1640 according to an embodiment of the present invention.
7 is a diagram of another form of thermal output module 1640 according to an embodiment of the present invention.
8 is a diagram of another form of thermal output module 1640 according to an embodiment of the present invention.
9 is a diagram of yet another form of heat output module 1640 according to an embodiment of the present invention.
10 is a diagram related to a heating operation for providing on-sense feedback according to an embodiment of the present invention.
11 is a graph related to the strength of the sense of touch feedback according to an embodiment of the present invention.
12 is a diagram related to a heating operation for providing cooling feedback according to an embodiment of the present invention.
13 is a graph of intensity of cooling sensation feedback according to an embodiment of the present invention.
14 is a graph of strength of hot/cold feedback using voltage regulation according to an embodiment of the present invention.
FIG. 15 is a graph related to the adjustment of intensity of warming/cooling feedback through operation control of each thermocouple group 1644 according to an embodiment of the present invention.
16 is a graph related to adjustment of intensity of warming/cooling feedback through control of power application timing according to an embodiment of the present invention.
17 is a diagram related to a heat grill operation of a voltage control method according to an embodiment of the present invention.
18 is a table related to voltages for providing neutral row grill feedback in a voltage regulation method according to an embodiment of the present invention.
19 is a diagram related to an operation of heat grilling in an area adjusting method according to an embodiment of the present invention.
FIG. 20 is a diagram showing a thermocouple array 1640 composed of thermocouple groups 1644 having different areas for thermal regulation according to an embodiment of the present invention.
21 is a diagram related to an example of a row grill operation using a time division method according to an embodiment of the present invention.
22 is a diagram related to another example of a row grill operation using a time division method according to an embodiment of the present invention.
23 is a diagram for an example of a row grilling operation using a combination of area adjustment and time division according to an embodiment of the present invention.
24 is a diagram related to another example of a row grilling operation using a method in which area adjustment and time division are combined according to an embodiment of the present invention.
25 is a diagram related to another example of a row grilling operation using a combined method of region adjustment and time division according to an embodiment of the present invention.
26 is a flowchart of a method for calibrating the intensity of thermal feedback according to an embodiment of the present invention.
27 is a flowchart of a method for calibrating strengths of warmth feedback and cold feedback according to an embodiment of the present invention.
28 is a graph related to setting the lowest intensity of warmth feedback and cold feedback according to an embodiment of the present invention.
29 is a graph related to setting the highest intensity of warmth feedback and cold feedback according to an embodiment of the present invention.
30 is a graph related to medium intensity settings of warmth feedback and cool feedback according to an embodiment of the present invention.
31 is a flowchart of a method for calibrating the intensity of thermal grill feedback according to an embodiment of the present invention.
32 is a table of voltages for providing thermal grill feedback based on a neutral ratio according to an embodiment of the present invention.
33 is a table of voltages for providing thermal grill feedback based on reference intensity according to an embodiment of the present invention.
34 is a table of voltages for providing thermal grill feedback based on final intensity according to an embodiment of the present invention.
35 is a table of voltages for providing thermal grill feedback based on detail intensity according to an embodiment of the present invention.
36 is a table of voltages and application times of the voltages for providing thermal grill feedback based on a neutral ratio according to an embodiment of the present invention.
37 is a table of voltages for providing thermal grill feedback based on reference intensity according to an embodiment of the present invention.
38 is a table of voltages for providing thermal grill feedback based on detail intensity according to an embodiment of the present invention.
39 is a flowchart of a method for checking a result of strength calibration according to an embodiment of the present invention.
40 is a flowchart of a method for calibrating a region of thermal feedback according to an embodiment of the present invention.
41 is a table for explaining settings of the same thermoelectric feedback output area according to an embodiment of the present invention.
42 is a table for explaining setting of a non-active area according to an embodiment of the present invention.
43 is a flowchart of a thermal feedback time calibration method according to an embodiment of the present invention.
44 is a diagram for explaining calculation of a correction time according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, the present invention is not limited or limited by one embodiment. Also, like reference numerals in each figure denote like members.

1. Thermal experience provision system

Hereinafter, a thermal experience providing system 1000 according to an embodiment of the present invention will be described.

1.1. Overview of Thermal Experience Delivery System

The thermal experience providing system 1000 according to an embodiment of the present invention is a system allowing a user to experience a thermal experience (TX). In detail, the system for providing thermal experience 1000 may allow a user to experience a thermal experience by outputting thermal feedback as part of an expression form of multimedia content when playing multimedia content.

Here, thermal feedback is a type of thermal stimulation that stimulates the thermal sensory organs distributed in the user's body so that the user feels a thermal sensation. should be interpreted as comprehensive.

Representative examples of thermal feedback include warm feedback and cold feedback. Warm feedback refers to applying heat to hot spots distributed on the skin so that the user feels a sense of warmth, while cool feedback refers to applying cold heat to cold spots distributed on the skin so that the user feels a sense of coolness. it means.

Here, since heat is a physical quantity expressed in the form of a positive scalar, the expression 'applying cold heat' or 'transmitting cold heat' may not be a strict expression from a physical point of view, but in this specification, for convenience of description, heat is applied Heat is applied or transferred to a phenomenon that occurs or is transmitted, and the opposite phenomenon, that is, a phenomenon that absorbs heat, is expressed as cold heat to be applied or transferred.

In addition, in the present specification, thermal feedback may further include thermal grill feedback in addition to warmth feedback and cool feedback. When heat and cold are given at the same time, the user perceives it as a pain sensation instead of recognizing it as an individual sense of heat and cold. That is, the heat grill feedback refers to thermal feedback that applies hot and cold heat in a complex manner, and can be mainly provided by simultaneously outputting hot feedback and cool feedback. In addition, the thermal grill feedback may be referred to as thermal sensation feedback in terms of providing a sensation close to a sensation. A more detailed description of the thermal grill feedback will be given later.

Also, here, the multimedia content may include various types of content including videos, games, virtual reality applications, and augmented reality applications.

In general, multimedia contents are provided to users in an audio-visual expression style based on video and audio, but in the present invention, a thermal expression based on the above-described thermal feedback may be included as an essential expression form.

On the other hand, 'reproduction' of multimedia contents should be interpreted as a comprehensive meaning that includes all operations of executing multimedia contents and providing them to users. Therefore, the term 'play' in this specification should be interpreted to include not only an operation of simply reproducing a video through a media player, but also an operation of executing a game program, educational program, virtual reality application, or augmented reality application. .

1.2. Configuration of the thermal experience providing system

1 is a block diagram of a configuration of a thermal experience providing system 1000 according to an embodiment of the present invention.

Referring to FIG. 1 , a thermal experience providing system 1000 may include a content playback device 1200 , an audiovisual device 1400 and a feedback device 1600 .

Here, the content reproducing device 1200 may reproduce multimedia content, the audiovisual device 1400 may output video or audio according to content reproduction, and the feedback device 1600 may output thermal feedback according to content reproduction.

For example, the content reproducing device 1200 decodes video content including video data/audio data/thermal feedback data and sends video signals/audio signals/thermal feedback to the audiovisual device 1400 and the feedback device 1600, respectively. can be transmitted as a signal. The audiovisual device 1400 may receive video signals and audio signals to output video and audio, and the feedback device 1600 may receive thermal feedback signals and output thermal feedback.

Hereinafter, each component of the thermal experience providing system 1000 will be described in detail.

1.2.1. Content playback device

The content playback device 1200 plays multimedia content.

2 is a block diagram of a configuration of a content reproducing device 1200 according to an embodiment of the present invention.

Referring to FIG. 2 , a content playback device 1200 may include a communication module 1220 , a memory 1240 and a controller 1260 .

The communication module 1220 may communicate with an external device. The content playback device 1200 may transmit/receive data with the audio-visual device 1400 or the feedback device 1600 through the communication module 1220 . For example, the content playback device 1200 may transmit an A/V signal to the audio/visual device 1400 or a thermal feedback signal to the feedback device 1600 through the communication module 1220 . In addition, the content playback device 1200 may download multimedia content by accessing the Internet through the communication module 1220 .

The communication module 1220 is largely divided into a wired type and a wireless type. Since the wired type and the wireless type each have advantages and disadvantages, the wired type and the wireless type may be simultaneously provided in the content reproducing device 1200 in some cases.

In the case of a wired type, LAN (Local Area Network) or USB (Universal Serial Bus) communication is a representative example, and other methods are also possible.

In the case of a wireless type, a wireless personal area network (WPAN)-based communication method such as Bluetooth or Zigbee may be used. However, since the wireless communication protocol is not limited thereto, the wireless type communication module may use a wireless local area network (WLAN)-based communication method such as Wi-Fi or other known communication methods.

Meanwhile, it is also possible to use a proprietary protocol developed by a game machine or console manufacturer as a wired/wireless communication protocol.

The memory 1240 may store various types of information. Various types of data may be temporarily or semi-permanently stored in the memory 1240 . Examples of the memory 1240 include a hard disk drive (HDD), a solid state drive (SSD), a flash memory, a read-only memory (ROM), a random access memory (RAM), and the like. This can be. The memory 1240 may be provided in a form embedded in the content reproducing device 1200 or in a detachable form.

The memory 1240 stores an operating system (OS) for driving the content playback device 1200 or various data necessary for the operation of the content playback device 1200, including content to be executed in the content playback device 1200. can

In addition, the memory 1240 includes values calibrated to output thermal feedback from the feedback device 1600, for example, the minimum intensity of the warm/cold/heat sensation feedback, the maximum intensity of the warm/cold/heat sensation feedback, and the warm sensation. Information related to the medium intensity of /cooling/heating sensation feedback may be stored. This will be described later.

The controller 1260 may control overall operations of the content playback device 1200 . For example, the controller 1260 may load and play multimedia content from the memory 1240 or generate a control signal to control video, audio, or thermal feedback output according to content playback.

The controller 1260 may be implemented as a CPU (Central Processing Unit) or similar device according to hardware or software or a combination thereof. It may be provided in the form of an electronic circuit that performs a control function by processing electrical signals in hardware, and may be provided in the form of a program or code that drives a hardware circuit in software.

1.2.2. audiovisual device

The audiovisual device 1400 may output video and audio according to multimedia playback.

3 is a block diagram of the configuration of an audio-visual device 1400 according to an embodiment of the present invention.

Referring to FIG. 3 , an audiovisual device 1400 may include a communication module 1420 and an A/V module 1440 .

The communication module 1420 may communicate with an external device. The audiovisual device 1400 may transmit/receive data with the content playback device 1200 through the communication module 1420 . For example, the audiovisual device 1400 may receive an A/V signal from the content playback device 1200 or the feedback device 1600 through the communication module 1420 .

Since the communication module 1420 of the audiovisual device 1400 may be provided similarly to the communication module 1220 of the content reproduction device 1200, a detailed description thereof will be omitted.

The A/V module 1440 may provide video or audio to the user. To this end, the A/V module 1440 may include a video module 1442 and an audio module 1444.

The image module 1442 is generally provided in the form of a display, and may output an image according to a video signal received from the content playback device 1200 or the feedback device 1600 . The voice module 1444 is generally provided in the form of a speaker and can output voice according to a voice signal received from the content reproduction device 1200 or the feedback device 1600 .

1.2.3. feedback device

The feedback device 1600 may output thermal feedback according to multimedia reproduction.

4 is a block diagram of a configuration of a feedback device 1600 according to an embodiment of the present invention.

Referring to FIG. 4 , a feedback device 1600 may include a communication module 1620 and a heat output module 1640 .

According to an embodiment of the present invention, the feedback controller 1648 may be a component distinct from the heat output module 1640 or may be included in the heat output module 1640 . In addition, the present invention is not limited thereto, and when the feedback controller 1648 exists outside the heat output module 1640, a feedback controller separate from the feedback controller 1648 may exist inside the heat output module 1640. In this specification, for convenience of explanation, it is assumed that the feedback controller 1648 is included in the column output module 1640 .

The communication module 1620 may communicate with an external device. The feedback device 1600 may transmit/receive data with the content reproduction device 1200 through the communication module 1620 . For example, the feedback device 1600 may receive a thermal feedback signal from the content playback device 1200 through the communication module 1620 . As another example, the feedback device 1600 may transmit a voice signal and/or a video signal to the audiovisual device 1400 through the communication module 1620 .

The thermal output module 1640 can output thermal feedback. Thermal feedback is a heat output module 1640 including a contact surface 1641 that comes into contact with the user's body and a thermoelectric element connected to the contact surface 1641, when power is applied, hot or cold heat generated in the thermoelectric element is transferred to the contact surface 1641. It can be output by applying to the user's body through.

The heat output module 1640 may output thermal feedback by performing a heating operation, heat absorbing operation, or heat grill operation according to the thermal feedback signal received from the content playback device 1200 through the communication module 1620, and the user may A thermal experience can be experienced by the output thermal feedback.

Meanwhile, a detailed description of a specific configuration or operating method of the heat output module 1640 will be described later.

2. Heat output module

Hereinafter, the heat output module 1640 according to an embodiment of the present invention will be described.

2.1. Overview of Heat Output Modules

The heat output module 1640 may output thermal feedback to transfer hot and cold heat to the user by performing a heat generating operation, a heat absorbing operation, or a heat grilling operation. In the thermal experience providing system 1000, the thermal output module 1640 mounted on the feedback device 1600 outputs thermal feedback when the feedback device 1600 receives a thermal feedback signal, and provides the thermal experience providing system 1000 to the user. To provide a thermal experience.

In order to perform the aforementioned heating operation, heat absorption operation, or heat grill operation, the heat output module 1640 may use a thermoelectric element such as a Peltier element.

The Peltier effect is a thermoelectric phenomenon discovered by Jean Peltier in 1834. When dissimilar metals are joined and then current flows, an exothermic reaction occurs on one side and a cooling reaction on the other side, depending on the direction of the current. means what is happening. The Peltier element is an element that causes such a Peltier effect. The Peltier element was initially made of heterogeneous metal junctions such as bismuth and antimony, but has recently been manufactured by arranging N-P semiconductors between two metal plates to have higher thermoelectric efficiency. .

In the Peltier element, when current is applied, heat generation and absorption are immediately induced in both metal plates, and it is possible to switch between heat generation and absorption according to the direction of the current, and the degree of heat generation or absorption can be controlled relatively precisely according to the amount of current. It is suitable for use in exothermic operation or endothermic operation. In particular, as a flexible thermoelectric element has been recently developed, it can be manufactured in a form that can be easily contacted with the user's body, and commercial applicability as the feedback device 1600 is increasing.

Accordingly, the heat output module 1640 may perform a heating operation or a heat absorbing operation as electricity is applied to the above-described thermoelectric element. Physically, an exothermic reaction and an endothermic reaction occur simultaneously in a thermoelectric element to which electricity is applied, but in the present specification, a surface in contact with the user's body of the heat output module 1640 generates heat as a heat generating operation, and absorbs heat. is defined as an endothermic action. For example, the thermoelectric element may be configured by disposing an N-P semiconductor on a substrate 1642, and when a current is applied thereto, heat is generated on one side and heat is absorbed on the other side. Here, if the side facing the user's body is the front and the opposite side is the back, heat generation from the front and absorption of heat from the back of the heat output module 1640 are defined as performing a heating operation, and vice versa. Endothermic, heat generation from the rear side can be defined as performing endothermic operation.

In addition, since the thermoelectric effect is induced by the charge flowing through the thermoelectric element, it is possible to describe the electricity that induces the heat generation operation or the heat absorption operation of the heat output module 1640 in terms of current, but in this specification, for convenience of description, it is collectively In general, it will be described in terms of voltage. However, this is only for the convenience of description, and the invention is based on the interpretation of the description in terms of voltage by a person with ordinary knowledge in the technical field to which the present invention belongs (hereinafter referred to as 'those skilled in the art') by substituting it in terms of current. Since no accident is required, it should be noted that the present invention should not be construed as limited in terms of voltage.

2.2. Construction of the heat output module

5 is a block diagram of a configuration of a heat output module 1640 according to an embodiment of the present invention.

Referring to FIG. 5 , the thermal output module 1640 includes a contact surface 1641, a substrate 1642, a thermocouple array 1643 disposed on the substrate 1642, and a power terminal for applying power to the thermal output module 1640. 1647 and a feedback controller 1645.

The contact surface 1641 directly contacts the user's body and transfers hot or cold heat generated from the heat output module 1640 to the user's skin. In other words, a part of the outer surface of the feedback device 1600 that directly contacts the user's body may be the contact surface 1641 . For example, the contact surface 1641 may be formed in a gripping portion of the casing of the feedback device 1600 that is gripped by a user.

For example, the contact surface 1641 may be provided as a layer that is directly or indirectly attached to an outer surface (direction of the user's body) of the thermocouple array 1643 that performs a heat generating operation or a heat absorbing operation in the heat output module 1640. The contact surface 1641 of this type may be disposed between the thermocouple array 1643 and the user's skin to transfer heat. To this end, the contact surface 1641 may be made of a material having high thermal conductivity so that heat is easily transferred from the thermocouple array 1643 to the user's body. In addition, the layer-type contact surface 1641 also serves to protect the thermocouple array 1643 from external impact by preventing the thermocouple array 1643 from being directly exposed to the outside.

Meanwhile, in the above, it has been described that the contact surface 1641 is a separate configuration disposed on the outer surface of the thermocouple array 1643, but it is possible that the outer surface of the thermocouple array 1643 itself becomes the contact surface 1641. . In other words, a part or all of the front surface of the thermocouple array 1643 may become the contact surface 1641 .

The substrate 1642 serves to support the unit thermocouple 1645 and is provided with an insulating material. For example, ceramic may be selected as the material of the substrate 1642 . In addition, the substrate 1642 may be of a flat plate shape, but this is not necessarily the case.

The substrate 1642 may be made of a flexible material so as to have flexibility that can be used universally for various types of feedback devices 1600 having contact surfaces 1641 of various shapes. For example, in the feedback device 1600 of the gaming controller type, most of the parts where the user grips the gaming controller with the palm have a curved shape. 1640) may be important to have this flexibility. For this purpose, as an example of a flexible material used for the substrate 1642, there may be glass fiber or flexible plastic.

The thermocouple array 1643 is composed of a plurality of unit thermocouple pairs 1645 disposed on a substrate 1642 . As the unit thermocouple 1645, a pair of metals different from each other (for example, bismuth and antimony, etc.) can be used, but mainly an N-type and P-type semiconductor pair can be used.

In the unit thermocouple 1645, the semiconductor pair is electrically connected at one end and electrically connected to the unit thermocouple 1645 at the other end. An electrical connection between the pair of semiconductors 1645a and 1646b or with an adjacent semiconductor is made by a conductor member 1646 disposed on the substrate 1642 . The conductor member 1646 may be a wire or electrode made of copper or silver.

The electrical connection of the unit thermocouples 1645 may be mainly made in series connection, and the unit thermocouples 1645 connected in series with each other form a thermocouple group 1644, and the thermocouple group 1644 is a thermocouple array ( 1643) can be achieved.

The power terminal 1647 may apply power to the heat output module 1640 . The thermocouple array 1643 may generate heat or absorb heat according to the voltage value and direction of the current applied to the power terminal 1647. More specifically, two power terminals 1647 may be connected to one thermocouple group 1644 . Accordingly, when there are multiple thermocouple groups 1644, two power supply terminals 1647 may be disposed for each thermocouple group 1644. According to this connection method, by individually controlling the voltage value or current direction for each thermocouple group 1644, whether to perform heat generation or heat absorption and the degree of heat generation or heat absorption can be adjusted.

Also, as will be described later, the power terminal 1647 receives the electric signal output by the feedback controller 1645, and consequently the feedback controller 1648 adjusts the direction or magnitude of the electric signal to control the output of the heat output module 1640. Exothermic operation and endothermic operation may be controlled. In addition, when there are a plurality of thermocouple groups 1644, it may be possible to individually control each thermocouple group 1644 by individually adjusting the electric signal applied to each power terminal 1647.

The feedback controller 1648 may apply an electrical signal to the thermocouple array 1643 through the power supply terminal 1647 . Specifically, the feedback controller 1648 receives information on thermal feedback from the controller 1260 of the content playback device 1200 through the communication module 1620, interprets the information on the thermal feedback, and interprets the type or strength of the thermal feedback. is determined, and an electric signal is generated according to the determination result and applied to the power terminal 1647 so that the thermocouple array 1643 outputs thermal feedback.

To this end, the feedback controller 1648 may perform calculations and processing of various types of information and output an electrical signal to the thermocouple array 1643 according to the processing result to control the operation of the thermocouple array 1643. Accordingly, the feedback controller 1648 may be implemented in a computer or similar device according to hardware or software or a combination thereof. In terms of hardware, the feedback controller 1648 may be provided in the form of an electronic circuit that performs a control function by processing electrical signals, and in terms of software, it may be provided in the form of a program or code that drives a hardware circuit.

A plurality of heat output modules 1640 may be provided in the feedback device 1600 . For example, when the feedback device 1600 has a plurality of gripping units, the heat output module 1640 may be mounted on each gripping unit of the feedback device 1600 . In this way, when a plurality of heat output modules 1640 are provided to one feedback device 1600, a feedback controller is provided for each heat output module 1640 in the feedback device 1600 or all heat output modules 1640 are provided. One feedback controller for integrated management may be provided. Also, when a plurality of feedback devices 1600 are provided in the thermal experience system 1000, one or a plurality of thermal output modules 1640 may be disposed in each feedback device 1600.

2.3. Type of heat output module

*

Based on the description of the configuration of the heat output module 1640 described above, some representative forms of the heat output module 1640 will be described.

6 is a diagram of one form of thermal output module 1640 according to an embodiment of the present invention.

Referring to FIG. 6 , in one form of a thermal output module 1640, a pair of substrates 1642 are provided facing each other. A contact surface 1641 is positioned on an outer side of one of the two substrates 1642 , so that heat generated by the heat output module 1640 can be transferred to the user's body. In addition, if the substrate 1642 is used as the flexible substrate 1642, flexibility may be imparted to the thermal output module 1640.

A plurality of unit thermocouple pairs 1645 are positioned between the substrates 1642 . Each unit thermocouple 1645 is composed of a semiconductor pair of an N-type semiconductor and a P-type semiconductor. In each unit thermocouple 1645, an N-type semiconductor and a P-type semiconductor are electrically connected to each other at one end by a conductor member 1646. In addition, the other ends of the N-type semiconductor and the P-type semiconductor of an arbitrary unit thermocouple 1645 are electrically connected to the other ends of the P-type semiconductor and the N-type semiconductor of the adjacent unit thermocouple 1645 by the conductor member 1646, respectively. Electrical connection between unit elements is made in such a way. Accordingly, unit connection elements are connected in series to form one thermocouple group 1644. In this form, the entire thermocouple array 1643 is composed of one thermocouple group 1644, and since all unit thermocouples 1645 are connected in series between the power terminals 1647, the heat output module 1640 The same action is performed over its entire front surface. That is, when power is applied to the power terminal 1647 in one direction, the heat output module 1640 may perform a heating operation, and when power is applied in the opposite direction, it may perform an absorbing operation.

7 is a diagram of another form of thermal output module 1640 according to an embodiment of the present invention.

Referring to FIG. 7 , another form of the thermal output module 1640 is similar to one form described above. However, in this embodiment, the thermocouple array 1643 has a plurality of thermocouple groups 1644, and as each thermocouple group 1644 is connected to each power supply terminal 1647, each thermocouple group 1644 is individually control is possible For example, in FIG. 7 , currents in different directions are applied to the first thermocouple group 1644 and the second thermocouple group 1644 so that the first thermocouple group 1644 performs a heating operation (the current direction at this time is referred to as the 'forward direction'), the second thermocouple group 1644 may perform an endothermic operation (the current direction at this time referred to as the 'reverse direction'). For another example, by applying different voltage values to the power terminal 1647 of the first thermocouple group 1644 and the power terminal 1647 of the second thermocouple group 1644, the first thermocouple group 1644 and the second thermocouple group 1644 may perform a heat generating operation or an endothermic operation to different degrees from each other.

Meanwhile, although FIG. 7 shows that the thermocouple group 1644 is arranged in a one-dimensional array in the thermocouple array 1643, it is possible to arrange the thermocouple group 1644 in a two-dimensional array. 8 is a diagram of another form of thermal output module 1640 according to an embodiment of the present invention. Referring to FIG. 8 , by using the thermocouple groups 1644 arranged in a two-dimensional array, more subdivided regional operation control may be possible.

On the other hand, in the above-described forms of the heat output module 1640, it has been described that a pair of facing substrates 1642 are used, but it is also possible to use a single substrate 1642 differently. 9 is a diagram of yet another form of heat output module 1640 according to an embodiment of the present invention. Referring to FIG. 9 , a unit thermocouple 1645 and a conductor member 1646 may be disposed on a single substrate 1642 in such a way that they are buried in the single substrate 1642 . For this purpose, it is possible to use glass fiber or the like as the substrate 1642 . Using a single substrate 1642 of this type may provide higher flexibility to the thermal output module 1640 .

Various forms of the heat output module 1640 described above may be combined or modified within a range apparent to those skilled in the art. For example, in each form of the heat output module 1640, it has been described that the contact surface 1641 on the front surface of the heat output module 1640 is formed as a separate layer from the heat output module 1640, but the heat output module 1640 ) may be the contact surface 1641 itself. For example, in one form of the heat output module 1640 described above, the outer surface of one substrate 1642 may serve as the contact surface 1641 .

2.4. Thermal feedback output

Hereinafter, a thermal feedback output operation performed by the feedback device 1600 will be described.

The feedback device 1600 may output thermal feedback as the heat output module 1640 performs a heat generating operation or a heat absorbing operation. Thermal feedback may include warmth feedback, cool feedback, and heat grill feedback.

Here, the warmth feedback may be output when the heat output module 1640 performs a heating operation, and the cooling feedback may be output when the heat output module 1640 performs a heat absorbing operation. In addition, the heat grill feedback may be output through a heat grill operation in which a heat generating operation and a heat absorbing operation are combined.

Meanwhile, the feedback device 1600 may output the above thermal feedback with various intensities. The strength of the thermal feedback may be adjusted in such a way that the feedback controller 1648 of the heat output module 1640 adjusts the magnitude of the voltage applied to the thermocouple array 1643 through the power supply terminal 1647. Here, the method of adjusting the magnitude of the voltage includes a method of applying power to the thermoelectric element after smoothing the duty signal. That is, adjusting the size of the voltage by adjusting the duty rate of the duty signal should also be considered as being included in adjusting the size of the voltage.

Hereinafter, a heat generating operation, a heat absorbing operation, and a heat grilling operation will be described in detail.

2.4.1. Exothermic/endothermic operation

The feedback device 1600 may perform a heating operation with the heat output module 1640 to provide a sense of warmth feedback to the user. Similarly, a cooling sensation feedback may be provided to the user by performing a heat absorbing operation with the heat output module 1640 .

FIG. 10 is a diagram of a heating operation for providing warmth feedback according to an embodiment of the present invention, and FIG. 11 is a graph of strength of the warmth feedback according to an embodiment of the present invention.

Referring to FIG. 10 , the heating operation may be performed by inducing a heating reaction in the direction of the contact surface 1641 as the feedback controller 1648 applies forward current to the thermocouple array 1643. Here, when the feedback controller 1648 applies a constant voltage (hereinafter, a voltage that causes an exothermic reaction is referred to as 'constant voltage') to the thermocouple array 1643, the thermocouple array 1643 starts a heating operation. 1641) rises to the saturation temperature over time as shown in FIG. Therefore, the user does not feel the warmth or feels weak at the beginning of the heating operation, feels the warmth rising until the saturation temperature is reached, and then receives the feedback corresponding to the saturation temperature after a certain period of time has elapsed. do.

12 is a diagram of a heating operation for providing cooling feedback according to an embodiment of the present invention, and FIG. 13 is a graph of intensity of cooling feedback according to an embodiment of the present invention.

Referring to FIG. 12 , the endothermic operation may be performed by inducing an endothermic reaction in the direction of the contact surface 1641 as the feedback controller 1648 applies a reverse current to the thermocouple array 1643. Here, when the feedback controller 1648 applies a constant voltage (hereinafter, a voltage that causes an endothermic reaction is referred to as 'reverse voltage') to the thermocouple array 1643, the thermocouple array 1643 starts an endothermic operation. As shown in FIG. 13, the temperature of 1641 rises to the saturation temperature over time. Therefore, the user does not feel the cooling sensation or feels it weakly at the beginning of the heat absorption operation, feels the cooling sensation increasing until the saturation temperature is reached, and after a certain period of time has elapsed, receives the cooling sensation feedback corresponding to the saturation temperature. do.

Meanwhile, when power is applied to the thermoelectric element, heat is generated as electrical energy is converted into thermal energy in addition to an exothermic reaction and an endothermic reaction occurring on both sides of the thermoelectric element. Therefore, when a voltage having the same magnitude is applied to the thermocouple array 1643 by changing only the direction of the current, the temperature change due to the heating operation may be greater than the temperature change due to the heat absorbing operation. Here, the temperature variation means a temperature difference between an initial temperature and a saturation temperature in a state in which the heat output module 1640 is not operating.

Meanwhile, hereinafter, a heat-generating operation and an endothermic operation performed by a thermoelectric element using electric energy will be collectively referred to as a 'thermoelectric operation'. In addition, since the heat grill operation, which will be additionally described below, is also a combination of heat generation operation and heat absorption operation, the heat grill operation can also be interpreted as a kind of 'thermoelectric operation'.

2.4.2. Intensity control of exothermic/endothermic action

As described above, when the heat output module 1640 performs a heating operation or a heat absorbing operation, the feedback controller 1648 controls the degree of heat generation or absorption of heat by the heat output module 1640 by adjusting the level of the applied voltage. can Accordingly, the feedback controller 1648 may adjust the intensity of the warm feedback or cold feedback by adjusting the magnitude of the voltage, in addition to selecting the type of thermal feedback to be provided from among the warm feedback and the cold feedback by adjusting the direction of the current.

14 is a graph of strength of hot/cold feedback using voltage regulation according to an embodiment of the present invention.

For example, referring to FIG. 14, the feedback controller 1648 applies voltage values of 5 steps in the forward or reverse direction, so that the feedback device 1600 provides the user with a total of 10 strengths of 5 steps of warm feedback and 5 steps of cold feedback. Thermal feedback can be provided.

Here, although FIG. 14 shows that the warm feedback and cold feedback have the same number of intensity levels, the number of intensity levels of the warm feedback and the cold feedback does not necessarily have to be the same and may be different from each other.

In addition, although it is shown here that hot and cold feedback are implemented by changing the current direction using the same voltage value, the magnitude of the voltage value applied for the warm feedback and the magnitude of the voltage value applied for the cold feedback do not have to be identical to each other.

In particular, when the heating operation and the endothermic operation are performed by applying the same voltage, the temperature change of the warm feedback due to the heating operation is generally greater than the temperature change according to the endothermic operation. It is also possible to show the same amount of temperature change in the intensity classes corresponding to each other by applying a voltage higher than the voltage applied to each other.

In the above, it has been described that the voltage value applied to the heat output module 1640 is adjusted to control the intensity of thermal feedback, but the intensity of thermal feedback can be controlled in other ways.

* For example, when the thermocouple array 1643 of the heat output module 1640 has a plurality of individually controllable thermocouple groups 1644, the feedback controller 1648 controls the operation of each thermocouple group 1644 to generate thermal energy. The intensity of the feedback can be adjusted.

FIG. 15 is a graph related to the adjustment of intensity of warming/cooling feedback through operation control of each thermocouple group 1644 according to an embodiment of the present invention. Referring to FIG. 15 , when the thermocouple array 1643 is composed of five thermocouple groups 1644-1, 1644-2, 1644-3, 1644-4, and 1644-5, the feedback controller 1648 is The intensity of thermal feedback can be adjusted by applying a voltage to all or part of the pair group 1644 . For example, the feedback controller 1648 may apply voltage to the entire group of thermocouples 1644 to provide thermal feedback of the highest intensity to the user, or may apply voltage to only the group of four thermocouples 1644 to provide the user with a moderate to high intensity. , providing a thermal feedback of moderate intensity to the user by applying a voltage to only the three thermocouple groups 1644, or providing a thermal feedback of moderate intensity to the user by applying a voltage to only the two groups of thermocouples 1644. Feedback may be provided, or a voltage may be applied to only one thermocouple group 1644 to provide thermal feedback of the lowest intensity to the user.

In this way, when adjusting the intensity of thermal feedback through whether voltage is applied or not applied to each thermocouple group 1644, the feedback controller 1648 controls the thermocouple group to which the voltage is applied so that the heat distribution is as uniform as possible within the allowable range. (1644) can be selected. To this end, the feedback controller 1648 applies voltage to the thermocouple group 1644 in such a way that the number of consecutive thermocouple groups 1644 to which voltage is applied or the number of consecutive thermocouple groups 1644 to which voltage is not applied is minimized. can decide whether Since the table shown in FIG. 15 considers the uniformity of heat distribution, it will be more clearly understood by referring to this table.

As another example, it is possible for the feedback controller 1648 to adjust the strength of the thermal feedback by controlling the power supply timing. Specifically, the feedback controller 1648 may apply power to the thermocouple array 1643 with an electric signal in the form of a duty signal having a duty cycle to adjust the strength of the thermal feedback.

16 is a graph related to adjustment of intensity of warming/cooling feedback through control of power application timing according to an embodiment of the present invention. Referring to FIG. 16 , it can be seen that the intensity of thermal feedback is controlled by adjusting the duty rate of the electrical signal.

As described above, if the strength of the thermal feedback is adjusted, it is possible to provide the user with subdivided thermal feedback such as a strong warm feeling, a weak warm feeling, a strong cold feeling, and a weak cold feeling, in addition to simply providing a warm feeling and a cold feeling to the user. Such diversely subdivided thermal feedback can provide users with a higher level of immersion in a game environment or a virtual/augmented reality environment, and when applied to a medical device, there is an advantage in that the patient's senses can be examined more precisely.

Meanwhile, in addition to the above-described thermal feedback intensity control method, the intensity of thermal feedback is adjusted by mixing a voltage control method, a control method for each thermocouple group 1644 (ie, control for each region), and a control method using a duty cycle. It is possible, and since combining them is only apparent to those skilled in the art, description thereof will be omitted.

2.4.2. Thermal grill action

The feedback device 1600 may provide heat grill feedback in addition to warmth feedback and cooling feedback. Thermal pain means that when a person's body is stimulated at the same time as a hot point and a cold point, it is recognized as a painful sensation instead of recognizing it as a warm sensation and a cold sensation. Accordingly, the feedback device 1600 may provide heat grill feedback to the user through a heat grill operation that performs a combination of a heating operation and a heat absorbing operation.

Meanwhile, the feedback device 1600 may perform various types of thermal grilling operations for providing thermal grill feedback, which will be described later after describing the types of thermal grill feedback.

2.4.2.1. Types of heat grill feedback

The hot grill feedback may include neutral hot grill feedback, warm grill feedback, and cold hot grill feedback.

Here, the neutral heat grill feedback, the warm grill feedback, and the cold heat grill feedback cause neutral heat pain sensation, heat pain sensation, and cold heat pain sensation to the user, respectively. Neutral heat sensitivity may mean that only pain sensation is felt without warmth and cold sensation, heat sensation may mean that pain sensation is felt in addition to warm sensation, and cold heat sensation may mean that pain sensation is felt in addition to cold sensation.

Neutral thermal pain is induced when the intensity of the warm and cool sensations felt by the user falls within a predetermined ratio range. The rate of feeling neutral thermal pain (hereinafter referred to as 'neutral ratio') may differ for each body part that receives thermal feedback, and even for the same body part, it may vary slightly from person to person. Neutral thermal pain tends to be felt in situations given greater than intensity.

Here, the strength of the thermal feedback may be the amount of heat applied to the body part in contact with the contact surface 1600 by the feedback device 1600 or the amount of heat absorbed from the body part. Accordingly, when thermal feedback is applied to a specific area for a specific period of time, the strength of the thermal feedback may be expressed as a difference between the temperature of the target region to which the thermal feedback is applied and the temperature of the warm or cool sensation.

On the other hand, the body temperature of a person is usually between 36.5 and 36.9 ℃, and the temperature of the skin varies from person to person and part to part, but is known to be about 30 to 32 ℃ on average. The temperature of the palm is about 33°C, slightly higher than the average skin temperature. Of course, the above-described temperature values may be slightly different depending on individuals, and may vary to some extent even for the same person.

According to an experimental example, it was confirmed that a neutral thermal sensation was felt when a warm sensation of about 40 ° C and a cool sensation of about 20 ° C were given to the palm at 33 ° C. This is given a warm feeling of +7 ° C and a cool feeling of -13 ° C based on the palm temperature, and therefore, the neutral ratio in terms of temperature may correspond to 1.86.

As can be seen from this, in the case of most people, when warm and cold sensations are continuously applied to the same size of the body area, it is expressed as the ratio of the temperature difference caused by the cold sensation to the temperature difference caused by the warm sensation on the skin, which is the contact target. The resulting neutral ratio is in the range of about 1.5 to 5. In addition, heat pain sensation can be felt when the magnitude of the warm sensation is greater than the neutral ratio, and cold heat pain sensation can be felt when the magnitude of the cold sensation is greater than the neutral ratio.

2.4.2.2. Heat grill operation according to voltage regulation

The feedback device 1600 may perform a heat grilling operation in a voltage-controlled manner. The heat grill operation of the voltage control method may be applied to the feedback device 1600 in which the thermocouple array 1643 includes a plurality of thermocouple groups 1644 .

Specifically, in the heat grill operation of the voltage regulation method, the feedback controller 1648 applies a forward voltage to a portion of the thermocouple group 1644 to perform a heating operation and applies a reverse voltage to the other portion to perform a heat absorbing operation, This can be achieved as the heat output module 1640 simultaneously provides warmth feedback and cool feedback.

17 is a diagram related to a heat grill operation of a voltage control method according to an embodiment of the present invention.

Referring to FIG. 17 , a thermocouple array 1643 includes a plurality of thermocouple groups 1644 arranged to form a plurality of lines. Here, the feedback controller 1648 causes the first thermocouple groups 1644-1 (eg, odd-numbered thermocouple groups) to perform a heating operation, and the second thermocouple groups 1644-2 (eg, thermocouple groups of odd-numbered lines) to perform a heating operation. Thermocouple groups of even-numbered lines) may apply power to perform an endothermic operation. In this way, when the thermocouple groups 1644 alternately perform a heat generating operation and a heat absorbing operation according to line arrangement, the user receives a feeling of warmth and a feeling of coolness at the same time, and as a result, may be provided with heat grill feedback. Here, since the distinction between odd-numbered lines and even-numbered lines is arbitrary, the opposite may be used.

Here, the feedback device 1600 determines that the saturation temperature according to the heating operation of the first thermocouple groups 1644-1 and the saturation temperature according to the endothermic operation of the second thermocouple groups 1644-2 depend on a neutral ratio. Neutral heat grill feedback can be provided by controlling

18 is a table related to voltages for providing neutral row grill feedback in a voltage regulation method according to an embodiment of the present invention.

For example, referring to FIG. 18 , the feedback controller 1648 may apply 5 positive voltages and 5 reverse voltages to the heat output module 1640, respectively, and the heat output module 1640 operates 5 levels of heat generation accordingly. Assuming a feedback device 1600 that performs a superheat endothermic operation, has the same magnitude of temperature change due to exothermic operation and endothermic operation of the same grade, and has a constant magnitude of temperature change between each grade, the neutral ratio is set to 3. In this case, the feedback controller 1648 applies the first class positive voltage, which is the smallest class, to the first thermocouple group 1644-1 and applies the third class reverse voltage to the second thermocouple group 1644-2. Applying a voltage allows the thermal output module 1640 to provide neutral thermal nociceptive feedback. Similarly, if the neutral ratio is 2.5, the feedback controller 1648 applies a constant voltage of the second class to the first thermocouple group 1644-1 to provide neutral heat grill feedback and then applies the second thermocouple group 1644 to the second thermocouple group 1644. For -2), a 5th grade reverse voltage can be applied. Alternatively, when the neutral ratio is 4, the feedback controller 1648 applies the first class positive voltage to the first thermocouple group 1644-1 and the fourth class inverse voltage to the second thermocouple group 1644-2. A voltage can be applied to generate a neutral thermal grill feedback. Alternatively, if the neutral ratio is 2, the feedback controller 1648 provides neutral heat relief by applying a first-class positive voltage and a second-class reverse voltage or a second-class positive voltage and a fourth-class reverse voltage. can do. In this case, the former's neutral heat loss (when the first-class constant voltage and the second-class reverse voltage are used) is stronger than the latter's neutral heat loss (when the second-class constant voltage and the fourth-grade reverse voltage are used). can be strong That is, even in the case of thermal grill feedback, the intensity can be adjusted. On the other hand, the above description of the method for providing a neutral thermal sensation is exemplary, and the present invention is not limited thereto. For example, the number of degrees of thermal feedback need not be 5 levels, and it is possible that the number of levels of cold heat and heat levels are different. In addition, it is not necessary that the temperature change intervals of each class be constant, for example, the voltage intervals of each class may be constant.

In addition, the feedback controller 1648 may provide hot grill feedback by adjusting the positive voltage and reverse voltage to be below the neutral ratio or provide cold grill feedback by adjusting the voltage to be above the neutral ratio.

For example, referring to FIG. 18 again, when the neutral ratio is set to 3, the feedback controller 1648 applies the first class constant voltage to the first thermocouple group 1644-1 and applies the second thermocouple group 1644 When a first or second grade reverse voltage is applied to -2), the heat output module 1640 generates a heat sensation and a sensation at a rate lower than the neutral rate, providing a user with feedback on the heating grill to feel both a warmth sensation and a sensation at the same time. can do. Meanwhile, the constant voltage at this time is not necessarily the constant voltage used for neutral row grill feedback. In other words, feedback controller 1648 may use 4 levels of positive voltage and 4 levels of reverse voltage to cause heat output module 1640 to provide heated grill feedback.

In the case of cold grill feedback, if the feedback controller 1648 is set to a neutral ratio of 3, (grade 1, 4) or (grade 1, 5) of (constant voltage, reverse voltage) to the heat output module 1640 can be applied to

However, when providing hot grill feedback or cold grill feedback, if positive and reverse voltages are applied at a ratio that deviate greatly from the neutral ratio, there may be a problem that the user may not feel, so the constant voltage should be close to the neutral ratio. /It may be desirable to adjust the grade of the reverse voltage.

2.4.2.3. Thermal grill behavior according to area adjustment

In the above description, the feedback device 1600 is formed by adjusting the voltage applied to the thermocouple group 1644 in a state where the heat generating region and the heat absorbing region are alternately arranged in the same size in the thermocouple array 1643. Although it has been described that the heat grill feedback is provided, it is also possible to generate the heat grill feedback by adjusting the size of the heating area and the heat absorbing area.

In detail, the area-adjustable column grilling operation may be performed by the feedback controller 1648 adjusting the area of the thermocouple group 1644 to which the forward voltage is applied and the area of the thermocouple group 1644 to which the reverse voltage is applied. there is.

19 is a diagram related to an operation of heat grilling in an area adjusting method according to an embodiment of the present invention.

Referring to FIG. 19 , a thermocouple array 1643 includes a plurality of thermocouple groups 1644 arranged to form a plurality of lines. Here, assuming that the area size of each line is the same and that the positive voltage and the reverse voltage are set to voltage values that make the temperature change amounts of the warm feedback and the cold feedback the same, when the neutral ratio is 3, the feedback controller 1648 For each of the thermocouple groups 1644-1 performing the heating operation, three thermocouple groups 1644-2 perform heat absorption by applying positive and reverse voltages to the heat output module 1640, thereby providing cooling feedback. The feedback device 1600 may provide a neutral thermal sensation by making the area of the contact surface 1600 to be three times larger than the area of the contact surface 1600 to provide thermal feedback.

However, here, the neutral ratio may mean a ratio of an area to which cold feedback is provided to an area to which warm feedback is provided, instead of a ratio of a temperature change amount during warm feedback and cool feedback. The neutral ratio from an area perspective may be the same as the neutral ratio from a temperature perspective, but may be a slightly different value.

In addition, the feedback controller 1648 reduces or increases the number of thermocouple groups 1644-2 that perform endothermic groups per thermocouple group 1644-1 that performs heat generation, so that the feedback device 1600 It is also possible to perform hot grill feedback or cold grill feedback.

Meanwhile, although the thermocouple groups 1644 are described as having the same area in FIG. 19 , it is possible to design the thermocouple groups 1644 in consideration of the neutral ratio.

20 is a diagram showing a thermocouple array 1643 composed of thermocouple groups 1644 having different areas for thermal regulation according to an embodiment of the present invention.

Referring to FIG. 20 , the first thermocouple group 1644-1 and the second thermocouple group 1644-2 are designed to have different areas, and their ratio may be a neutral ratio. When such a thermocouple array 1643 is used, the feedback controller 1648 applies a positive voltage and a reverse voltage to the first thermocouple group 1644-1 and the second thermocouple group 1644-2, respectively, so that the feedback device ( 1600) to provide neutral heat grill feedback.

In the above, the provision of heat grill feedback by adjusting the heating area and the heat absorbing area has been described on the assumption that the constant voltage and reverse voltage are used for the same temperature change in the hot and cold feedback. When the amount of temperature change is different, the area ratio should be adjusted in consideration of the effect thereof.

In other words, in order to provide a neutral thermal sensation, a value calculated from two variables, the ratio of the heat absorbing area to the heating area and the cooling temperature change to the warming temperature change, may be a neutral ratio. For example, the feedback device 1600 may provide heat grill feedback by making a product of a temperature change rate and an area change rate a neutral rate.

Compared to the thermal grilling operation using voltage, the thermal grilling operation according to the above-described area control method has an advantage in that feedback strength can be easily adjusted.

When the same voltage is applied to the thermoelectric element to perform an exothermic operation and an endothermic operation, a temperature change in the exothermic operation is generally greater than a temperature change in the endothermic operation. When this point is combined with the fact that in the case of the heat grill operation using voltage regulation, the temperature change of the cooling feedback must be larger than the temperature change of the warm feedback by the neutral ratio, the magnitude ratio of the reverse voltage to the positive voltage is greater than the neutral ratio in terms of temperature. It turns out to be a fairly large number. Therefore, in order to provide neutral heat grill feedback in a voltage-controlled manner, the feedback controller 1648 must output an electrical signal in a wide voltage range. Accordingly, when the voltage range of the applied power is limited, it may be difficult to substantially adjust the strength of the thermal grill feedback.

On the other hand, in the area control method, neutral heat grill feedback is processed by adjusting the area of the warm feedback area and the area of the cool feedback area. The intensity of the neutral heat grill feedback can be adjusted simply by increasing or decreasing the amount of temperature change.

Referring specifically to FIG. 18 , feedback controller 1648 both increases the magnitude of the positive and reverse voltages so that heat output module 1640 provides strong neutral heat grill feedback, or decreases them together to provide weak heat grill feedback. can provide. As already mentioned in the description of FIG. 18, since the neutral ratio for the neutral heat grill feedback is already satisfied by the heating area and the heat absorbing area, the feedback controller 1648 relatively freely adjusts the magnitude of the positive voltage and the reverse voltage to heat the heat grill. You can control the strength of the feedback.

2.4.2.4. Column grill behavior over time slices

In addition, the column grilling operation may be implemented according to a time division method. In detail, the heat grilling operation according to the time division method may be implemented by alternately performing a heating operation and a heat absorbing operation in time. This is because when warm and cold feedbacks are alternately delivered within a relatively short time interval, human sensory organs may mistake them for sensuous sensations.

The feedback controller 1648 may alternately apply a positive voltage and a reverse voltage to the heat output module 1640 so that a heating operation and a heat absorbing operation are alternately performed. Here, the neutral heat grill feedback may be performed by adjusting at least one of a voltage level and a time interval.

21 is a diagram related to an example of a row grill operation using a time division method according to an embodiment of the present invention.

Assuming that the constant voltage and the reverse voltage are set to the same temperature change amount of the warm feedback and the cold feedback, the feedback controller 1648 generates an electric signal so that the ratio of the time during which the reverse voltage is applied to the time during which the positive voltage is applied becomes a neutral ratio. output timing can be controlled. For example, referring to FIG. 21 , when the neutral ratio is 3, the feedback controller 1648 may provide neutral row grill feedback by applying a positive voltage for 20 ms and a reverse voltage for 60 ms. Here, the hot grill feedback or the cold grill feedback may be performed by adjusting a ratio of signal output timing. Meanwhile, when the time interval is set to a neutral ratio, the feedback controller 1648 may adjust the intensity of the heat grilling operation by increasing or decreasing the magnitudes of the positive voltage and the reverse voltage together.

22 is a diagram related to another example of a row grill operation using a time division method according to an embodiment of the present invention. Assuming that the application times of the warm feedback and the cool feedback are set to the same size, the feedback controller 1648 may adjust the voltage value of the electric signal so that the temperature change amount of the warm feedback and the cool feedback during the same time has a neutral ratio. For example, referring to FIG. 22, when the neutral ratio is 3, the feedback controller 1648 alternately applies a forward voltage and a reverse voltage at intervals of 20 ms, but the temperature change in the cooling operation section is the temperature change in the heating operation section. Neutral heat grill feedback can be provided by scaling the positive and reverse voltages to be three times the value of . Here, the hot grill feedback or the cold grill feedback may be performed by adjusting the magnitudes of the positive voltage and the reverse voltage.

Of course, it is also possible for the feedback controller 1648 to adjust the time interval and the magnitude of the voltage together.

On the other hand, the heat grill operation of the voltage control method or the area control method causes numbness sensoryally, but physically applies hot and cold heat to the user's body at the same time. However, if the user's sensory organs are continuously stimulated by such thermal sensation, the user's body feels the afterimage for a certain period of time even after the thermal grill feedback is removed. Since thermal grill feedback is mainly a sensation close to pain, a user may feel uncomfortable due to the afterimage. The cause of such an afterimage is that the hot and cold points of the skin are exposed to heat and cold sensations of rather high intensity for a long period of time in order to provide effective heat grill feedback. On the other hand, the heat grill operation according to the time division method has the advantage of removing the afterimage effect to some extent because it does not continuously stimulate the hot and cold points of the skin.

2.4.2.5. Thermal grill behavior with a combination of area scaling and time slices

Also, the thermal grilling operation may be performed by combining the concept of the area control method with the thermal grilling operation according to the above-described time division method.

Here, the heat grilling operation is performed by alternatingly performing a heating operation and a heat absorbing operation over time in one area and another area of the thermocouple array 1643, and allowing one area and another area to perform different operations. can

23 is a diagram for an example of a row grilling operation using a combination of area adjustment and time division according to an embodiment of the present invention.

Referring to FIG. 23 , a thermocouple array 1643 may include a first thermocouple group 1644-1 performing a first operation and a second thermocouple group 1644-2 performing a second operation. there is. Here, the first operation and the second operation are the same in that the heat generation operation and the heat absorption operation are alternately performed according to time, but the timings of the heat generation and absorption are staggered. The feedback controller 1648 sequentially applies a positive voltage and a reverse voltage to the first thermocouple group 1644-1 to control the first thermocouple group 1644-1 to perform a first operation, and to control the second thermocouple group 1644-1 to perform a first operation. The second thermocouple group 1644-2 may be controlled to perform a second operation by sequentially applying a reverse voltage and a forward voltage to the 1644-2. Accordingly, since the heat output module 1640 simultaneously outputs heat feedback and cool feedback in the area of the first thermocouple group 1644-1 and the area of the second thermocouple group 1644-2, the feedback device 1600 You will be able to provide thermal grill feedback. When the first thermocouple group 1644-1 and the second thermocouple group 1644-2 have the same area, and the time length of the exothermic operation and the time length of the endothermic operation are the same in the first operation and the second operation, The feedback device 1600 may provide neutral heat grill feedback, hot grill feedback, or cold heat grill feedback according to the ratio of the voltage values of the positive voltage and the reverse voltage.

Meanwhile, the time length of the heat generation operation and the heat absorption operation may be a relatively long time interval, unlike the case of performing the heat grill operation in a simple time division method. In the case of the simple time division method, an illusion must be evoked in the human sensory organs depending on the time division interval, whereas in the case of the complex method, even if the time interval is long, a sensation of pain can be felt by providing both warm and cold feedback at the same time. Because. That is, in the case of the simple time division method, each of the application time of the positive voltage and the application time of the reverse voltage needs to be adjusted below the perceptual time necessary for the user to feel a sense of warmth according to the heating operation or a cooling sensation according to the endothermic operation. On the other hand, in the case of the complex method of alternating by area, there is no or weak advantage of time limitation.

Furthermore, since the combined heat grill operation does not continuously provide hot or cold heat to the human skin, but alternately provides hot/cold heat periodically, damage to the skin can be minimized. For this purpose, it may not be good to have too long a time interval.

In relation to FIG. 23 , the thermocouple array 1643 has been described as having two thermocouple groups 1644 operating in a staggered manner, but it is possible to apply a composite method to various types of thermocouple arrays 1643 in addition to this.

24 is a diagram related to another example of a row grilling operation using a method in which area adjustment and time division are combined according to an embodiment of the present invention.

Referring to FIG. 24 , a thermocouple array 1643 may include four thermocouple groups 1644-1, 1644-2, 1644-3, and 1644-4. Here, the feedback controller 1648 may apply the following electrical signal to each thermocouple group 1644. First, during the first time interval, a positive voltage is applied to the first thermocouple group 1644-1 to perform a heating operation, and a reverse voltage is applied to the second thermocouple group 1644-2 to perform an endothermic operation. , voltage is not applied to the remaining groups 1644-3 and 1644-4. Next, during the second time interval, a positive voltage is applied to the third thermocouple group 1644-3 to perform a heating operation, and a reverse voltage is applied to the second thermocouple group 1644-4 to perform an endothermic operation. However, voltage is not applied to the remaining groups 1644-1 and 1644-2. Thereafter, during the third time period, a reverse voltage is applied to the first thermocouple group 1644-1 to perform a heat absorbing operation, and a positive voltage is applied to the second thermocouple group 1644-2 to perform a heating operation. , voltage is not applied to the remaining groups 1644-3 and 1644-4. During the next fourth time period, a reverse voltage is applied to the third thermocouple group 1644-3 to perform a heat absorbing operation, and a positive voltage is applied to the fourth thermocouple group 1644-4 to perform a heating operation. can Thereafter, the steps from the first time interval to the fourth time interval may be repeated. Alternatively, it is also possible to perform the modification by repeating only the first time interval and the second time interval. According to this operation, the feedback device 1600 provides heat grill feedback by cooperation of the first thermocouple group 1644-1 and the second thermocouple group 1644-2, and the third thermocouple group 1644 -3) and the fourth thermocouple group 1644-4 are alternately provided with heat grill feedback, so that the same effect as providing continuous heat grill feedback can be obtained from the user's point of view. here,

Meanwhile, in the foregoing, the period during which the heat grill operation is performed by the first and second thermocouple groups 1644-1 and 1644-2 related to FIG. 24 and the third and fourth thermocouple groups 1644-3 and 1644-2 Although it has been described in 4) that the period during which the row grilling operation is performed does not overlap in time, it is also possible to have a period in which the two row grilling operations overlap in time.

25 is a diagram related to another example of a row grilling operation using a combined method of region adjustment and time division according to an embodiment of the present invention.

Referring to FIG. 25, the time sections described with reference to FIG. 24 are spaced apart from each other, and overlapping sections may be inserted therebetween. In the overlapping section, the operation of the previous time section and the row grilling operation to be performed in the operation of the next time section are performed together. The heat grill operation in the form of an overlapping section can mitigate that heat grill feedback is not delivered to a user during a time required for the thermoelectric element to actually rise to a saturation temperature from the time when voltage is applied for heat generation/endothermic operation.

In addition, the thermal grill feedback operation can be implemented in various ways by combining time division and region control, and the present invention should be construed as including a modification that combines the examples mentioned in this specification.

3. Calibration

Hereinafter, calibration according to an embodiment of the present invention will be described.

3.1. Calibration Overview

Hereinafter, calibration may be understood as an operation of adjusting a parameter related to thermal feedback to suit a user or a characteristic of the feedback device 1600 .

As described above, the feedback device 1600 can output thermal feedback at various intensities. However, even if the feedback device 1600 outputs the thermal feedback with the same intensity, the experience intensity of actually feeling the thermal feedback may be different for each user. For example, when the feedback controller 1648 applies a constant voltage of the first class, which is the smallest class, to the thermocouple group 1644 so that the heat output module 1640 performs a heating operation, the first user receives heat. cannot feel the heat, the second user feels the heat finely, and the third user can strongly feel the heat.

This can be attributed to various causes. For example, since the degree of distribution of hot and cold points and the location of distribution may be different for each user, the intensity of the experience may be different for each user. In addition, as another example, as the degree to which each user holds the feedback device 1600 (eg, whether the user holds the feedback device 1600 tightly or lightly) is different, the experience intensity may be different for each user. can In addition, experience intensity may be different for each user due to various characteristics of each user.

Meanwhile, the content reproducing device 1200 may transmit a thermal feedback signal to the feedback device 1600, and the feedback device 1600 may output thermal feedback based on the corresponding thermal feedback signal. For example, the thermal feedback signal output by the content reproducing device 1200 includes information on the intensity of the thermal feedback, and the feedback device 1600 outputs the thermal feedback with an intensity corresponding to the information on the intensity of the thermal feedback. can do. As a specific example, the content reproducing device 1200 outputs a thermal feedback signal including a command to output thermal feedback of a first intensity level when playing a specific part of content, and the feedback device 1600 outputs the thermal feedback signal Accordingly, thermal feedback of the first intensity level may be output. However, depending on the user, the temperature of thermal feedback corresponding to the first intensity level (ie, saturation temperature) may not be recognized. In this case, since the user does not recognize the temperature of the thermal feedback corresponding to the first intensity level, despite providing thermal feedback from the feedback device 1600, the user does not experience a thermal experience when playing a specific part of the content. may not experience it.

However, in the above case, if the temperature of the thermal feedback corresponding to the first intensity level output from the feedback device 1600 is previously adjusted to a temperature that the user can perceive, the feedback device 1600 The thermal feedback can be output at a temperature that can be recognized by the user, and accordingly, the user can experience a thermal experience when playing a specific part of the content. Therefore, it is necessary to calibrate the intensity of thermal feedback.

In addition, although the calibration for the intensity of thermal feedback has been described above, calibration for various parameters such as area and time may be possible in addition to the intensity.

Hereinafter, for convenience of explanation, it will be described that the calibration is performed in the feedback device 1600 . However, it is not limited thereto, and the calibration may be performed by the content playback device 1200 or may be performed by a third device other than the feedback device 1600 and the content playback device 1200.

3.2. User input for calibration

In an embodiment of the present invention, the feedback device 1600 may obtain a user input from a user and perform calibration for thermal feedback. That is, the feedback device 1600 may obtain a user input with respect to a specific intensity of thermal feedback, a specific region, and a specific time point, and perform calibration for the thermal feedback based on the user input.

For example, when performing intensity calibration, the feedback device 1600 may sequentially output thermal feedback according to a plurality of intensities, and may receive a specific intensity selected from among the plurality of intensities through a user input. Then, the feedback device 1600 may adjust the strength of the thermal feedback to the selected strength. As above, in order to obtain the user input, the feedback device 1600 may include a user input module.

The user input module may obtain user input from the user. For example, the user input module may be configured in various shapes such as a touch panel, a button, and a stick. For example, the user input module may include a pressure sensor (eg, a pressure sensor). Of course, the user input module is not limited to the above-described examples.

As a specific example, a pressure sensor may be disposed as a user input module in a specific area of the casing of the feedback device 1600 . For intensity calibration, the feedback device 1600 may sequentially output thermal feedback of a plurality of intensities in a state in which the user's body touches the specific region, and the user moves the user's body in the specific region at the specific intensity. can be taken off In this case, the feedback device 1600 may detect the time when the user's body is separated from the specific region through the pressure sensor, and the specific intensity output at the time the user's body is separated is the intensity selected by the user. can be set to Then, the feedback device 1600 may adjust the intensity of thermal feedback to the specific intensity.

Also, in the above, the user input module is expressed as being included in the feedback device 1600, but is not limited thereto, and the user input module may be configured as a device independent of the feedback device 1600, and a content playback device. 1200 or the audiovisual device 1400.

Also, in an embodiment of the present invention, the feedback device 1600 may perform calibration of thermal feedback using the audiovisual device 1400 . For example, when calibration is in progress, the feedback device 1600 may transmit a video signal and/or an audio signal to the audiovisual device 1400 . In this case, the video signal and/or the audio signal is related to the calibration of the thermal feedback, and may include, for example, calibration start information, calibration progress information, and calibration end information. In addition, the video signal and/or the audio signal may include information on the strength of the thermal feedback currently output from the feedback device 1600, information on the region currently outputting the thermal feedback among the entire contact surface 1641, and information at the output time of the thermal feedback. information may be included.

The audiovisual device 1400 may receive a video signal and/or audio signal from the feedback device 1600 and output video and/or audio, and the user may receive a user input for calibration with the help of the video and/or audio. can be performed.

Of course, it is not limited thereto, and the feedback device 1600 itself may output video and/or audio.

Also, in an embodiment of the present invention, the feedback device 1600 may output thermal feedback of multiple intensities for calibration. In this case, the feedback controller 1648 may sequentially apply the voltage values corresponding to the respective intensities to the thermocouple group 1644, but may set a predetermined time interval between applying the voltage values corresponding to the respective intensities. there is. For example, in the example of FIG. 28(a) to be described later, after the feedback controller 1648 applies a voltage value corresponding to LV _H-m1 to the thermocouple group 1644, it takes a predetermined time (eg, After 1 second) has elapsed, a voltage value corresponding to LV _H-m2 may be applied to the thermocouple group 1644. This is because, when thermal feedback corresponding to a plurality of intensities is continuously output, a user's senses are disturbed, and thus calibration accuracy may be lowered. Accordingly, in order to eliminate disturbance of the user's senses, a predetermined time interval may exist between points at which thermal feedback of a plurality of intensities is applied.

In addition, in order to eliminate disturbance of the user's senses, the feedback device 1600 induces a different part of the user's body to come into contact at each point in time when thermal feedback corresponding to a plurality of intensities is output. can For example, the feedback device 1600 provides a video signal and/or an audio signal to the audiovisual device 1400, or the feedback device 1600 itself outputs an image and/or audio so as to provide thermal feedback of the first intensity. In case of outputting, the user's thumb may be brought into contact with the contact surface 1641, and in the case of outputting the thermal feedback of the second intensity, the user's index finger may be brought into contact with the contact surface 1641. Whenever the thermal feedback of each intensity is output, other body parts of the user come into contact with the contact surface 1641, so the user's sensory disturbance can be eliminated, and thus the calibration accuracy can be improved.

3.3. intensity calibration

26 is a flowchart of a method for calibrating the intensity of thermal feedback according to an embodiment of the present invention.

* The intensity calibration method according to FIG. 26 may include calibrating the intensity of the warmth feedback and the cold feedback (S2600) and calibrating the intensity of the heat grill feedback (S2700).

Hereinafter, each step described above will be described in detail.

First, the feedback device 1600 may calibrate the intensity of the warmth feedback and the cold feedback (S2600).

It may not matter which thermal feedback is calibrated first among the warm feedback and the cold feedback. Hereinafter, for convenience of explanation, it will be described that the warm feedback is calibrated first and then the cold feedback is calibrated, but it is not limited thereto, and the warm feedback may be calibrated after the cold feedback is calibrated first. In addition, the feedback device 1600 may set at least one intermediate intensity after performing calibration for the lowest intensity and the highest intensity of the warmth feedback and the cool feedback.

Also, the feedback device 1600 may calibrate the strength of the thermal grill feedback (S2700).

The heat grill feedback may be generated according to a ratio of the intensity of the warm sensation feedback to the intensity of the cold sensation feedback in a predetermined body part. Accordingly, it may be desirable to calibrate the intensity of the hot grill feedback by adjusting the intensity of the warm feedback and/or the intensity of the cold feedback after the intensity of the warm feedback and the intensity of the cold feedback have been previously calibrated. However, the present invention is not limited thereto, and even if the intensity of the warm feedback and the intensity of the cold feedback are not previously calibrated, the intensity of the hot grill feedback may be calibrated using preset values of the intensity of the warm feedback and the intensity of the cold feedback.

Steps S2600 and S2700 will be described in more detail below.

*

3.3.1. Intensity calibration of warm and cool feedback

3.3.1.1. Setting the lowest intensity of warm feedback and cold feedback

27 is a flowchart of a method for calibrating strengths of warmth feedback and cold feedback according to an embodiment of the present invention.

The intensity calibration method according to FIG. 27 includes setting the lowest intensity of the warm and cold feedback (S2610), setting the highest intensity of the warm and cool feedback (S2620), and at least one of the warm and cold feedback. A step of setting an intermediate intensity (S2630) may be included.

Whether the strength of thermal feedback is set first among the warmth feedback and the cool feedback according to the present invention does not significantly affect calibration accuracy.

In addition, the intensity calibration for the cold feedback may be performed after setting the lowest intensity, the highest intensity, and the middle intensity of the warmth feedback, and after setting the lowest intensity of the warmth feedback and the cold feedback, the highest Intensity may be set, and then intermediate intensities of the warmth feedback and the cold feedback may be set.

Hereinafter, for convenience of explanation, the lowest intensity of the warm feedback and cold feedback is set first, the highest intensity of the warm feedback and cold feedback is set, and then the middle intensity of the warm feedback and cold feedback is set in order of warm feedback. and intensity calibration of cooling sensation feedback.

Hereinafter, each step described above will be described in detail.

First, the feedback device 1600 may set the lowest intensity of the warmth feedback and the cold feedback (S2610).

Also, in an embodiment of the present invention, the feedback device 1600 may first calibrate the lowest intensities of the warm feedback and cold feedback, and then calibrate the highest intensities of the warm feedback and cold feedback. This is in consideration of the user's sensation according to the intensity calibration. If the calibration of the lowest intensity is performed after the highest intensity calibration, thermal feedback according to the highest intensity calibration can be transmitted to the user, and the user can receive the highest level of energy for a predetermined time. Thresholds of hot and cold points of the user are increased by thermal feedback according to intensity calibration. Accordingly, if the lowest intensity calibration is performed during the predetermined time period, even if the thermal feedback according to the minimum intensity calibration is transmitted to the user, the user may not feel the thermal feedback according to the minimum intensity calibration.

On the other hand, if the highest intensity calibration is performed after the lowest intensity calibration, even if the thermal feedback according to the lowest intensity calibration is transmitted to the user, the user's hot and cold point thresholds may be relatively low. When the thermal feedback according to the calibration is transmitted to the user, the user may feel the thermal feedback according to the calibration of the highest intensity.

Therefore, in the present invention, preferably, when performing the intensity calibration of the warmth feedback and the cool feedback, the lowest intensity calibration may be performed first, and then the highest intensity calibration may be performed.

However, the user's hot and cold point thresholds may return to their original states after a certain period of time has elapsed. Therefore, without being limited to the above, when performing the intensity calibration of the warm feedback and cool feedback, the highest intensity calibration may be performed first, and then the lowest intensity calibration may be performed.

In an embodiment of the present invention, the feedback device 1600 may set the lowest intensity of the warmth feedback.

28 is a graph related to setting the lowest intensity of warmth feedback and cold feedback according to an embodiment of the present invention. Referring to (a) of FIG. 28 , the feedback device 1600 may preset a plurality of intensities (LV _H-m1 to LV _H-m4 ) of the on-feeling feedback, and among the plurality of intensities, LV _H- Onsen feedback can be output in order from _m1 to LV _H-m4, which are strong intensities. That is, voltage values corresponding to the plurality of intensities (LV _H-m1 to LV _H-m4 ) may be different, and the feedback controller 1648 sequentially assigns voltage values corresponding to the respective intensities to the thermocouple group 1644. can be authorized.

In one embodiment of the present invention, the temperatures of the plurality of intensities (LV _H-m1 to LV _H-m4 ) may be lower than the temperature feedback stage 1 described with reference to FIG. 14 . Of course, the temperatures of the plurality of intensities (LV _H-m1 to LV _H-m4 ) may not be related to the steps of temperature feedback described in FIG. 14 .

In addition, in the example of FIG. 28 , the plurality of intensities (LV _H-m1 to LV _H-m4 ) are expressed in four stages, but is not limited thereto, and the plurality of intensities may be set to various numbers.

The feedback device 1600 may obtain a user input for any one intensity among the plurality of intensities (LV _H-m1 to LV _H-m4 ). For example, when the warmth feedback is output from the weak intensity to the strong intensity, the user may not feel the warmth at first, but may feel the warmth when the feedback device 1600 outputs the warmth feedback at a specific intensity. At this time, the feedback device 1600 may obtain a user input for the specific intensity and set the specific intensity as the lowest intensity of the sense of touch feedback.

Also, in one embodiment of the present invention, when the user input is obtained, the feedback device 1600 may stop outputting the sense of touch feedback.

Also, in another embodiment of the present invention, when the user input is obtained, the feedback device 1600 may not stop outputting the sense of touch feedback.

For example, the plurality of intensities (LV _H-m1 to LV _H-m4 ) may be used to set the highest intensity as well as the lowest intensity of the sense of touch feedback. In this case, even if the sense feedback is output from the weak intensity to the strong intensity and a user input is obtained for any one of the plurality of intensities (LV _H-m1 to LV _H-m4 ), the feedback device 1600 may continue to sequentially output the sense of touch feedback, and then obtain a user input with respect to an intensity different from an intensity already obtained through a user input. In this case, the intensity later acquired through the user input may be set as the highest intensity of the sense of touch feedback.

Also, in an embodiment of the present invention, the feedback device 1600 may set the lowest strength of the cooling sensation feedback. Referring to (b) of FIG. 28, the feedback device 1600 may preset a plurality of intensities (LV _C-m1 to LV _C-m4 ) of cooling feedback, and among the plurality of intensities, LV _C- m is the weakest intensity. Cooling sensation feedback can be output in the order of LV _C-m4, which is a strong intensity from _m1 . That is, voltage values corresponding to the plurality of intensities LV _C-m1 to LV _C-m4 may be different, and the feedback controller 1648 may sequentially apply voltage values corresponding to the respective intensities.

Similar to setting the lowest intensity of warmth feedback, the feedback device 1600 may obtain a user input for any one intensity among the plurality of intensities (LV _C-m1 to LV _C-m4 ). The feedback device 1600 may set the intensity input from the user among the plurality of intensities (LV _C-m1 to LV _C-m4 ) as the lowest intensity of the cooling sensation feedback. Since the description of the setting of the lowest intensity of the warmth feedback can be applied to the setting of the lowest intensity of the cold feedback, descriptions of contents overlapping those described in the setting of the minimum intensity of the warmth feedback will be omitted.

3.3.1.2. Setting the maximum intensity of warm feedback and cool feedback

In an embodiment of the present invention, the feedback device 1600 may set the maximum strength of the warm feedback and cold feedback (S2620). 29 is a graph related to setting the highest intensity of warmth feedback and cold feedback according to an embodiment of the present invention. Referring to (a) of FIG. 29 , the feedback device 1600 may preset a plurality of intensities (LV _H-M1 to LV _H-M4 ) of the on-feeling feedback, and among the plurality of intensities, LV _H- Onsen feedback can be output in order from _M1 to LV _H-M4, which are strong intensities. That is, voltage values corresponding to the plurality of intensities (LV _H-M1 to LV _H-M4 ) may be different, and the feedback controller 1648 may sequentially apply voltage values corresponding to the respective intensities.

In this case, the feedback device 1600 may determine the temperatures of the plurality of intensities (LV _H-M1 to LV _H-M4 ) in consideration of damage to the user's body according to the thermal feedback.

Specifically, since the thermoelectric operation described above stimulates the hot/cold points of the skin, damage to the skin or sensory organs may be caused when a certain amount of heat is transferred to the user. For example, when thermal feedback is provided to the user at an excessively high intensity, skin tissue is denatured by heat, or when thermal feedback is continuously provided for a long period of time, confusion may be caused to sensory organs.

Accordingly, in order to prevent damage to the user due to thermal feedback, in the present invention, the threshold temperature of warmth feedback (T _Hdmg ) and the threshold temperature of cooling feedback (T _Cdmg ) may be set. In this case, the temperature of the contact surface 1641 according to the output of the warmth feedback may be lower than the threshold temperature (T _Hdmg ), and the temperature of the contact surface 1641 according to the output of the cool feeling feedback may be higher than the threshold temperature (T _Cdmg ). can

Accordingly, when setting the maximum temperature of the temperature feedback, the temperatures of the plurality of intensities (LV _H-M1 to LV _H-M4 ) may be set lower than the threshold temperature (T _Hdmg ).

In one embodiment of the present invention, the temperature of the plurality of intensities (LV _H-M1 to LV _H-M4 ) may be a lower temperature than the fifth temperature feedback stage described in FIG. 14 . Of course, the temperatures of the plurality of intensities (LV _H-M1 to LV _H-M4 ) may have nothing to do with the steps of temperature feedback described in FIG. 14 . In some cases, the plurality of intensities (LV _H-M1 to LV _H-M4 ) may be the same as or different from the plurality of intensities (LV _H-m1 to LV _H-m4 ) described in FIG. 28 . may be

In addition, in the example of FIG. 29 , the plurality of intensities (LV _H-M1 to LV _H-M4 ) are expressed in four stages, but is not limited thereto, and the plurality of intensities may be set to various numbers of intensities.

Also, the feedback device 1600 may obtain a user input for any one of the plurality of intensities (LV _H-M1 to LV _H-M4 ). For example, when the temperature feedback is output from the weak intensity to the strong intensity, the intensity of the highest temperature may be selected according to the user's judgment, and the feedback device 1600 may obtain a user input for the intensity of the maximum temperature. The received intensity may be set as the highest intensity of the sense of touch feedback.

Also, in one embodiment of the present invention, when the user input is obtained, the feedback device 1600 may stop outputting the sense of touch feedback.

Also, in an embodiment of the present invention, the feedback device 1600 may set the maximum strength of the cooling sensation feedback. Referring to (b) of FIG. 29 , the feedback device 1600 may preset a plurality of intensities (LV _C-M1 to LV _C-M4 ) of cooling sensation feedback, and among the plurality of intensities, a weak intensity LV _C- Cooling sensation feedback can be output in order from _M1 to LV _C-M4, which are strong in intensity. That is, voltage values corresponding to the plurality of intensities LV _C-M1 to LV _C-M4 may be different, and the feedback controller 1648 may sequentially apply voltage values corresponding to the respective intensities.

Similar to the setting of the highest intensity of the warmth feedback, in order to protect the user's body according to the cooling feedback, when the maximum intensity of the cooling feedback is set, the temperatures of the plurality of intensities (LV _C-M1 to LV _C-M4 ) of the cooling feedback It may be set higher than the critical temperature (T _Cdmg ). Also, the feedback device 1600 may obtain a user input for any one of the plurality of intensities (LV _C-M1 to LV _C-M4 ). The feedback device 1600 may set the intensity input from the user among the plurality of intensities (LV _C-M1 to LV _C-M4 ) as the highest intensity of the cooling sensation feedback. Since the description of the setting of the highest intensity of the warm feedback can be applied to the setting of the highest intensity of the cold feedback, the description of the contents overlapping with the setting of the highest intensity of the warm feedback will be omitted.

3.3.1.3. Moderate intensity settings for warm feedback and cool feedback

In an embodiment of the present invention, the feedback device 1600 may set intermediate strengths of the warmth feedback and the cold feedback (S2630).

As described above, as described above with reference to FIG. 14 , the feedback device 1600 may output thermal feedback with a plurality of intensities (eg, 5 stages of warm feedback and 5 stages of cold feedback).

In steps S2610 and S2620, the lowest intensity and the highest intensity of the warmth feedback and the cold feedback are set, and in step S2630, an intermediate intensity between the lowest intensity and the highest intensity is set.

In an embodiment of the present invention, the number of medium intensities may be at least one or more, which may be preset in the feedback device 1600 or may be determined according to the number of medium intensities preset in the content playback device 1200. Also, the number of intermediate intensities may be determined by the number of intensities of thermal feedback output from the feedback device 1600 for intensity calibration. For example, the number of intermediate intensities may be identical to the number of intensities other than the lowest intensity and the highest intensity among the number of intensities of thermal feedback output by the feedback device 1600 for intensity calibration.

Of course, in some cases, the intermediate intensity may not exist, and in this case, step S2630 may not be performed.

In an embodiment of the present invention, the feedback device 1600 may set at least one moderate intensity of the warmth feedback.

30 is a graph related to medium intensity settings of warmth feedback and cool feedback according to an embodiment of the present invention.

Referring to (a) of FIG. 30 , the lowest intensity (LV _Hm ) and the highest intensity (LV _HM ) of warmth feedback may be set in advance. In addition, the number of medium intensities of the sense of touch feedback may be set to three. In this case, the feedback device 1600 may set three intermediate intensities (LV _Ha , LV _Hb , and LV _Hc ) using the lowest intensity (LV _Hm ) and the highest intensity (LV _HM ) of the warmth feedback. In this case, the temperature of the highest intensity (LV _HM ) may be lower than a preset critical temperature (T _Hdmg ).

In one embodiment of the present invention, the feedback device 1600 interpolates voltage values or temperatures corresponding to the lowest intensity (LV _Hm ) and the highest intensity (LV _HM ) of the warmth feedback to intermediate intensity (LV _Ha , LV _Hb , LV _Hc ) can be set.

For example, the feedback device 1600 interpolates the voltage value corresponding to the lowest intensity (LV _Hm ) and the voltage value corresponding to the highest intensity (LV _HM ) to calculate three voltage values, and calculates the three voltage values. Each intensity corresponding to the value (interpolation voltage value) may be set as the intermediate intensity (LV _Ha , LV _Hb , LV _Hc ).

As another example, the feedback device 1600 checks the temperature corresponding to the lowest intensity (LV _Hm ) and the temperature corresponding to the highest intensity (LV _HM ), and the temperature corresponding to the lowest intensity (LV _Hm ) and the Three temperatures (interpolated temperatures) can be calculated by interpolating the temperature corresponding to the highest intensity (LV _HM ). In this case, the feedback device 1600 may set each of the three calculated temperatures to a temperature corresponding to each of the intermediate intensities (LV _Ha , LV _Hb , and LV _Hc ). Thereafter, the feedback device 1600 calculates a voltage value corresponding to each temperature of the set intermediate intensities (LV _Ha , LV _Hb , and LV _Hc ), and calculates a voltage value corresponding to each of the set intermediate intensities (LV _Ha , LV _Hb , and LV _Hc ). When the mid-intensity warmth feedback is output, a voltage value corresponding to the mid-intensity may be applied to the heat output module 1640 .

In addition, in another embodiment of the present invention, the feedback device 1600 may set preset intensities to medium intensities (LV _Ha , LV _Hb , LV _Hc ).

For example, the feedback device 1600 provides a voltage between the voltage value of the lowest intensity (LV _Hm ) and the highest intensity (LV _HM ) set in steps S2610 and S2620 among at least one intensity having a preset voltage value. Intensities with values can be set to medium intensities (LV _Ha , LV _Hb , LV _Hc ).

In another example, the feedback device 1600 determines an intensity having a temperature between the temperature of the lowest intensity (LV _Hm ) and the temperature of the highest intensity (LV _HM ) among at least one intensity of a preset temperature, medium intensity (LV _Ha , LV _Hb , LV _Hc ).

In addition, the feedback device 1600 determines that the voltage values or temperatures of the preset intermediate intensities (LV _Ha , LV _Hb , LV _Hc ) are the voltage values of the lowest intensity (LV _Hm ) and the highest intensity (LV _HM ) of the warmth feedback or It is possible to check whether it is within the range of temperature. If the voltage values or temperatures of the preset intermediate intensities (LV _Ha , LV _Hb , LV _Hc ) fall within the range of voltage values or temperatures of the lowest intensity (LV _Hm ) and the highest intensity (LV _HM ) of the warmth feedback , The feedback device 1600 may maintain the voltage value or temperature of the preset medium intensity (LV _Ha , LV _Hb , LV _Hc ). On the other hand, if the voltage value or temperature of the preset medium intensity (LV _Ha , LV _Hb , LV _Hc ) is within the range of the voltage value or temperature of the lowest intensity (LV _Hm ) and the highest intensity (LV _HM ) of the warmth feedback. If they do not belong, the feedback device 1600 adjusts the intermediate intensities (LV _Ha , LV _Hb , LV _Hc ) to fall within the range of the voltage value or temperature of the lowest intensity (LV _Hm ) and the highest intensity (LV _HM ) of the warmth feedback. You can reset the voltage value or temperature.

Also, in an embodiment of the present invention, the feedback device 1600 may set at least one medium intensity of the cooling sensation feedback.

Referring to (b) of FIG. 30 , the lowest intensity (LV _Cm ) and the highest intensity (LV _CM ) of cooling feedback may be set in advance. Also, the number of medium intensities of the cooling sensation feedback may be set to three. In this case, the feedback device 1600 may set three intermediate intensities (LV _Ca , LV _Cb , and LV _Cc ) using the lowest intensity (LV _Cm ) and the highest intensity (LV _CM ) of the cooling feedback. In this case, the temperature of the highest intensity (LV _CM ) may be higher than a predetermined critical temperature (T _Cdmg ).

In one embodiment of the present invention, the feedback device 1600 interpolates voltage values or temperatures corresponding to the lowest intensity (LV _Cm ) and the highest intensity (LV _CM ) of cooling feedback to obtain medium intensity (LV _Ca , LV _Cb , LV _Cc ) can be set.

In addition _{, in another embodiment of the present invention, the feedback device 1600 controls the medium intensity (LV Ca , LV Cb} , LV _Cc ) can be set.

Since the contents described in the medium intensity setting of the warm feedback may be applied to the medium intensity setting of the cold feedback as they are, descriptions of contents overlapping with those described in the medium intensity setting of the warm feedback are omitted.

3.3.2. Intensity calibration of thermal grill feedback

31 is a flowchart of a method for calibrating the intensity of thermal grill feedback according to an embodiment of the present invention.

The intensity calibration method according to FIG. 31 may include setting reference intensity of thermal grill feedback ( S3100 ) and setting final intensity of thermal grill feedback based on the reference intensity ( S3200 ).

As described above, the feedback device 1600 may provide heat grill feedback to the user through a heat grill operation that performs a combination of a heating operation and a heat absorbing operation. The thermal grill feedback provides a user with a sense of heat pain, and the user feels a sense of heat pain without feeling warmth or coolness when hot and cold points are simultaneously stimulated on the user's body.

Specifically, whether or not heat pain is perceived may be determined depending on the perceived intensity of the warm and cold sensations and the ratio of the warm and cold sensations. can Accordingly, even if the feedback device 1600 outputs thermal pain feedback, some users may not be able to recognize heat pain sensation, and even if they feel heat pain sensation, the intensity of heat pain sensation felt by each user may differ from person to person. In addition, even for the same user, the intensity of thermal pain may be different depending on the body part of the user.

If the heat grill feedback output from the feedback device 1600 is pre-adjusted to the user and the characteristics of the body part, the user will feel the thermal sensation of the intended intensity from the feedback device 1600 and/or the content device 1200. can Therefore, calibration is also required for thermal grill feedback.

In an embodiment of the present invention, the heat grill feedback may include neutral heat grill feedback, warm grill feedback, and cold grill feedback, and whether the heat grill feedback is neutral heat/hot heat/cold heat depends on the strength of the warmth feedback and the cool feeling. It may be determined according to the ratio of the strength of the feedback.

Hereinafter, for convenience of description, the calibration of the neutral thermal grip feedback will be mainly described. However, it is not limited thereto, and since the neutral heat grill feedback and the hot/cold grill feedback have a difference in the ratio of the intensity of the warm feedback and the intensity of the cold feedback, the following will be described also for the calibration of the hot grill feedback and the cold grill feedback. can be applied

In addition, it was previously confirmed that the thermal grill operation can be performed by voltage regulation, area regulation, and time division. Accordingly, a calibration method according to voltage control, area control, and time division will be described below.

3.3.2.1. Calibration according to voltage regulation

The feedback device 1600 may calibrate the thermal grill feedback in a voltage-controlled manner.

In an embodiment of the present invention, the feedback device 1600 may perform calibration of the thermal grill feedback using the lowest intensity, the highest intensity, and/or at least the middle intensity set in the aforementioned intensity calibration of the warmth feedback and the cold feedback. Because the thermal grill feedback is performed as a combination of the hot feedback and the cool feedback, when the intensity information of the warm feedback and cool feedback adjusted to the user's characteristics is used, the calibration of the thermal grill feedback can be performed more accurately and quickly. am.

Of course, the present invention is not limited thereto, and it is also possible to calibrate the thermal grill feedback using uncalibrated intensity information of the warmth feedback and the cold feedback.

Hereinafter, for convenience of description, the intensity information (temperature on the contact surface 1641 for each intensity, thermocouple group 1644 for each intensity) of the n-level (intensity) of the warmth feedback is obtained through calibration of the warmth feedback and the cool feedback. It is assumed that intensity information of an applied voltage value) and an n level of cooling feedback are set in advance. Accordingly, the feedback controller 1648 may apply n positive voltages and reverse voltages to the thermocouple group 1644, respectively, and accordingly, the thermocouple group 1644 may perform heat generation and endothermic operations of n grades, respectively. It is assumed that the magnitude of the temperature change due to the same grade of exothermic operation and endothermic operation is the same.

In an embodiment of the present invention, the feedback device 1600 may set the reference strength of the column grill feedback (S3100). It may be triggered when the intensity of the warm and cool sensations felt by the user falls within a predetermined ratio range, that is, a neutral ratio. In addition, even if the neutral ratio is the same, as the difference between hot heat according to the warmth feedback and cold heat according to the cool feedback increases, the intensity of the heat grill feedback may increase.

First, the feedback device 1600 may set a neutral ratio for outputting heat grill feedback.

In one embodiment of the present invention, the neutral ratio may be preset. For example, the neutral ratio may be set to any one of 2 to 5 ratios.

Also, in another embodiment of the present invention, the feedback device 1600 may obtain a user input for the neutral ratio.

32 is a table of voltages for providing thermal grill feedback based on a neutral ratio according to an embodiment of the present invention.

Referring to FIG. 32, V _H-1 denotes voltages applied to the thermocouple group when the first grade (strength) temperature feedback is output, and V _C-2 , V _C-3 , V _C-4 , and V _{C -5} denotes a voltage applied to the thermocouple group at the time of second to fifth grade cooling feedback outputs. Also, in order to output thermal grill feedback, the feedback device 1600 may apply power so that the first thermocouple group performs a heating operation and the second thermocouple group performs a heat absorbing operation.

In an embodiment of the present invention, the feedback device 1600 may output thermal sensation feedback in an order from a low neutral ratio to a high neutral ratio. Of course, the feedback device 1600 may output thermal sensation feedback in the order of a high neutral ratio to a low neutral ratio. The feedback device 1600 may obtain a user input for any one neutral ratio among the plurality of neutral ratios. For example, when heat grill feedback is output from a low neutral ratio to a high neutral ratio, the user does not feel heat pain at first, but feels heat pain when the feedback device 1600 outputs warmth feedback at a specific neutral ratio. can At this time, the feedback device 1600 may obtain a user input for the specific neutral ratio, and may set the specific neutral ratio as a neutral ratio for feedback to be drawn.

In addition, in an embodiment of the present invention, the feedback device 1600 uses a set neutral ratio (a preset neutral ratio or a neutral ratio set based on a user input) and a resultant value of intensity calibration of the warmth feedback and the cool feedback to draw a column. You can set the reference strength of feedback.

Referring to FIG. 33 , FIG. 33 is a table of voltages for providing thermal grille feedback based on reference intensity according to an embodiment of the present invention.

In FIG. 33 , V _H-1 , V _H-2 , V _H-3 , V _H-4 , and V _H-5 are applied to the thermocouple group at the time of outputting first (strength) to fifth grade temperature feedback. V _C-2 , V _C-4 , V _C-6 , V _C-8 , V _C-10 are the second class, fourth class, sixth class, eighth class, and tenth class voltage. Indicates the voltage applied to the thermocouple group at the time of cooling feedback output. In the example of FIG. 33 , it is assumed that the neutral ratio is set to 2. The V _H-1 to V _H-5 and the V _C-2 to V _C-10 may be result values of intensity calibration of the warmth feedback and the cold feedback.

According to the neutral ratio 2, the feedback device 1600 sets the applied voltage of the first thermocouple group for the thermal grill feedback of the first reference intensity to V _H-1 corresponding to the first-class temperature feedback, and the second thermoelectric The pair group applied voltage may be set to V _C-2 corresponding to the second-class on-feed feedback. Similarly, the feedback device 1600 may set the voltage applied to the first thermocouple group and the voltage applied to the second thermocouple group for the thermal grill feedback of the second to fifth reference strengths according to FIG. 33 . In other words, when the first-class warmth feedback is the lowest intensity of warmth feedback and the tenth-class cold feedback is the highest intensity of warmth feedback, the feedback device 1600 provides the minimum intensity of the warmth feedback, the maximum intensity of the cold feedback, and The reference intensity of the thermal grill feedback may be set using the intermediate intensity of the warm feedback/cool feedback.

As described above, as the temperature difference between the hot heat output from the first thermocouple group and the cold heat output from the second thermocouple group increases, the strength of the heat relief feedback may increase. In the example of FIG. 33 , when the heat grill feedback of the first reference intensity is output, the heat grill feedback of the fifth reference intensity is greater than the temperature difference between the hot heat output from the first thermocouple group and the cold heat output from the second thermocouple group. A temperature difference between hot heat output from the first thermocouple group and cold heat output from the second thermocouple group at the time of outputting may be greater. Accordingly, the first reference intensity may be the minimum reference intensity of the thermal grill feedback, the fifth reference intensity may be the highest reference intensity of the thermal grill feedback, and the second to fourth reference intensities may be the middle of the thermal grill feedback. It can be a reference strength.

In the example of FIG. 33 , the reference strength in the case of a neutral ratio of 2 has been described, but the embodiment described in FIG. 33 can be applied to other neutral ratios as well. For example, when the neutral ratio is 3, the feedback device 1600 sets the voltage applied to the first thermocouple group for the thermal grill feedback of the first reference intensity to V _H-1 corresponding to the first-class temperature feedback. And, the voltage applied to the second thermocouple group may be set to V _C-3 corresponding to the second level of on-feed feedback. In addition, the feedback device 1600 sets the voltage applied to the first thermocouple group for the thermal grill feedback of the first reference intensity to V _H-5 corresponding to the feedback of the fifth level of the temperature, and the voltage applied to the second thermocouple group. may be set to V _C-15 corresponding to the 15th level of warmth feedback.

Also, in an embodiment of the present invention, the feedback device 1600 may set the final strength based on the reference strength (S3200).

As described above, the reference intensity may be generated based on preset minimum intensity, maximum intensity, and medium intensity of the warmth feedback and the cold feedback. This is due to the fact that the intensity of the preset warmth feedback and cool sensation feedback is adjusted according to the user's characteristics, but nevertheless, depending on the user's characteristics, the heat sensation is not recognized by the heat grill feedback according to the reference intensity or , can be perceived weakly. Therefore, in step S3200, the reference strength may be more precisely adjusted to suit the user's characteristics, and final strength indicating the strength of the row grill feedback suitable for the user may be set. Here, the final intensity may include the lowest intensity, the highest intensity, and at least one intermediate intensity of the thermal grill feedback.

In an embodiment of the present invention, the feedback device 1600 may select a final intensity suitable for the user from among the reference intensities through a user input.

In detail, in one embodiment of the present invention, the feedback device 1600 may sequentially output column grill feedback of the first to fifth reference intensities.

At this time, the feedback device 1600 may set the lowest intensity among the final intensity through a user input. More specifically, when heat grill feedback is sequentially output from the feedback device 1600, the user can perform a user input when a feeling of heat pain is felt, and the feedback device 1600 outputs the user input at the time of obtaining the user input. The reference strength of the thermal grill feedback may be set to the lowest strength among the final strengths.

Also, the feedback device 1600 may set the highest intensity among the final intensities through a user input. More specifically, when heat grill feedback is sequentially output from the feedback device 1600, the user can perform user input when it is difficult to endure heat pain, and the feedback device 1600 determines the point at which the user input is obtained. A reference intensity lower than the reference intensity of the thermal grill feedback at , or the reference intensity of the thermal grill feedback at the time when the user input is acquired may be set as the highest final intensity.

Also, in another embodiment, the contact surface 1641 of the heat output module 1640 may be disposed in a specific region of the casing of the feedback device 1600, and a pressure sensor may be disposed in or around the specific region. The feedback device 1600 may sequentially output heat grill feedback according to the reference strength, and the user may touch the specific area with the user's body until the user can endure the heat pain. However, as the intensity of the heat grill feedback increases, it may be difficult for the user to endure the heat pain, and at this time, the user's body may be separated from the specific area.

The feedback device 1600 may detect when the user's body is separated from the specific region using the pressure sensor, and the feedback device 1600 outputs an output when the user's body is separated from the specific region. A reference intensity lower than the reference intensity of the thermal grill feedback or the reference intensity of the thermal grill feedback output when the user's body is separated from the specific region may be set as the highest final intensity.

In an embodiment of the present invention, in order to prevent user's body damage, threshold intensity of heat relief feedback may be set in advance, and the first to fifth reference intensity may be lower than the threshold intensity. For example, the feedback device 1600 may set the threshold intensity of the heat grill feedback based on the maximum intensity of the warmth feedback and/or the maximum intensity of the cool feedback. Also, as another example, the feedback device 1600 may set, as a threshold intensity, a heat grill feedback intensity in which a temperature difference between output hot and cold heat becomes a predetermined temperature difference for heat grill feedback of a specific intensity. In addition, the threshold strength may be determined based on the threshold temperature of warmth feedback (T _Hdmg ) and/or the threshold temperature of cold feedback (T _Cdmg ). Of course, the threshold strength may be set in various ways.

In an embodiment, the feedback device 1600 may determine whether the first to fifth reference intensities are equal to or less than the threshold, and some of the first to fifth reference intensities may be set to the threshold level or less. If the intensity is higher than the threshold intensity, the feedback device 1600 may not output thermal grille feedback of the partial reference intensity.

Also, the feedback device 1600 may set at least one intermediate intensity among the final intensities through a user input.

More specifically, the user may perform a user input whenever a different degree of thermal pain is felt. For example, when heat grill feedback is sequentially output from the feedback device 1600, the user may perform a user input whenever the heat sensation caused by the heat grill feedback becomes stronger, and the feedback device 1600 receives the user input The reference strength at the point of time when this is obtained may be set to the middle strength of thermal grill feedback.

* In a specific embodiment of the present invention, when the feedback device 1600 sequentially outputs heat grill feedback of the first to fifth reference intensities, when the second reference intensity is output, when the third reference intensity is output, When a user input is obtained during the fourth reference emphasis output, the feedback device 1600 sets the second reference strength to the lowest strength of the final strength, sets the fourth reference strength to the highest strength of the final strength, and sets the second reference strength to the highest strength of the final strength. 3 The reference intensity can be set to an intermediate intensity of the final intensity. Accordingly, as shown in FIG. 34 , final intensities of three grades may be set.

Also, in another embodiment of the present invention, the feedback device 1600 may set at least one medium intensity using the lowest intensity and the highest intensity among the final intensity without a user input.

For example, the feedback device 1600 may obtain the lowest intensity and the highest intensity among the final intensities through a user input. The feedback device 1600 may set at least one reference strength existing between the reference strength corresponding to the lowest strength and the reference strength corresponding to the highest strength to the at least one intermediate strength.

In another embodiment of the present invention, the feedback device 1600 may set the final intensity by adjusting the temperature (or voltage value) of the reference intensity.

35 is a table of voltages for providing thermal grill feedback based on detail intensity according to an embodiment of the present invention. Here, the detailed intensity may mean the temperature of the contact surface 1641 according to the heat grill feedback of a specific intensity or the intensity of the thermal grill feedback when the voltage value applied to the thermocouple group is adjusted for the specific intensity of the thermal grill feedback. can

35 shows only the detailed strength of the first reference strength, but detailed strength applicable to other reference strengths (eg, the second reference strength to the fifth reference strength) may also be set.

In FIG. 35 , the 1-1st to 1-9th intensities may represent detailed intensities of the first reference intensity. As for the 1-1 strength, V _H-1 may be applied to the first thermocouple group and V _C-2 may be applied to the second thermocouple group, the same as the first reference strength. However, in the 1-2 intensities to 1-9 intensities, the voltage values applied to the first thermocouple group and the second thermocouple group are changed, and as a result, the temperatures in the first thermocouple group and the second thermocouple group are changed. may change. For example, in FIG. 35 , 1.1V _H-1 is applied to the first thermocouple group at intensities 1-6, 0.9V _C-2 is applied to the second thermocouple group, and at intensities 1-8 0.9V _H-1 may be applied to the first thermocouple group, and 1.1V _C-2 may be applied to the second thermocouple group. Here, coefficients in front of voltage values such as 1.1 and 0.9 do not mean only ratios such as 1.1 times and 0.9 times the voltage values. The coefficient indicates an increase or decrease in the voltage value, 1.1V _Hn means that the voltage value is higher than V _Hn , and 0.9V _Hn means that the voltage value is lower than V _Hn . Also, the difference between 1.1V _Hn and V _Hn or the difference between 0.9V _Hn and V _Hn may be preset or determined according to the value of V _Hn (or V _Cn ).

In one embodiment, the feedback device 1600 may output thermal grill feedback of at least one intensity from 1-2 to 1-9. For example, the feedback device 1600 may sequentially output row grill feedback of intensities 1-1 through 1-9. Also, as an example, the feedback device 1600 outputs heat grill feedback of 1-6th intensity and 1-8th intensity in which the temperature difference between hot and cold heat in the 1-1 intensity heat grill feedback can be maintained. can do.

The feedback device 1600 may receive a user input for any one intensity among at least one output intensity, and in this case, the feedback device 1600 may determine the selected intensity as the final intensity.

For example, the feedback device 1600 may output detailed intensities of the first to fifth reference intensities with respect to the first to fifth reference intensities, respectively, and through a user input, the first reference intensities. A detail intensity may be selected for each of the fifth through fifth reference intensities. In this case, the feedback device 1600 may set the detail intensity selected through the user input among the detailed intensities of the first reference intensity to the lowest intensity among the final intensities, and the detailed intensity selected through the user input among the detailed intensities of the fifth reference intensity. may be set as the highest intensity among the final intensities, and detailed intensities selected through a user input among the detailed intensities of the second to fourth reference intensities may be set as intermediate intensities of the final intensities.

Also, the feedback device 1600 may adjust the final intensity by adjusting a preset temperature value of the final intensity. In detail, the feedback device 1600 may set detailed intensity for a preset final intensity. The feedback device 1600 may output thermal grill feedback of the detail intensity, select a specific detail intensity from among the detail intensity through a user input, and adjust the final intensity to the specific detail intensity.

For example, the feedback device 1600 may receive a final intensity suitable for the user from among the reference intensities through a user input, and set the minimum intensity, the middle intensity, and the maximum intensity. At this time, the feedback device 1600 adjusts temperature or voltage values of the lowest intensity, middle intensity, and highest intensity, sets a plurality of detailed intensities for the lowest intensity, middle intensity, and maximum intensity, and sets the plurality of detailed intensities. You can print detailed intensities. For example, the feedback device 1600 may output 9 detailed intensities for each of the lowest intensity/middle intensity/highest intensity. The feedback device 1600 may receive selection of the specific detail intensity of the lowest intensity, the specific detail intensity of the middle intensity, and the specific detail intensity of the highest intensity through a user input, and set the selected detail intensity to the lowest final intensity. It can be set to Intensity, Medium Intensity and Highest Intensity.

3.3.2.2. Calibration according to area control

The feedback device 1600 may perform calibration of the thermal grille feedback in an area adjustment method.

Previously, it has been described that the feedback device 1600 can perform a heat grilling operation in an area adjusting method. The feedback device 1600 may output thermal grill feedback by adjusting the area of the thermocouple group 1644 to which the forward voltage is applied and the area of the thermocouple group 1644 to which the reverse voltage is applied.

Specifically, in the heat grill operation according to area adjustment, the neutral ratio may mean a ratio of an area to which a feeling of warmth is provided to an area to which a feeling of coolness is provided, and the degree to which a user feels a sense of heat is different according to the neutral ratio. can do.

In addition, even if the neutral ratio is the same, the degree to which the user feels thermal pain may be different depending on the temperature difference between hot heat based on the warmth feedback and cold heat based on the cool feedback. Therefore, it is necessary to calibrate the heat relief feedback even in the heat grill operation according to the area adjustment.

In an embodiment of the present invention, the feedback device 1600 may set the reference strength of the column grill feedback (S3100).

First, the feedback device 1600 may set a neutral ratio for outputting heat grill feedback.

In one embodiment of the invention, the feedback device 1600 may obtain user input for the neutral ratio.

36 is a table of voltages and application times of the voltages for providing thermal grill feedback based on a neutral ratio according to an embodiment of the present invention.

Referring to FIG. 36 , the feedback device 1600 may output heat grill feedback according to a neutral ratio. For example, when the neutral ratio is 2, the feedback device 1600 sets an area ratio of a thermocouple group performing a heat-generating operation and a thermocouple group performing an endothermic operation at a ratio of 1:2, and heats the heat according to the area ratio. You can output feedback to draw. In addition, even when the neutral ratio is n, the area ratio of the thermocouple group performing the heat generating operation and the thermocouple group performing the heat absorbing operation may be set to a ratio of 1:n.

In one embodiment, the feedback device 1600 may output thermal sensation feedback in the order of a low neutral to high neutral ratio. Of course, the feedback device 1600 may output thermal sensation feedback in the order of a high neutral ratio to a low neutral ratio. Also, the feedback device 1600 may obtain a user input for any one neutral ratio among the plurality of neutral ratios. The feedback device 1600 may set a neutral ratio selected through a user input as a neutral ratio for feedback for row drawing.

Of course, the neutral ratio may be preset in the feedback device 1600.

In addition, in an embodiment of the present invention, the feedback device 1600 uses a set neutral ratio (a preset neutral ratio or a neutral ratio set based on a user input) and a resultant value of intensity calibration of the warmth feedback and the cool feedback to draw a column. You can set the reference strength of feedback.

37 is a table of voltages for providing thermal grill feedback based on reference intensity according to an embodiment of the present invention.

Referring to FIG. 37 , V _H-1 , V _H-2 , V _H-3 , V _H-4 , and V _H-5 are applied to the thermocouple group when first to fifth grade temperature feedback is output. V _C-1 , V _C-2 , V _C-3 , V _C-4 , V _C-5 represent the first, second, third, fourth and fifth degrees of coldness. Indicates the voltage applied to the thermocouple group at the time of feedback output.

In one embodiment, the feedback device 1600 may apply a voltage corresponding to the same level of hot feedback/cold feedback for each reference intensity. Of course, voltages corresponding to different levels of warmth feedback/cold feedback may be applied for each reference intensity.

As the reference strength increases, the magnitude of the voltage applied to the thermocouple group performing the heating operation and the thermocouple group performing the heat absorbing operation may increase, and accordingly, the intensity of the thermal grill feedback may increase. Accordingly, in the example of FIG. 37 , the first reference strength becomes the lowest reference strength of the thermal grill feedback, the fourth reference strength becomes the highest reference strength of the thermal grill feedback, and the second reference strength and the third reference strength become the thermal grill feedback strength. It can be the medium reference strength of the feedback. Since the description in step S3100 of calibration according to voltage control can be applied to the setting of the reference emphasis, a detailed description thereof will be omitted.

Also, in an embodiment of the present invention, the feedback device 1600 may set the final strength based on the reference strength (S3200).

As described in step S3200 of calibration according to voltage regulation, in an embodiment of the present invention, the feedback device 1600 sequentially outputs feedback of the first to fifth reference intensities of the column grille, and through a user input, Among output reference intensities, a final intensity suitable for the user may be selected.

Also, in an embodiment of the present invention, the feedback device 1600 may set the final intensity by adjusting the temperature (or voltage value) of the reference intensity. 38 is a table of voltages for providing thermal grill feedback based on detail intensity according to an embodiment of the present invention. Referring to FIG. 38 , the feedback device 1600 outputs at least one detail intensity of FIG. 38 , receives a selection of at least one detail intensity from among the output detail intensity through a user input, and based on the selected detail intensity You can set the final intensity. Since the content described in step S3200 of calibration according to voltage control may be applied to step S3200 of calibration through region control, detailed description thereof will be omitted.

3.3.2.3. Calibration by time division

The feedback device 1600 may perform calibration of thermal grille feedback in a time division manner.

Previously, it has been described that the feedback device 1600 may perform a row grilling operation in a time division manner. Specifically, the feedback device 1600 may perform a heat grilling operation by alternately performing a heating operation and a heat absorbing operation in time.

Specifically, in the heat grill operation according to the time division, the neutral ratio may mean the ratio of the time to which the reverse voltage is applied to the time to which the positive voltage is applied, and the degree to which the user feels heat relief may vary according to the neutral ratio. can

In addition, even if the neutral ratio is the same, the degree to which the user feels thermal pain may be different depending on the temperature difference between hot heat based on the warmth feedback and cold heat based on the cool feedback. Therefore, it is necessary to calibrate the heat loss feedback even in the heat grill operation according to the time division.

In an embodiment of the present invention, the feedback device 1600 may set the reference strength of the column grill feedback (S3100).

First, the feedback device 1600 may set a neutral ratio for outputting heat grill feedback. In one embodiment of the invention, the feedback device 1600 may obtain user input for the neutral ratio.

Referring to FIG. 36 , the feedback device 1600 may output heat grill feedback according to a neutral ratio. For example, when the neutral ratio is n, the feedback device 1600 sets the ratio between the time for which the positive voltage is applied and the time for which the reverse voltage is applied as a ratio of 1:n, and outputs heat grill feedback according to the time ratio. can do.

In one embodiment, the feedback device 1600 may output thermal sensation feedback in the order of a low neutral to high neutral ratio. Of course, the feedback device 1600 may output thermal sensation feedback in the order of a high neutral ratio to a low neutral ratio. Also, the feedback device 1600 may obtain a user input for any one neutral ratio among the plurality of neutral ratios. The feedback device 1600 may set a neutral ratio selected through a user input as a neutral ratio for feedback for row drawing.

Of course, the neutral ratio may be preset in the feedback device 1600.

In addition, in an embodiment of the present invention, the feedback device 1600 uses a set neutral ratio (a preset neutral ratio or a neutral ratio set based on a user input) and a resultant value of intensity calibration of the warmth feedback and the cool feedback to draw a column. You can set the reference strength of feedback.

Referring to FIG. 37 , the feedback device 1600 may apply a voltage corresponding to the same level of hot feedback/cold feedback for each reference intensity of FIG. 37 . Of course, voltages corresponding to different levels of warmth feedback/cold feedback may be applied for each reference intensity.

As the reference strength increases, the magnitude of the voltage applied to the thermocouple group performing the heating operation and the thermocouple group performing the heat absorbing operation may increase, and accordingly, the intensity of the thermal grill feedback may increase. Accordingly, in the example of FIG. 37 , the first reference strength becomes the lowest reference strength of the thermal grill feedback, the fourth reference strength becomes the highest reference strength of the thermal grill feedback, and the second reference strength and the third reference strength become the thermal grill feedback strength. It can be the medium reference strength of the feedback. Since the description in step S3100 of calibration according to voltage control can be applied to the setting of the reference emphasis, a detailed description thereof will be omitted.

Also, in an embodiment of the present invention, the feedback device 1600 may set the final strength based on the reference strength (S3200).

As described in step S3200 of calibration according to voltage regulation, in an embodiment of the present invention, the feedback device 1600 sequentially outputs feedback of the first to fifth reference intensities of the column grille, and through a user input, Among output reference intensities, a final intensity suitable for the user may be selected.

Also, in an embodiment of the present invention, the feedback device 1600 may set the final intensity by adjusting the temperature (or voltage value) of the reference intensity. For example, the feedback device 1600 outputs at least one detail intensity of FIG. 37, receives a selection of at least one detail intensity from among the output detail intensity through a user input, and determines a final intensity based on the selected detail intensity. can be set Since the content described in step S3200 of calibration according to voltage control may be applied to step S3200 of calibration through time division, a detailed description thereof will be omitted.

3.3. Check the results of strength calibration

39 is a flowchart of a method for checking a result of strength calibration according to an embodiment of the present invention.

Referring to FIG. 39 , the feedback device 1600 may check the calibrated result in step S2600 and/or step S2700.

Specifically, the feedback device 1600 may output thermal feedback of the intensity set in steps S2600 and/or step S2700 (S3910).

In an embodiment of the present invention, in the case of hot feedback and cold feedback, the feedback device 1600 may output hot feedback and cold feedback of the lowest intensity, the highest intensity, and at least one medium intensity.

* For example, the feedback device 1600 may output the warm feedback and the cold feedback in order from the lowest intensity to the highest intensity, or may output only at least one medium intensity of the warmth feedback and the cold feedback.

Also, in another embodiment of the present invention, in the case of thermal grill feedback, the feedback device 1600 may output thermal grill feedback of the lowest intensity, the highest intensity, and at least one intermediate intensity among final intensities.

Also, in an embodiment of the present invention, the feedback device 1600 may obtain a result of recognizing the thermal feedback output in step S3910 through a user input (S3920).

Specifically, when the lowest intensity of the warm feedback/cool feedback/heat grill feedback is output in step S3910, the feedback device 1600 determines whether the warm feedback/cool feedback/heat grill feedback is felt through a user input. can receive For example, when the lowest intensity of the warmth feedback is output, the user may check whether the warmth is felt, and if the warmth is sensed (or if the warmth is not felt), the user may input the feedback The device 1600 may obtain the user input.

As another example, when the warm feedback/cool feedback/heat grill feedback of the lowest intensity is output, the feedback device 1600 may check whether the warm feedback/cool feedback/heat grill feedback is not too strong through a user input. there is. For example, when the heat grill feedback of the highest intensity is output, the user can check whether the heat sensation is too strong, and if the heat sensation is too strong (or. The heat sensation is at a level that can be tolerated), A user input may be performed, and the feedback device 1600 may obtain the user input.

As another example, when at least one medium intensity of hot feedback/cold feedback/heat grill feedback is output, the feedback device 1600 may determine whether the at least one medium intensity is distinguished from each other. For example, when cooling feedback of a plurality of intensities is output, the user may check whether or not the intensity of the output cooling sensation feedback is distinguished, and if the intensity of the cooling sensation feedback is distinguished (or the intensity of the cooling sensation feedback is not distinguished). If not), user input may be performed, and the feedback device 1600 may obtain the user input.

Also, in an embodiment of the present invention, the feedback device 1600 may maintain or change the intensity set in steps S2600 and/or step S2700 according to the thermal feedback recognition result obtained in step S3920.

In one embodiment of the present invention, the feedback device 1600 may determine whether or not the intensity set in steps S2600 and/or step S2700 is suitable based on the thermal feedback recognition result through the user input. For example, if it is confirmed that the user can perceive the thermal feedback of the lowest intensity, if it is confirmed that the user can tolerate the thermal feedback of the highest intensity, or if it is confirmed that the user can distinguish at least one moderate intensity, The feedback device 1600 may determine that the intensity set in step S2600 and/or step S2700 is appropriate. In this case, the feedback device 1600 may maintain the intensity set in step S2600 and/or step S2700 (S3930).

In another example, if it is confirmed that the user cannot perceive the thermal feedback of the lowest intensity, if it is confirmed that the user cannot tolerate the thermal feedback of the highest intensity, or if it is confirmed that the user cannot distinguish at least one intermediate intensity. , the feedback device 1600 may determine that the strength set in step S2600 and/or step S2700 is inappropriate. In this case, the feedback device 1600 re-performs steps S2600 and/or step S2700 to reset the intensity of the thermal feedback (S3940), or regardless of steps S2600 and S2700, the intensity of the thermal feedback is determined in advance. You can change it to default settings.

3.4. zone calibration

*

In one embodiment of the invention, it can also be calibrated for the region of thermal feedback. As described above, for example, when the thermocouple array 1643 is composed of a plurality of thermocouple groups, the feedback controller 1648 may individually control the output of thermal feedback for each of the plurality of thermocouple groups. there is. At this time, depending on the user, the first thermocouple group 1644-1 and the second thermocouple group 1644-2 may want to individually output thermal feedback, or the first thermocouple group 1644-2 may individually output thermal feedback. 1) and the second group of thermocouples 1644-2 may output the same thermal feedback as one group of thermocouples. Also, the user may want not to output thermal feedback for at least one thermal pair group among a plurality of thermal image groups. In order to meet such user needs, the area of thermal feedback of the feedback device, that is, the resolution of thermal feedback, can be calibrated.

40 is a flowchart of a method for calibrating a region of thermal feedback according to an embodiment of the present invention.

The region calibration method according to FIG. 40 may include identifying a plurality of thermocouple groups for outputting thermal feedback (S4010) and performing calibration on the plurality of thermocouple groups (S4020).

Hereinafter, each step described above will be described in detail.

In an embodiment of the present invention, the feedback device 1600 may check a plurality of thermocouple groups (S4010).

As described above, the thermocouple array 1643 of the heat output module 1640 has a plurality of thermocouple groups 1644, and each thermocouple group 1644 is connected to a respective power supply terminal 1647, so that the thermocouple Individual control for each pair group 1644 is possible.

Referring to the example of FIG. 15 , a thermocouple array 1643 may include five thermocouple groups 1644-1, 1644-2, 1644-3, 1644-4, and 1644-5, and each thermocouple group Individual control may be possible for each (1644-1, 1644-2, 1644-3, 1644-4, 1644-5). The feedback device 1600 may check whether individual control is possible for the plurality of thermocouple groups 1644 and the plurality of thermocouple groups 1644 . Hereinafter, it is assumed that individual control of the plurality of thermocouple groups 1644 is possible.

Also, in an embodiment of the present invention, the feedback device 1600 may perform calibration for a plurality of thermocouple groups (S4020).

Specifically, in an embodiment of the present invention, the feedback device 1600 may set the same thermoelectric feedback output region indicating the thermocouple group to which the same voltage is applied among the plurality of thermocouple groups.

As described above, the feedback device 1600 may individually control each of the plurality of thermocouple groups 1644, but in some cases, some of the plurality of thermocouple groups 1644 may correspond to one thermoelectric phase group. It may also be necessary to output thermal feedback. For example, although 10 thermocouple groups are included in the feedback device 1600 and individual control is possible for the 10 thermocouple groups, the feedback device 1600 may individually control 5 thermocouple groups according to user characteristics. , or you may want all groups of 10 thermocouples to output the same thermal feedback as one group of thermocouples. To satisfy these user needs, the feedback device 1600 may set the same thermoelectric feedback output area for a plurality of thermocouple groups.

41 is a table for explaining settings of the same thermoelectric feedback output area according to an embodiment of the present invention.

Referring to FIG. 41 , a thermocouple array 1643 of the feedback device 1600 may include 10 thermocouple groups 1644 . Letters a to j in FIG. 41 may represent the same thermoelectric feedback output area.

In an embodiment of the present invention, the feedback device 1600 may set the same number of thermoelectric feedback output regions. For example, the feedback device 1600 may obtain the number of identical thermoelectric feedback output regions through a user input. Also, as another example, the feedback device 1600 may obtain the number of identical thermoelectric feedback output regions from the content reproducing device 1200, and the same number of thermoelectric feedback output regions may be previously stored in the feedback device 1600. there is.

The feedback device 1600 may set the same thermoelectric feedback output region for a plurality of thermoelectric couple groups according to the set number of identical thermoelectric feedback output regions. For example, as shown in FIG. 41 , when the number of identical thermoelectric feedback output regions is set to 10, the feedback device 1600 may set different identical thermoelectric feedback output regions for each of a plurality of thermocouple groups. In addition, when the number of identical thermoelectric feedback output regions is set to three, the feedback device 1600 sets the first to third thermocouple groups as the first identical thermoelectric feedback output regions, and the fourth to fourth thermocouple groups to The sixth thermocouple group may be set as the second same thermoelectric feedback output region, and the seventh to tenth thermocouple groups may be set as the third same thermoelectric feedback output region. Also, when the number of identical thermoelectric feedback output regions is set to one, the feedback device 1600 may set all of the plurality of thermoelectric couple groups as one identical thermoelectric feedback output region.

The same voltage may be applied to the thermocouple group corresponding to the same thermoelectric feedback output region. For example, when the number of identical thermoelectric feedback output regions is set to two, the same constant voltage is applied to the first to fifth thermocouple groups at a first time, and the sixth to tenth thermocouple groups are applied. The same reverse voltage may be applied to the groups.

*

In an embodiment of the present invention, the feedback device 1600 may set an inactive area indicating a thermocouple group to which no voltage is applied among the plurality of thermocouple groups.

As described above, a user may prefer not to output thermal feedback for at least one thermal pair group among a plurality of thermal phase groups. In order to satisfy such user's needs, the feedback device 1600 may set inactive areas for a plurality of thermocouple groups.

42 is a table for explaining setting of a non-active area according to an embodiment of the present invention. In FIG. 42 , O may represent a region of the thermocouple group to which voltage is applied, and X may represent an inactive region of the thermocouple group to which voltage is not applied.

In an embodiment of the present invention, the feedback device 1600 may set the number of inactive areas. For example, the feedback device 1600 may obtain the number of inactive regions through a user input. Also, as another example, the feedback device 1600 may obtain the number of non-active areas from the content reproduction device 1200, and the number of non-active areas may be pre-stored in the feedback device 1600.

The feedback device 1600 may set inactive areas for a plurality of thermocouple groups according to the set number of inactive areas. For example, as shown in FIG. 42 , when the number of inactive regions is set to two, the feedback device 1600 may set two thermocouple groups among a plurality of thermocouple groups as inactive regions. In FIG. 42 , the inactive regions are indicated as the fifth thermocouple group and the tenth thermocouple group, but the present invention is not limited thereto, and various methods may exist for which thermocouple group among the plurality of thermocouple groups is set as the inactive region. . For example, the feedback device 1600 may receive a selection of thermocouple groups serving as inactive regions through a user input, and thermocouple groups serving as inactive regions may be preset in correspondence with the number of inactive regions.

Also, when the number of inactive regions is set to 10, the feedback device 1600 may set all of the first to tenth thermocouple groups as the inactive regions. This is equivalent to turning off the thermal feedback output function of the thermal output module 1640.

The voltage for the output of thermal feedback is not applied to the thermocouple group corresponding to the inactive area. For example, when the number of inactive regions is set to 6, a voltage for thermal feedback is applied to the third to fifth thermocouple groups and the eighth to tenth thermocouple groups at a first time point. It may not be.

3.5. time calibration

When interlocking thermal feedback with video or audio when reproducing video content, it may be important to synchronize thermal feedback with a specific scene or specific audio to which thermal feedback is to be interlocked. For example, when it is desired to feel the sense of touch feedback when playing an explosion scene, it is preferable that the video output time of the explosion scene coincides with the point in time of the sensation of the sense of touch feedback. Otherwise, the user experience may be hindered.

However, if the feedback controller 1645 applies power for outputting the thermal feedback at the time of outputting the specific scene, a time difference may occur between the outputting time of the specific scene and the time of feeling the thermal feedback.

One of the causes is that even if power is applied to the thermocouple array 1643, it takes some time for the temperature of the contact surface 1641 to reach a temperature at which the user can feel the thermal feedback. In other words, since the power-on time and the user's experience time experiencing thermal feedback may not coincide, when the output time of a specific scene and the power-on time are matched, the video and the thermal feedback are out of sync. In addition, the time required for the temperature of the contact surface 1641 to reach a temperature at which the user can feel the thermal feedback may not be uniform. This is because the time required for the temperature of the contact surface 1641 to reach a temperature at which the user can feel the thermal feedback may vary depending on the degree of deterioration of the heat output module 1640 . In addition, even if the temperature is the same, the sensory temperature perceived by the user may be different according to the characteristics of the user.

Due to these various causes, a time difference may occur between a time point of outputting a specific scene and a time point of experiencing thermal feedback.

In order to solve this problem, in the present invention, the feedback device 1600 acquires an output time point of the thermal feedback from the content reproducing device 1200 and outputs the thermal feedback according to the output time point, and the output time point and correction time Thermal feedback can be output based on Here, the correction time may be a time interval from a time point at which power is applied to the thermocouple array 1643 to a time point at which the temperature of the contact surface 1641 reaches a temperature at which the user can feel the thermal feedback. As the thermal feedback is output based on the output time and the correction time, the user can feel the thermal feedback at the output time of a specific scene.

However, the correction time may vary depending on the user or the characteristics of the thermal output module 1640 . That is, when the calibration time is calibrated to suit the user or the thermal output module 1640, the user can feel the thermal feedback more appropriately at the time of outputting the specific scene. Therefore, in the present invention, a method of calibrating the output timing of thermal feedback, that is, a method of calibrating the correction time will be described.

43 is a flowchart of a thermal feedback time calibration method according to an embodiment of the present invention.

The time calibration method according to FIG. 43 includes outputting thermal feedback (S4310), acquiring a user's perceived point of view for the thermal feedback (S4320), and calculating a correction time based on the perceived point of time (S4330). ) may be included.

Hereinafter, each step described above will be described in detail.

In an embodiment of the present invention, the feedback device 1600 may output thermal feedback (S4310). At this time, the feedback device 1600 may notify the user of the output time of the thermal feedback. For example, the feedback device 1600 may output the thermal feedback when a thermal event is reproduced. In addition, even if it is not related to the reproduction time of the thermal event, the feedback device 1600 provides a video signal and/or an audio signal including information indicating that the thermal feedback is output to the audio-visual device 1400 to determine the reproduction time of the thermal feedback. users can be notified.

In addition, the feedback device 1600 may acquire a point in time of feeling the thermal feedback (S4320). In one embodiment, the feedback device 1600 may obtain the sensed point through a user input. When a user feels a sense of heat, a user input may be performed, and the feedback device 1600 may obtain the user input.

Also, the feedback device 1600 may calculate a correction time based on the felt time.

44 is a diagram for explaining calculation of a correction time according to an embodiment.

Referring to FIG. 44 , in (a), the feedback device 1600 may check the thermal feedback output time point and obtain the experienced time through a user input. The feedback device 1600 may calculate the time between the felt time and the thermal feedback output point as the correction time.

In another embodiment of the present invention, the correction time may be set differently for each type of thermal feedback, for each intensity of thermal feedback, or for each type and intensity of thermal feedback. In this case, the feedback device 1600 performs steps S4310 to S4330 for each type of thermal feedback or for each intensity of thermal feedback or for each type and intensity of thermal feedback to provide thermal feedback for each type of thermal feedback or intensity of thermal feedback. Correction time can be obtained for each type and intensity of .

In an embodiment of the present invention, the feedback device 1600 may output thermal feedback by reflecting the correction time. Specifically, the feedback device 1600 may output thermal feedback at a time point ahead of a thermal event reproduction time or a preset thermal feedback output time by a correction time, as shown in (b) of FIG. 44 . Accordingly, the user can feel the thermal feedback at the time of reproducing the thermal event, and as the reproducing time of the thermal event coincides with the time of feeling the thermal feedback, the user experience can be improved.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program commands recorded on the medium may be specially designed and configured for the embodiment or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with limited examples and drawings, those skilled in the art can make various modifications and variations from the above description. For example, the described techniques may be performed in an order different from the method described, and/or components of the described system, structure, device, circuit, etc. may be combined or combined in a different form than the method described, or other components may be used. Or even if it is replaced or substituted by equivalents, appropriate results can be achieved.

Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

Claims (14)

An electronic device for providing thermal feedback,
a memory storing at least a portion of content including thermal feedback data for providing thermal feedback associated with a specific scene;
a thermoelectric element performing a thermoelectric operation to provide the thermal feedback; and
A controller controlling the thermoelectric element; including,
The controller,
Applying power to the thermoelectric element at a first time to provide a first thermal feedback corresponding to the thermal feedback data;
obtaining a first user input from a user indicating a first felt time point at which the first thermal feedback corresponding to power applied at the first time point is felt;
Calculating a first correction time based on the first time point and the first felt time point;
Based on the calculated first correction time, it is set to apply power at a first thermoelectric operation start time prior to a playback time of the specific scene interlocked with the first thermal feedback;
The first thermoelectric operation start time is determined based on the playback time of the specific scene and the first correction time.
electronic device.
According to claim 1,
The controller,
Applying power to the thermoelectric element at a second time to provide a second thermal feedback of a different type from the first thermal feedback;
obtaining a second user input from the user indicating a second felt time point at which the second thermal feedback corresponding to power applied at the second time point is felt;
Calculating a second correction time based on the second time point and the second felt time point;
Correcting the first thermoelectric operation start point by applying a different correction time according to the type of thermal feedback associated with the specific scene based on the calculated first and second correction times,
electronic device.
According to claim 1,
The controller,
Applying power to the thermoelectric element at a third time to provide a third thermal feedback having an intensity different from that of the first thermal feedback;
Obtaining a third user input from the user indicating a third sensed point in time at which the third thermal feedback corresponding to power applied at the third point in time is felt;
Calculating a third correction time based on the third time point and the third felt time point;
Correcting the first thermoelectric operation start point by applying a different correction time according to the intensity of thermal feedback associated with the specific scene based on the calculated first correction time and third correction time,
electronic device.
According to claim 1,
Further comprising a pressure sensor to obtain a user input,
The controller,
Obtaining a time point when the user's body is separated from the pressure sensor as a first user input indicating the first sensed time point,
electronic device.
According to claim 2,
The controller,
The voltage applied at the first time point and the voltage applied at the second time point have different voltage directions.
electronic device.
According to claim 3,
The controller,
The third time point is a time point that is a certain time later than the first time point,
The voltage applied at the third time point is higher than the voltage applied at the first time point,
electronic device.
According to claim 1,
The controller,
Power is applied to the thermoelectric element at a second time point to provide a second thermal feedback of a different type from the first thermal feedback, and at a third time point to provide a third thermal feedback having an intensity different from the first thermal feedback. Apply power to the thermoelectric element,
obtaining second and third user inputs indicating second and third felt points at which the second and third thermal feedbacks corresponding to power applied at the second and third points are felt from the user;
calculating second and third correction times corresponding to the thermal feedbacks based on the second and third points of time and the second and third felt points;
Correcting the first thermoelectric operation start point by applying a different correction time according to the intensity and type of thermal feedback associated with the specific scene based on the calculated second and third correction times,
electronic device.
A memory storing at least a part of contents including thermal feedback data for providing thermal feedback in conjunction with a specific scene, a thermoelectric element performing a thermoelectric operation for providing the thermal feedback, and a controller controlling the thermoelectric element A method for providing thermal feedback using an electronic device for
applying power to the thermoelectric element at a first time to provide a first thermal feedback corresponding to the thermal feedback data;
obtaining a first user input indicating a first felt point in time at which the first thermal feedback corresponding to the power applied at the first point in time is sensed from a user;
calculating a first correction time based on the first time point and the first felt time point; and
Setting power to be applied at a first thermoelectric operation start time prior to a playback time of the specific scene interlocked with the first thermal feedback based on the calculated first correction time;
The first thermoelectric operation start time is determined based on the playback time of the specific scene and the first correction time.
method.
According to claim 8,
The step of applying the power,
applying power to the thermoelectric element at a second time to provide a second thermal feedback of a different type from the first thermal feedback;
To obtain the input,
obtaining a second user input from the user indicating a second sensed point in time at which the second thermal feedback corresponding to the power applied at the second point in time is felt;
Calculating the correction time,
Further comprising calculating a second correction time based on the second time point and the second felt time point;
In the setting step,
Correcting the first thermoelectric operation start point by applying a different correction time according to the type of thermal feedback associated with the specific scene based on the calculated first and second correction times,
method.
According to claim 8,
The step of applying the power,
Applying power to the thermoelectric element at a third time to provide a third thermal feedback having an intensity different from that of the first thermal feedback;
To obtain the input,
obtaining a third user input from the user indicating a third sensed point in time at which the third thermal feedback corresponding to power applied at the third point in time is felt;
In the step of calculating the correction time,
Further comprising calculating a third correction time based on the third time point and the third felt time point;
In the setting step,
Correcting the first thermoelectric operation start point by applying a different correction time according to the intensity of thermal feedback associated with the specific scene, based on the calculated first and third correction times,
method.
According to claim 8,
To obtain the input,
Obtaining a time point when the user's body is separated from the pressure sensor as a first user input indicating the first sensed time point,
method
According to claim 9,
The voltage applied at the first time point and the voltage applied at the second time point have different voltage directions.
method.
According to claim 10,
The third time point is a time point that is a certain time later than the first time point,
The voltage applied at the third time point is higher than the voltage applied at the first time point,
method.
According to claim 8,
The step of applying the power,
Power is applied to the thermoelectric element at a second time point to provide a second thermal feedback of a different type from the first thermal feedback, and at a third time point to provide a third thermal feedback having an intensity different from the first thermal feedback. Further comprising the step of applying power to the thermoelectric element,
To obtain the input,
obtaining second and third user inputs indicating second and third felt points at which the second and third thermal feedbacks corresponding to power applied at the second and third points are felt from the user; contain more,
Calculating the correction time,
Calculating second and third correction times corresponding to the thermal feedbacks based on the second and third points in time and the second and third felt points;
In the setting step,
Correcting the first thermoelectric operation start point by applying a different correction time according to the intensity and type of thermal feedback associated with the specific scene based on the calculated second and third correction times,
method.

Images