JP6591924B2 - Skin sense presentation system - Google Patents

Description

  The present invention relates to a skin sensation presentation system capable of giving a skin sensation stimulus to a user, and more particularly to a skin sensation presentation system capable of giving a skin sensation stimulation according to any operation of the user.

  In order to obtain information from the outside world, humans effectively use senses (five senses) received from receptors such as vision, hearing, skin sense, olfactory sense, and taste sense. In addition, in communication between humans, language is effectively used in addition to the five senses. Communication takes place based on the five receptors, the whole body sensation through them, and the cognitive process in which the sensation was judged through the central nervous system such as the brain, spine, and medulla oblongata.

  Among them, especially in face-to-face conversations, gestures and skinship are important communication methods. In this way, communication between people and the outside world, communication between people can be said to be the exchange of information through the five senses, other senses, and cognition, and this communication of information is reproduced by a computer to support communication. There have been many proposals to activate.

  Currently, many methods for presenting information through vision and hearing have been proposed, and some of them are widely used. There are also attempts to fuse visual and auditory information with real-world objects.

  On the other hand, there are also technologies aimed at presenting skin sensation information including tactile information and force sensation information directly to the body part by, for example, electrical stimulation, or realizing virtual reality in a wearable form. Exists (see Non-Patent Documents 1 and 2). With the advancement of information presentation technology to these skins, it is expected that the processing of human senses and cognition will be expanded and communication will be enriched.

Haruna Eto et al., “Touch Display Technology for Tactile Presentation by Electrical Stimulation of Fingertips”, Information Processing Society of Japan Interaction 2012, pp. 105-112 “Phillips' unknown heroes, the technology of touching the mind.” Philips Electronics Japan, Internet <http://www.uh.philips.co.jp/magazine_02/>

  However, the techniques disclosed in Non-Patent Documents 1 and 2 have the following problems. That is, firstly, in the technology disclosed in Non-Patent Document 1, a touch-sensitive display using an electrical stimulus is incorporated in a touch panel display, and a user can operate only predetermined menus corresponding to buttons on the touch panel. First, there was a problem that the user interface was fixed.

Secondly, in the techniques disclosed in Non-Patent Documents 1 and 2, there is a problem that the device is not provided in a form that the user can easily and easily use such as when going out.
Third, the techniques disclosed in Non-Patent Documents 1 and 2 have a problem that only one user is presented with a skin sensation stimulus and is not in a form that allows interaction with other users. .

The present invention has been made in consideration of such circumstances, and provides a skin sensation presentation system that can be easily used by a user and can provide skin sensation stimulation according to any user operation. The purpose is to do.
It is another object of the present invention to provide a skin sensation presentation system that can interact with other users.

The present invention is a skin sense presentation system including an electronic device and a wearable device, wherein the electronic device includes an input unit that receives a user operation, a signal pattern generation unit that generates a signal pattern corresponding to the user operation, Communication means for transmitting the signal pattern to the wearable device, wherein the wearable device includes a plurality of stimulus presentation means attached to the clothing so as to contact the body surface of the user, and is attached to the clothing, one of said stimulus presentation means, said to have a control device for providing a user the skin perception stimulated by applying a driving signal corresponding to the signal pattern transmitted from the electronic device, the electronic device further display Display information control means for causing the display device to display an image corresponding to display information, and the input means includes the table. A touch panel arranged in combination with a device, wherein the signal pattern generation means generates the signal pattern corresponding to the display information and user operation information in accordance with an operation performed on the touch panel by a user, The signal pattern includes at least position designation information for designating a position on the wearable device corresponding to a position designated by the user by operating the input means, and the display information control means is configured to allow the user to An image of the wearable device in a worn state is displayed on the display device .

Further, Example 1 structure of the skin-feedback system of the present invention may further include a server device, the signal pattern generation unit of the electronic device, a signal pattern in which the display information and has been associated with the displayed information and the user operation information Is received from the server device, and the signal pattern is generated based on the application program .

Moreover, in one configuration example of the skin sensation presentation system of the present invention, each of the plurality of stimulus presentation units of the wearable device includes at least a pair of electrodes attached to clothing so as to contact the body surface of the user, The control device of the wearable device selects a stimulus presentation unit corresponding to the signal pattern from the plurality of stimulus presentation units, and applies the drive signal between the pair of electrodes of the selected stimulus presentation unit. It is a feature.
Further, in one configuration example of the skin sensation presentation system of the present invention, each of the plurality of stimulus presentation units of the wearable device is further disposed between the clothing and the pair of electrodes, and has an insulating property having moisture retention. A first insulating member made of an insulating material, and a second insulating member made of an insulating material having a moisture retention property, disposed between the pair of electrodes.
Further, in one configuration example of the skin sensation presentation system of the present invention, each of the pair of electrodes is made of a fabric impregnated with PEDOT-PSS.

  Also, one configuration example of the skin sensation presentation system of the present invention includes a plurality of the electronic devices possessed by a plurality of users and a plurality of wearable devices worn by the plurality of users, and the communication of each electronic device The means further includes a function of performing bidirectional communication directly between electronic devices or a function of performing bidirectional communication between electronic devices via a communication network, and a communication unit of a transmission source electronic device that transmits the signal pattern includes: The signal pattern generated by the signal pattern generation means of the own device is transmitted to a predetermined transmission destination electronic device or a transmission destination electronic device designated by the user of the own device, and the communication means of the transmission destination electronic device Transmits the signal pattern received from the transmission source electronic device to the wearable device corresponding to the device itself.

  According to the present invention, an input unit, a signal pattern generation unit, and a communication unit are provided in the electronic device, and a plurality of stimulus presentation units and a control device are provided in the wearable device, so that the user can easily perform when going out. A skin sense presentation system that can be used can be realized. Further, in the present invention, since the user interface is not fixed, it is possible to give the user a skin sensation stimulus according to the user's arbitrary operation.

  According to the present invention, the electronic device is provided with a display device and display information control means, and the input means is a touch panel arranged in combination with the display device, so that the user can intuitively know the position where the skin sensation is presented. Can be recognized.

  In the present invention, various skin sensation presentation applications can be realized by downloading an application program from the server device.

  Further, in the present invention, by providing the first insulating member between the clothing and the pair of electrodes, it is possible to prevent the electrodes from being dried and to prevent the combined resistance between the user's skin and the electrodes from increasing. In addition, by providing the second insulating member between the pair of electrodes, it is possible to prevent the pair of electrodes from being short-circuited.

  Moreover, in this invention, a feeling of mounting | wearing can be improved by comprising each of a pair of electrode with the fabric which impregnated PEDOT-PSS, and long-term continuous wearing is attained.

  Further, in the present invention, by using a plurality of electronic devices and a plurality of wearable devices, it is possible to present a skin sensation by reflecting an operation performed by a certain user on the electronic device on the wearable device of the other user. It becomes possible. As a result, in the present invention, a skin sensation presentation system capable of interacting with other users can be realized.

It is a figure which shows the utilization image of the skin sense presentation system which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structure of the whole skin sense presentation system which concerns on the 1st Embodiment of this invention. 1 is a block diagram showing a configuration of an electronic device according to a first embodiment of the present invention. It is a block diagram which shows the structure of the control apparatus of the wearable apparatus which concerns on the 1st Embodiment of this invention. It is a mimetic diagram showing signs that a user wears wearable equipment in a 1st embodiment of the present invention. It is sectional drawing which shows the structure of the stimulus presentation part of the wearable apparatus which concerns on the 1st Embodiment of this invention. It is a top view which shows the structure of the stimulus presentation part of the wearable apparatus which concerns on the 1st Embodiment of this invention. It is a figure which shows one example of the waveform of the drive signal output to the stimulus presentation part from the stimulus control part of a wearable apparatus at the time of skin sense information presentation in the 1st Embodiment of this invention. It is a figure which shows the other example of the waveform of the drive signal output to the stimulus presentation part from the stimulus control part of a wearable apparatus in the 1st Embodiment of this invention at the time of skin sense information presentation. It is a figure which shows typically the skin sense stimulus given to a user in the 1st Embodiment of this invention, and a figure which shows the example of the waveform of the drive signal corresponding to skin sense stimulus. It is a figure which shows typically another example of the skin sensation stimulus given to a user in the 1st Embodiment of this invention, and a figure which shows the example of the waveform of the drive signal corresponding to a skin sensation stimulus. It is a figure which shows typically another example of the skin sensation stimulus given to a user in the 1st Embodiment of this invention, and a figure which shows the example of the waveform of the drive signal corresponding to a skin sensation stimulus. It is a figure which shows typically another example of the skin sensation stimulus given to a user in the 1st Embodiment of this invention, and a figure which shows the example of the waveform of the drive signal corresponding to a skin sensation stimulus. It is a figure explaining the user's operation with respect to an electronic device in the 1st Embodiment of this invention. It is a flowchart explaining operation | movement of the skin sense presentation system which concerns on the 1st Embodiment of this invention. It is a figure which shows the utilization image of the skin sense presentation system which concerns on the 2nd Embodiment of this invention. It is a block diagram which shows the structure of the whole skin sense presentation system which concerns on the 2nd Embodiment of this invention. It is a block diagram which shows the structure of the whole skin sense presentation system which concerns on the 3rd Embodiment of this invention.

  Hereinafter, although the present invention will be described with reference to the drawings based on preferred embodiments, the present invention is not limited to the embodiments.

[First Embodiment]
(Overall description)
First, the overall configuration of the skin sensation presentation system of the present embodiment will be described. FIG. 1 shows a usage image of the skin sensation presentation system according to the present embodiment. FIG. 2 is a block diagram showing a configuration of the entire skin sensation presentation system according to the present embodiment. As shown in FIG. 1, the skin sensation presentation system according to the present embodiment is connected to wearable device 1 worn by user 100, electronic device 2 possessed by user 100, and electronic device 2 via communication network 4. The server device 3 is configured.

  The wearable device 1 includes a garment 10 such as a shirt, a plurality of stimulus presentation units 11 attached to the garment 10 so as to contact the body surface of the user 100, and a control that controls the stimulus presentation unit 11 attached to the garment 10. The apparatus 12 is comprised. FIG. 1A shows an enlarged view of a part of the wearable device 1. The control device 12 is electrically connected to the plurality of stimulus presentation units 11 via the wiring 13.

  The electronic device 2 wirelessly communicates with a control device 12 built in the garment 10, and a plurality of stimulus presentation units attached to the surface of the garment 10 with arbitrary skin information specified by the user on the display screen of the electronic device 2 11 is given to the user. The example of FIG. 1 shows that when the user 100 traces the display image 200 with a finger, a skin sensation stimulus corresponding to this operation is generated, and 14 in FIG. It shows skin sensation stimulation (electrical stimulation).

  As shown in FIG. 2, the electronic device 2 is connected to a server device 3 including a database (not shown) via a communication network 4. If a known technique is used, the communication network 4 can be the Internet.

  2 represents a drive signal applied to the stimulus presentation unit 11 from the control device 12 of the wearable device 1, b represents information exchanged between the electronic device 2 and the control device 12, and c represents the electronic device. 2 represents information exchanged between the communication device 4 and the communication network 4, and d represents information exchanged between the server device 3 and the communication network 4.

(Description of electronic device)
FIG. 3 is a block diagram illustrating a configuration example of the electronic device 2 according to the present embodiment. Examples of the electronic device 2 include known smartphones and tablet terminals. That is, a known smartphone or tablet terminal only needs to have at least the function of the electronic device 2 described below.

  The electronic device 2 includes a display device 20 and a touch panel 21 (input means) disposed on the display surface side of the display device 20 so as to cover the display device 20. The user operates the electronic device 2 by touching the touch panel 21 with a finger or a pen or inputting a gesture with respect to the content displayed on the display device 20. It goes without saying that the user can view the image displayed on the display device 20 and transmitted through the touch panel 21.

  As the touch panel 21, various known touch panels such as an electrostatic type, a resistance film type, an optical type, an ultrasonic type, and an electromagnetic type can be used. The touch panel 21 is often attached to a glass plate because of its configuration, and in this case, the touch panel 21 is defined as a touch panel including the glass plate.

  The touch panel 21 is controlled by the touch panel control unit 22. The touch panel control unit 22 displays the position and range on the touch panel 21 touched by the user, the direction in which the user moved the fingertip on the touch panel 21, the speed at which the user moved the fingertip on the touch panel 21, and the time when the user touched the touch panel 21. Can be detected. The microcomputer 23 can obtain operation information (position, direction, speed, contact time, etc.) obtained from the user's operation on the touch panel 21 from the touch panel control unit 22.

  As the display device 20, a known liquid crystal method, organic EL method, electronic paper method, or other display device can be used. The display device 20 is controlled by the display information control unit 24. The microcomputer 23 can cause the display device 20 to perform arbitrary display via the display information control unit 24.

  In the present embodiment, the external type configuration in which the touch panel 21 is attached on the display device 20 has been described. However, a built-in type in which the display device 20 and the touch panel 21 are integrated may be employed. For example, a method such as an in-cell type touch panel in which the touch panel function is integrated inside the liquid crystal panel or an on-cell type touch panel in which the touch panel function is integrated on the surface of the liquid crystal panel may be used. By adopting these methods, The electronic device 2 can be further reduced in thickness and weight.

  Further, the electronic device 2 includes a ROM (Read-Only Memory) 25 that stores various programs of the microcomputer 23, a RAM (Random Access Memory) 26 that stores various data processed by the microcomputer 23, and the display device 20. A display information recording unit 27 that stores display information to be displayed, a communication interface unit 28 (communication means) that communicates with the outside, various I / O units 29 that perform various inputs and outputs, and power of each unit of the electronic device 2 And a power supply unit 30 for supplying power.

  The communication interface unit 28, for example, a known LTE / 3G communication function for communicating with the server device 3 and other electronic devices 2 via the communication network 4, the control device 12 of the wearable device 1, and other electronic devices 2. For example, a well-known Bluetooth (registered trademark) communication function and a Wi-Fi communication function are provided.

  The microcomputer 23 and the display information recording unit 27 constitute signal pattern generation means. The display information recording unit 27 includes a signal pattern for controlling the stimulus presentation unit 11 of the wearable device 1 in order to present the user operation information and skin sense information corresponding to the user operation information together with the display information. Are recorded in association with the display information.

  The microcomputer 23 determines whether or not a signal pattern corresponding to display information and user operation information is held in the display information recording unit 27. When the signal pattern corresponding to the display information and the user operation information is held in the display information recording unit 27, the microcomputer 23 transmits this signal pattern to the control device 12 of the wearable device 1 via the communication interface unit 28. Send.

  The signal pattern includes, for example, position designation information for designating a specific position on the wearable device 1 and time designation information for designating a duration for giving a skin sensation to the specific position. These position designation information and time designation information Is a set of information described in time series.

  An application program for operating the electronic device 2 as an element of the skin sensation presentation system can be freely downloaded from the server device 3 via the communication network 4 by the user through the communication interface unit 28 free of charge or for a fee. . The application program transmitted from the server device 3 includes a program for operating the microcomputer 23, display information, and a signal pattern associated with the display information and user operation information.

The microcomputer 23 executes processing described in the present embodiment in accordance with a program downloaded from the server device 3 and stored in the ROM 25.
The signal pattern information may be information indicating a signal pattern set by the user with respect to the display information.

(Description of wearable device control device)
FIG. 4 is a block diagram illustrating a configuration example of the control device 12 of the wearable device 1 illustrated in FIGS. 1 and 2. The control device 12 includes a communication interface unit 120, a CPU 121, a sensor unit 122, a stimulus control unit 123, and a power supply unit 124.

The power supply unit 124 supplies power to the communication interface unit 120, the CPU 121, the sensor unit 122, and the stimulus control unit 123.
The communication interface unit 120 includes, for example, a Bluetooth communication function and a Wi-Fi communication function for communicating with the electronic device 2, and performs an appropriate process for communicating with the CPU 121.

  The CPU 121 executes processing described in the present embodiment in accordance with a program stored in an internal memory (not shown), appropriately processes a signal pattern received from the electronic device 2 via the communication interface unit 120, and outputs a signal. A function for giving a command according to a pattern to the stimulus control unit 123, a function for appropriately managing the power supply unit 124, and a sensor signal supplied from the sensor unit 122 are appropriately processed, and the communication interface unit 120 is used. The function of transmitting to the electronic device 2 is realized.

  The sensor unit 122 includes, for example, an illuminance sensor, a magnetic sensor, an acceleration sensor, a heart rate sensor, a respiration sensor, and a body temperature sensor. The illuminance, the magnitude and direction of the magnetic field detected by these sensors, acceleration, heart rate, respiration rate, A sensor signal indicating the body temperature is transmitted to the CPU 121. Note that it is not necessary to mount all of these sensors, and one or more sensors may be mounted as necessary.

  The microcomputer 23 of the electronic device 2 receives the sensor signal transmitted from the control device 12 of the wearable device 1 via the communication interface unit 28 and acquires the sensor signal and a known GPS (Global Positioning System) function. Information (for example, remaining battery level of the power supply unit 30) managed by the microcomputer 23 or the communication network 4 is estimated from the position information and the like, by estimating the user's position / posture and the user's physical condition (normal / abnormal vital signs). Context information derived from the user may be generated based on an input from the outside (for example, a WEB service) via the Internet.

  The stimulus control unit 123 generates a drive signal in accordance with a command from the CPU 121, and outputs the drive signal to the stimulus presentation unit 11 to control the stimulus presentation unit 11 to perform skin sense presentation.

(Description of wearable device)
FIGS. 5A and 5B are schematic views showing a state in which the user wears the wearable device 1, FIG. 5A is a front view of the user, and FIG. 5B is a rear view of the user. . In the example of FIGS. 5A and 5B, the control device 12 is attached to the garment 10 so that the user 100 is positioned on the upper left chest of the user 100 when wearing the garment 10 (wearable device 1). It has been.

  The plurality of stimulus presentation units 11 are arranged on the garment 10 so as to be spaced apart from each other, and are attached to the garment 10 so that each of them comes into contact with the body surface of the user 100. The plurality of stimulus presentation units 11 are electrically connected to the control device 12 via the wiring 13. 5A and 5B, only part of the wirings 13 are shown for the sake of illustration, and the remaining wirings 13 are not shown.

  In the present embodiment, as shown in FIGS. 1, 5A, and 5B, a shirt is taken as an example of the garment 10 constituting the wearable device 1, but the garment 10 is a user. What is necessary is just what can wear | wear, for example, underwear, trousers, a stomach wrap, a supporter, a band, etc. may be sufficient.

  Moreover, in this Embodiment, although the stimulus presentation part 11 and the wiring 13 shall be fixed to the clothing 10, the control apparatus 12 may be fixed to the clothing 10 and is attached or detached with respect to the clothing 10. A possible configuration may be used. 5A and 5B, the positions on the clothing 10 where the wiring 13 and the stimulus presentation unit 11 are installed (fixed) are merely examples, and FIG. 5A and FIG. It is not limited to the position shown in ().

  Next, a configuration example of the stimulus presentation unit 11 will be described with reference to FIGS. 6 and 7. FIG. 6 is a diagram schematically illustrating a cross-sectional structure of the stimulus presentation unit 11, and FIG. 7 is a diagram schematically illustrating a planar structure of the stimulus presentation unit 11. FIG. 7 illustrates a configuration in which the stimulus presentation unit 11 is viewed from the user's body side.

  The stimulus presentation unit 11 is a device that generates a skin sensation stimulus for a living body (user) based on a drive signal (for example, a voltage signal) input from the stimulus control unit 123. The stimulus presentation unit 11 is formed on the contact surface of the garment 10 with the user. That is, the stimulus presentation unit 11 is formed so as to come into contact with the skin surface of the user when the user wears the clothing 10 (wearable device 1).

  In addition, a plurality of stimulus presentation units 11 are arranged on the clothing 10 as described above. Specifically, as shown in FIGS. 5 (A) and 5 (B), when the user wears clothing 10 (wearable device 1), the stimulus presentation unit 11 is placed in a region other than the periphery of the user's heart. Are arranged evenly. The reason why the stimulus presentation unit 11 is arranged around the user's heart is to avoid applying electrical stimulation to the user's heart.

  As shown in FIGS. 6 and 7, the stimulus presentation unit 11 includes a sheet-like insulating member 101 fixed to the contact surface of the garment 10 with the user, and 2 fixed to the contact surface of the insulating member 101 with the user. The electrode 102-1 and 102-2 are comprised from the insulating member 103 fixed to the insulating member 101 so that the two electrodes 102-1 and 102-2 may be divided.

  The insulating member 101 is formed of an insulating material having moisture retention. Examples of the insulating material having moisture retention include a polyurethane material having flexibility (for example, Polyflex (registered trademark) manufactured by Poly Tape Co., Ltd.). The insulating member 103 is made of, for example, an insulating material having moisture retention similar to that of the insulating member 101.

  As a method of fixing the insulating member 101 to the garment 10, there are a method of sewing the insulating member 101 to the garment 10 or a method of fixing by bonding. The fixing method of the insulating member 103 to the insulating member 101 is also the same.

  The electrodes 102-1 and 102-2 are formed, for example, in a cloth shape from a conductive cloth material, specifically, a polymer composite material or silver-plated fiber. Here, the conductive polymer composite material is a mixture containing a conductive polymer and a binder resin. Examples of the conductive polymer include PEDOT-PSS and PEDOT-S, which are excellent in conductivity and hydrophilicity. Moreover, as a binder resin, a thermoplastic resin, a thermosetting resin, a photocurable resin etc. are used, for example, Nafion, a polycarbonate, polyethylene etc. can be illustrated. Electrodes 102-1 and 102-2 are produced by impregnating the fabric with this conductive polymer composite material.

  In the present embodiment, by using the electrodes 102-1 and 102-2 of the conductive polymer composite material in the form of cloth, the feeling of wearing is improved by the breathability and flexibility of this material, and long-term continuous wearing is possible. It becomes possible.

  In addition, in order to reduce the synthetic resistance of the user's skin and the electrodes 102-1 and 102-2, for example, glycerol, electrolyte solution, It is desirable to impregnate at least one of the ionic liquids.

Further, the silver-plated fiber used as another example of the electrodes 102-1 and 102-2 is a fiber in which a silver material is deposited on a fiber such as nylon by a known technique to have a conductive state. is there.
Examples of a method for fixing the electrodes 102-1 and 102-2 to the insulating member 101 include a method for sewing the electrodes 102-1 and 102-2 to the insulating member 101, and a method for fixing by bonding.

The two electrodes 102-1 and 102-2 function as a positive electrode terminal and a negative electrode terminal of the AC voltage, and an AC voltage (drive signal) applied between the two electrodes 102-1 and 102-2. Appropriate skin information (electrical stimulation) is given to the user.
As illustrated in FIG. 7, the electrode 102-1 and the electrode 102-2 are arranged with the insulating member 103 interposed therebetween in a plan view. Thereby, it is possible to prevent the electrode 102-1 and the electrode 102-2 from being short-circuited.

  Further, as shown in FIGS. 6 and 7, the electrodes 102-1 and 102-2 are not directly fixed to the clothing 10, but are fixed to the clothing 10 through the insulating member 101. Therefore, even if it is a case where the some stimulus presentation part 11 is arrange | positioned on the clothing 10, it can prevent short-circuiting between the stimulus presentation parts 11 mutually. The insulating member 101 can function as a moisture retaining layer that prevents evaporation of moisture contained in the electrodes 102-1 and 102-2.

  FIG. 8 shows an example of the waveform of the drive signal output from the stimulus control unit 123 to the stimulus presentation unit 11 when the skin sense information is presented. FIG. 8 shows a single period waveform of the drive signal in a single channel (one stimulus presentation unit 11). When a drive signal as shown in FIG. 8 is applied between the two electrodes 102-1 and 102-2, the voltage V, pulse width T1, bipolar pulse interval T2, and period width T3 of the drive signal are controlled by the user. Arbitrary skin sense information can be presented. In this embodiment, a set of the positive pulse having the pulse width T1 and the negative pulse having the pulse width T1 is referred to as a unit pulse signal.

  FIGS. 9A and 9B are diagrams illustrating another example of the waveform of the drive signal output from the stimulus control unit 123 to the stimulus presentation unit 11 when the skin information is presented. These are measurements of the voltage across the electrodes 102-1 and 102-2 when a drive signal generated using a known low-frequency treatment technique is applied to the human body. Here, a case is shown in which a drive signal composed of a collection of unit pulse signals having a voltage of ± 20 V and a frequency of 1.2 kHz is generated.

  The drive signal shown in FIG. 9A is composed of a collection of a plurality of unit pulse signals that are intermittently applied to the stimulus presentation unit 11. By applying the drive signal having such a waveform to the stimulus presentation unit 11, the user can feel the stimulus “smothered”.

  As described above, the microcomputer 23 of the electronic device 2 acquires operation information (position, direction, speed, contact time, etc.) obtained from the user's operation on the touch panel 21 from the touch panel control unit 22. When the user performs an operation of “grazing” on the touch panel 21, the user's multiple fingers are approaching or moving away while being in contact with the touch panel 21. Therefore, the microcomputer 23 can detect a position where a plurality of fingers of the user are in contact with the touch panel 21 and a change with time of the position.

  Then, the microcomputer 23 acquires the display information displayed on the display device 20 and the signal pattern corresponding to the user operation information acquired from the touch panel control unit 22 from the display information recording unit 27. In the signal pattern, the information on the position on the touch panel 21 touched by the user's finger is converted into the position specifying information for specifying the position on the corresponding wearable device 1, and the user touches the same position on the touch panel 21. The duration information is converted into time designation information for designating a duration for giving a stimulus to the position on the wearable device 1 designated by the position designation information.

  As described above, since the position on the touch panel 21 touched by the user's finger changes with time, if a signal pattern in which the set of position designation information and time designation information changes with time is prepared, Skin sense information corresponding to an operation performed on the touch panel 21 of the electronic device 2 by the user can be presented to the user through the stimulus presentation unit 11.

  The drive signal shown in FIG. 9B has a waveform in which a wave packet 50 composed of a plurality of unit pulse signals is repeatedly applied. By applying the drive signal having such a waveform to the stimulus presentation unit 11, the user can feel a stimulus “weared”.

  A method for creating a signal pattern in the electronic apparatus 2 is the same as that in the case of FIG. The difference from FIG. 9A is that the duration of the time when the user's finger is touching one place on the touch panel 21 of the electronic device 2 is longer than that in the case of FIG. The number of pulse signals is larger than that in the case of FIG.

When the CPU 121 of the control device 12 of the wearable device 1 receives the signal pattern from the electronic device 2 via the communication interface unit 120, the stimulus existing at the position on the wearable device 1 specified by the position specifying information included in the signal pattern. The presentation unit 11 is selected, and the stimulus presentation unit 11 outputs a command to the stimulation control unit 123 so as to give the skin sense stimulus to the user for the duration specified by the time designation information included in the signal pattern.
The stimulus control unit 123 generates a drive signal as described above in accordance with a command from the CPU 121, and outputs this drive signal to the stimulus presentation unit 11 selected by the CPU 121.

  The drive signal may be applied to all the stimulus presentation units 11 provided in the wearable device 1 in the same manner, or may be applied only to a part of the stimulus presentation units 11. Good.

  For example, when the user touches the touch panel 21 of the electronic device 2 with a plurality of fingers, the operation information of the user acquired from the touch panel control unit 22 by the microcomputer 23 of the electronic device 2 includes a plurality of pieces of position information (touched by the user's finger). Position information of a plurality of locations). In this case, the microcomputer 23 may generate a signal pattern for each position information. In accordance with these signal patterns, the CPU 121 of the control device 12 of the wearable device 1 outputs the above-described command for the stimulus control unit 123 for each signal pattern.

Next, an example in which a drive signal is applied with a time difference for the plurality of stimulus presentation units 11 will be described.
FIG. 10A is a diagram schematically showing skin sensation stimulation given to the user, and FIG. 10B is a diagram showing a waveform example of a drive signal corresponding to the skin sensation stimulation of FIG. 10A. FIG. 10 (A) shows a skin sensation that gently rubs the user's waist around the user's waist in the direction from 11-C, 11-F to the stimulus presentation units 11-A, 11-D arranged in the wearable device 1. The case where a stimulus is given is shown.

  In order to give a skin sensation stimulus as shown in FIG. 10 (A), as shown in FIG. 10 (B), the drive signal applied to the stimulus presentation units 11-A and 11-D and the stimulus presentation units 11-B and 11 A time difference is provided between the drive signal applied to -E and the drive signal applied to the stimulus presentation units 11-B and 11-E and the drive signal applied to the stimulus presentation units 11-C and 11-F. A drive signal may be applied in order along the direction of skin sensation stimulation from the user's back to the lumbar region. As described above, the position, direction, and speed at which skin stimulation is applied are determined by the operation performed by the user on the touch panel 21 of the electronic device 2.

  11A schematically shows another example of skin sensation stimulation given to the user, and FIG. 11B shows a waveform example of a drive signal corresponding to the skin sensation stimulation of FIG. 11A. FIG. In contrast to FIG. 10A, FIG. 11A shows the user in the direction of the stimulus presentation units 11-C and 11-F arranged in the wearable device 1 toward 11-A and 11-D. It shows the case of applying skin sensation that gently rubs around the waist.

  In order to give a skin sensation stimulus as shown in FIG. 11A, as shown in FIG. 11B, a drive signal applied to the stimulus presentation units 11-C and 11-F and the stimulus presentation units 11-B and 11 A time difference is provided between the drive signal applied to -E and the drive signal applied to the stimulus presentation units 11-B and 11-E and the drive signal applied to the stimulus presentation units 11-A and 11-D. A drive signal may be applied in order along the direction of skin sense stimulation from the user's waist to the back, such as providing a time difference.

  12A schematically shows another example of skin sensation stimulation given to the user, and FIG. 12B shows a waveform example of a drive signal corresponding to the skin sensation stimulation of FIG. 12A. FIG. 12A shows the directions of the stimulus presentation units 11-A, 11-D to 11-B, 11-E and the stimulus presentation units 11-C, 11-F to 11-B, which are arranged in the wearable device 1. FIG. The case is shown in which a skin sensation stimulus is given to the user in the direction 11-E, that is, from the top and bottom to the center of the waist.

  In order to give a skin sensation stimulus as shown in FIG. 12 (A), as shown in FIG. 12 (B), drive signals applied to the stimulus presentation units 11-A, 11-C, 11-D, and 11-F; A time difference is provided between the stimulus presentation units 11-B and 11-E and the drive signals applied to the stimulus presentation units 11-B and 11-E. What is necessary is just to apply a drive signal in order.

  13A schematically illustrates another example of skin sensation stimulation given to the user, and FIG. 13B illustrates a waveform example of a drive signal corresponding to the skin sensation stimulation of FIG. 13A. FIG. In FIG. 13A, contrary to the case of FIG. 12A, directions of stimulus presentation units 11 -B and 11 -E to 11 -A and 11 -D and stimulus presentation units arranged in the wearable device 1. It shows a case where skin stimulation is given to the user in the direction of 11-B, 11-E to 11-C, 11-F, that is, gently and gently rubbing upward and downward from the waist center.

  In order to give a skin sensation stimulus as shown in FIG. 13A, as shown in FIG. 13B, a drive signal applied to the stimulus presentation units 11-B and 11-E and the stimulus presentation units 11-A and 11 -C, 11-D, 11-F are provided with a time difference from the drive signal applied to the user, such as from the center of the user's waist to the back, and at the same time along the direction of skin sense stimulation from the center of the waist to the buttocks. What is necessary is just to apply a drive signal in order.

  In the above description, the method of presenting skin sensation stimulation by the six stimulus presentation units 11 has been described. Needless to say, when six or more stimulation presentation units 11 are used, various skin sensation stimulations can be presented.

(Explanation of user operations)
User operations on the electronic device 2 will be described with reference to FIGS. In the present embodiment, the display information is provided by an application program capable of displaying an image on the electronic device 2 and controlling the stimulus presentation unit 11 of the wearable device 1 in accordance with a user operation on the electronic device 2, for example. Information.

  11A and 11B show an example of an image displayed on the display device 20 of the electronic device 2 in accordance with the display information provided by the application program. In this application program, the wearable device 1 in a state worn by the user 100 is displayed on the electronic device 2 so that the user 100 can intuitively recognize the position where the skin sensation is presented.

  Here, an example in which the user operates the touch panel 21 with a finger will be described. However, the input unit may be not only a finger but another member such as a pen. The method for the user to operate the touch panel 21 with a finger includes an operation of one-clicking the touch panel 21, an operation of double-clicking the touch panel 21 with a finger, an operation of moving the finger by flicking the finger on the touch panel 21, The operation is generally divided into an operation of moving without releasing, an operation of closing two open fingers, and an operation of opening two closed fingers.

  Here, when operating the touch panel 21 of the electronic device 2 with the user's finger and giving the user a skin sensation according to the operation, the user moves the touch panel 21 without releasing the finger from the above operation methods. Since the operation is suitable, in this embodiment, processing is performed so that the characteristics of this operation can be utilized. The operation of moving the electronic device 2 without releasing the finger from the touch panel 21 is hereinafter referred to as a tracing operation.

  The user's tracing operation is an operation of touching the touch panel 21 of the electronic apparatus 2 with a finger and then sliding the finger up and down, left and right on the touch panel 21 to release the finger from the touch panel 21 at an arbitrary place. For example, the tracing operation is performed when a skin sensation in a desired direction is input to a desired position on the surface of the user's body by tracing the wearable device 1 displayed on the display device 20 as shown in FIG. It is.

  As described above, FIGS. 11A and 11B show a state where the wearable device 1 worn by the user 100 is displayed on the display device 20 of the electronic device 2 after the application is started. Yes. FIG. 11A shows a state when the user 100 places a finger on the image of the wearable device 1 displayed on the display device 20. FIG. 11B shows a state in which the user 100 performs a tracing operation in the direction of the arrow on the image of the wearable device 1 displayed on the display device 20.

  In this example, the user 100 performs a tracing operation on the image (touch panel 21) displayed on the display device 20 of the electronic device 2 from the state of FIG. 11A to the state of FIG. FIG. 11C shows that each stimulus presentation unit 11 corresponding to a position where the user 100 touches the touch panel 21 gives a skin stimulus to the user 100 in order from the state of FIG. 11C to the state of FIG. Yes.

  FIG. 15 is a flowchart for explaining the operation of the skin sense presentation system of the present embodiment. When the application is activated, the display information control unit 24 of the electronic device 2 displays an image corresponding to the display information on the display device 20 (step S1 in FIG. 15). When the user operates the touch panel 21 of the electronic device 2 (step S2 in FIG. 15), the microcomputer 23 of the electronic device 2 displays the signal pattern corresponding to the display information and the operation information of the user on the control device of the wearable device 1. 12 (step S3 in FIG. 15).

  CPU121 of the control apparatus 12 of the wearable apparatus 1 outputs the instruction | command according to a signal pattern to the stimulus control part 123 (FIG. 15 step S4). The stimulus control unit 123 outputs a drive signal corresponding to the command from the CPU 121 to the stimulus presenting unit 11 (step S5 in FIG. 15). Until the application ends (YES in step S6 in FIG. 15), the processes in steps S2 to S5 are repeatedly executed. Details of the operation of each part are as described above.

  Thus, in this embodiment, it is possible to realize a system that can be easily used by the user when going out and the like, and it is possible to give the user a skin sensation according to any user operation.

[Second Embodiment]
Next, a second embodiment of the present invention will be described with reference to FIGS. FIG. 16 is a diagram showing a use image of the skin sensation presentation system according to the present embodiment, and FIG. 17 is a block diagram showing a configuration of the entire skin sensation presentation system according to the present embodiment.

  In the present embodiment, as shown in FIG. 16, a usage image when there are two users will be described. In this case, the electronic device 2-1 possessed by the user 100-1 and the control device 12-2 incorporated in the wearable device 1-2 worn by the user 100-2 are possessed by the user 100-2. The stimulus presentation unit 11-2 of the wearable device 1-2 is linked via the electronic device 2-2, and the user 100-1 performs a tracing operation on the display image 200-1 (touch panel 21) of the electronic device 2-1. Provides a skin sensation stimulus to the user 100-2.

  Similarly, the electronic device 2-2 possessed by the user 100-2 and the control device 12-1 incorporated in the wearable device 1-1 worn by the user 100-1 are possessed by the user 100-1. The stimulus presentation unit 11-1 of the wearable device 1-1 is linked via the electronic device 2-1, and the user 100-2 performs a tracing operation on the display image 200-2 (touch panel 21) of the electronic device 2-2. Provides a skin sensation stimulus to the user 100-1.

  As shown in FIG. 17, the electronic device 2-1 of the user 100-1 and the electronic device 2-2 of the user 100-2 can be paired bidirectionally by a known Bluetooth communication or the like. . Alternatively, the electronic devices 2-1 and 2-2 may be linked via the communication network 4.

  17, a1 and a2 represent drive signals applied to the stimulus presentation units 11-1 and 11-2 from the control devices 12-1 and 12-2 of the wearable devices 1-1 and 1-2, and b1 and b2 It represents information exchanged between the electronic devices 2-1 and 2-2 and the control devices 12-1 and 12-2, and c represents information exchanged between the electronic devices 2-1 and 2-2. D represents information exchanged between the electronic device 2-1 and the communication network 4, and e represents information exchanged between the electronic device 2-2 and the communication network 4.

  As in the first embodiment, the operation of the skin sensation presentation system according to the present embodiment is defined by an application program. In the present embodiment, the user 100-1 is placed on the touch panel 21 of the electronic device 2-1. When the operation is performed, the microcomputer 23 of the electronic device 2-1 transmits a signal pattern corresponding to the display information and the user operation information to the linked electronic device 2-2.

  When the microcomputer 23 of the electronic device 2-2 receives the signal pattern from the transmission source electronic device 2-1, the microcomputer 23 transmits the signal pattern to the control device 12-2 of the wearable device 1-2 corresponding to the own device.

  Similarly, when the user 100-2 operates the touch panel 21 of the electronic device 2-2, the microcomputer 23 of the electronic device 2-2 links the display information and the signal pattern corresponding to the user operation information. Transmit to the previous electronic device 2-1.

When the microcomputer 23 of the electronic device 2-1 receives the signal pattern from the transmission source electronic device 2-2, it transmits this signal pattern to the control device 12-1 of the wearable device 1-1 corresponding to its own device.
The operation in each of the wearable devices 1-1 and 1-2 is as described in the first embodiment.

  In the first embodiment, an operation performed by one user can be reflected on the wearable device worn by the user himself. However, in the present embodiment, operations performed by two users respectively. Can be reflected in the wearable device of the other user and the skin sensation can be presented.

[Third Embodiment]
Next, a third embodiment of the present invention will be described with reference to FIG. FIG. 18 is a block diagram showing a configuration of the entire skin sense presentation system according to the present embodiment. 18, a1, a2, and a3 are the stimulus presentation units 11-1, 11-2, and 11- from the control devices 12-1, 12-2, and 12-3 of the wearable devices 1-1, 1-2, and 1-3. 3, b1, b2, and b3 are exchanged between the electronic devices 2-1, 2-2, 2-3 and the control devices 12-1, 12-2, 12-3. C represents information exchanged between the electronic device 2-1 and the communication network 4, e represents information exchanged between the electronic device 2-2 and the communication network 4, and f represents The information exchanged between the electronic device 2-3 and the communication network 4 is represented, and d represents the information exchanged between the server device 3 and the communication network 4.

  In the present embodiment, three electronic devices 2-1, 2-2 and 2-3 are linked to each other via the communication network 4, and each of the electronic devices 2-1, 2-2 and 2-3 is linked. Can transmit skin information to each other's users.

In the case of the present embodiment, a destination electronic device 2 (wearable device 1) to which a certain electronic device 2 transmits a signal pattern may be determined in advance by an application program installed in each electronic device 2, or skin A user who wants to transmit visual information operates the electronic device 2 to designate a destination user, and the signal pattern may be transmitted to the electronic device 2 (wearable device 1) of the destination user.
Since the configuration and operation of each electronic device 2 and each wearable device 1 are the same as those in the first and second embodiments, detailed description thereof is omitted.

In FIG. 14, three electronic devices 2 are taken as an example, but it goes without saying that four or more electronic devices 2 may participate in the skin sense presentation system.
As described above, if the application program is downloaded from the server device 3 and the application is activated, the electronic device 2 can participate in the skin sensation presentation system. On the other hand, when the application is terminated, the electronic device 2 is detached from the skin sense presentation system.

  As described above, in the first to third embodiments, it has been mainly described that the drive signal is transmitted to the plurality of stimulus presentation units 11 provided in the wearable device 1 worn by the user, but the wearable device 1 is provided. Needless to say, the first to third embodiments may be applied to known tactile actuators other than the plurality of stimulus presentation units 11.

  The skin sense presentation system according to the present invention can be widely used as a skin sense presentation means capable of easy interaction in a wide range of fields such as a human interface.

  DESCRIPTION OF SYMBOLS 1 ... Wearable apparatus, 2 ... Electronic device, 3 ... Server apparatus, 10 ... Clothing, 11 ... Stimulus presentation part, 12 ... Control apparatus, 13 ... Wiring, 20 ... Display apparatus, 21 ... Touch panel, 22 ... Touch panel control part, 23 DESCRIPTION OF SYMBOLS ... Microcomputer, 24 ... Display information control part, 25 ... ROM, 26 ... RAM, 27 ... Display information recording part, 28, 120 ... Communication interface part, 29 ... Various I / O part, 30, 124 ... Power supply part, 100 ... User, 101, 103 ... Insulating member, 102-1, 102-2 ... Electrode, 121 ... CPU, 122 ... Sensor part, 123 ... Stimulation control part.

Claims (6)

A skin sense presentation system comprising an electronic device and a wearable device,
The electronic device is
Input means for accepting user operations;
Signal pattern generation means for generating a signal pattern corresponding to a user operation;
Communication means for transmitting the signal pattern to the wearable device;
The wearable device is
A plurality of stimulus presentation means attached to clothing to contact the user's body surface;
Wherein mounted on the garment, possess at least one of said stimulus presentation means, and a control device for providing a user the skin perception stimulated by applying a driving signal corresponding to the signal pattern transmitted from the electronic device,
The electronic device is
A display device;
Display information control means for causing the display device to display an image according to display information,
The input means is a touch panel arranged in combination with the display device,
The signal pattern generation unit generates the signal pattern corresponding to the display information and user operation information in accordance with an operation performed by the user on the touch panel,
The signal pattern includes at least position designation information for designating a position on the wearable device corresponding to a position designated by a user by operating the input unit,
The display information control means causes the display device to display an image of the wearable device worn by a user based on the display information . The skin sensation presentation system according to claim 1 ,
Furthermore, a server device is provided,
The signal pattern generation means of the electronic device receives an application program including the display information and a signal pattern associated with the display information and user operation information from the server device, and the signal based on the application program A skin sense presentation system characterized by generating a pattern. The skin sensation presentation system according to claim 1 or 2 ,
Each of the plurality of stimulus presentation means of the wearable device includes at least a pair of electrodes attached to clothing so as to contact the user's body surface;
The control device of the wearable device selects a stimulus presentation unit corresponding to the signal pattern from the plurality of stimulus presentation units, and applies the drive signal between the pair of electrodes of the selected stimulus presentation unit. Dermatology presentation system featuring. The skin sensation presentation system according to claim 3 ,
Each of the plurality of stimulus presentation means of the wearable device,
Furthermore, a first insulating member that is disposed between the clothing and the pair of electrodes and is made of an insulating material having moisture retention,
A skin sensation presentation system comprising: a second insulating member that is disposed between the pair of electrodes and made of an insulating material having moisture retention. The skin sense presentation system according to claim 3 or 4 ,
Each of the pair of electrodes is made of a fabric impregnated with PEDOT-PSS. The skin sense presentation system according to any one of claims 1 to 5 ,
A plurality of the electronic devices possessed by a plurality of users;
A plurality of wearable devices worn by a plurality of users;
The communication means of each electronic device further includes a function of bidirectional communication directly between electronic devices or a function of bidirectional communication between electronic devices via a communication network,
The communication means of the transmission source electronic device that transmits the signal pattern is a transmission destination designated by a predetermined transmission destination electronic device or a user of the own device using the signal pattern generated by the signal pattern generation unit of the own device. To the electronic device
The skin sense presentation system, wherein the communication means of the transmission destination electronic device transmits a signal pattern received from the transmission source electronic device to the wearable device corresponding to the own device.