JP4456434B2 - Tactile display - Google Patents

Description

The present invention relates to a tactile display equipment to convey information tactilely represents a two-dimensional graphic of the concavo-convex shape by protruding the tactile pins from the flat operating surface.

  2. Description of the Related Art Conventionally, development has been carried out to convey to a visually handicapped person object information shown as a visually recognizable visual object such as an icon in a GUI (Graphical User Interface) environment of a computer or a digital terrestrial broadcast screen. ing. And the tactile information transmission apparatus which has a tactile pin for conveying the object information by the visual object on a screen to an operator is disclosed (for example, refer patent document 1).

  This tactile information transmission device converts and presents object information into a tactile object that can be tactilely recognized on a two-dimensional plane based on the result of the tactile drive of the tactile pin, and includes the following means: .

  That is, the tactile information transmission device includes object conversion means for converting a shape representing a visual object into abstract graphic information, and the graphic information converted by the object conversion means as a tactile object on a two-dimensional plane. A tactile display that presents a three-dimensional shape by means of unevenness, a photographing means for photographing the presenting area of the tactile display, and an operator on the presenting area of the tactile display based on a video signal photographed by the photographing means An indication position detection means for detecting the indication position indicated by the object, an object detection means for detecting a tactile object existing at the indication position based on the indication position detected by the indication position detection means, and selection of the tactile object Selection instruction means for instructing the tactile object by the selection instruction means When the-object is selected, and a, and an object selection command means for generating a selection result signal indicating that the visual object is selected corresponding to the haptic object.

For this reason, the tactile information transmission device can recognize the content indicated by the tactile object by directly touching the tactile object that is three-dimensionally expressed in the two-dimensional plane with the tactile pin presented on the tactile display. it can. Then, the position of the tactile pin indicated by the operator is recognized by the video signal taken from the photographing means, and the selection instruction signal is sent from the tactile display to the control device by the switch as the selection instruction means, thereby selecting the tactile display. Can do. For this reason, the tactile information transmission device can access information indicated by the tactile object even for visually impaired persons, and can grasp the entire configuration of the menu screen presented on the tactile display. A necessary object can be easily selected from existing objects.
JP 2003-241891 A (paragraph numbers 0031 to 0088, FIGS. 1 to 8)

  However, the conventional tactile display or tactile information transmission device has a point to be further improved. That is, the conventional tactile display or tactile information transmission device detects the position of the operator's finger on the tactile display by imaging the position of the finger with the imaging means. For this reason, the imaging means is disposed at a position overlooking the entire tactile display, which may limit the movement of the operator's arm, and has been demanded to make the configuration easier to use.

When detecting the position of a finger by a tactile display or a tactile information transmission device, a specific color is applied to the nail surface to identify the color of the fingernail surface. Since preparation is required, a configuration that does not require preparation work has been desired.
In addition, since the tactile display or the tactile information transmission device identifies the color of the fingernail surface by the imaging means, it may be affected by optical disturbances, and the finger position may not be detected correctly. There was a need for further improvements.

The present invention was devised in view of the above requirements, does not restrict the movement of the operator's arm, does not require preparation such as coloring the nail surface, and has always been operated correctly by the finger. It is an object to provide a tactile display device capable of detecting a position.

  In order to solve the above-described problem, the tactile display device according to the present invention can recognize the three-dimensional shape represented by the tactile pin based on the result of the protruding state of the tactile pin arranged vertically and horizontally on the planar operation surface. In the tactile display device, the tactile display device includes a first film layer disposed so as to face the operation surface, and a second film layer disposed so as to face the first film layer and be spaced apart via an insulating layer. The tactile pin provided in the second film layer, the insulating layer, and the first film layer so as to freely protrude and retract through a through hole, and a switch mechanism provided between the first film layer and the second film layer, The switch mechanism is spaced apart from the first wiring portion provided in the first film layer at a position adjacent to each other along each column of the tactile pins. A second wiring portion provided on the second film layer at a position adjacent to each other along each row of the tactile pins, and each intersection point where the second wiring portion and the first wiring portion face each other. It has a short circuit part provided in each of both wiring parts.

  In the tactile display device configured as described above, when the operator does not select the tactile object, that is, when the operation surface is not pressed with a certain force or more, the short-circuit portion of the switch mechanism causes the first wiring portion and the second wiring portion to move. The separated state is maintained through the insulating layer for separation. In addition, when a tactile object converted from a visual object is presented by a tactile pin, the tactile object that is three-dimensionally shown by unevenness as a result of the drive of the tactile pin on the operation surface is displayed by the operator's finger. By pressing the tactile pin and pressing the operation surface with a predetermined pressing force, the tactile pin is short-circuited at the intersection of the first wiring portion and the second wiring portion located in the column and the row, and the position Is shown as a pressed position.

  Further, the tactile display device according to the present invention is the tactile display device capable of tactile recognition of the shape represented by the tactile pin based on the protruding state of the tactile pins arranged vertically and horizontally on a planar operation surface. The display device includes a first film layer disposed to face the operation surface, a second film layer disposed to face and separate from the first film layer, the second film layer, and the first film layer. A tactile pin provided so as to be able to move in and out through a through hole, and a switch mechanism provided between the first film layer and the second film layer, and the switch mechanism is arranged along each column of the tactile pins. The first wiring part provided in the first film layer at a position adjacent to the first wiring part, and a position adjacent to the first wiring part along each row of the tactile pins. A second wiring portion provided in the second film layer, a short-circuit portion provided in each of the wiring portions at each intersection position where the second wiring portion and the first wiring portion face each other, and the short-circuit portion exposed. In this state, an insulating layer provided on at least one of the first wiring portion and the second wiring portion is provided.

  In the tactile display configured as described above, when the operator does not select a tactile object, the state in which the short-circuit portion of the switch mechanism is separated through the insulating layers provided in the first wiring portion and the second wiring portion is maintained. Also, by pressing the tactile pin with the operator's finger and pressing the intersection position of the first wiring part and the second wiring part facing the operation surface with a force of a certain level or more, the short circuit part is short-circuited, The position is shown as a pressed position.

  Furthermore, in the tactile display device according to the present invention, the switch mechanism includes a first wiring current detection unit having a detection unit provided in each of the first wiring units, and a detection unit provided in each of the second wiring units. And second intersection current detection means for calculating the position of the short-circuit portion based on the current detection position detected by the second wiring current detection means and the first wiring current detection means. .

  The tactile display device configured as described above is short-circuited by pressing the tactile pin with an operator's finger and pressing the intersection position of the first wiring part and the second wiring part that further face the operation surface with a certain force or more. When the part is short-circuited, the current of the short-circuit part short-circuited by the first wiring current detection means and the second wiring current detection means is detected via each detection part. Note that the current of the short-circuit portion is detected by generating a current when the short-circuit portion is short-circuited, for example, by configuring each detection unit to be connected via a power source. When the current that flows when the short-circuit portion is short-circuited is detected, the position of the short-circuit portion short-circuited from both wiring current detection means is calculated by the intersection coordinate detection means, and the indicated position coordinate information corresponding to the selected tactile pin is obtained. Is output.

The tactile display device according to the present invention may use a tactile information transmission device having the following configuration. That is, the tactile information transmission device presents one or more selectable visual objects that are visualized and displayed on the screen in the form of tactile objects that are previously recognized by the tactile pins of the tactile pins that are recognized by the tactile sense of the operator. The tactile pins arranged vertically and horizontally on a planar operation surface with respect to text data corresponding to the tactile object and input data including at least object coordinate information corresponding to the tactile object are included as data. In the tactile information transmission device that presents the tactile object using the tactile display device that has the tactile display device, the tactile information transmission device includes an object extracting unit, a storage unit, a tactile object presenting unit, and an object collating unit.

  The tactile information transmission device configured as described above is based on received digital broadcasting (ISDB: Integrated Services Digital Broadcasting) or XML (eXtensible Markup Language) BML (Broadcast Markup Language) developed for multimedia coding. The object extracting means extracts the tactile object, the text data corresponding to the tactile object, and the object coordinate information corresponding to the tactile object from the input data by broadcasting or communication. The tactile information transmission apparatus stores the extracted tactile object shape data (tactile object), text data, and the object coordinate information in the storage unit. Further, the tactile information transmission device causes the tactile object presenting means to present the tactile object in a three-dimensional shape with unevenness of the tactile pin, and the object collating means pushes the tactile pin corresponding to the tactile object presented by the operator. Then, the tactile object selected by depressing the switch mechanism provided along the operation surface at the position is collated with the tactile object of the storage means. When the tactile object is collated, identification information for identifying the tactile object is output from the tactile object collating means.

The tactile display device according to the present invention may use a tactile information transmission device having the following configuration. That is, the tactile information transmission device includes visual image data indicating types of one or more selectable visual objects that are visualized and displayed on the screen, text data corresponding to the visual objects, and visual objects. Tactile recognition of the visual object by a tactile display device that presents a three-dimensional shape as a result of the protruding state of tactile pins arranged vertically and horizontally on a planar operation surface with respect to input data including at least corresponding object coordinate information In the tactile information transmission device that converts and presents a tactile object that can be displayed, an object extracting unit, an object converting unit, a storage unit, a tactile object presenting unit, and an object collating unit are provided.

  With this configuration, the tactile information transmission device extracts visual image data, text data, and object coordinate information from the input data by the object extraction unit, and the conversion condition set in advance by the object conversion unit. The visual image data is converted into a tactile object to be presented as a tactile shape of a tactile pin as graphic information. The converted haptic object is stored in the storage unit together with the text data and the object coordinate information. Further, the tactile information transmission device causes the tactile object presenting means to present the tactile object in a three-dimensional shape with unevenness of the tactile pin, and the object collating means pushes the tactile pin corresponding to the tactile object presented by the operator. Then, the tactile object selected by depressing the switch mechanism provided along the operation surface at the position is collated with the tactile object of the storage means. When the tactile object is collated, identification information for identifying the tactile object is output from the tactile object collating means.

The present invention has the following excellent effects.
In the tactile display device according to the first and second aspects of the present invention, since the tactile display device is provided with a switch mechanism along the vertical and horizontal rows of the tactile pins directly below the operation surface and facing the operation surface, the tactile pins are arranged vertically and horizontally. Arranged and projecting, there is nothing that hinders the operator's operation around the operation surface, and the position of the tactile object selected by the switch mechanism can be stabilized by pressing the operation surface Identification, that is, direct input (intention display) by pressing the operation surface is enabled. In addition, the tactile display device has a configuration in which an insulating layer is provided on at least one of the first wiring portion and the second wiring portion of the switch mechanism so that the insulating layer is provided separately from both wiring portions. The number of parts can be reduced and the manufacturing process can be simplified.

  According to a third aspect of the present invention, the tactile display device includes the first and second wiring current detection means and the intersection coordinate detection means. The indication position information of the tactile object selected by the operator can be output without coloring. In addition, the tactile display device can identify one location of the short-circuited part that is short-circuited first by the intersection coordinate detection means even when the interval between the tactile pins is narrow. it can.

  The best mode for carrying out the present invention will be described below with reference to the drawings. 1 is a plan view showing a haptic information transmission device and a haptic display device, FIG. 2 is a block diagram showing the entire structure of the haptic information transmission device and the haptic display device, and FIG. 3 is a schematic diagram of the entire haptic display device of the haptic information transmission device. 4 is an exploded perspective view showing a configuration of a tactile display device of the tactile information transmission device, and FIGS. 5A and 5B are a switch mechanism and a tactile pin in the tactile display device of the tactile information transmission device. FIG. 6 is a block diagram showing first wiring current detection means, second wiring current detection means, and intersection point coordinate detection means of the tactile display device.

  As shown in FIG. 1 and FIG. 2, the haptic information transmission device 1 outputs a voice as a haptic display device 2 for displaying an input visual object as a haptic object and a result of operating the haptic display device 2. Voice output device 8, a Braille display device 9 for outputting Braille, and a control device 10 for controlling each device.

  This tactile information transmission device 1 is a broadcasting service called BML (Broadcast Markup Language) developed for multimedia coding based on Integrated Services Digital Broadcasting (ISDB) or XML (eXtensible Markup Language). Alternatively, visual image data indicating types of one or more selectable visual objects that are visualized and displayed on the screen, text data corresponding to the visual objects, and object coordinate information corresponding to the visual objects A visually selectable object (visual object) such as a menu screen used in communication data that is input data including at least a tactile sensation by a three-dimensional shape as a result of a protruding state of the tactile pins 3 arranged on a plane. Expressing and tactilely expressing objects ( This is a device that makes it possible to select a tactile object) with a part such as a finger.

  As shown in FIGS. 1 and 3, the tactile display device 2 includes a tactile pin 3 in which a plurality of tactile pins are arranged vertically and horizontally on the operation surface, and a switch mechanism 4 provided along each column and each row of the tactile pins. Here, the Braille display device 9 and the audio output device 8 are provided integrally around the tactile pins 3. In addition, the operation surface of the tactile display device 2 refers to a planar portion in a state where the tactile pins 3 do not protrude, and here refers to a plane formed by the cover film 3B.

  As shown in FIG. 1 and FIG. 5, the tactile pins 3 are provided so as to be able to appear and retract in alignment with the operation surface in the vertical and horizontal directions. For example, the tactile pins 3 are formed in a cylindrical shape having a diameter of 1 to 2 mm, and are arranged vertically and horizontally at an installation interval of 2.5 to 4 mm so as to protrude between about 1 to 3 cm from the operation surface. It is configured. Then, the moving operation of the contact pin 3 is configured to be performed via a drive mechanism such as a piezoelectric bimorph actuator 3A, for example.

  The piezoelectric bimorph actuator 3A is subjected to an operation in which one surface of the piezoelectric bimorph 3C contracts by applying a voltage, and at the same time, the other surface expands, thereby bending the piezoelectric bimorph. Thus, the tactile pin 3 appears and disappears. The piezoelectric bimorph actuator 3A is configured to allow the operator to forcibly push in the tactile pin 3 after the tactile pin 3 protrudes from the operation surface to present the tactile object. The tactile pin 3 protruding from the operation surface is bent by such a force that the piezoelectric bimorph 3C is forced to be pushed when a force larger than the force by which the piezoelectric bimorph 3C is bent by the voltage is applied. Is protruding. However, since the piezoelectric bimorph actuator 3A is in a state where a voltage is applied so that the target tactile pin 3 always protrudes upward so that the same form can be maintained until the next tactile object, it is once forcedly pushed in. The tactile pin 3 is projected immediately.

  When the tactile pin 3 is pressed to activate a switch mechanism 4 to be described later and the tactile object presented by the tactile pin 3 is set to change to the next figure (tactile object), the tactile sense When the pin 3 is pushed by the operator and protrudes from the operation surface again, the pin 3 indicates the tactile object presented as a result of the selection.

  As shown in FIGS. 1 and 4, the switch mechanism 4 includes a first film layer 4 a disposed facing the operation surface, and a second film layer 4 b disposed facing the first film layer 4 a. The first wiring portion 4d provided on the first film layer 4a along each column of the tactile pins 3 and the respective rows of the tactile pins 3 facing the first wiring portion 4d. The second wiring portion 4e provided on the second film layer 4b along the insulating layer 4c for separating the second wiring portion 4e and the first wiring portion 4d, and the insulating layer 4c, Short circuit portions 4g and 4h provided at intersection positions where the first wiring portion 4d and the second wiring portion 4e face each other.

  The first film layer 4a is arranged to face the cover film 3B (operation surface) that is directly touched by the operator's finger, and has a through hole corresponding to the installation position of the tactile pin 3, and is made of PET (polyester terephthalate). ) And a film material such as nylon. The first film layer 4a may also be used as the cover film 3B that is directly contacted by the operator's finger. The first film layer 4a may be a resin having an insulating property, and when the operator presses the operation surface, the pressed portion is once bent and deformed to restore the original state again. It is desirable that the elastic body is provided. Here, the 1st film layer 4a is formed by the thickness of 0.025 mm as an example.

  The 2nd film layer 4b is attached to the top plate side which accommodates the piezoelectric bimorph actuator 3A, and the through-hole is formed corresponding to the installation position of the tactile pin 3. The second film layer 4b is formed of a film material such as PET (polyester terephthalate) or nylon. The second film layer 4b may be formed of an elastic body equivalent to the first film layer 4a, or may be a hard resin having no restoring force. Here, the 2nd film layer 4b is formed by the thickness of 0.025 mm as an example.

  4 d of 1st wiring parts are formed in the strip shape in the 1st film layer 4a, and are formed in the position which adjoins along each column of the tactile pin 3. The first wiring portion 4d is formed with a short-circuit portion 4g at a position between the tactile pins 3 and 3, that is, an intersection position facing the second wiring portion 4e described later, and other than the short-circuit portion 4g. In the portion, an insulating film may be formed so as not to conduct to the surface. Here, as an example, the first wiring portion 4d is formed in a state where the width is 0.6 mm, the thickness is 0.035 mm, and there is no insulating film.

  The second wiring part 4 e is formed in a strip shape on the second film layer 4 b and is formed at a position adjacent to each other along each row of the tactile pins 3. The second wiring portion 4e is formed with a short-circuit portion 4h at a position between the tactile pins 3 and 3, that is, at an intersection position facing the first wiring portion 4d, and a portion other than the short-circuit portion 4h. Then, an insulating film may be formed so as not to conduct. Here, the 2nd wiring part 4e demonstrates as the state which formed the insulating film in surface parts other than the short circuit part 4h. As an example, the second wiring portion 4e has a width of 0.5 mm and a thickness of 0.01 mm, a short-circuit portion 4h having a width of 0.5 mm, and an insulating film formed between the short-circuit portions 4h and 4h. did.

  Moreover, both the wiring parts 4d and 4e use the conductive ink containing conductive particles, such as silver and carbon (carbon), and each film layer 4a at regular intervals in a strip shape by a printing method such as a screen printing method. You may form in 4b. In addition, both the wiring portions 4d and 4e are formed as compound layers made of any one of gold, platinum, chromium, indium, silver, copper, and aluminum as a strip-like conductive layer or a composite material, and are formed on the respective film layers 4a and 4b. It may be formed. As an example of a method for obtaining this conductive layer, the metal other than the conductive layer is masked, and a metal is laminated using a known film forming technique such as a sputtering method, an ion plating method, a vacuum deposition method, or a plating method.

  When the first wiring portion 4d is provided with an insulating film and the short-circuit portion 4g is provided, the second wiring portion 4e may be provided with the short-circuit portion 4h without providing an insulating film. When the short circuit portion 4g is provided without providing the insulating film in the one wiring portion 4d, the second wiring portion 4e may be formed so as to provide the short circuit portion 4h by providing an insulating film. Furthermore, the insulating film may not be formed at all on the portions other than the short-circuit portion 4h of the second wiring portion 4e and the short-circuit portion 4g of the first wiring portion 4d.

  As shown in FIG. 4, the insulating layer 4 c has the short-circuit portions 4 g and 4 h in a state where the operator does not operate the operation surface or a state where a force smaller than a preset pressing force is applied to the operation surface. This is to prevent contact. The insulating layer 4c will be described here as being formed as a separate member from the wiring portions 4d and 4e. The insulating layer 4c is formed in a width that can open a space where the wiring portions 4d and 4e face each other at a position corresponding to the arrangement of the tactile pins 3, and is made of polyester resin such as polyethylene terephthalate (PET), acrylic Insulating polymer sheet material such as resin or polystyrene resin is formed in a strip shape, and through holes are punched out at the positions of the tactile pins 3.

  In addition, although this insulating layer 4c demonstrated the shape formed in strip shape as an example, it forms in the circumference | surroundings of the through-hole of the 1st film layer 4a or the 2nd film layer 4b, and it faces and faces. It is good also as what protruded toward the 2nd film layer 4b or the 1st film layer 4a, and the thing which can make the short circuit parts 4g and 4h space apart except the case where predetermined pressing force is applied. The state is not limited. When the insulating layer 4c is formed integrally with the first film layer 4a or the second film layer 4b, it is possible to reduce the number of parts and improve the assembly work.

  As shown in FIGS. 3 and 6, the position of the tactile pin 3 protruded by the operator is pushed in, and short-circuit portions 4g and 4h (see FIG. 4) located around the pushed-in are short-circuited. The first wiring current detection means 5 and the second wiring current detection means 6 for detecting the current supply power to the closed loop circuit so that a current is generated when the short-circuit parts 4g and 4h (see FIG. 4) are short-circuited. It is configured via AC. The first wiring current detection means 5 and the second wiring current detection means 6 are respectively provided with detection parts 5a and 6a that detect the current when the current flows in the closed loop circuit, as the first wiring part 4d and the second wiring. Connection is made for each strip row of the portion 4e. In FIG. 6, the first wiring part 4 d is X-axis side wirings 1, 2 to n, and the second wiring part 4 e is Y-axis side wirings 1, 2 to n.

  Further, the intersection coordinate detection means 7 detects which intersection coordinates the short-circuit portions 4g and 4h are detected from the current detection positions of the short-circuit portions 4g and 4h detected by both the wiring current detection means 5 and 6. Yes, any of the X-axis side wires 1, 2 to n of the first wiring portion 4d in which the current is detected is set as the X-axis side coordinates, and the Y-axis side wiring of the second wiring portion 4e in which the current is detected Any one of 1, 2 to n is used as a coordinate on the Y-axis side, and an instruction position indicating which position coordinate is detected from the current detection position sent from both the wiring current detection means 5 and 6; It is output as coordinate information.

  Note that four short-circuit portions 4g and 4h are formed around one tactile pin 3. Here, as an example, all four short-circuit portions 4g and 4h around the tactile pin 3 are arranged. A switch corresponding to the tactile pin 3 is used. Therefore, one short-circuit part 4g, 4h installed at the intersection of the first wiring part 4d and the second wiring part 4e is short-circuited by the shape of the tactile object, so that four adjacent tactile pins 3 at a time. May be indicated as being selected. Here, in the tactile display device 2, the object is achieved if the tactile object presented by the short-circuit portions 4g and 4h is short-circuited. It is not an absolute requirement to support one of these. Of course, since the number of the short-circuit portions 4g and 4h is also arranged corresponding to the number of the tactile pins 3, by setting the correspondence relationship in advance, one location of the short-circuit portions 4g and 4h is one of the tactile pins 3. It can also be set as a switch corresponding to.

Further, the operator recognizes a tactile object arranged as a figure or a pseudo operation button according to the protruding state of the tactile pin 3 by actively moving the finger on the upper surface portion of the operation surface. It has been recognized by measurement experiments that the pressing force when the finger is moved and touched at this time is approximately less than 1 g / mm ² . Further, when the area of the tactile display portion of the tactile display device 2 is larger than the palm area, the operator can comfortably perform the tactile work by bringing the wrist portion into contact with the tactile display portion. In many cases, it is recognized by measurement experiments that the pressing force is less than 1 g / mm ² even in such an operation posture.

Therefore, the switch mechanism 4 has a threshold value for positively pressing the operation surface to short-circuit the short-circuit portions 4g and 4h, which is larger than 1 g / mm ² which is a value when the tactile work described above is performed. This minimizes the occurrence of operator error. As an example, here, the pressing force for short-circuiting the short-circuit portions 4g and 4h of the switch mechanism 4 is 1.5 to 10 g / mm ² , more preferably 2.5 to 3.5 g / mm ^2. The best value is set as 2.5 g / mm ² . When the pressing force for short-circuiting is less than 1.5 g / mm ² , it approaches the pressing force for performing normal tactile work, and a cause of erroneous operation is likely to occur, and when it is 10 g / mm ² or more, For many operators, the pressing operation feels burdensome.

  Next, the configuration of the control device 10 will be described as shown in FIG. The control device 10 includes an object extraction unit 11, a conversion unit (object conversion unit) 12, a tactile object storage unit 13, a tactile object presentation unit 14, a tactile pin drive circuit 15, an object coordinate information storage unit 16, an object collation unit 17, a text Data storage means 18, text data presentation means 19, speech synthesis means 20, and braille generation means 21 are provided. The tactile object storage means 13, the object coordinate information storage means 16, and the text data storage means 18 may be the same storage means.

  The object extraction means 11 includes integrated digital broadcasting (ISDB), BML developed for multimedia encoding based on XML, or visual image data indicating the type of visual object, and text corresponding to the visual object. Text data, visual image data, and object coordinate information are extracted from input data including at least data and object coordinate information corresponding to the visual object. Further, the visual image data extracted by the object extraction unit 11 is notified to the conversion unit 12. The text data is notified to the text data storage means 18 and the object coordinate information is notified to the object coordinate information storage means 16.

  The conversion means 12 converts visual image data into a haptic object, which is graphic information that can be displayed by a haptic pin, based on a preset conversion condition. The tactile object converted by the conversion means 12 is stored in the tactile object storage means 13. When converting the visual image data, the conversion means 12 determines a tactile object as abstract graphic information set in advance in the visual image data indicating the type, and from the visual image data according to the conversion condition. It has been converted to a tactile object.

  The haptic object storage means 13 stores the haptic object converted by the conversion means 12, is constituted by a general memory such as SRAM, and is referred to by the haptic object presenting means 14.

  The tactile object presenting means 14 generates drive data for presenting the tactile object indicated by the concavo-convex shape by projecting the tactile pin 3 at a predetermined position from the operation surface, and outputs it to the tactile pin drive circuit 15 as will be described later. Based on the identification information of the tactile object notified from the object collating unit 17, the driving data generated by referring to the tactile object storage unit 13 is output to the tactile pin driving circuit 15.

The tactile pin drive circuit 15 drives the tactile pins 3 of the tactile display device 2 to appear and disappear based on the notified drive data.
The object coordinate information storage unit 16 stores the object coordinate information notified by the object extraction unit 11 in association with the tactile object.

  The object collating unit 17 collates the tactile object selected by the operator with reference to the object coordinate information storage unit 16 based on the designated position coordinate information notified from the tactile display device 2, and determines the selected tactile object. The identification information is notified to the tactile object presenting means 14 and the text data presenting means 19.

  The text data storage means 18 stores text data in association with the tactile object. The text data has a button area item, an outline of the contents of the data area, a character string of the message area, and the like in association with the tactile object.

  The text data presenting means 19 outputs the target text data to at least one of the speech synthesizing means 20 and the braille generating means 21 with reference to the text data storage means 18 based on the identification information notified from the object collating means. To do.

  The voice synthesizing unit 20 synthesizes voice corresponding to the input text data (character information) by a text synthesis method and outputs the synthesized voice data. The voice synthesizing unit 20 performs voice synthesis on the text data of the tactile object notified from the text data presenting unit 19, that is, the text data associated with the tactile object selected by the operator, and sends it to the voice output device 8. Output.

  The Braille generating means 21 generates Braille data corresponding to the input text data (character information). The braille generating unit 21 generates braille data for the text data of the tactile object notified from the text data presenting unit 19, that is, the text data associated with the tactile object selected by the operator, and the braille display device. 9 is output.

  As mentioned above, although the structure of the tactile information transmission apparatus 1 and the tactile display apparatus 2 which concern on this invention was demonstrated based on one Embodiment, this invention is not limited to this. For example, the control device 10 in the tactile information transmission device 1 may be independent, or the control device 10 and the tactile display device 2 may be incorporated in a television receiver.

  Next, the operation of the tactile display device 2 will be described together with the operation of the tactile information transmission device 1 with reference mainly to FIG. Here, in particular, it relates to menu screen data (ISDB data) used for integrated digital broadcasting (ISDB) or multimedia coding BML or visual objects from an external integrated digital broadcasting television receiver. Input data including at least the visual image data, text data, and object coordinate information is input, and a selectable object (visual object) of the screen data is presented as a tactile object that allows the tactile display device 2 to tactilely recognize, The operation of selecting the tactile object by the operator will be described, and the description of the operation will be omitted for the output by voice or Braille.

  First, the tactile information transmission device 1 receives BML for integrated digital broadcasting (ISDB) or multimedia encoding, and the object extraction means 11 extracts text data, visual image data, and object coordinate information (step 1). . Then, the visual image data extracted by the object extracting unit 11 is notified to the converting unit 12, and graphic information (tactile object) obtained by converting the visual image data into an abstracted graphic is generated. (Step 2). The tactile object as graphic information converted by the conversion means 12 is stored in the tactile object storage means 13 (step 3).

  On the other hand, the text data extracted from the item contents of the object information by the object extracting means 11 for the items in the button area, the outline of the contents of the data area, and the character string in the message area is stored in the text data storage means 18 ( Step 4). Similarly, the object coordinate information extracted by the object extraction unit 11 as coordinate information for each area of the object information is stored in the object coordinate information storage unit 16 (step 5). further,

The tactile information transmission device 1 generates the tactile object as drive data for driving the tactile object into the convex shape or the concave shape of the tactile pin 3 by the tactile object presenting means 14 (step 6). Then, a tactile object is presented in the presenting area of the tactile display device 2 (step 7).
5A and 5B, when the voltage is applied to the piezoelectric bimorph actuator 3A, the piezoelectric bimorph 3C pushes up the lower end of the tactile pin 3 from the operation surface. 3 is projected. When the tactile pin 3 protrudes, a voltage is always applied to the piezoelectric bimorph actuator 3A.

  Through the above operation, the tactile information transmission device 1 can make tactile recognition of the selectable object (visual object) on the menu screen used for integrated digital broadcasting (ISDB), BML, or input data by the unevenness of the tactile pins. It can be presented as a haptic object.

[Object selection operation]
Next, a tactile object selection operation in the tactile display device 2 will be described with reference to FIGS. 7A and 7B are perspective views showing a state in which a tactile object is presented on the tactile display device, and FIGS. 8A, 8B, and 8C are pressing the tactile pin and the switch mechanism of the tactile display device. It is a schematic diagram which shows typically the cross-sectional state when doing.

  As shown in FIG. 7 (a), the tactile information transmission device 1 performs the above-described operations from step 1 to step 7 as soon as the main power supply is turned on. An object is presented. Here, an example in which the appearance of a butterfly and operation buttons “1”, “2”, and “3” are presented as tactile objects will be described.

  The operator first recognizes the whole of the plurality of presented tactile objects by a tactile sensation touched by a finger. Then, when the main tactile object being presented (here, butterfly figure) is recognized and a tactile object indicating a button to be pressed is recognized for the tactile object, the tactile pin 3 indicating the button is forced. The tactile object is selected by pushing it in.

  For example, when the operator selects a tactile object indicating “1” of the operation button and pushes in the tactile pin 3 presenting “1”, FIGS. 8A, 8B, and 8C. As shown in FIG. 5, the pressing force is also applied to the switch mechanism 4 arranged at the position of the operation surface, and the short-circuit portions 4g and 4h maintained in the separated state by the insulating layer 4c (see FIG. 5) are in contact with each other. The short-circuit portions 4g and 4h at the pressed position are short-circuited. Then, as shown in FIG. 6, the tactile display device 2 is connected to the first wiring current detecting means 5 and the second wiring current detecting means 6 and the short-circuit portions 4g and 4h short-circuited by the intersection coordinate detecting means 7 (FIG. 8C). )) Is notified to the control device 10 as designated position coordinate information.

  As shown in FIGS. 5 and 8, when the short-circuit portions 4g and 4h are brought into contact with each other to perform a short-circuit operation, the area of the finger is the intersection position of the first wiring portion 4d and the second wiring portion 4e. Since it is larger than the short-circuit portions 4g and 4h, the plurality of short-circuit portions 4g and 4h are pushed at a time to be short-circuited. Therefore, as shown in FIG. 6, the coordinate positions of the short-circuit portions 4g and 4h that are short-circuited when the intersection point coordinate detection means 7 is first pressed by the detected currents from the first wiring current detection means 5 and the second wiring current detection means 6. Is detected and notified to the control device 10 as designated position coordinate information, so that the inconvenience caused by short-circuiting to the short-circuit portions 4g and 4h of portions not set as tactile objects is eliminated.

When the operator is in contact with the tactile object indicated by the tactile pin 3, the operator may contact the other short-circuit portions 4g and 4h on the operation surface, but does not press the operation surface with a certain pressing force or more. As long as the short-circuit parts 4g and 4h are not short-circuited. Here, as an example, the switch mechanism 4 has a thickness of the first wiring portion 4d provided on the first film layer 4a of 0.02 mm, a thickness of the insulating layer 4c of 0.03 mm, and a gap between the insulating layers 4c. The interval was 1 mm, the width of the first wiring part 4 d was 0.6 mm, and the width of the second wiring part 4 e was 0.5 mm. Further, when the pressing force is 2.5 g / mm ² or more, the separation distance is configured so that the short-circuit portions 4g and 4h are short-circuited.

  When the indication position coordinate information is notified from the tactile display device 2 to the object collation unit 17 of the control device 10, the object collation unit 17 refers to the object coordinate information storage unit 16 and collates which tactile object is selected. The identification information for the tactile object is notified to the tactile object presenting means 14 and to the text data presenting means 19.

The tactile object presenting means 14 refers to the tactile object stored in the tactile object storage means 13, generates drive data for the next tactile object based on the notified identification information, and passes through the tactile pin drive circuit 15. The tactile pin 3 is driven in and out.
The text data presenting means 19 sends the text data stored in the text data storage means 18 in association with the tactile object based on the notified identification information to at least one of the speech synthesis means 20 and the Braille generation means 21, The sound is output by the voice output device 8 or the Braille output device 9. For example, if the text data related to the tactile object indicated by the identification information is an explanation of the biology of the presented butterfly, the explanation is performed by voice and Braille.

  When the tactile object presented by the tactile pin 3 of the tactile display device 2 changes to the following by the tactile object selected by the operator, all the tactile pins 3 are once buried in the operation surface and new tactile objects A new tactile object from the state that all tactile pins 3 project once to present a new tactile object, and the tactile pin 3 that forms the present tactile object. The tactile pin 3 presenting may be changed as an appearance state. Then, when a new tactile object is presented by the tactile pin 3 as an uneven state, the operator presses the tactile pin 3 corresponding to the tactile object serving as the operation button again to operate the switch mechanism 4 as described above. By doing so, the operation of selecting the tactile object is performed.

As described above, the tactile display device 2 includes the switch mechanism 4 that can indicate the result of selecting the tactile object on the operation surface, thereby improving the operability of the operator and having a simple configuration as the entire device. It becomes possible.
When the input data input to the haptic information transmission device 1 is data including a preset haptic object, the object extraction means 11 stores the haptic object storage without using the conversion means 12 shown in FIG. The tactile object is stored in the means 13. The data including the preset haptic object refers to one or more selectable visual objects that are visualized and displayed on the screen in a concavo-convex shape of a haptic pin that is recognized by the operator's haptic sense in advance. Haptic object shape data (here, shape data is, for example, binarized data [see FIG. 9 to be described later] abstract graphic data) and text data corresponding to the haptic object; and , Input data including at least object coordinate information corresponding to the tactile object.

  In addition, as shown in FIG. 9, the tactile information transmission device 1 can input a data broadcast menu screen or the like as a visual object, convert it into a tactile object, and present it. FIG. 9A shows the contents of the visualized menu screen, and FIG. 9B shows the visual object of FIG. 9A converted into an abstract graphic and presented in the binarized tactile object presentation area. FIG. 9C is an explanatory diagram of a state where the haptic object of FIG. 9B is presented by a haptic pin.

  First, when the visual object is a visual object showing a menu screen shown by data broadcasting, the visual object is converted by each means already described such as the object extracting means 11 and presented as a tactile object by the tactile pin 3. Here, when a visual object is converted into a tactile object, the following is performed.

  As shown in FIG. 9A, in the visual object, B1, B2, B3, and B4 are represented as button areas, D1 as a data area, and M1 as a message area. Then, the button area (B1, B2, B3 and B4) is converted into an abstract graphic rectangle (B1 ', B2', B3 'and B4'), and the data area (D1) is converted into an abstract graphic rectangle (D1 '). The region (M1) is converted into a rounded rectangle (M1 ′) of an abstract graphic (based on conversion conditions set in advance) and binarized. Here, binarization means that the area of the abstract figure has a tactile pin of the tactile display device 2 (see FIG. 1) having a convex shape and the other area has a concave shape.

  As a result, the screen corresponding to the button area is displayed on the display area (operation surface) where the tactile pin 3 of the tactile display device 2 moves in and out as shown in FIG. 9C. The tactile pins 3 are projected and presented as buttons b1 to b4, a data area button d1 corresponding to the data area, and a message area button m1 corresponding to the message area. Therefore, the operator can simultaneously recognize the type of the object and the information on the entire screen by touching the presenting area of the tactile display device 2 with a finger or the like.

  Therefore, when the operator depresses one of the tactile pins 3 of the message area button m1 to press the operation surface and actuate the switch mechanism 4 (see FIG. 1), as described above, the tactile object that has been depressed. Is selected, and for example, the voice output device 8 (see FIG. 1) or the Braille output device 9 (see FIG. 1) outputs the voice or Braille corresponding to the message area button m1. Further, the operator listens to the voice message and then selects one of the operation buttons b1 to b4. For example, the operator presses the tactile pin 3 of the operation button b1 to press the operation surface to switch the switch mechanism 4. When (see FIG. 1) is operated, data processing is performed by the control device 10 (see FIG. 1) as described above, and voice or Braille corresponding to the operation button b1 is output.

  In this way, in the haptic information transmission device 1 having the haptic display device 2, the menu screen (visual object) displayed visually in the data broadcast is converted into a haptic object and presented, and the data broadcast service is recognized by the operator. However, it is possible to enjoy as much as healthy people. In addition, since the tactile display device 2 is disposed so as to face the operation surface, the tactile display device 2 can be installed not only on a flat surface such as a desk but also on a vertical surface such as a wall surface.

  In the tactile display device 2, the insulating layer 4c of the switch mechanism 4 may be configured as shown in FIG. FIGS. 10A and 10B are perspective views showing other forms of the first wiring portion and the second wiring portion in the switch mechanism of the tactile display device.

  As shown in FIG. 10, at least one of the first wiring portion 24d and the second wiring portion 24e (on the first wiring portion 24d side in the drawing), spin coating or spraying is applied to a portion other than the intersection position of both wiring portions 24d and 24e. By providing and patterning an insulator by spraying, it is possible to realize a configuration corresponding to the insulating layer 4c (see FIG. 4) having a predetermined thickness. In this way, by forming the insulator 24c with a predetermined thickness in at least one of the first wiring portion 24d and the second wiring portion 24e, a through hole is formed in the insulator 24c as compared with the configuration of FIG. This eliminates the need for this, and the insulator 24c need not be configured separately from the first wiring portion 24d or the second wiring portion 24e.

In the tactile display device 2, the tactile object presents the operation button with the tactile pin 3, presses the tactile pin 3 corresponding to the operation button, and presses the switch mechanism provided facing the operation surface. The tactile object is selected but is not set as an operation button. For example, the tactile pin 3 presenting a tactile object indicating a butterfly is pressed to short-circuit the short-circuit portions 4g and 4h of the switch mechanism. Then, the operation may proceed to the next operation, that is, the operation of selecting the tactile object and presenting the next tactile object, such as explanation of the tactile object.
In addition, the tactile information transmission device does not need to use an imaging unit, and it is not necessary to provide a switch on the operation surface of the tactile pin. Excellent operability for recognizing tactile objects. For this reason, the tactile information transmission device can access information indicated by the tactile object even for visually impaired persons, and can grasp the entire configuration of the menu screen presented on the tactile display. A necessary object can be easily selected from existing objects.
Therefore, the tactile information transmission device converts a visual object represented by a digital broadcast into a tactile object and presents it, and selects a digital broadcast or input data screen presented as a tactile object to recognize each tactile object. Thus, an operation equivalent to the remote control operation can be performed. It should be noted that the tactile information transmission device is sufficient if the input data includes a tactile object in advance, and does not require object conversion means.

It is a top view which shows the tactile information transmission apparatus and tactile display apparatus which concern on this invention. It is a block diagram which shows the whole structure of the tactile information transmission apparatus and tactile display apparatus which concern on this invention. It is a perspective view showing typically the whole tactile display device of a tactile information transmission device concerning the present invention. It is a disassembled perspective view which shows the structure of the tactile display apparatus of the tactile information transmission apparatus which concerns on this invention. (A), (b) is sectional drawing which shows typically the drive mechanism of the switch mechanism and tactile pin in the tactile display apparatus of the tactile information transmission apparatus which concerns on this invention. It is a block diagram which shows the 1st wiring current detection means of the tactile display apparatus which concerns on this invention, a 2nd wiring current detection means, and an intersection coordinate detection means. (A), (b) is a perspective view which shows the state which showed the tactile object to the tactile display apparatus which concerns on this invention. (A), (b), (c) is a schematic diagram which shows typically a cross-sectional state when pressing down the tactile pin and switch mechanism of the tactile display device according to the present invention. (A) shows the contents of the menu screen visualized in the haptic information transmission device according to the present invention, and (b) shows the binarized haptic object converted from the visual object of (a) into an abstract figure. The screen presented in the presentation area is shown, and (c) is an explanatory diagram of a state in which the haptic object of (b) is presented by a haptic pin. (A), (b) is a perspective view which shows the other form of the 1st wiring part in the switch mechanism of the tactile display apparatus which concerns on this invention, and a 2nd wiring part.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Tactile information transmission apparatus 2 Tactile display apparatus 3 Tactile pin 3A Piezoelectric bimorph actuator 3B Cover film 3C Piezoelectric bimorph 4 Switch mechanism 4a 1st film layer 4b 2nd film layer 4c Insulating layer 4d 1st wiring part 4e 2nd wiring part 4g Short circuit Section 4h Short-circuit section 5 First wiring current detection means 6 Second wiring current detection means 7 Intersection coordinate detection means 8 Audio output device 9 Braille display device 10 Control device 11 Object extraction means 12 Conversion means (object conversion means)
13 tactile object storage means 14 tactile object presentation means 15 tactile pin drive circuit 16 object coordinate information storage means (storage means)
17 Object collation means 18 Text data storage means (storage means)
19 Text data presentation means (storage means)
20 Speech synthesis means 21 Braille generation means

Claims (3)

In the tactile display device capable of recognizing the three-dimensional shape represented by the tactile pin by tactile sense as a result of the protruding state of the tactile pin arranged vertically and horizontally on the planar operation surface
A first film layer disposed to face the operation surface; a second film layer disposed to face the first film layer and spaced apart through an insulating layer; the second film layer; and the insulating layer. And the tactile pin provided in the first film layer so as to be able to appear and retract through a through hole, and a switch mechanism provided between the first film layer and the second film layer,
The switch mechanism is provided at a position adjacent to each other along each column of the tactile pins, the first wiring portion provided on the first film layer, and spaced apart from the first wiring portion. A second wiring portion provided on the second film layer at a position adjacent to each row, and each wiring portion provided at each intersection position where the second wiring portion and the first wiring portion face each other. A tactile display device having a short-circuit portion. In the tactile display device capable of recognizing the shape represented by the tactile pin by tactile sense as a result of the protruding state of the tactile pin arranged vertically and horizontally on the planar operation surface,
A first film layer disposed to face the operation surface, a second film layer disposed to face and separate from the first film layer, and a through hole in the second film layer and the first film layer The tactile pin provided so as to be able to move in and out via a switch mechanism provided between the first film layer and the second film layer,
The switch mechanism is provided at a position adjacent to each other along each column of the tactile pins, the first wiring portion provided on the first film layer, and spaced apart from the first wiring portion. A second wiring portion provided in the second film layer at a position adjacent to each row, and each wiring portion at each intersection position where the second wiring portion and the first wiring portion face each other. A tactile display device comprising: a short-circuit portion; and an insulating layer provided on at least one of the first wiring portion and the second wiring portion with the short-circuit portion exposed.   The switch mechanism includes a first wiring current detection unit having a detection unit provided in each of the first wiring units, a second wiring current detection unit having a detection unit provided in each of the second wiring units, The cross-point coordinate detection means for detecting the position of the short-circuit portion based on the current detection position detected by the second wiring current detection means and the first wiring current detection means. Tactile display device.

Images