JPH09330319A - Intention communication supporting method and information processor using the same method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable an intention communication over wider language area without specifying object people by communicating intention by translation from a language to an image. SOLUTION: A document consisting of an input character string is divided into words by a word division part 330. More than one piece of image information for associating a thing, feeling, or intention expressed by each word are selected out of pieces of image information in a cell data storage part 4 by referring to a cell correspondence table, etc., and displayed on a display device 5. Therefore, not only translation between languages, but also translation from a language to an image becomes possible and intehtion can be communicated over a wider language area without specifying object people.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a willingness communication support method using a function such as language translation and an information processing apparatus using the method, and in particular, a willingness expressed in a certain language is visually recognized using an image. TECHNICAL FIELD The present invention relates to an improved will communication support method and information processing device that can be converted into various types of information.

[0002]

2. Description of the Related Art In recent years, CPUs have been used in the field of computers.
The processing speed has been improved, and the miniaturization of peripheral devices has been promoted by the advancement of semiconductor technology. As a result, a portable information terminal having the machine translation function, which was previously realized only in relatively large systems, has been developed. . In a typical portable translator of this type, a fixed phrase of daily conversation in one language is translated into another language and output as characters or voice.

However, since this translation function is intended to be used only in major languages such as English, German, and French, it is difficult to use it in other languages. Also,
There is also a problem in that the person who communicates with the portable translator is limited to those who have a hearing ability to read characters or hear the output voice.

[0004]

As described above, in the past, the available language areas, the parties to communicate with, etc. are limited, and communication is intended only with a limited number of parties in a specific country or region. There was a problem that I could not do it.

The present invention has been made in view of the above circumstances, and enables the communication of intentions by translation from language to image rather than translation between languages, thereby selecting a partner in a wider language range. It is an object of the present invention to provide a will communication support method and an information processing apparatus using the method, which is capable of supporting communication.

[0006]

The present invention is a willingness communication support method for visually communicating a will of a communication target by using an information processing device having an image display function. , Or an intention such as an intention is specified, the constituent elements are determined from the object to be communicated, and necessary for associating the determined element among a plurality of image information prepared in advance. One or more pieces of image information are selected, the selected image information is displayed on a screen, and the specified transmission target can be converted into an image.

In this method for supporting communication of a will, for example, a character string input from a keyboard or the like of an information processing device such as a portable information terminal or a character string constituting a standard sentence of daily conversation assigned to a specific key of the keyboard. As described above, when the user specifies an object, emotion, or will to be transmitted, the elements constituting the transmission target are determined by processing such as extracting words from the transmission target. Then, one or more pieces of image information for associating an object, an emotion, or an intention expressed by, for example, a word determined as the element are selected from a plurality of pieces of image information and displayed on the screen of the information processing device. To be done. Therefore, it is possible to translate from a language to an image instead of translating between languages, and it is possible to communicate a will in a wider language area without selecting a partner.

The image information can be selected by using, for example, an image correspondence table showing the identifier of the image information associated with each type of word. In this case, by defining a plurality of image information identifiers for the words that represent the motion, the transmission target expressed by the input character string indicates the motion or its direction in the moving image by continuously displaying the plurality of image information. It can be converted, and it becomes possible to communicate the will more clearly. In addition, by adding instruction information that specifies the display mode of image information corresponding to a word that represents an action, one image can be moved and displayed on the screen, or superimposed on another image. Can be displayed.

Further, the intention transmission support method of the present invention parses a sentence represented by an input character string, divides the document into a plurality of types of cases which are constituent elements of the sentence, and divides it into word units. It is characterized in that a plurality of pieces of image information corresponding to each word included in the input character string are displayed in an order corresponding to a case to which the word belongs. This allows
It is possible to express the contents of a complicated document by using a plurality of image information. In this case, display order information corresponding to the language of the input character string among a plurality of display order information describing the relationship between the type of case and the display order of image information,
Alternatively, by determining the display order by referring to the display order information specified by the user, it becomes possible to control the order of image display in a state in which the word order of each language is taken into consideration, which enables smoother communication. Become.

[0010]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows the functional configuration of a portable translator that uses the intention transmission support method according to the embodiment of the present invention. This portable translator is for converting things, emotions, or intentions expressed in a language into image information, and the conversion function is to execute an image translation support program on the portable translator. Is realized by.

This portable translator is, as shown in the figure, an input device 1 for a user to input a character string using a keyboard, a touch panel or the like, or to give various instructions to this device.
And a table 2 storing a word table 21, a syntax rule table 22, a cell correspondence table 23, and a display order table 24, which will be described later with reference to FIG.
A control device 3 including hardware such as a CPU and a memory and the above-described image translation support program, an actual image (hereinafter referred to as a cell), and cell data storage that stores a display method for displaying the image. It is composed of a section 4 and a display device 5 for displaying an image of a processing result of a character string input by the user, an error message and the like.

The control device 3 includes a control unit 300, six processing units, that is, a system initialization unit 310 and a character string input unit 3.
20, a word division unit 330, a syntax analysis unit 340, an image creation unit 350, a display unit 360, and a buffer unit 370.

The control unit 300 controls the entire apparatus, and controls the operation of each processing unit and transfers data between them. This control unit 300 is a CPU
It is constituted by. System initialization unit 310, character string input unit 320, word division unit 330, syntax analysis unit 34
0, the image creation unit 350, the display unit 360, and the buffer unit 370 are functional elements of the above-described image translation support program.

FIG. 2 shows the respective functions and connection relations of these units constituting the control device 3. The system initialization unit 310 performs initialization processing such as specification of a display method of processing results and clearing of various buffers necessary for system operation. The character string input unit 320 stores a character string input by the user from an input device such as a keyboard in the input character buffer 371. The word dividing unit 330 divides the character string stored in the input character string buffer 371 into word units by referring to the word table 21, replaces it with a word identifier, and stores it in the word identifier buffer 372. In addition, the word attribute corresponding to each word identifier is stored in the word attribute buffer 37.
Stored in 3. Further, the number of words when the character string is divided is stored in the word number buffer 374.

The syntactic analysis unit 340 sorts the word identifiers stored in the word identifier buffer 372 using the word attributes stored in the word attribute buffer 373 by referring to the syntax rule table 22, and stores them in the case buffer 375. . The image creation unit 350 refers to the cell correspondence table 23 in the order instructed by the display mode designation buffer 377, and the case buffer 37
The word identifier stored in 5 is expanded into a cell identifier and stored in the output cell buffer 376.

The display section 360 has an output cell buffer 376.
Sequentially reading out the cell identifiers stored in the cell data 4
The actual image stored in is output to the display device 5. Further, the buffer unit 370 is for storing various information necessary for the present apparatus, and here, as shown in FIG. 2, the input character string buffer 371, the word identifier buffer 372,
It has a word attribute buffer 373, a word number buffer 374, a case buffer 375, an output cell buffer 376, and a display mode designation buffer 377.

The table 2 is composed of a word table 21, a syntax rule table 22, a cell correspondence table 23, and a display order table 24, as shown in FIG. As shown in FIG. 7, the word table 21 has a structure in which a word identifier corresponding to each character string is associated with a word attribute in order to divide the character string input by the user into words. Even if the word identifiers are different character strings, they are the same as long as they are semantically equivalent character strings. Therefore, as shown in FIG. 7, the character strings “row”, “go”, and “go” have the same word identifier “w200”. "have. The word attribute represents part-of-speech information such as a noun and a verb corresponding to each character string.

As shown in FIG. 8, the syntax rule table 22 is used to check the relationship between the word attributes stored in the word attribute buffer 373, and to assign the corresponding word identifier to each position of the case buffer 375. It has a structure that associates relations with case identifiers. The attribute relationship represents a connection relationship such as “noun and particle” and “verb and auxiliary verb”. Further, as shown in the case buffer of FIG. 16, the case identifier is in the case buffer such as a nominal case "B1" in which a word identifier that is a subject of the sentence is stored, and an action case "B6" in which a word identifier related to a motion is stored. Represents the position of.

As shown in FIG. 9, the cell correspondence table 23 has a structure in which word identifiers are associated with cell identifiers. The cell identifier represents one still image or a method of displaying the image. For example, cell "c17" represents a still image "water", as shown in FIG. 23 (1), and cell "c70".
"2" represents a display form in which the target cell is displayed while moving from right to left. In addition, as for the word related to the operation such as the word identifier “w101 (like)”, FIG.
3 (3), multiple cells "c10
4, c105, c106, c107 ”are allocated, and a plurality of cells can be continuously displayed by this.

The display order table 24, as shown in FIG.
It has a structure that associates the display mode with the display order. The display mode is the word order that exists in some languages (Word O
rder), and is for identifying the display order. The display order is the order in which the word identifiers in the case buffer are read out when the word identifiers are expanded into cell identifiers by the case identifier.

Next, the translation processing procedure of this embodiment will be described. FIG. 3 is a flowchart showing the procedure of the translation process in this embodiment. First, when the system is activated, the system initialization unit 310 causes the buffer unit 370 to operate.
Various buffers in the buffer are cleared, and as shown in FIG. 11, various initialization modes necessary for translation are performed, such as storing arbitrary display modes D1 and D2 in the display mode designation buffer 377. (Step S1).

Here, a character string input screen for translation processing as shown in FIG. 22A and, if necessary, FIG.
The display mode selection screen as shown in FIG.
It is output to the display device 5 via 0. This character string input screen has an input line for the user to input a character string. The display mode selection screen allows the user to specify the display mode.

When the character string input screen is displayed, the character string can be input. In this state, the user inputs a character string (“I want to go to the station” in this example) using the input device 1. At this time, the input character string is input as shown in FIG. 22B via the character string input unit 320 and stored in the input character string buffer 371 (FIG. 12 (4)) (step S2). ).

Next, the control unit 300 causes the character string dividing unit 3
20 is activated. The character string dividing unit 320 divides the character string stored in the input character string buffer 371 into words by referring to the word table 21, replaces the word with a word identifier, and stores the word in the word identifier buffer 372. In addition, the word attribute corresponding to each word identifier is stored in the word attribute buffer 373.
Further, the number of words when the character string is divided is stored in the word number buffer 374 (step S3).

When the word is divided and the word identifier is stored in the word identifier buffer 372, the parsing unit 340 is activated. Here, as a preprocessing of the syntax analysis, the syntax analysis unit 340 checks the number of words in the word number buffer 374. When the number of words is 0 (YES in step S4), the character string dividing unit 320 shifts the control to step S7. When the number of words is other than 0 (NO in step S4), step S5
Control is transferred to (step S4).

The number of words is 1 (YE in step S5).
In S), the input character string does not need to be parsed, so control is moved to step S7. If the number of words is other than 1 (NO in step S5), control is moved to step S6 (step S6). S5).

The syntax analysis section 340 refers to the syntax rule table 22 to sort the word identifiers stored in the word identifier buffer 372 using the word attributes stored in the word attribute buffer 373 and stores them in the case buffer 375. (Step S6).

When the syntax analysis section 340 is activated, the image creation section 350 is subsequently activated. Image creation unit 350
Refers to the cell correspondence table 24 in the order instructed by the display mode designation buffer 377, expands the word identifier stored in the case buffer 375 into a cell identifier, and stores it in the output cell buffer 376 (step S7). .

When the process of step S7 is completed, the display unit 360 is activated. The display unit 360 sequentially reads the cell identifiers stored in the output cell buffer 376 and outputs the actual image (see FIG. 24) stored in the cell data 4 to the output device 5 (step S8). In FIG.
Images corresponding to "To Station" are displayed moving from right to left, and multiple images showing people walking corresponding to "Go" are displayed continuously. In response, the plurality of images showing the person wanting to do something are continuously displayed.

Next, the word division processing in step S3,
The syntax analysis process of step S6 and the image creation process of step S8 will be specifically described. FIG. 4 is a flowchart showing the word division processing in step S3.

When a character string such as "I want to go to the station" is input from the input device 1 through the character string input unit,
The character string is the input character string buffer 371 (Fig. 4 (4)).
Stored in.

The control unit 300 controls the character string dividing unit 320.
Is started. The character string dividing unit 320 divides the character string “I want to go to the station” stored in the input character string buffer 371 into words by referring to the word table 21 (FIG. 7), and the word identifiers “w18 (station), w502”. (To), w200 (To),
w100 (tai) "to replace the word identifier buffer 3
It stores in 72 (FIG.15 (4)) (step S31).

Further, each word identifier "w18, w502,
The word attributes “A3 (noun), A10 (particle“ to ”), A5 (verb), A6 corresponding to“ w200, w100 ”
The "auxiliary verb" ~ tai ")" is stored in the word attribute buffer 373 (FIG. 14 (4)) (step S32).

Furthermore, the word number "4" when the character string is divided is stored in the word number buffer 374 (FIG. 13).
(4)). If the input character string does not exist in the word table 21, the number of words 0 is stored (FIG. 12 (2)).
In the example of the character string "Wabi", the number of words is "0",
It is stored as shown in FIG. 13B) (step S3)
3).

FIG. 5 is a flow chart showing the syntax analysis process of step S6. When the word identifier is stored in the word identifier buffer 372, the word attribute is stored in the word attribute buffer 373, and the word is stored in the word count buffer 374, the syntax analysis unit 340 is activated.

In step S5, when the number of words in the word number buffer 374 is 2 or more, it is necessary to perform the syntax analysis process, and therefore the control is moved to step S6. Parser 340
Is the word identifier “w18, w502, w200, w1” stored in the word identifier buffer 372 (FIG. 14 (4)).
00 ”is the word attribute“ A3, which corresponds to each word identifier.
"A10, A5, A6" is used to refer to the syntax rule table 22 and allocate to the case buffer 375 (FIG. 16). According to the syntax rule table 22 (FIG. 8), the attribute relationship “A3 + A10
(Noun and particle "to e") "to the case identifier" B3 (destination case) ", and" A5 + A6 (verb and auxiliary verb "totai") "to" B6 (action case) " From the syntax rule of storing, as shown in FIG. 18, the case identifier “B
The word identifiers "w18, w502" are stored in "3", and "w200, w100" are stored in "B6" (step S6).
1).

During the parsing process, when the attribute relation obtained from the input character string does not exist in the syntax rule table 22,
It is determined that the syntax analysis has failed (YE in step S62).
S), the error value (99999) is stored in the word number buffer (step S63).

FIG. 6 is a flow chart showing the image creating process of step S7. When the syntax analysis unit 340 is activated, the image creation unit 350 is subsequently activated.

The image creating section 350 reads the display mode of the display mode designation buffer 377 (FIG. 11) (step S71). Next, the word count buffer 374 is read out,
Control is transferred to the following steps according to the number of words.

When the number of words is 0, control is passed to step S75. In order to inform the user that the input character string does not exist in the word table 21, the output cell buffer 3
The cell identifier "c9998" is stored in 76 (step S75). In the example of the character string “Wabi” in FIG. 20 (2),
The output cell buffer 376 stores the cell identifier “c999
8 ”(FIG. 27A) is stored.

If the number of words is 1, control is passed to step S76. Since the input character string is one word, the parsing process is omitted. Therefore, the word identifier in the word identifier buffer 372 is directly input to the cell correspondence table 23.
Is expanded to the output cell buffer 376 (step S76). In the example of the character string “water” in FIG. 20 (1),
The output cell buffer 376 stores the cell identifier “c17”.

When the number of words is 99999, that is, when there is a syntax analysis error, control is passed to step S77. In order to inform the user that the parsing has failed, the cell identifier “c9999” (FIG. 27) is output to the output cell buffer 376.
(B)) is stored (step S77).

When the number of words is other than the above (2 to 99998), it is necessary to perform the syntax analysis process, and therefore the control is moved to step S73. In the display mode read in step S71, the display order table 24 (FIG. 10) is referred to, and the contents of the word identifiers stored in the case identifiers of the case buffer 375 are read in the order of display order. The operation of step S74 below is
The number of case identifiers is repeated (step S73).

The word identifier stored in the item of the corresponding case identifier in the case buffer 375 is taken out, and the cell correspondence table 23
With reference to, the cell identifier is expanded in the output cell buffer 376 (step S74).

Taking the case buffer shown in FIG. 18 as an example,
The image creation unit 350 develops a cell identifier in the output cell buffer 376, as shown in FIG. In this way, when you enter the character string "water",
When the character string “Wabi” is input to the still image of FIG. 23 (1), the still image of FIG. 23 (2) is input, and when the character string “I like” is input, the moving image of FIG. 23 (3). When "D1" is specified as the display mode and the character string "I want to go to the station" is input, the moving image in Fig. 23 (4) is specified as the display mode and the character string "I I would like to send this to Japan by air mail ",
When "D2" is specified as the display mode and the character string "I want to send this to Japan by airmail" is input,
The moving image of can be output.

As described above, in this embodiment,
By adding new cell data, it is possible to convert the input character string into the image information stored in the cell data. It is possible to provide a communication support device having a visual interface without limiting the communication target person. In addition, even if different character strings are semantically equal, by using a word table in which the same word identifier is associated with each other, if the input character strings are different, the meaning is equal. Since it is possible to convert the image information stored in the same cell data, it is possible to reduce the capacity of the cell data in which the image information is stored.

In addition, in the case where an input character string represents an action or a direction by adding a cell correspondence table storing a plurality of cell identifiers to the word identifier to the cell correspondence table when expressing the action. Can handle moving images, so communication can be made easier. Furthermore, by adding a cell correspondence table that stores instruction information of display method when expressing an action to a word identifier to the cell correspondence table, the input character string can be moved or overlapped. If you want to show the match, move the target image,
Since the superimposed display can be handled, the communication of will can be made easier.

Further, by adding the word division function, when the input character string consists of a plurality of words, the character string is divided into a plurality of word identifiers, so that a more complex intention is expressed. You can Further, by using the syntactic analysis means, when the input character string is a sentence, the relationship between the words in the sentence is examined, so that a more complicated intention can be expressed. Furthermore, since the images are read out in the order specified in the display mode, the display order of the input character string and the output image must be converted into image information without depending on the input character string order. This is convenient when outputting the result and considering the word order depending on each language.

The present invention is not limited to the above embodiment. In the present embodiment, the character string input by the user is treated as Japanese for convenience of explanation, but a word table and a syntax rule table may be prepared for each desired language.

Further, instead of inputting character by character, a fixed phrase or a certain fixed phrase is assigned to a specific key, and a character string forming the fixed phrase or phrase is input at a time by using that key. Good.

Further, the present embodiment can be applied to a sign language support device, a will communication support device, a super-large screen display device, a video projector, an unspecified multi-guest guide device, an information guide device, and the like. For example, sign language support can be easily realized by converting an input character string into an image showing the movement of a hand or a face.

[0052]

As described above, according to the present invention, it becomes possible to communicate with each other not by translating between languages but by translating from a language into an image. It becomes possible to carry out communication.

[Brief description of drawings]

FIG. 1 is a block diagram showing a functional configuration of a portable translator according to an embodiment of the present invention.

FIG. 2 is a block diagram showing a functional configuration of a control device provided in the portable translator of the same embodiment.

FIG. 3 is an exemplary flowchart showing a flow of an entire translation process of the portable translator according to the embodiment.

FIG. 4 is an exemplary flowchart showing a procedure of word division processing performed in the translation processing of the portable translator of the embodiment.

FIG. 5 is an exemplary flowchart showing the procedure of a syntax analysis process performed in the translation process of the portable translator according to the first embodiment.

FIG. 6 is an exemplary flowchart showing a procedure of image creation processing performed in the translation processing of the portable translator according to the same embodiment.

FIG. 7 is an exemplary view showing an example of a word table used in a translation process of the portable translator according to the embodiment.

FIG. 8 is an exemplary view showing an example of a syntax rule table used in a translation process of the portable translator of the embodiment.

FIG. 9 is an exemplary view showing a cell correspondence table used in a translation process of the portable translator according to the embodiment.

FIG. 10 is a view showing an example of a display order table used in a translation process of the portable translator of the same embodiment.

FIG. 11 is a diagram showing a storage example of a display mode designation buffer used in a translation process of the portable translator of the embodiment.

FIG. 12 is a diagram showing a storage example of an input character string buffer used in a translation process of the portable translator of the embodiment.

FIG. 13 is a diagram showing an example of storage of a word number buffer used in a translation process of the portable translator according to the same embodiment.

FIG. 14 is a diagram showing a storage example of a word attribute buffer used in a translation process of the portable translator according to the same embodiment.

FIG. 15 is an exemplary view showing a storage example of a word identifier buffer used in a translation process of the portable translator of the embodiment.

FIG. 16 is a view showing a case buffer used in a translation process of the portable translator of the embodiment.

FIG. 17 is a diagram showing a first storage example of a case buffer used in a translation process of the portable translator according to the same embodiment.

FIG. 18 is a diagram showing a second storage example of a case buffer used in a translation process of the portable translator according to the same embodiment.

FIG. 19 is a diagram showing a third storage example of the case buffer used in the translation process of the portable translator according to the same embodiment.

FIG. 20 is a diagram showing a first storage example of an output cell buffer used in a translation process of the portable translator according to the same embodiment.

FIG. 21 is a diagram showing a second storage example of the output cell buffer used in the translation process of the portable translator according to the same embodiment.

FIG. 22 is an exemplary view showing an input screen used in a translation process of the portable translator of the embodiment.

FIG. 23 is a diagram showing a first example of an output screen used in a translation process of the portable translator according to the same embodiment.

FIG. 24 is a diagram showing a second example of an output screen used in a translation process of the portable translator of the same embodiment.

FIG. 25 is a diagram showing a third example of an output screen used in a translation process of the portable translator of the same embodiment.

FIG. 26 is a diagram showing a fourth example of an output screen used in a translation process of the portable translator according to the same embodiment.

FIG. 27 is a diagram showing a fifth example of an output screen used in a translation process of the portable translator according to the same embodiment.

[Explanation of symbols]

1 ... Input device, 3 ... Control device, 4 ... Cell data storage unit,
320 ... Character string input section, 330 ... Word division section, 340 ...
Syntactic analysis unit, 350 ... Image creation unit, 371 ... Input character string buffer, 372 ... Word identifier buffer, 373 ... Word attribute buffer, 374 ... Word number buffer, 375 ... Case buffer, 376 ... Output cell buffer, 377 ... Display mode The designated buffer.

Claims (12)

[Claims] 1. A method for supporting intention transmission, which visually conveys an intention of an object to be transmitted using an information processing device having an image display function, wherein an object, an emotion, or an intention that can be expressed by a language is an object to be transmitted. When specified, the constituent elements are determined from the transmission target, and one or more image information necessary for associating the determined element is selected from a plurality of image information prepared in advance. The intention transmission support method, wherein the selected image information is displayed on a screen so that the designated transmission target can be converted into an image. 2. The transmission target is specified by an input character string, and as an element constituting the transmission target, a word is extracted from the input character string, and an identifier of image information that associates it with each type of word is shown. The method for supporting communication of intention according to claim 1, wherein one or more pieces of image information necessary for associating the extracted words are selected with reference to an image correspondence table. 3. In the image correspondence table, a plurality of image information identifiers are defined for a word representing a motion, and the transmission target represented by the input character string represents the motion or its direction. The method for supporting communication of intentions according to claim 2, wherein a plurality of pieces of image information are continuously displayed when the user is present. 4. In the image correspondence table, instruction information for designating a display form of image information corresponding to a word representing an action is added to the image correspondence table, and a transmission target represented by the input character string is displayed. 3. The method for supporting communication of intention according to claim 2, wherein when expressing the action or its direction, the image information is displayed on the screen by moving or superimposing it on another image. 5. The transmission target is designated by an input character string, the sentence expressed by the input character string is parsed,
The document is divided word by word into a plurality of cases that are constituent elements of the document, and a plurality of pieces of image information corresponding to each word included in the input character string are arranged in an order corresponding to the case to which the words belong. The method for supporting communication of intention according to claim 1, wherein the method is displayed. 6. The display order information corresponding to the language of the input character string among a plurality of display order information describing the relationship between the case type and the display order of image information, or the display order specified by the user. The method of claim 5, wherein the plurality of pieces of image information are displayed in an order defined by the display order information by referring to the information. 7. An information processing apparatus, which has an image display function and visually conveys the intention of a communication target, when the communication target such as a thing, emotion, or intention expressible by language is designated. Element determining means for determining elements constituting the object to be transmitted, and image information for selecting one or more pieces of image information necessary to associate the determined elements from a plurality of image information prepared in advance. An information processing apparatus comprising: a selection unit and a unit for displaying the selected image information on a screen so that the designated transmission target can be converted into an image. 8. The transmission target is designated by an input character string, and the element determining means includes means for extracting a word from the input character string and determining the word as an element constituting the transmission target, The image information selection stage refers to an image correspondence table showing identifiers of image information associated with each type of word, and one or more images necessary to associate the extracted word with reference to the image correspondence table. The information processing apparatus according to claim 7, further comprising means for selecting image information. 9. The image correspondence table defines a plurality of image information identifiers for words representing motions, and the transmission target represented by the input character string represents motions or directions thereof. 9. The information processing apparatus according to claim 8, wherein a plurality of pieces of image information are continuously displayed when the information is displayed. 10. In the image correspondence table, instruction information designating a display form of image information corresponding to a word representing an action is added to the image correspondence table, and the transmission target represented by the input character string is 9. The information processing apparatus according to claim 8, wherein the image information is configured to move on the screen or to be superimposed on another image and displayed when expressing the action or the direction thereof. 11. The transmission target is designated by an input character string, and the element determining means parses a sentence expressed by the input character string,
The document includes a unit that divides the document into a plurality of types of cases that are constituent elements of the document on a word-by-word basis. The information processing apparatus according to claim 7, wherein the information processing apparatus is configured to be displayed in the order of. 12. The display order information corresponding to the language of the input character string among a plurality of display order information describing the relationship between the case type and the display order of image information, or the display order specified by the user. The information processing apparatus according to claim 11, characterized in that the image information is displayed in an order defined by the display order information with reference to the information.