JP2518467B2 - Dialogue evaluation device - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a dialog evaluation device for evaluating a dialog situation between a user and a device to be evaluated having an operation section and a display section.

[0002]

2. Description of the Related Art Conventionally, this type of dialog evaluation apparatus has been used to visualize a dialog history of a user in an interactive product and support analysis of operability and the like. For example, 199
October 1st, 7th Human Interface Symposium Proceedings (P1-P4) and Japanese Patent Application No. 3-31816
As described in No. 1 "Dialogue history creating device", an input signal and an output signal are detected for an interactive device, such as a facsimile machine, in which a user advances work while observing the response of the device, and the operation contents A mechanism has been proposed that displays the user's dialogue history consisting of response contents as a state transition diagram.

[0003]

The feature of the conventional method as introduced in the above two documents is that the operation contents are expressed as arcs and the response contents as nodes in the state transition diagram, and the dialogue history is visually expressed. That is. However, in the conventional method, it is difficult to evaluate the usability because the difference between the regular procedure and the procedure of the user is not clearly shown. Moreover, since the attribute of the response content corresponding to the display of each node is not reflected, it is difficult to grasp the dialogue situation.

The object of the present invention is to solve the above-mentioned problems,
An object of the present invention is to provide a dialogue evaluation device in which a user's erroneous operation can be easily found, an operation and the like can be easily evaluated, and a dialogue situation can be easily grasped.

[0005]

A dialogue evaluation apparatus of the first invention is
And the evaluation device having a display unit and an operation unit, wherein the evaluation device
A regular dialogue procedure between the user and the user within the operation of the evaluation device.
And the response content of the evaluated device to the operation content
A reference interactive recording apparatus for recording based dialogue procedure ordered time, the operation content of the reference dialogue procedure Roh
And a reference dialogue drawing device for converting the response contents into a reference dialogue diagram which is expressed by an arc and displaying it on a display device, and the device under evaluation connected to the device under evaluation and actually evaluated by the user.
And operation contents for a pair of the response content of the object evaluation device
It comprises a dialogue detecting device for detecting a story history , and a judging device for reading the dialogue history and comparing it with the reference dialogue procedure to draw a different portion on the reference dialogue diagram.

[0006] Interactive evaluation apparatus of the second invention, and the object to be evaluated device having a display section and an operation section, and the object evaluation device and user
The regular interactive procedure of the operation contents of the evaluation device and the
The response contents of the evaluated device to the operation contents are arranged in time order.
Roh and reference dialogue recording apparatus for recording the ordered reference dialogue procedure, the attribute recording device for recording the attributes of each response content of the reference dialogue procedure, the operation content of the reference dialogue procedure
Over de, the response content is expressed by an arc, and a reference dialogue drawing device for displaying a reference interaction diagram obtained by registering the attribute to represent the node on the display device, connected to said evaluation target device user actually performed Operation contents for the evaluated device,
A dialogue detecting device for detecting a dialogue history with the response contents of the device to be evaluated, and the reference dialogue procedure for reading the dialogue history.
And a different device for drawing different points on the reference dialogue diagram.

[0007]

Using the method described in the prior art, a dialogue history consisting of operation contents and response contents is recorded. A normal dialogue procedure is recorded in advance as the reference dialogue, and the reference dialogue diagram is created by arranging the response contents as nodes on a straight line. In general, a dialogue performed by a user includes an erroneous operation that does not exist in the reference dialogue. By adding and drawing this erroneous operation part on top of the original reference dialogue diagram, the difference between the reference dialogue and the user operation procedure can be clearly shown. Also,
When you create a reference interaction, the response content of the attribute (the initial state, the function selection, data input, etc.) to set the. When displaying the standard dialogue diagram, the nodes that represent the response contents are displayed by displaying positions and colors according to their attributes.
By displaying the erroneous operation of the user dialogue history on the reference dialogue diagram, it becomes easy to grasp the progress of the dialogue of the user.

[0008]

Embodiments of the present invention will now be described with reference to the drawings. FIG. 1 is a block diagram showing an embodiment of the first invention. The evaluated device 10 has an operation unit including buttons and keys, and a display unit including a liquid crystal screen and LED lamps. The user performs some operation on the operation unit for the desired task, and the response to the operation is output to the display unit. The dialogue detecting device 11 is connected to the device to be evaluated 10 and detects an operation performed by the user and a response thereto as a dialogue history. The dialogue history detection method is, for example, October 1991, No. 7
Annual Human Interface Symposium Proceedings,
The method described in P1 to P4 can be used.
In the reference dialogue recording device 12, a procedure necessary for executing a certain task for the evaluated device 10 is recorded as a dialogue history. This dialogue history can be easily created by properly operating the evaluated device 10 while referring to a manual or the like, and recording the operations and response contents detected by the dialogue detecting device 11 in chronological order. Standard interactive drawing device 14
Displays the content of each response in the dialogue history as a node and the content of each operation as an arc on the display device 15 configured by a CRT or the like. Hereinafter, a diagram in which this regular operation procedure is expressed by nodes and arcs is referred to as a reference dialogue diagram. A device to be evaluated 1 for the same task as a function realized by a user in a standard dialogue
When 0 is operated, the dialogue detection device 11 detects this dialogue history. The determination device 13 compares the detected dialogue history of the user with the reference dialogue history and additionally draws different portions as arcs or nodes on the reference dialogue diagram.

The operation of the present invention when a facsimile machine is assumed as the device to be evaluated 10 will be described below in detail with reference to FIGS. 1, 2, 3 and 4. Figure 2
(A) is an example of a reference dialogue history recorded in the reference dialogue recording device 12 for realizing a certain task. The name 21 of the button to be pressed as the operation content and the liquid crystal display unit of the facsimile device as the response content. The display content 22 of is recorded. In FIG. 2A, 7 operations and 8 response contents are recorded, and the reference dialogue drawing device 14 arranges 8 nodes on a straight line, and from each node and 7 arcs connecting between them. Create a structured dialogue diagram. Figure 2 (a)
Is an example of a standard dialogue diagram, in which “●” representing nodes is arranged on a straight line and arcs are represented by arrows. Each node and arc in FIG. 2A correspond to the response content and the operation content in FIG.
5, arc 24 indicates operation 26. However, in the present invention, the shapes of the nodes and arcs are not particularly limited as long as they can be distinguished, and the same operation can be realized in any direction of arranging the nodes.

Next, a method of expressing the user dialogue history on the standard dialogue diagram will be described. Now, the determination device 13 for which the dialogue history as shown in FIG.
It was recorded in. In the standard dialogue procedure, the state 31 shifts to the state 33 through the operation 32, as shown in FIG.
In the example, it can be seen that the operation 34 “stop” is executed and the operation is redone from the state 35. The determination device 13 sequentially compares the two dialogue histories and adds a new arc on the reference dialogue diagram when an operation content (erroneous operation) different from the reference dialogue such as the operation 34 is detected. Further, the determination device 13 determines the destination of the arc by searching the reference dialogue history for the response content 35 immediately after the erroneous operation in the user dialogue history. In the case of the reference dialogue example of FIG. 2, since the responses 25 are the same, the arc to be newly drawn has the node 23 corresponding thereto as a jump destination. This drawing example is shown in FIG.
It is shown as the arc 36 in (a).

An example of the case where the response content immediately after the erroneous operation does not exist in the reference dialogue history will be described with reference to FIG. FIG.
In the dialogue history shown in (A), the erroneous operation 41 is first detected by the same operation as in the example of FIG. In the case of this dialogue history, the response content 43 immediately after the erroneous operation does not exist in the reference dialogue history. At this time, the determination device 13 further searches the response content of the reference dialogue history for the next response content 44, and sets the response content 27 equal to this as the destination of the arc. This operation is repeated until the jump destination can be determined. FIG. 4A shows a display example of the arcs 45 and 46 corresponding to the erroneous operations 41 and 42, respectively, and a node 47 corresponding to the response content 43 that does not exist in the reference dialogue history is added.

FIG. 5 is a block diagram for explaining an embodiment of the second invention. In the figure, a device to be evaluated 10, a dialogue detecting device 11, a reference dialogue recording device 12, and a judging device 1
3, the reference interactive drawing device 14, and the display device 15 are the same as the respective devices described in the embodiment shown in FIG. Attribute recording device 16
The attribute of each response content is registered in. Figure 2 now
FIG. 6 is shown for each response content appearing in the standard dialogue history in (a).
It is assumed that attributes such as are registered in the attribute recording device 16. However, in this example, a portion to be ignored when comparing the contents is indicated by “*” so that the same attribute can be determined even when only a part of the display is different. The reference dialogue drawing device 14 retrieves the attribute of each response content of the reference dialogue and expresses the attribute when drawing with the node.

FIG. 7 is an example in which each attribute of the reference dialogue is represented by the drawing position of the node, and it is shown that nodes of the same level have the same attribute. The determination of the starting point and the jump destination of the erroneous operation arc is realized by the same operation as that of the first invention. An arc 71 in FIG. 7 is an example expressing an erroneous operation of the user dialogue history in FIG. In addition to this, as a means for expressing the attribute, it is possible to add a label or a color to each node or change the size or shape.

[0014]

As described above, the dialogue evaluation apparatus according to the present invention displays the reference dialogue registered in advance by the nodes and arcs on the straight line, and additionally draws only the erroneous operation portion of the user. By doing so, it is possible to easily detect an erroneous operation and to easily evaluate the erroneous operation.
Further, in the second invention, since the attribute of each response content is specified, it becomes easy to grasp the dialogue situation.

[Brief description of drawings]

FIG. 1 is a diagram showing an embodiment of a first invention.

FIG. 2A is a diagram for explaining a reference dialogue history,
(A) is a figure explaining the example of drawing of a reference | standard dialog diagram.

FIG. 3A is a diagram illustrating an example of a user interaction history, and FIG. 3A is a diagram illustrating a display method of an erroneous operation included in the user interaction history.

FIG. 4A is a diagram illustrating an example of another user interaction history, and FIG. 4A is a diagram illustrating a display method of an erroneous operation included in the other user interaction history.

FIG. 5 is a diagram illustrating an embodiment of the second invention.

FIG. 6 is a diagram illustrating an example of an attribute of response content.

FIG. 7 is an example in which the attribute of each response content is represented by the display position of a node.

[Explanation of symbols]

 10 Evaluated Device 11 Dialogue Detection Device 12 Reference Dialogue Recording Device 13 Judgment Device 14 Reference Dialogue Drawing Device 15 Display Device 16 Attribute Recording Device

Claims (2)

(57) [Claims] 1. A device to be evaluated having an operation unit and a display unit , and a regular dialogue procedure between the device to be evaluated and a user are described in the evaluation.
Value device operation content and the evaluated target for the operation content
A reference interactive recording apparatus for recording contents of the response devices based dialogue procedure time-sequenced, node the operation content of the reference dialogue procedure, said response
A reference dialogue drawing device for converting the contents into an arc reference dialogue diagram and displaying it on the display device, and the evaluation actually performed by the user connected to the evaluation target device.
Operation contents of the evaluation device and the response contents of the evaluated device
A dialogue evaluation device comprising: a dialogue detection device for detecting a dialogue history with the dialogue dialogue device; and a determination device for reading the dialogue history and comparing the dialogue history with the reference dialogue procedure to draw a different portion on the reference dialogue diagram. Wherein the object evaluation apparatus having a display section and an operation section, a regular dialogue procedure between the object evaluation device and the user, the Review
Value device operation content and the evaluated target for the operation content
A reference interactive recording apparatus for recording contents of the response devices based dialogue procedure time-sequenced, and the attributes recording apparatus for recording the attributes of each response content of the reference dialogue procedure, the node the operation content of the reference dialogue procedure , Within the response
Content is represented by an arc, and the above attribute is registered in the node representation.
A reference dialogue drawing device for displaying the recorded reference dialogue diagram on a display device, and the evaluation actually performed by the user connected to the evaluation target device.
Operation contents of the evaluation device and the response contents of the evaluated device
A dialogue evaluation device comprising: a dialogue detection device for detecting a dialogue history with the dialogue dialogue device; and a determination device for reading the dialogue history and comparing the dialogue history with the reference dialogue procedure to draw a different portion on the reference dialogue diagram.