JP2003140880A - Equipment operating device, program, recording medium and image forming device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an equipment operating device enabling even a visually handicapped person to easily perform various operations of equipment similarly to a healthy person. SOLUTION: This device is equipped with a function control part 110 for shifting the operation of the equipment to a voice mode, when a user is recognized to be a visually handicapped person, and an operation control part 120 for controlling various operations from the user in the case of the voice mode. The operation control part 120 controls a menu control part 160 for arranging operation items of the equipment as a hierarchical menu comprising set items and function numbers corresponding thereto, and managing movement to a desired set item on the hierarchy and the selection state of the set item, an operation input part 130 for inputting the movement to the set item on the hierarchical menu or the selection operation of the user, and a sound output part 180 for informing the user of the operation result by a sound and a voice according to the movement to the set item on the hierarchical menu or the selection by the user. Consequently, the visually handicapped person can operate the equipment without using vision.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus operating device, a program and a recording medium, and an image forming apparatus, and more particularly, to the functions provided by a copying machine, a facsimile apparatus, a printer apparatus, a scanner apparatus and their OA equipment. In various operations of the multifunction machine integrated into one unit, a device operating device capable of performing an operation in consideration of use by a visually impaired person, a program for executing the function of the device operating device, and a computer readable recording the program The present invention relates to a recording medium and an image forming apparatus.

[0002]

2. Description of the Related Art In recent years, a multifunction machine (hereinafter, referred to as an MFP (Multi-Fu) that integrates the functions provided by a copying machine, a facsimile machine, a printer machine, a scanner machine, and OA equipment thereof.
devices such as nctionPeripherals) have a variety of functions to handle, and it is no longer possible to operate only with the numeric keypad or function keys.Therefore, a touch panel is provided on the display, and characters indicating operation procedures and pictures showing the input location are displayed on the screen. 2. Description of the Related Art A touch panel input method in which a user touches an input area that is displayed and preset corresponding to a picture is widely used.

[0003]

[Problems to be Solved by the Invention] From the viewpoint of promoting social advancement of persons with physical disabilities, it is desirable to maintain an office environment so that persons with physical disabilities can work in the same way as sighted persons. In particular, in the United States, Article 508 of the Rehabilitation Act came into effect on June 21, 2001, and the US federal government is obliged to purchase equipment that can be used by persons with disabilities in IT equipment procurement. Is also following the movement.

The operation of the MFP as described above tends to become more complicated, and it becomes difficult to use it properly unless the instruction is displayed on the display panel or the touch panel. Therefore, it is difficult for persons with visual impairment to use the MFP effectively. For example, when a visually impaired person operates, it is difficult to operate because the effective touch area of the touch panel cannot be visually confirmed. In order to operate, the operation procedure and the position of the touch area must be remembered in advance. However, if the operating procedure of the device or the position of the touch area is changed, the operating procedure or the position of the touch area that the user remembers becomes invalid.

In order to solve this, the above-mentioned MF
When it is determined that there is a visual impairment by inserting an ID card or earphones that records information on the visually impaired person into P, voice guidance is performed by a voice synthesizer, or Braille guidance is performed using a braille output device. There is a device to go.

On the other hand, in the case of an automated teller machine such as an automatic teller machine or an automatic teller machine used in a financial institution, an ID card or earphone that records information of a visually impaired person is automatically dealt with. When it is determined that there is visual impairment by inserting it into the device, it has a key with Braille, a Braille output device that outputs arbitrary Braille, and a function that outputs voice guidance from the handset, and operation guidance from the handset By voice guidance, select the transaction type and enter the amount with the key with braille, and output the input result with a braille device so that even visually impaired people can perform transactions by their own operation There is.

However, the number of users with disabilities who need these measures is very small with respect to the number of users with sighted eyes. Too expensive to implement. Also, if an automatic transaction device that does not have a device such as a braille output device or a handset or an automatic transaction device that has a different position or usage method of the braille output device or handset exists at the same time, the user will be confused.

In order to solve the above problems, the present invention provides
A device operating device that allows the visually impaired person to easily perform various operations while suppressing the manufacturing cost of the device, a program for executing the function of the device operating device, and a computer reading the program recorded therein. An object of the present invention is to provide a recording medium and an image forming apparatus that can be used. Another object of the present invention is to provide a device that allows a sighted person to easily assist a visually impaired person.

[0009]

In order to solve the above problems, the device operating apparatus according to claim 1 of the present invention operates the device by voice mode when the user is recognized as a visually impaired person. And a function control unit for controlling various operations from the user in the case of this voice mode, wherein the operation control unit sets the operation items of the device as setting items and function numbers corresponding thereto. A menu control unit for arranging as a hierarchical menu consisting of, and managing the movement to a desired setting item on the hierarchy and the selection status of the setting item, and the user moving or selecting operation to the setting item of the hierarchical menu. The operation input section for inputting and the sound output section for notifying the user of the operation result by sound and voice in response to the user moving or selecting the setting item on the hierarchical menu are controlled, and the visual output is controlled. Obstacle Who is characterized in that to be able to operate the equipment without the use of vision.

According to a second aspect of the present invention, in the device operating device according to the first aspect, the sound output by the sound output section is a sound corresponding to the type of the setting item. Is characterized by.

According to a third aspect of the present invention, in the device operating device according to the first or second aspect, the sound output by the sound output section is different when the floor is moved up and down. It is characterized by having done.

Further, claim 4 of the present invention includes claims 1, 2
Or the sound output by the sound output unit is an operation sound, a sound icon, and / or B.
It is characterized by being GM.

Further, claim 5 of the present invention includes claim 1,
In the device operating device described in item 2, 3 or 4, the sound output from the sound output unit can be changed in voice or pitch, speed of sound, rhythm, tone and volume. .

According to a sixth aspect of the present invention, in the device operating device according to any one of the first to fifth aspects, a direction moving key or a substitute key thereof is used as the operation input section. And

According to a seventh aspect of the present invention, in the device operating device according to any one of the first to sixth aspects, the menu control section is such that the user performs a confirmation operation for each setting item. At this time, the provision of information on the setting item is notified by voice via the sound output unit.

[0016] According to an eighth aspect of the present invention, in the equipment operating device according to any one of the first to seventh aspects, the menu control unit is configured to allow the user to perform a collective confirmation operation. When the default value of the setting item is changed, the setting item is sequentially moved to the changed setting item, and the change of the setting content is notified by voice by the sound output unit.

According to a ninth aspect of the present invention, in the device operating apparatus according to the first to eighth aspects, the menu control unit sets a layer below a position currently being operated by a user on a hierarchical menu. When you perform the operation to return the setting value of the item to the default value, whether to return to the default value for each setting item,
It is characterized in that an inquiry is made by voice through the sound output unit.

According to a tenth aspect of the present invention, in the device operating apparatus according to the first to eighth aspects, the menu control unit sets a layer below a position currently being operated by a user on a hierarchical menu. When an operation of returning the set value of the item to the default value is performed, an inquiry is made by voice via the sound output unit as to whether or not all of the setting items under the hierarchy may be returned to the default value.

The eleventh aspect of the present invention is the device operating apparatus according to any one of the first to tenth aspects, further comprising a voice input section, and recognizing the voice of the user input from the voice input section. However, the menu control unit is directly moved to the setting item.

The twelfth aspect of the present invention is the eleventh aspect.
In the device operating apparatus according to the item (1), the voice of the user input through the voice input unit is a setting item name or a function number.

A thirteenth aspect of the present invention is the apparatus operating device according to any one of the first to twelfth aspects, further comprising a visual display device, and the menu control section allows the user to select the setting item. When is confirmed, the sound output unit notifies the determined operation content by voice,
The content determined at this time is also displayed on this visual display device.

A fourteenth aspect of the present invention is a thirteenth aspect.
In the device operating device according to, a visual input device is provided,
With respect to the setting status displayed on the visual display device, setting items input from the visual input device are also notified to the user of the setting status by the sound output unit, and can be used by both sighted people and visually impaired people. It is characterized by doing so.

[0023] A fifteenth aspect of the present invention is the apparatus operating device according to any one of the first to fourteenth aspects, wherein the operation control section is provided when an operation of the apparatus is in progress and / or when the operation is completed. The sound output section notifies the user of the operation result by sound and voice.

A program according to claim 16 of the present invention is a program for causing a computer to function as the device operating device according to any one of claims 1 to 15.

A recording medium according to claim 17 of the present invention is
A computer-readable recording medium in which the device operation program according to claim 16 is recorded.

An image forming apparatus according to claim 18 of the present invention selects and decides a setting item for a function of the image forming apparatus by using the equipment operating device according to any one of claims 1 to 15. It is characterized in that the image formation is performed from. Therefore, it is possible to provide a device in which the manufacturing cost of the device is suppressed, various operations can be easily performed even by a visually impaired person, and a sighted person can easily assist the visually impaired person.

[0027]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the description of this embodiment,
The device operation device of the present invention is an MFP (digital multi-function peripheral: Mult
It will be described as one incorporated in i-Function Peripherals) (hereinafter referred to as this device). However, the device operation device according to the present invention is not limited to be incorporated in the MFP, and the same effect can be expected by incorporating the device having various functions.

A. Outline of operation of this apparatus An outline of operation of this apparatus will be described below with reference to "operation for copying a document". First, by inserting a headset equipped with headphones and a microphone, it is determined that the device is used by the visually impaired (see FIG. 1). Less than,
A processing mode when a sighted person uses this apparatus is called a "normal mode", and a processing mode when a visually impaired person uses this apparatus is called a "voice mode". Further, a visually impaired person who uses this apparatus will be simply referred to as a “user”. Alternatively, the visually impaired person may judge that the visually impaired person should use the IC card by recognizing the non-contact type IC card for personal identification of the visually impaired person or storing information such as the operation record so far. Alternatively, by pressing a specific key, the visually impaired person may recognize the use.

Next, by pressing the "COPY" function key (see FIG. 2) on the operation section of the apparatus, the user is informed by voice from the headphones that "the copier can be operated". In addition, this device classifies all operation items that can be operated in advance for each device such as a copying machine or a facsimile device according to the function, and further subdivides the classification into a single layer having multiple layers. Create a menu. For example, the functions of the copying machine just described are classified into a hierarchy as shown in FIGS. 3 and 4 (these functional classifications are only a part).

The user uses the directional movement key of the operation unit or a substitute key (hereinafter, referred to as directional movement key) to move to a desired setting item by tracing the hierarchy of this hierarchical menu and select it. By repeating the operation to perform the desired setting and then pressing the start key, a copy of the document is created. In the process of operating the hierarchical menu by the user, this device provides the user with a description of the function to be selected and a description of the setting contents up to the present, such as voice, sound and BG.
By feeding back by M (Back Ground Music), it becomes possible to operate without looking at the display screen of the operation unit of this device or inputting from the touch panel. Here, the voice, the sound, and the BGM are changed and output according to the slowness of the rhythm, the pitch of the pitch, the type of the setting item, the processing status, the depth of the layer, and the like.

Further, the selection process by the directional movement key is made to substantially correspond to the transition of the screen of the operation unit, and
By allowing the input instruction from the touch panel of the operation unit to be used together, the operation from the touch panel of the operation unit and the operation from the direction shift key can be performed in parallel, so that the sighted person can assist the user. Further, if the user has low vision, the operation in the normal mode can be used while operating in the voice mode, which is convenient.

B. Details of operation in this device (1) Structure of menu All the operable operation items are classified by function for each device such as a copying machine, a facsimile device, a printer device, a scanner device, and a NetFile device handled by the device of the present invention. ,
Create a single menu with a multi-level tree structure, such as further subdividing the classification. For example,
If there are still detailed setting items such as "variable" and "double-sided", group them as subgroup names,
Under that subgroup, further "actual size", "magnification",
A setting item to be selected such as “reduction” is arranged, and the setting item is subdivided until it becomes one final setting item such as “115%” and “87%”.

As the types of items on this hierarchical menu,
There are the following. -Selection item that can be selected only one in the same layer For example, "115%" or "1" under the selection item of "Enlarge"
22% "etc. ・ Toggle item that can toggle ON / OFF of the function, eg whether or not the finisher sorts, etc. ・ Numerical item that can set a numerical value, eg, in case of the number of copies to be copied, after selecting that item Enter the value using the numeric keypad. -Operation item that starts some operation, for example, creation of a destination list registered in the facsimile machine

For example, in the case of a copying machine, first, as shown in FIGS. 3 and 4, the operation items of the first layer are (number of copies, originals, paper, scaling, double-sided / consolidation / division, finisher),
They are subdivided into the second layer and the third layer, respectively. Also, as shown in FIG. 3, setting items of each layer correspond to numbers, and by specifying these numbers, the setting items can be directly selected without tracing each layer. . Hereinafter, this number is referred to as "function number".

(2) Menu Operation Method Next, a method of operating the above-mentioned hierarchical menu will be described. FIG. 2 is a schematic diagram of an operation unit included in this device. In FIG. 2, the operation unit is a function key for selecting each function such as copying, facsimile, printer, scanner, and net file, a screen for displaying operation status and messages, and a touch panel for selecting various setting items on the screen, It is equipped with direction keys or substitutable keys, numeric keys for entering numbers, start / stop keys, and setting confirmation keys. To move / select the setting items arranged on the above-mentioned hierarchical menu, the directional movement key or a key that can be used instead of the direction movement key is used, but in the following description, the numeric keypad is used instead. FIG. 6 shows the functions assigned to each numeric keypad.

That is, the hierarchy is moved up and down by depressing the vertically arranged keys in the ten-key, and the adjacent items in the same hierarchy are operated by the horizontally arranged keys in the ten-key. In FIG. 6, pressing the key “2” moves up the hierarchy, and pressing the key “8” moves down the hierarchy. Also, pressing the key "4" traces the same layer to the left, and pressing the key "6" traces the layer to the right. Incidentally, a direction moving key may be assigned in the reverse of the above.

When the user gives an instruction to move to the lower layer of the hierarchical menu, if there are a plurality of lower layer setting items, the setting item is moved to the next setting item by one of the predetermined methods listed below.・ Move to the first item in the lower layer. If none of the default values are used, for example, when selecting the type of document.・ Move to the currently selected item in the lower layer. For example, if there is an already set item in the setting items in the lower layer, the item is moved to the already set item in order to continue the setting after the item or to correct the contents of the item.・ Move to the default item in the lower layer. For example, in the case of the density setting, there are selection items of "light, normal, and dark", and generally, "normal" is set as the default value, but the default value is moved.

When the user operates the horizontal movement key to move a setting item in the same layer, the setting item at the end is moved to the setting item at the opposite end, and cyclic movement is performed. I do. By always moving in a certain direction, you can find the item you want to select. However, the user cannot grasp the number of setting items in this layer and is likely to get lost on the menu. Alternatively, this circulation movement may not be performed, and the movement may not be further performed when the end is reached. In this case, when the selection fails, the move key must be pressed in the opposite direction, but it is possible to grasp how many selection items there are.

Further, when the user does not know in which hierarchy in the middle of setting or wants to reselect from the beginning, for example, by pressing the key "1", the top hierarchy (from any hierarchy) ( In the example of FIG.
It is possible to return to the "first copy" number of copies (see Fig. 6). In this case, the setting items that have been selected so far can be stored in the apparatus and moved to the item that has been selected for setting up to that point with the movement key or the confirmation key.

Further, the user can directly move to a setting item he / she wants to set. For example, by pressing the key "0", a numerical value can be input, and the function number attached to the setting item to be moved directly is input there. For example, if the numerical value of "435" is input using the ten keys after pressing the key "0", the device will change to "magnification" →
It is determined that “reduction” → “71%” is selected (see FIGS. 3 and 4). This function number may be a setting item in an intermediate layer instead of the setting item in the lowest layer.

Further, instead of directly inputting the function number of the item to be set by the key "0" as described above, the user presses the key "9" and the user selects "function number" or "setting item name". , The device recognizes it and moves directly to the item.

By pressing the partial clear key (assigned to the key "7"), the value of the setting item in the lower hierarchy from the current hierarchy on the hierarchy menu can be returned to the default value. When setting values are returned, inquire about each setting item and only the items that can be returned are returned to the default values. Alternatively, it may be inquired whether or not to return all the setting items whose default values have been changed. For example, if you are currently in the "Finisher" section of the hierarchical menu, if you change the default value with the following settings "Sort / Stack", "Staple", and "Punch", you must clear that setting value. Restore defaults.

Further, in order to know what kind of setting item the user has selected so far, the user presses the "confirm setting" key to sequentially change from the default value to the setting item whose setting has been changed. You can move it and change its settings.

When the item to be set or the numerical value input is completed as described above, the key "#" is pressed to confirm the set item. As a result, the present apparatus displays the contents of the confirmed setting item on the screen of the operation unit.

Further, the IC set as above is set.
By storing the card with an operation name, the same operation can be executed from the next time by designating the operation name from the IC card and reading the operation content without resetting the same operation one by one.

(3) Feedback of operation sound of operation result, sound icon and BGM to user As described above, when performing operation of moving / selecting the setting items arranged on the hierarchical menu using the ten keys, The device notifies the user of the confirmation of the result of the following operation by an operation sound, a sound icon, and BGM (background music). Here, the sound icon is static information indicating the property of the target object, and refers to a static sound (short single sound) having different timbres for the purpose of discriminating the types of setting items.

The operation sound is a movement (chord or a very short melody) of the same tone color for the purpose of helping the image of the operation result, and the movement and the music theoretically correspond to each other. For example, ascending and descending tones for up and down in the hierarchy, ups and down dissonances that make you feel uneasy at dead ends (failure to move), and a dominant to mean solution for selection and confirmation. Use motion. In this way, by notifying the user with the operation sound that makes the user understand the operation image, the sound icon indicating the type of the setting item, and the BGM, it is possible for the user to recognize the current state and to make sure that the input has been made. Alternatively, it is possible to reduce anxiety about whether or not the operation is completed.

Also, operation sounds for notifying the movement of the upper and lower layers are prepared respectively, and when the user moves to the upper and lower layers, the operation sound is output to inform that the user has moved up and down the layers. This operation sound is different from the sound icon of the above setting item. Also, BGM at this time
Also, for example, if the BGM has a slow tone in the upper layer and the BGM has a faster tone in the lower layer, it is possible to recognize which side the layer is currently located. At this time, it is possible to notify the user that the user cannot move by outputting an operation sound as to whether or not there is a setting item in the lower layer of the destination. In addition, it is possible to inform the user of the number of setting items in the lower layer of the destination by the operation sound.

When the circular movement of the same level is not set in the present apparatus, when the movement is instructed in the horizontal direction and there is no item to move further, the operation sound of "dead end" is given to the user. Let me know. Furthermore, the user is also notified by an operation sound of "dead end" in the vertical direction of the hierarchy. Also, when a key such as move to the top, move in the horizontal direction, move directly, or press a key such as voice recognition is output, the operation sound confirming the selected operation is output, so that the user can be surely accepted the operation. I can recognize that.

Also, in the case of inputting a numerical value such as inputting the number of copies, it is possible to confirm that the numerical value is input by playing BGM until the input of the numerical value is completed.

The state of the apparatus during operation, for example,
"User is out of paper", "toner shortage", "paper jam", "front cover is open", etc. are notified to the user by voice. If such a state cannot be resolved immediately, if the voice is interrupted, the state cannot be grasped. For example, when the user is away from the apparatus while the copying operation is being performed and "a paper jam occurs", the user does not know only by this voice. However, if BGM is played after the voice, the user can recognize even in such a state.

When the user designates 40 copies, the BGM is sent so that the user can recognize how many copies have been completed, and the user can use that BG.
Depending on which side of M is heard, it is possible to know how far copying has progressed.

(4) Feedback of the operation result to the user by voice As described above, when performing the operation of moving / selecting the setting items arranged on the hierarchical menu using the ten-key pad, this apparatus uses the headset by voice. Confirm the operation result to the user by outputting from the headphones. By thus notifying by voice, the user can recognize whether the input and the operation result have been made surely, and anxiety can be reduced.

When the user moves to each setting item, the user can recognize which setting item the user has moved to by performing voice feedback with a predetermined content for identifying the item. In addition, when moving, the user is audibly fed back to the user as to whether or not there are more setting items below a certain setting item and how many items there are. For example, when moving to a setting item such as “enlarge” or “114%”, the item name is read aloud.

When the partial clear key (key "7") is pressed, a voice inquiry is made as to whether the setting change made from the current position on the hierarchical menu to the setting item on the lower layer is read aloud and returned to the default value. . At this time, instead of inquiring whether or not to return the set values to the default values one by one, inquire whether all the setting items in the lower layers may be returned to the default values. If OK, restore the default values at once. You may do it.

By pressing the key "5", for example, by pressing the key "5", which setting item is currently selected by the operation movement key, the information provision for the setting item is fed back by a voice having a predetermined content. The information includes, for example, the name and function number of the setting item. When the key "5" is pressed after confirming the setting of the paper to be A4 size, voice feedback is given, "The paper is set to A4 size".

When the selection of the setting item is completed and the confirmation operation is performed with the key "#", for example, the voice feedback of the predetermined contents for explaining the confirmed operation contents is performed. For example, when "200%" is selected / confirmed in "Enlargement", there is a voice feedback saying "Magnification is set to 200% enlargement".

When the "Confirm setting" key is pressed, the setting items whose settings have been changed by the user from the default values below the setting items (including the intermediate layer) on the current hierarchical menu are collectively voiced. Read it out and notify the user. At this time, instead of giving voice feedback to all setting items at a time, voice feedback is given for one setting item, and if there is an error in that setting item, correct it and operate the move key to set the next changed setting. It is also possible to move to the item and finally press the key “#” to finalize the item. Also, if you want to know all the setting items that have been changed from the default values so far, you can confirm all at once by moving to the top of the hierarchical menu with the key "0" and then pressing this "setting confirmation" key.

When the setting for each setting item is completed and the start key is pressed, when the operation for this setting is completed, voice feedback of a predetermined content for notifying the success or failure is performed. For example, the results such as “copying is completed when the magnification is changed by 122%” and “copying could not be performed due to paper jam” are voice-feedbacked.

In addition, the state of the apparatus during operation or operation is
After the operation sound, for example, "paper is exhausted",
Notify the user by the voice of the speaker different from the voice when operating the setting items such as "Toner is running low", "Paper jam has occurred", "Front cover is open", etc. .

By providing a knob for changing the pitch, volume, rhythm, tone and speed of the voice by the above-mentioned voice feedback, it is possible to make the voice output easy for the user to hear. Further, without waiting for the end of the voice feedback, the speech speed is automatically increased when the next key operation is performed, so that the user's irritability can be reduced.

By providing such a hierarchical menu structure and guidance by sound and voice, the user can get used to the operation almost by practicing for about 5 minutes when handling the apparatus for the first time.

By displaying the operation result by the user described above almost in synchronization with the screen of the operation unit of the present apparatus and inputting it from the touch panel of the operation unit, the sighted person can assist the visually impaired person. Alternatively, a person with low vision can view and operate the screen. For example, when a user loses control of an operation halfway through, the user can select a setting item on the touch panel with the assistance of a sighted person, and the setting is output to the headphones as a sound icon and voice, so the user can You can see if you have set.

(4) Example of Operation Next, an example of operation until the operation is completed by setting the number of copies to 2 using the above-described apparatus will be described. First, when the hierarchical menu is operated to move to the "number of copies", there is a sound icon "(pillon) number of copies" from the headphones, followed by a voice description of the setting items. When the user presses the key “#” here, BGM flows from the headphone between the voice guidance “Enter the number of copies with the (calan) numeric keypad and press the key #” and the numeric input. When the user presses "2" on the numeric keypad, the number entered from the headphones is read, and when the user presses the key "#",
From the headphones, you can hear the voice "The number of (Kylang) has been set to 2". Where "(pyron)"
The sound "(caran)" indicates the operation sound. After that, when the user presses the start key, BGM is played while copying from the headphones, and when it is finished, there is a voice guidance saying "two copies are finished".

C. Functional Configuration of Present Device FIG. 7 is a functional configuration diagram showing an embodiment of the present invention. The apparatus of the present invention shown in FIG. 7 is composed of a control unit 100 that performs execution control according to an instruction from a user, and a support unit 200 that performs voice recognition and voice synthesis processing according to an instruction from the control unit 100.

The control unit 100 includes a function control unit 110,
Operation control unit 120, operation input unit 130, visual input unit 14
0, a visual display unit 150, a menu control unit 160, a voice input unit 170, a sound output unit 180, and a function execution unit 190. The function control unit 110 determines whether to use the normal mode or the voice mode, prompts the user to use which device function such as a copying machine or a facsimile machine, and performs an initial setting for the operation. And control the whole. The function control unit 110 is normally in the normal mode, and when the user inserts a headset including headphones and a microphone, or when a specific key is pressed,
If a visually impaired person uses this device when he / she recognizes a non-contact type IC card for personal identification of a visually impaired person or for storing information such as past operation records, it is assumed that the visually impaired person will use the device to control the whole in a voice mode. To do.

The operation control unit 120 controls various input operations by the user and operations such as displaying the processing result thereof. The operation input unit 130 inputs numbers and the like from the ten keys. Further, in the voice mode, the operation input unit 130 inputs numbers from the direction keys for moving the hierarchical structure of the hierarchical menu, various execution keys for selecting and confirming setting items, and ten keys.

The visual input unit 140 generally uses a touch panel installed on the screen to perform input for selecting various setting items displayed on the screen in the normal mode. In the voice mode, it is used for selection of an item with the assistance of a sighted person and selection of a setting for a low vision person. In the normal mode, the visual display unit 150 displays various functions on the screen. In the voice mode, the setting items selected and confirmed by the user from the hierarchical menu are displayed on the screen. For the hierarchical menu corresponding to the device function designated by the user, the user selects and confirms the setting item using the numeric keypad, but the menu control unit 160 uses the numeric keypad and voice input to operate the hierarchical menu. Manage the current position on.

In the voice mode, the voice input unit 170 inputs the setting item name and the function number by the user, and hands over the result of voice recognition to the menu control unit 160. This allows the user to directly move to the desired setting item in the hierarchical menu. The sound output unit 180, in the voice mode, has the menu control unit 160 and the operation control unit 12.
With an instruction of 0, operation sounds, voice guidance, BGM, etc. indicating success or failure of various operations and function execution by the ten-key pad are output. After various setting items are selected, the function executing unit 190 executes a function (for example, a copying function, facsimile transmission / reception, etc.) with the setting.

Further, the support unit 200 includes a voice recognition unit 2
10, a voice synthesis unit 220. The voice recognition unit 210 is called by the voice input unit 170, and uses a voice recognition dictionary (for example, a copy machine dictionary) for the device function that the user is currently operating (voices produced by the user (operation). The result of voice recognition of the menu setting item name, function number, and operation command) is returned to the voice input unit 170. The voice synthesis unit 220 is called from the sound output unit 180, and when performing voice feedback to the user, the voice synthesis unit 220 uses the voice synthesis dictionary to synthesize the voice synthesized from the text.
Return to. Here, when performing voice feedback by the sound output unit 180, the recorded voice may be used instead of the voice synthesis by the voice synthesis unit 220 from the text.

The operation of the apparatus of this embodiment having the above-described structure will be described with reference to "operation for copying a document". First, when a user inserts a headset including headphones and a microphone, the function control unit 110 determines that a visually impaired person uses the device, and shifts to a voice mode. Alternatively, the visually impaired person may judge that the visually impaired person should use the IC card by recognizing the non-contact type IC card for personal identification of the visually impaired person or storing information such as the operation record so far. Alternatively, by pressing a specific key, the visually impaired person may recognize the use. Next, when the user presses a function key to select each function such as copy, facsimile, printer, scanner, and net file, the function control unit 110 determines the device function to be used by the user, and the device function. The hierarchical menu for is extracted from the hierarchical menu data and initialized.

The user moves the hierarchy up and down or moves to an adjacent item on the same hierarchy by using the direction movement keys or the ten keys. The operation input section 13 is used for input from the direction movement keys and the numeric keypad.
Perform at 0. The operation control unit 120 receives the input key information (for example, a code indicating a direction in the case of a direction movement key,
If it is a ten-key, the value of the number written on the key is passed to the menu control unit 160 to manage where it is in the hierarchical menu. Further, when input, the operation control unit 120 calls the sound output unit 180 to output the operation sound, the sound icon, and the setting item name of the destination moved by the move key by voice, and also the BGM corresponding to this item. Output. The voice at this time is a voice in which the item name is synthesized by the voice synthesis unit 220.

When the user gives an instruction to move to the lower layer of the hierarchical menu, if there are a plurality of lower layer setting items, the menu control unit 160 selects the next setting item by one of the methods listed below. Manage the current position on the hierarchical menu so that you can move to.・ Move to the first item in the lower layer.・ Move to the currently selected item in the lower layer.・ Move to the default item in the lower layer. When moving, the menu control unit 160 calls the sound output unit 180, plays the operation sound and BGM, and also outputs the setting item name by voice to notify the user that the operation is being performed reliably.

When the user operates the horizontal movement keys to move the setting items in the same layer, the menu control section 160 moves to the setting item at the opposite end after the setting item at that end. To manage the current position on the hierarchical menu as follows. Alternatively, the current position on the hierarchical menu is managed so as not to move further because there is no item to move further when the end is reached without performing this circular movement.
In this case, the sound output unit 180 is called to output a "dead end" operation sound to notify the user. When a dead end is reached in the vertical direction on the hierarchical menu, the operation sound of "dead end" is output to inform the user.

When the user presses the key "1" to instruct to return to the top hierarchy, the menu control unit 160
Stores the setting items selected so far, and manages the current position so that the setting items in the first menu of the highest hierarchy are set. At the time of this movement, the menu control unit 1
The 60 calls the sound output unit 180, outputs the sound of the sound icon and the setting item name of the moving destination thereof, and notifies the user that the operation is correct.

When the user presses the key "0" to instruct to move directly to the setting item to be set, the menu control section 160 calls the sound output section 180, and inputs the operation sound and "function number. Please output the voice and BGM. When the user inputs a number from the ten-key while the BGM is playing, the input number is read aloud via the sound output unit 180. Finally, when the user presses the key “#”, the menu control unit 160 causes the BGM
Stop playing, and output the operation sound and the name of the setting item of the function number corresponding to the numerical value input so far by voice, and manage the setting item as the current position. For example, if the user presses the key "0" and then inputs "435" using the ten-key pad, the voice feedback "The scaling has been set to 71% reduction" is given.

When the user presses the key "5" to instruct the provision of information as to which setting item of the hierarchical menu, the menu control unit 160 calls the sound output unit 180 and sets the sound icon and the setting item name. And the function number etc. are notified to the user by voice.

Further, when the user presses the key "9", the menu control section 160 calls the sound output section 180 and outputs a voice saying "Please speak the setting item name or function number" along with the operation sound. . Subsequently, the menu control unit 160 calls the voice input unit 170, causes the user to utter a “setting item name” or a “function number”, and recognizes the setting item of the recognition result recognized by the voice recognition unit 210 to the current position. Manage as. When the voice input is completed, the menu control unit 160 calls the sound output unit 180, outputs the sound icon and the input setting item name by voice, and notifies the user that the voice input is correctly recognized.

When the user presses the confirmation key “#” to instruct to confirm the selection of the setting item, the menu control unit 160 calls the sound output unit 180, and the operation sound and the confirmed operation content. Is output by voice to notify the user. In addition, the menu control unit 160 calls the visual display unit 150 and displays the determined content on the screen of the operation unit.

When the user presses the partial clear key to instruct to return the setting value of the setting item in the hierarchy below the current position on the hierarchy menu to the default value, the menu control section 160 causes the sound output section 180 is called and the user is notified by an operation sound and its command content (a message "Clearing the setting item in the current position on the hierarchy menu and the layers below it"). Next, the menu control unit 160
Asks the user to search for a setting item in the hierarchy below the current position on the hierarchical menu, and if that setting item has been changed from the default value, read the setting value of that setting item and return it to the default value. Contact us. When the user indicates that the setting may be changed (for example, by the setting key), the setting value of the setting item is returned to the default value. After that, a sound icon and a voice message of operation completion are output to notify the user that the partial clear is completed. Alternatively, instead of inquiring one by one here, it is possible to collectively inquire by voice whether the set values changed from the default values may be returned to the default values.

Further, when the user presses the “setting confirmation” key in order to know what kind of setting item the user has selected so far, the menu control section 160 causes the user to change the setting from the default value. The set items are sequentially moved, the sound output unit 180 is called, the set contents are read aloud, and the user is notified. At this time, the menu control unit 160 can manage the destination as the current position and correct the setting item if there is an error.

Further, the function control section 110 monitors the state of the apparatus during operation and, for example, "out of paper", "insufficient toner", "paper jam", "front cover is open".
In the case of etc., the sound output unit 180 is called, and after the sound icon, for example, “paper is exhausted”, “toner is running low”, “paper jam has occurred”, “front cover” Is opened "and BGM are output to notify the user.

When the setting of each setting item is completed and the user depresses the start key, the operation control unit 120 calls the function execution unit 190 to operate, for example, the device function initially selected by the user. For example, if the device function is related to a copying machine, the copy operation according to the setting is performed. When this operation is completed, the operation control unit 120 calls the sound output unit 180 and informs the user of its success or failure by voice. For example, the results such as “copying is completed when the magnification is changed by 122%” and “copying could not be performed due to paper jam” are voice-feedbacked. In addition, when the user specifies the copy of 40 copies, the operation control unit 120 sends BGM so that the sound output unit 180 can recognize how much copy is finished,
The user can know how much processing has been completed according to the progress of the BGM.

D. Other Device Configurations (Usage Forms) In the above-described embodiments, the device operation device (control unit 100 and support unit 200) of the present invention is incorporated in the MFP. Here, as another embodiment, as shown in FIG. 8, the control unit 100 of the device operating apparatus is incorporated into an MFP, a facsimile apparatus, a printer apparatus, a scanner apparatus, etc., and a general-purpose computer (hereinafter referred to as a PC) support section 200. May be incorporated. In this case, in order to communicate with the control unit 100 and the support unit 200, the communication unit 300 and the communication unit 400 are connected by a cable or a communication line (including a network). In such a configuration, when the voice recognition process is performed from the control unit 100, the key information indicating that the voice recognition process is requested and the voice data input by the voice input unit 170 are transmitted via the communication unit 300 to the communication unit. Then, the communication unit 400 calls the voice recognition unit 210 from this key information, attaches the previous key information to the voice recognition result, and sends it back to the communication unit 300. Based on the key information, the received data is determined to be the voice recognition result and returned to the voice input unit 170.

When the voice synthesis processing is performed from the control unit 100, the key information indicating that the voice synthesis processing is requested and the text sentence to be converted into voice data by the sound output unit 180 are communicated via the communication unit 300. Then, the communication unit 400 calls the voice synthesis unit 220 from this key information, attaches the previous key information to the voice synthesis result, and the communication unit 3
Send back to 00. The received data is judged from the key information as a voice synthesis result and returned to the sound output unit 180 of the control unit. When obtaining voice data, the recorded voice data may be selected according to the key information of voice data (classification of what kind of voice data is desired) instead of synthesizing voice from text. .

By thus dividing the functions between the MFP and the PC and the PC, each MFP or the like does not have the dictionary information having a large amount of data and the processing functions of the voice recognition and the voice synthesis that require a long processing time, like the support unit 200. In addition, the dictionary of the support unit, the processing system, and the PC itself can be easily maintained. In the case of such a configuration, the cost balance is better if a plurality of MFPs and the like are connected to one PC.

E. Embodiment as Program Each function constituting the above-described embodiment is programmed and written in advance in a recording medium such as a CD-ROM, and this CD-ROM is installed in a medium drive device such as a CD-ROM drive. By installing it in a computer equipped with it, storing these programs in the memory or storage device of the computer, and executing them,
It goes without saying that the object of the present invention is achieved. In this case, the program itself read from the recording medium realizes the functions of the above-described embodiments, and the program and the recording medium recording the program also constitute the present invention.

The recording medium is a semiconductor medium (eg, ROM, non-volatile memory card, etc.), optical medium (eg, DVD, MO, MD, CD-R, etc.), magnetic medium (eg, magnetic tape, flexible disk). Etc.).

Further, not only the functions of the above-described embodiments are realized by executing the loaded program, but the operating system or the like performs some or all of the actual processing based on the instructions of the program, The case where the functions of the above-described embodiments are realized by the processing is also included.

A program for realizing the functions of the above-described embodiments is loaded into a memory provided in a function expansion board or a function expansion unit, and a CPU provided in the function expansion board or the function expansion unit is instructed based on the instruction of the program. Includes the case where some or all of the actual processing is performed and the processing realizes the functions of the above-described embodiments.

Further, the above-mentioned program is stored in a storage device such as a magnetic disk of a server computer,
When distributed in a format such as download from a user's computer connected by a communication network, the storage device of this server computer is also included in the recording medium of the present invention.

[0092]

As described above, according to the present invention,
While reducing the manufacturing cost of the device, even visually impaired people can easily perform various operations on the device,
It was possible to provide a device that facilitates sighted persons to assist visually impaired persons.

[Brief description of drawings]

FIG. 1 is an explanatory diagram when a user uses an embodiment of the present invention.

FIG. 2 is a schematic diagram of an operation unit according to the present embodiment.

FIG. 3 is a diagram showing an example of a hierarchical menu (a part) relating to a copying machine.

FIG. 4 is a view showing a sequel to FIG. 3;

FIG. 5 is a diagram showing an example of expanding a hierarchical menu according to the present embodiment.

FIG. 6 is a diagram showing an example of the functional layout of the numeric keypad in the present embodiment.

FIG. 7 is a functional configuration diagram of the present embodiment.

FIG. 8 is a device configuration diagram of another embodiment of the present invention.

[Explanation of symbols]

100 ... Control part, 110 ... Function control part, 120 ... Operation control part, 130 ... Operation input part, 140 ... Visual input part, 15
0 ... Visual display unit, 160 ... Menu control unit, 170 ... Voice input unit, 180 ... Sound output unit, 190 ... Function execution unit, 2
00 ... support unit, 210 ... voice recognition unit, 220 ... voice synthesis unit, 300 ... communication unit, 400 ... communication unit.

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G10L 13/00 G10L 3/00 551A 15/00 551P 15/06 521W 15/28 3/02 A 21/04 3/00 Q H04N 1/00 B41J 29/00 T G10L 3/00 571H (72) Inventor Atsushi Yamane 1-3-6 Nakamagome, Ota-ku, Tokyo F-term (Reference) 2C061 AP03 AP04 BB10 in Ricoh Co., Ltd. CQ03 CQ14 CQ29 CQ32 CQ43 CQ47 2H027 FA30 FA35 GA11 GA19 GA32 GA48 GB13 ZA07 5C062 AA02 AA05 AB20 AB23 AC02 AC05 AE11 AF12 BA00 5D015 GG01 KK01 KK04 5D045 AB01 AB04 AB16 BA01 BA02

Claims (18)

[Claims] 1. A function control unit that shifts an operation of a device to a voice mode when a visually impaired person is recognized, and an operation control unit that controls various operations from a user in the voice mode. The operation control unit arranges the operation items of the device as a hierarchical menu including setting items and function numbers corresponding to the setting items, and manages movement to a desired setting item on the hierarchy and selection status of the setting item. Menu control section, an operation input section for inputting a user's operation to move to or select a setting item in the hierarchical menu, and a sound corresponding to the user moving or selecting the setting item in the hierarchical menu. And a sound output unit for notifying the user of the operation result by a voice so that a visually impaired person can operate the device without using the sight. 2. The device operating device according to claim 1, wherein the sound output by the sound output unit is a sound corresponding to the type of the setting item. 3. The equipment operation device according to claim 1, wherein the sound output by the sound output unit outputs different sounds when moving up and down in the hierarchy. apparatus. 4. The equipment operating device according to claim 1, 2 or 3, wherein the sound output by the sound output unit is an operation sound,
A device operating device comprising a sound icon and / or a BGM. 5. The equipment operating device according to claim 1, 2, 3 or 4, wherein the sound output by the sound output unit changes the pitch of the sound, the speed of the sound, the rhythm, the tone or the volume. A device operating device characterized by being able to do so. 6. The device operating device according to claim 1, wherein a direction moving key or a key that can be used instead of the direction moving key is used as the operation input unit. 7. The device operating device according to claim 1, wherein the menu control unit causes the sound output unit to operate when the user performs a confirmation operation for each setting item. An apparatus operation device characterized in that information provision of the setting item is notified by voice via the device. 8. The equipment operating device according to claim 1, wherein the menu control unit allows the user to set a default value of the setting item when the user performs a collective confirmation operation. When changed, the apparatus operating device is characterized in that the changed setting item is sequentially moved and the change of the setting content is notified by voice by the sound output unit. 9. The equipment operating device according to claim 1, wherein the menu control unit sets a setting value of a setting item of a layer below a position currently being operated by a user on a hierarchical menu to a default value. A device operating device characterized in that, when a returning operation is performed, an inquiry is made by voice through the sound output unit as to whether or not the setting value may be returned to the default value. 10. The device operating device according to claim 1, wherein the menu control unit sets a setting value of a setting item of a layer below a position currently being operated by a user on a hierarchical menu to a default value. A device operating device characterized in that, when a returning operation is performed, an inquiry is made by voice via the sound output unit as to whether or not all setting items under the hierarchy may be returned to default values. 11. The device operating device according to claim 1, further comprising a voice input unit, which recognizes a user's voice input from the voice input unit, and the menu control unit outputs the voice. An equipment operating device characterized in that it is adapted to directly move to a setting item. 12. The device operating device according to claim 11, wherein the user's voice input through the voice input unit is a setting item name or a function number. 13. The device operating device according to claim 1, further comprising a visual display device, wherein the menu control unit displays the sound when the user confirms the selection of the setting item. An apparatus operation device characterized in that the output unit notifies the determined operation content by voice and also displays the confirmed operation content on this visual display device. 14. The apparatus operating device according to claim 13, further comprising a visual input device, wherein the setting items input from the visual input device with respect to the setting status displayed on the visual display device are also the sound output unit. The device operating device is characterized in that the setting status is notified to the user so that both the sighted person and the visually impaired person can use it. 15. The device operating apparatus according to claim 1, wherein the operation control unit causes the sound output unit to perform an operation when the operation of the device is in progress and / or when the operation is completed. An equipment operation device characterized in that the result is notified to the user by sound and voice. 16. A program for causing a computer to function as the device operating device according to claim 1. 17. A computer-readable recording medium in which the device operation program according to claim 16 is recorded. 18. The apparatus operation device according to claim 1, wherein the image forming is performed after selecting and deciding a setting item for the function of the image forming apparatus. Image forming apparatus.