JP6005788B2 - Display operation device, control method thereof, and image processing device - Google Patents

Description

  The present invention relates to a display operation device for giving an instruction to an electronic device, and in particular, a display device that receives a user instruction using a user interface (UI) component such as a software key that triggers some processing, and such a display operation. The present invention relates to an image processing apparatus having the apparatus.

  As one type of image processing apparatus that is an electronic device, an image forming apparatus (typically a copier) is installed in many offices (company, office, etc.). The main function of the image forming apparatus is to form an image on a recording sheet. Therefore, the image forming apparatus often has a printer function and a copy function. An image forming apparatus is often connected to a network and used by a plurality of users. One type of such an image forming apparatus is a multifunction peripheral (MFP (Multi Function Peripheral)). The multi-function peripheral has a scanner function, and has a plurality of basic operation modes such as a copy mode, a facsimile mode (hereinafter, facsimile may be described as FAX or FAX), and a network compatible printer mode. . The scanner function is expected to be used more frequently in these image forming apparatuses. Even in the copy mode and facsimile mode, the scanner function can be used to scan images, set double-sided printing, consolidate (2 in 1 for 2 pages, 4 in 1 for 4 pages), enlargement, reduction, etc. .

  When using such an image forming apparatus, for example, the user performs the following operation. The user first causes the image forming apparatus to read image data in the scanner mode. Next, the user inputs various instructions from the operation panel to perform image processing (eg, aggregation). Thereafter, the user gives an instruction (printing on recording paper, transmission by facsimile, saving as a file, etc.) indicating that the image is to be finally processed. For example, a function setting screen in each operation mode is displayed on the operation panel. Therefore, the user can easily set various functions.

  Recently, a touch panel display is often used as an operation panel. The touch panel display includes a liquid crystal panel (display panel) and a touch panel laminated on the liquid crystal panel. Usually, an item (software key) for selecting an operation mode in the image forming apparatus is displayed on the touch panel display. The user who sees the display presses the position where the desired item is displayed on the touch panel display. The user feels as if he / she pressed a software key. Information regarding which position is pressed is sent to a computer that controls the image forming apparatus, and what operation is performed in accordance with the position is determined by a program executed on the computer.

  The touch panel display can provide both a display function and an operation function. It is superior in that it has a smaller installation area, a variety of display functions, and a variety of functions than those provided with a display unit and an operation unit separately.

  An MFP having such a touch panel display as an operation panel displays a copy start key (button) on the display as an initial screen in the copy mode, for example. When this copy start key is pressed, the document placed on the automatic document reader is automatically read by using it as a trigger, and a copy is formed on the recording paper.

  By the way, there are cases where it is desired to stop copying for some reason after starting copying. For this purpose, it is common to display a copy stop key together with a copy start key and stop the copy by pressing the copy stop key after starting the copy. However, when such a copy stop key is displayed together with a copy start key, there is a problem that the area of the touch panel display cannot be effectively used. Especially because MFPs are becoming more multifunctional, it is necessary to display a lot of information on the display, and it is necessary to display such information in an easy-to-understand and understandable manner. Uselessly should be avoided.

  In order to solve such a problem, Japanese Utility Model Publication No. 59-58457 (Patent Document 1) described later discloses a technique for using both a copy start switch and a copy stop switch. That is, a technique is disclosed in which a copy start key is used as a copy stop key during copying. In the device disclosed in this publication, one of the two characters “START” and “STOP” can be lit on the hardware key. The letter corresponding to any available function is lit on this key.

  On the other hand, in the MFP, various problems relating to so-called supply occur. For example, paper shortage, toner shortage, and paper jam. Japanese Patent Application Laid-Open No. 2004-133620 describes a plurality of states of a copying machine (paper shortage, toner shortage, paper jam, etc.) when copying is performed on a copy start push button for starting copying in a copying function operating device. The one that displays the pictograms is disclosed.

Japanese Utility Model Publication No.59-58457 JP 59-140463 A

  In the case of the technique described in Patent Document 1 and the technique described in Patent Document 2, keys or keys having different functions (hereinafter referred to as “keys”) are provided at the same position, and both are used in common. It is thought that it is based on the same idea. These techniques are excellent in that the area on the operating device can be effectively used by such techniques.

  However, there seems to be some further improvements in these technologies. That is a problem related to an MFP that employs a touch panel as described above as an operation device. A key for instructing execution of various functions may be displayed on the touch panel. In such an MFP, even if the technique disclosed in Patent Document 1 and Patent Document 2 is to be adopted, the following problem occurs. That is, in such an MFP, an execution instruction key is provided for each of the plurality of functions. This complicates a combination of a key that instructs execution of each function and a key for executing a process related to the key or a place where information related to the process is displayed. For this reason, it is difficult for the user to immediately respond to a problem when a problem occurs.

  Therefore, an object of the present invention is to provide a display operation device having a function such as a touch panel, and how various problems occur in relation to various functions or processing necessary in relation to execution of the functions. It is an object of the present invention to provide a display operation device capable of easily and immediately confirming whether it is a device, and an image processing device having such a display operation device.

  A display operation device according to a first aspect of the present invention includes a display-integrated operation panel having a display surface, and a first UI component display for displaying an image of a first user interface (UI) component on the display surface. In response to the user operating the first UI component displayed on the display surface by the first UI component display unit and the first UI component display unit, the process associated with the first UI component is activated. In response to the occurrence of a predetermined condition related to the process activated by the process activation unit in association with the first UI component, the second UI component is displayed on the display surface. And a second UI part display means for displaying the second UI part, and the second UI part is displayed at the display position of the first UI part so as to overlap the first UI part.

  When the execution of the process, which is the operation of the first UI component, is started, if a condition related to the process occurs, the second UI component is positioned at the display position of the first UI component. It is displayed so as to overlap the part. Since the user can view the second UI component without changing the viewpoint position, the user can view the second UI component and immediately execute the processing necessary to respond to the generated condition. It is possible to easily recognize the conditions. The user can easily understand the situation related to the processing related to the first UI component, and the operability is improved.

  As a result, for various functions, a display operation device that can easily and immediately confirm what kind of processing has occurred in relation to the problem occurring in connection with the function or execution of the function. Can provide.

  Preferably, the second UI component display means is responsive to the start of the process associated with the first UI component by the process activation means at the position of the first UI component on the display surface. The display operation device further includes a unit for displaying the second UI component, and the display operation device is further configured to stop the execution of the process activated by the process activation unit in response to the user operating the second UI component. Includes stopping means.

  By operating the second UI component, it is possible to cancel the process started by operating the first UI component. Since the second UI component is displayed at the same position as the first UI component, the second UI component is immediately generated when a situation for stopping the process started by operating the first UI component occurs. To finish the process.

  More preferably, the second UI component display means detects the occurrence of an event that is a failure of the process to be activated by the process activation means, and places the first UI component in the same position as the first UI component. Disabling means for disabling the user's operation on the first UI component is displayed by displaying the second UI component in an overlapping manner.

  When a processing failure by the processing activation means occurs, the second UI component is displayed at the same position as the first UI component, so that the user can easily understand the occurrence of the failure and can easily handle it. it can. Since the operation of the first UI component is disabled, a malfunction due to the occurrence of a failure can be prevented in advance.

  More preferably, the display operation device is attached to an image processing device that uses toner, and the first UI component display means displays an image formation start key for starting processing for forming an image using toner. And the disabling unit responds to the toner shortage detecting unit for detecting the shortage of toner used for image formation by the image processing apparatus, and the fact that the toner shortage is detected by the toner shortage detecting unit. Then, a supply message display means for displaying a message prompting the supply of toner as the second UI component is superimposed on the image formation start key.

  When toner shortage is detected during image formation using toner, a message prompting toner replenishment is displayed as the second UI component. Since toner can be replenished before starting image formation, the operation can be smoothed.

  The toner shortage detecting means may include means for separately detecting black and white toner shortage and color toner shortage. The replenishment message display means responds to the fact that the shortage of black and white toner or the shortage of color toner or both are detected by the toner shortage detection means, and replenishment of black and white toner, replenishment of color toner, or black and white toner and color toner. You may include the message display means classified by toner for displaying the display which prompts replenishment as a 2nd UI component.

  Since either the black toner or the color toner to be replenished is displayed by the second UI component, the replenishment work can be performed smoothly.

  Preferably, the first UI component includes a first key for instructing start of image formation using black and white toner and a second key for instructing start of image formation using color toner. The message display means for each toner prompts the toner to be replenished on the first key when the shortage of black and white toner is detected, and on the second key when the shortage of color toner is detected. Displays keys that contain.

  Which of the black toner and color toner should be replenished is displayed by the second UI component. Furthermore, even when black toner is insufficient, if there is color toner, it is possible to instruct the start of image formation using the color toner. Even if there is no black toner, the user can easily understand that an image can be formed using only the color toner, and the user can perform an appropriate operation.

  More preferably, the display operation device is attached to an image processing device that uses a recording medium. The first UI component display means is a means for displaying an image formation start key for starting processing for forming an image on a recording medium. The disabling unit includes a failure detection unit for detecting a failure occurring in the replenishment of the recording medium of the image processing apparatus, and in response to the detection of the failure by the failure detection unit, superimposed on the image formation start key, The second UI component includes a failure solution message display means for displaying a message for prompting the solution of the failure occurring in the recording medium.

  When a failure occurs in the recording medium, a message for urging the failure is displayed as a second UI component at the position of the first UI component. The user can easily recognize the occurrence of the failure and can appropriately deal with the failure.

  More preferably, the image formation start key includes first and second keys for instructing to form an image using black toner and color toner on the recording medium, respectively, and the second UI component includes the first UI component And the second key are displayed so as to overlap both.

  When a failure occurs in the recording medium, neither image formation using black toner nor image formation using color toner can be performed. Therefore, it is possible to prevent the apparatus from operating wastefully by disabling them by covering both the first and second keys.

  The display operation device may be attached to an image processing device that transmits image data via communication means. The first UI component display means is means for displaying an image transmission start key for starting processing for transmitting an image to a designated destination via the communication means. The disabling unit responds to a failure detection unit for detecting that an appropriate destination is not designated when an image is transmitted by the image processing device, and a failure detected by the failure detection unit, Overlaying the image transmission start key, the second UI component includes destination input message display means for displaying a message prompting the user to input an appropriate destination of the image.

  When an appropriate destination is not input as an image transmission destination, the fact that the destination should be input is displayed as a second UI component on the image transmission start key. Prior to image transmission, the destination can be input reliably, and failure in image transmission can be reliably prevented.

  There may be a plurality of first UI components, and the display color of the second UI component is different from the display color of the first UI component and may be displayed on any of the first UI components. The same color may be used.

  When the second UI component is displayed on any first UI component, it is displayed in the same color. When the second UI component is displayed, the user can easily understand the meaning and can perform an appropriate operation without hesitation.

  More preferably, the contour shape of the second UI component may coincide with the contour shape of the first UI component.

  The contour shape of the second UI component matches the contour shape of the first UI component. The user can easily understand that the two are related, and can perform an appropriate operation without hesitation.

  More preferably, the second UI part is transparently displayed so that a key displayed on a layer below the second UI part can be recognized.

  The first UI component displayed on the lower layer can be recognized through the second UI component. The user can easily understand what kind of problem has occurred for what kind of processing, and can cope with it appropriately.

  The display operation device further detects the occurrence of an event that is an obstacle to the process to be started by the process starting unit, and overlaps the first UI part at the same position as the first UI part, and the third UI part. By displaying, disabling means for disabling the user's operation on the first UI component may be included. At this time, the second UI component is displayed in the first display color, and the third UI component is displayed in the second display color different from the first display color.

  Since the second UI component is displayed in the first display color and the third UI component is displayed in the second display color, the user can display the UI component displayed on the first UI component in the second display color. It can be easily understood whether it is a UI component or a third UI component, and appropriate processing can be performed.

  There may be a plurality of first UI parts. In this case, the second UI component is displayed in the first display color when displayed on any of the plurality of first UI components, and the third UI component is displayed in the plurality of first UI components. When displayed on any UI component, it is displayed in a second display color different from the first display color.

  Even if the second UI part or the third UI part is displayed on any part of the first UI part, the user can distinguish the UI part by the display color, and can immediately understand the meaning. As a result, the user can immediately perform appropriate processing.

  An image processing apparatus according to a second aspect of the present invention is connected to any one of the display operation apparatuses described above, an image generation apparatus for generating image data, a display operation apparatus, and an image generation apparatus, and generates an image. An image processing unit that processes image data generated by the device based on an output instruction from the display operation device.

  As described above, according to the present invention, when the execution of the process is started in response to the operation of the first UI component, the second UI component is displayed when a condition related to the process occurs. The The second UI component is displayed at the display position of the first UI component so as to overlap the first UI component. The user can view the second UI component without changing the viewpoint position, and the user can immediately execute the processing necessary to deal with the generated condition or correctly recognize the generated condition. Can be easily done. It becomes easier for the user to understand the processing status related to the first UI component, and the operability is improved.

1 is a perspective view illustrating an appearance of an image forming apparatus according to an embodiment of the present invention. FIG. 2 is a diagram illustrating a simplified internal configuration of the image forming apparatus illustrated in FIG. 1. FIG. 2 is a block diagram illustrating a hardware configuration of the image forming apparatus illustrated in FIG. 1. FIG. 2 is a block diagram of a display 130 of the image forming apparatus shown in FIG. 1. 6 is a diagram illustrating an initial screen in a copy mode in a preview display of the image forming apparatus. FIG. FIG. 3 is a diagram illustrating a transition of display of a task trigger area when a paper out is detected in the image forming apparatus illustrated in FIG. 1. It is a flowchart which shows the control structure of the program which implement | achieves the display of FIG. FIG. 6 is a diagram showing a transition of display of a task trigger area when toner out is detected in the image forming apparatus shown in FIG. 1. It is a flowchart which shows the control structure of the program which implement | achieves the display of FIG. FIG. 8 is a diagram showing a transition of display of a task trigger area when document reading processing is executed in the image forming apparatus shown in FIG. 1. 1 is a first half of a flowchart of a program that realizes transition of display of a task trigger area as shown in FIG. 10 in the image forming apparatus shown in FIG. FIG. 11 is a second half of a flowchart of a program for reading an image that realizes transition of display of a task trigger area as shown in FIG. 10 in the image forming apparatus shown in FIG. FIG. 6 is a diagram illustrating a transition of display of a task trigger area when executing a copy process in the image forming apparatus illustrated in FIG. 1. 14 is a flowchart of a program for copy processing that realizes transition of display of a task trigger area as shown in FIG. 13 in the image forming apparatus shown in FIG. FIG. 6 is a diagram showing transition of display of a task trigger area when a facsimile transmission process is executed in the image forming apparatus shown in FIG. 1. 16 is a flowchart of a program for facsimile transmission processing that realizes transition of display of a task trigger area as shown in FIG. 15 in the image forming apparatus shown in FIG.

  In the following description and drawings, the same parts are denoted by the same reference numerals. Their functions and names are also the same. Therefore, detailed description thereof will not be repeated.

  In the embodiment of the present invention, the display operation device is used in combination with an image forming apparatus which is a kind of image processing apparatus. However, the display operation device according to the present invention is not limited to the image forming apparatus. The present invention can be applied to other apparatuses such as an image processing apparatus or an arbitrary electronic apparatus that gives an operation instruction using a screen.

  In the following description, a software key is given as an example of a UI component. However, the present invention is not limited to such an embodiment. The present invention can be applied to any UI component that can function as a trigger for starting or stopping some processing in response to an operation.

  An image forming apparatus 100 (see FIG. 1) described below includes a touch panel (hereinafter simply referred to as “touch panel”) as a display operation device.

  This image forming apparatus forms an image on a recording sheet by an electrophotographic method. This image forming apparatus has, as operation modes, a copy mode, a FAX mode, a document filing mode (a mode in which a read original image is stored in a storage device inside the image forming apparatus), and a mail mode (the read image is converted into an e-mail). Mode to send in attached format). The image forming apparatus may further include a network printer mode. However, the present invention is not limited to this, and is an image forming apparatus having at least one operation mode among four operation modes of a copy mode, a FAX mode, a document filing mode, and a mail mode, Any image forming apparatus that requests an operation of pressing a key displayed on the touch panel as a task trigger in the operation mode may be used. Further, the printing method is not limited to the electrophotographic method.

[Constitution]
An image forming apparatus 100 according to an embodiment of the present invention will be described with reference to FIGS.

  With reference to FIGS. 1 to 3, the image forming apparatus 100 includes a document reading unit 102, an image forming unit 104, a paper feeding unit 106, a paper discharge processing device 108, and an operation unit 120. The operation unit 120 includes a display 130 (hereinafter simply referred to as “display 130”) and a display operation unit 140. The display 130 includes a display panel 132 made of a liquid crystal panel or the like, and a touch panel 134 disposed so as to overlap the display panel 132. The touch panel 134 can detect that the user's finger has touched the surface and its position. Display operation unit 140 includes an indicator lamp 142, a power key 144, an energy saving key (hereinafter referred to as “energy saving key”) 146, and a home key 148 for returning the display of display 130 to the home screen. The home screen refers to a screen for the user to select various operation modes.

  Referring to FIG. 4, in more detail, display 130 is connected to bus 310 in addition to display panel 132 and touch panel 134 described above, and displays various keys described later by executing a predetermined display control program. Is connected to the UI control device 180, the UI control device 180, and the bus 310, and stores information related to various objects necessary for screen display. It includes a UI information storage device 182, and a display image generation device 184 that is connected to the UI control device 180 and the UI information storage device 182 and generates display images of various objects on the screen displayed on the display panel 132. The display 130 is further connected to the UI control device 180, the display panel 132, and the display image generation device 184, and is a display control device for controlling the display panel 132 so as to display the display image generated by the display image generation device 184. 186, and an operation detection device 188 that is connected to the touch panel 134 and the UI control device 180, detects that the user touches the touch panel 134, outputs its position coordinates, and gives the UI control device 180. The UI control device 180 detects information about which key the user has operated and what kind of locus the user's finger has drawn based on the position coordinate information and information about the display image, The result is output to the CPU 300 of the image forming apparatus 100 via the bus 310.

  The image forming apparatus 100 according to the present embodiment includes a display 130 and a display operation unit 140 including hardware keys and indicator lights as main operation devices. Unlike the software keys realized by the display 130, the keys (power key 144, energy saving key 146, home key 148) of the display operation unit 140 are realized by hardware keys.

  A feature of the present embodiment is that, with respect to keys displayed at the time of instructing execution of tasks such as reading of a document, facsimile transmission of a document, and copying, after the operation instruction is given by them, substantially the same display form ( Keys for color, shape, configuration (marks, etc.), design, etc.) and keys for instructing instructions related to the process for which an operation instruction has been given (stop, end, continue, etc.) is there. Here, for example, in the case of colors, whether or not they are similar is determined by comparing the distance between vectors indicating colors represented by RGB components (a vector of three elements) with the maximum distance between the vectors. For example, when it is within 5%, it may be determined that both are similar.

  Such processing is executed in any of the copy mode, mail mode, FAX mode, and document filing mode.

  In the following description, first, a schematic configuration of the image forming apparatus 100 will be described mainly using the copy mode as an example. After that, display transitions in document reading, facsimile mode, and copy mode will be described.

  In the copy mode, the document reading unit 102 and the image forming unit 104 mainly operate.

  In image forming apparatus 100, a document placed on a document placement table is read as image data by document reading unit 102. Various types of image processing are performed on the read image data, and the image data is output to the image forming unit 104.

  The image forming unit 104 prints an image of a document indicated by the image data on a recording medium (in many cases, a recording sheet). The image forming unit 104 includes a photosensitive drum 222, a charging device 224, a laser scan unit (hereinafter referred to as “LSU”) 226, a developing device 228, a transfer device 230, a cleaning device 232, a fixing device 234, and a static elimination (not shown). Including devices.

  The image forming unit 104 is provided with a main transport path 236 and a reverse transport path 238. The recording paper fed from the paper feed unit 106 is transported along the main transport path 236. The paper feed unit 106 pulls out the recording paper stored in the paper cassette 240 or the recording paper placed on the manual feed tray 242 one by one, and sends the recording paper to the main conveyance path 236 of the image forming unit 104.

  While the recording paper is being conveyed along the main conveyance path 236 of the image forming unit 104, the recording paper passes between the photosensitive drum 222 and the transfer device 230, and further passes through the fixing device 234 to be recorded. Printing on paper is performed.

  The photosensitive drum 222 rotates in one direction, and its surface is cleaned by the cleaning device 232 and the static eliminator and then uniformly charged by the charging device 224.

  The LSU 226 modulates a laser beam based on the image data to be printed, and repeatedly scans the surface of the photosensitive drum 222 in the main scanning direction with the laser beam to form an electrostatic latent image on the surface of the photosensitive drum 222. To do.

  The developing device 228 develops the electrostatic latent image by supplying toner to the surface of the photosensitive drum 222, and forms a toner image on the surface of the photosensitive drum 222.

  The transfer device 230 transfers the toner image on the surface of the photosensitive drum 222 onto a recording sheet that passes between the transfer device 230 and the photosensitive drum 222.

  The fixing device 234 includes a heating roller 248 for heating the recording paper and a pressure roller 250 for pressing the recording paper. The recording sheet is heated by the heating roller 248 and pressed by the pressure roller 250, whereby the toner image transferred onto the recording sheet is fixed on the recording sheet. The heater is heated by the electric power supplied to the fixing device 234 so that the temperature of the heating roller 248 becomes a temperature suitable for fixing. Note that when shifting to the energy saving mode, for example, the power supplied to the heater is stopped or reduced.

  A branching claw 244 is disposed at a connection position between the main conveyance path 236 and the reverse conveyance path 238. When printing is performed only on one side of the recording paper, the branch claw 244 is positioned, and the recording paper from the fixing device 234 is guided to the paper discharge tray 246 or the paper discharge processing device 108 by the branch claw 244.

  When printing is performed on both sides of the recording paper, the branching claw 244 is rotated in a predetermined direction, and the recording paper is guided toward the reverse conveyance path 238. The recording sheet passes through the reverse conveyance path 238, is reversed on the front and back, and is conveyed again to the main conveyance path 236. During the re-conveyance of the main conveyance path 236, printing on the back surface is performed and the recording paper is discharged. It is guided toward the paper tray 246 or the paper discharge processing device 108.

  The recording paper printed as described above is guided toward the paper discharge tray 246 or the paper discharge processing device 108 and discharged to the paper discharge tray 246, or the recording paper on each paper discharge tray 110 of the paper discharge processing device 108. Discharged to either.

  In the paper discharge processing device 108, a process for sorting and discharging a plurality of recording papers to each paper discharge tray 110, a process for punching each recording paper, and a process for stapling each recording paper are performed. For example, when a plurality of printed materials are to be created, each recording sheet is sorted and discharged to each paper discharge tray 110 so that a part of the printed material is allocated to each paper discharge tray 110. In addition, punched processing or stapling processing is performed on each recording sheet on the paper discharge tray 110 to create a printed matter.

  Note that a sensor for detecting toner shortage is provided for both black toner and color toner. Further, a paper sensor for detecting the absence of paper in the paper cassette 240 and various sensors necessary for detecting the occurrence of paper jam on the paper transport path are the main transport path 236 and the reverse transport path 238. Etc. are provided.

  Referring to FIG. 3, image forming apparatus 100 further includes an operation unit 120 capable of setting functions relating to a copy mode, a facsimile mode, a document filing mode, and a mail mode, a ROM 306 for storing a program, and the like, A hard disk 302 that is a non-volatile storage area capable of storing a program and data even when the program is interrupted, a RAM (Random Access Memory) 308 for providing a storage area when executing the program, and the above Various sensors 309.

  The image forming apparatus 100 further includes a document reading unit 102, an image forming unit 104, a FAX communication unit 160, an operation unit 120, a ROM 306, a hard disk 302, a bus 310 connected to the RAM 308, and an image forming unit connected to the bus 310. CPU300 for implement | achieving the general function as an apparatus is included.

  The hard disk 302 stores image data files of originals read by the image forming apparatus 100 together with save date / time and save user name for each folder.

  The ROM 306 stores programs and data necessary for controlling the operation of the image forming apparatus 100. The CPU 300 controls the image forming apparatus 100 according to the program and data stored in the ROM 306 and executes control related to each function of the image forming apparatus 100.

  As shown in FIG. 3, a public line is connected to the FAX communication unit 160 for image data transmission / reception, and a network line is connected to the network interface 304. A computer or the like using the image forming apparatus 100 as a network compatible printer is connected to the network line, or a computer or the like specified by a URL (Uniform Resource Locator) designated via the Internet is connected. . When connected to the Internet in this way, the image forming apparatus 100 can acquire necessary information via the Internet.

  The RAM 308 provides a function as a working memory that temporarily stores the results of calculation and processing by the CPU 300 and a function as a frame memory that stores image data.

  Control of the document reading unit 102, the image forming unit 104, the display 130 and the display operation unit 140 constituting the operation unit 120, the ROM 306, the hard disk 302, and the RAM 308 is performed by the CPU 300 executing predetermined programs. Note that the operation unit 120 communicates with the CPU 300 via an input / output interface.

  The operation unit 120 is configured by a plate-like panel that is provided so as to be easily viewed by the user. On the surface of the operation unit 120, the display 130 is in the left area, and the display operation unit 140 (the indicator lamp 142, the power key 144 that is a hardware key, the energy saving key 146, and the home key 148) is in the right area. Is provided. The display 130 and the display operation unit 140 are configured such that the operation unit 120 is integrated as a whole.

  As described above, the display 130 includes the display panel 132 and the touch panel 134 disposed on the display panel 132. On the display 130, a home screen for selecting an operation mode in the image forming apparatus 100, a current state of the image forming apparatus 100, a destination designation state, a job processing state, and the like are displayed on the display panel 132. A selection key which is a software key is displayed on the display area of the display panel 132. When the area where the selection key is displayed is pressed with a finger, the touch panel 134 detects the pressed position and indicates the position. Output information. By comparing the display position of the selection key and the output of the touch panel 134 on the program, the operation mode selection, function setting, operation instruction, and the like of the image forming apparatus 100 are performed. In addition to such a touch operation (command input operation based on a pressed position by a user), the image forming apparatus 100 supports the above-described gesture operation (command input operation based on an operation locus by a user).

The indicator lamp 142 of the display operation unit 140 is, for example, an LED (Light Emitting).
The CPU 300 controls lighting / extinguishing (/ flashing). When the user presses the power key 144 provided separately from the main power switch, the image forming apparatus 100 shifts from the standby mode (for example, only the FAX reception operation is possible with the main power on) to the normal mode, and the indicator lamp 142 lights up. When the time during which the user does not operate passes a predetermined time or when the user presses the energy saving key 146, the image forming apparatus 100 shifts from the normal mode to the energy saving mode, and the indicator lamp 142 blinks. When the user presses the energy saving key 146 in the energy saving mode, the image forming apparatus 100 shifts from the energy saving mode to the normal mode. The home key 148 is a hardware key for returning the display on the display 130 to the initial state (home screen).

  The image forming apparatus 100 according to the present embodiment includes the above-described four operation modes (copy mode, fax mode, document filing mode, and mail mode). The display 130 displays a function setting software key in each operation mode and, if necessary, a preview or destination setting key as an image forming image.

  In the memo display area 354, maintenance information and the like desired to be notified to all users of the image forming apparatus 100 are displayed.

[Basic copy screen layout]
FIG. 5 shows a basic layout (this is referred to as a “copy basic screen”) 510 in the copy mode operation on the display 130. The copy basic screen 510 is a screen that is displayed first when the copy mode is selected. In the present embodiment, the preview can be basically performed on all screens including the copy basic screen. A similar image preview can be selected, for example, when sending a fax, sending an image by e-mail, or filing an image. In any of these operation modes, the basic screen configuration regarding the preview display is the same. Therefore, in the following description, only the copy basic screen will be described.

  Referring to FIG. 5, a horizontal display 130 (for example, horizontal 1024 pixels × vertical 600 pixels) is assumed here. A system area 400 is arranged at the top. A preview area 480 is arranged at the center of the screen. On the left side of the preview area 480, a function selection area 410 for setting functions and confirming the contents of the functions is arranged. An area called an action panel area (hereinafter referred to as “action panel area 482”) is arranged in the upper right part of the preview area 480. A task trigger area 484 is arranged at the lower right of the preview area 480. These areas are changed in size according to the preview display mode.

  In the system area 400, the current state of the image forming apparatus 100 is displayed, the title of the operation mode being operated, and the status / state of the image forming apparatus 100 are displayed. For example, the system area 400 displays an operation mode name, an interrupt key, a login user name, a job status being processed, a built-in memory usage status, a time, and the like.

  In the function selection area 410, function selection menus (icons, keys, setting item screens, function list screens, etc.) operated by the user for setting each function, switching the display, and confirming the settings are displayed. These are for setting data conversion performed on image data of a document, conditions for executing a task, and the like. In the function selection area 410, a function icon group 512 and a text group 514 describing the function of each function icon are displayed.

  In preview area 480, an output (finished) image of the document is displayed. Each time the user instructs finishing, the image displayed in the preview area 480 is changed. At the time of reading, the read original image is displayed.

  A preview change key group for changing the display style of the preview area 480 is provided in the lower part of the preview area 480. The preview change keys include a rotation key for rotating the preview by a desired angle, a zoom bar for enlarging and reducing the preview image, an original display mode key 452 for instructing change to an original display mode to be described later, and a finished preview. A finish preview key 454 for instructing a change to the screen and a fit to screen key 456 for instructing a change to the fit to screen mode are arranged. An image editing key 468 for instructing a change to an image editing mode in which the document can be edited is arranged on the upper right of the preview area 480.

  When the number of pages of the document image displayed in the preview area 480 is large, a page selection key (page number input key, page feed key, page return key, single page display key, multiple page display key, etc.) not shown is displayed. To do. By flicking the document image displayed in the preview area 480, the document can be paged and paged back. When the document image displayed in the preview area 480 is large, a scroll bar capable of touch operation or gesture operation is displayed.

  In the action panel area 482, information on assistance, advice, and suggestions regarding the operation is displayed. For example, when a user selects a specific function, a function related to the function is displayed in the action panel area 482. Other functions may be displayed for the same purpose as that function. The user or a user of the group to which the user belongs may display the function selected in combination with the function selected by the user as a “recommended function”.

  On the left side of the action panel area 482, an action panel reduction key 486 operated by the user when the action panel area 482 is reduced is displayed. When the action panel reduction key 486 is pressed, the action panel area 482 is reduced and displayed in a key format on the right side of the screen. When this key is pressed, the action panel area 482 is again enlarged and displayed. In other words, the action panel area 482 can be reduced or enlarged by pressing a key by the user. Accordingly, the preview area 480 is enlarged or reduced. Confirmation of the preview image and confirmation of the operation hint can be easily performed based on the user's intention.

  In the task trigger area 484, an item (a software key which is a kind of UI component) serving as a trigger for starting a process in the image forming apparatus 100 is displayed. These items are displayed when all settings in a certain operation mode are completed and the image forming apparatus 100 can actually be operated. For example, in the task trigger area 484, a read start key, a monochrome copy start key, a color copy start key, and a clear all key (CA) are displayed. The reading start key is a key for starting a process of reading and previewing a document once in copying, FAX transmission, and the like. The black-and-white copy start key is a key for starting a process of forming a black-and-white image on a recording sheet immediately after reading an original, or a process of forming a black-and-white image on a recording sheet based on the read image. Similarly, the color copy start key is a key for immediately starting a process for forming a color image of a document or a process for forming a color image on a recording sheet based on an image once read. The clear all key is a key for clearing all input information. For example, when the clear all key is pressed during document reading, all the read documents are cleared and the screen returns to the initial copy screen.

  In the present embodiment, when a key for starting various processes (UI parts which are various keys in the task trigger area 484) is pressed, the other key related to the process is overlapped with the position of the key. For example, a cancel key or a stop key (another UI component) is displayed. At this time, the display forms (colors, shapes, outlines, configurations (marks, etc.), designs, etc.) of the keys displayed at the same position are substantially the same.

  The key display according to the present embodiment is realized in various aspects. The display mode of the task trigger area 484 and the control structure of the program that realizes such display will be described below when out of paper, toner out, document reading, and facsimile transmission.

<When out of paper occurs>
Referring to FIG. 6, when a paper out occurs, the display of task trigger area 484 changes as follows. Referring to the left side of FIG. 6, the task trigger area 484 normally includes a read start key 600, a clear all key 602, a black and white copy start key 604 for starting processing for forming an image using black toner, In addition, a color copy start key 606 for starting processing for forming an image using color toner is displayed. These are displayed at different positions so as not to overlap each other. However, since the clear all key 602 cannot be used before the reading is started, it is grayed out.

  As shown in the center of FIG. 6, when the user tries to output something on the paper (typically, when trying to execute a copy process), the required paper is not detected in the paper cassette 240. In addition, on the black and white copy start key 604 and the color copy start key 606, a paper out key 608 which is a message prompting the replenishment of paper is displayed at a position and shape so as to cover them. While the out-of-paper key 608 is displayed, the user cannot operate the monochrome copy start key 604 and the color copy start key 606. When the user replenishes the paper, the out-of-paper key 608 is erased as shown on the right side of FIG. 6, and a monochrome copy start key 604 and a color copy start key 606 are displayed. The user can start the copy process by operating these keys.

<< Program structure for realizing out-of-paper processing >>
FIG. 7 shows a control structure of a program for realizing the display of FIG. 6 in the form of a flowchart. Referring to FIG. 7, this program is periodically executed, and the result is displayed when it indicates that the user's operation requires output on paper. For example, the execution result of this program is displayed on the basic screen of the copy process. First, in step 540, it is determined whether or not a sheet required for output exists in the sheet cassette 240. If the determination is affirmative, control proceeds to step 542 where the read start key 600 is validated, the clear all key 602 is invalidated, and the monochrome copy start key 604 and color copy start key 606 are validated. If the out-of-paper key 608 is displayed, the out-of-paper key 608 is erased. After step 542, execution of this program is terminated and control returns to the parent routine. If the determination in step 540 is negative, control proceeds to step 544. In step 544, the read start key 600 and the clear all key 602 are validated, and the monochrome copy start key 604 and the color copy start key 606 are invalidated. Further, the out-of-paper key 608 is displayed at the same position as the monochrome copy start key 604 and the color copy start key 606 so as to overlap them. After step 544, execution of this program is terminated and control returns to the parent routine.

  Therefore, once the out-of-paper key 608 is displayed, the black-and-white copy start key 604 and the color copy start key 606 are not displayed unless the paper cassette 240 is replenished or the user changes the setting. Processing cannot be started.

<When toner runs out>
In the image forming apparatus, when toner runs out, it is impossible to form an image on a recording sheet. FIG. 8 shows a display form of the task trigger area 484 when toner runs out.

  The upper left of FIG. 8 is a display form of a normal task trigger area 484. Here, when the absence of black toner is detected, the display changes to that shown in the upper right of FIG. Referring to the upper right of FIG. 8, in this case, a black tonerless key 620 that is a message for prompting the supply of black toner is displayed at the same position so as to overlap both the black and white copy start key 604 and the color copy start key 606. Is done. In this example, the black tonerless key 620 is translucent, and the black and white copy start key 604 and the color copy start key 606 are seen through thereunder. However, as long as the black tonerless key 620 is displayed, neither the monochrome copy start key 604 nor the color copy start key 606 can be operated.

  On the other hand, when the absence of color toner is detected in the state where the task trigger area 484 is in the upper left of FIG. 8, the display changes as shown in the lower left of FIG. In this state, there is no color toner but black toner is sufficient. Therefore, color copying is not possible, but monochrome copying is possible. For this reason, the no color toner key 622 which is a message prompting the replenishment of color toner is displayed so as to be the same size at the same position as the color copy start key 606. The display of the monochrome copy start key 604 does not change. Since the color toner absent key 622 is translucently displayed, the color copy start key 606 can be seen below, but the color copy start key 606 cannot be operated. Therefore, monochrome copying can be started by operating the monochrome copying start key 604, but color copying cannot be performed unless the color toner is supplied.

  When it is detected that both the black and white toner and the color toner are insufficient, the display of the task trigger area 484 changes as shown in the lower right of FIG. That is, a black toner no key 624 is displayed on the black and white copy start key 604, and a color toner no key 622 is displayed on the color copy start key 606. Both the monochrome copy start key 604 and the color copy start key 606 cannot be operated, and copying cannot be performed.

  In any of the states shown in the upper right, lower left, and lower right of FIG. 8, when the toner is replenished, the display of the task trigger area 484 returns to the state shown in the upper left of FIG.

  FIG. 9 shows a flowchart of a program for realizing the display of the task trigger area 484 shown in FIG. This program is periodically executed by a timer. For example, this program is executed at intervals of 1 second. The result is reflected in the task trigger area 484 on, for example, a basic screen of processing (copy processing) using toner.

  The program starts at step 560, where it is determined whether there is sufficient black toner. If the determination is affirmative, control proceeds to step 562, and if negative, control proceeds to step 568.

  In step 562, it is determined whether there is sufficient color toner. If the determination is affirmative, control proceeds to step 566, and if negative, control proceeds to step 564.

  In step 566, the read start key 600 is activated. The clear all key 602 is displayed according to the situation at that time. That is, the clear all key 602 is validated when something is set, and the clear all key 602 is invalidated when nothing is set. Both the monochrome copy start key 604 and the color copy start key 606 are validated. The black toner-free key 624, the color toner-free key 622, the black toner-free key 620, etc. are all erased. As a result, the display shown in the upper left of FIG. 8 is realized. After step 566, execution of this program ends and control returns to the parent routine.

  On the other hand, in step 564, the read start key 600 is validated. The clear all key 602 is validated or invalidated depending on the situation. The black and white copy start key 604 is validated. The color copy start key 606 is invalidated. The black toner no key 624 and the black toner no key 620 are erased, and the color toner no key 622 is displayed. As a result, the display shown in the lower left of FIG. 8 is realized. After step 564, execution of this program ends and control returns to the parent routine.

  On the other hand, if the determination in step 560 is negative, it is determined in step 568 whether there is sufficient color toner. If the determination is affirmative, control proceeds to step 570, and if negative, control proceeds to step 572.

  In step 570, the read start key 600 is validated, and the clear all key 602 is validated or invalidated according to the setting. Both the monochrome copy start key 604 and the color copy start key 606 are invalidated. A black tonerless key 620 is displayed. The black toner no key 624 and the color toner no key 622 are erased. As a result, the display shown in the upper right of FIG. 8 is realized. After step 570, execution of this program ends and control returns to the parent program.

  On the other hand, if the determination result in step 568 is negative, the reading start key 600 is validated in step 572, and the clear all key 602 is validated or invalidated according to the presence / absence of the setting. Both the black and white copy start key 604 and the color copy start key 606 are invalidated, and both the black toner no key 624 and the color toner no key 622 are displayed. As a result, the display of the task trigger area 484 is as shown in the lower right of FIG. After step 572, execution of this program ends and control returns to the parent routine.

<Document scanning process>
Referring to FIG. 10, the display of task trigger area 484 changes as follows during document reading. Referring to the left side of FIG. 10, in task trigger area 484, read start key 600, clear all key 602, black and white copy start key 604, and color copy start key 606 are displayed as described above.

  Here, it is assumed that the user presses the reading start key 600 in order to read the document. The task trigger area 484 being read changes as shown in the center of FIG. That is, a reading stop key 610 is displayed over the reading start key 600. The reading stop key 610 and the reading start key 600 are displayed at the same position, the same shape, and the same size. The function of the reading stop key 610 is to stop the reading process started by operating the reading start key 600. The reading stop key 610 is displayed in the same display form at the same position as the reading start key 600. That is, the reading stop key 610 is displayed on the upper layer of the reading start key 600. When the expression is changed, the read start key 600 is displayed in a layer below the read stop key 610. The same applies to other keys. Any key cannot be operated when another key is displayed on the upper layer. That is, it is disabled.

  Further, when the reading is finished, instead of the reading stop key 610, as shown on the right side of FIG. 10, the additional reading key 612 has the same size as the reading stop key 610 at the same position as the read stop key 610. Is displayed. The function of the additional reading key 612 is to read a document image in addition to the document read immediately before and save it as a series of document images. This function can be considered to be resumed after the processing that was started when the read start key 600 is operated is once completed. The functions of both are similar to each other. Therefore, the additional reading key 612 is displayed in the same display form at the same position as the reading start key 600.

<< Program structure for realizing document reading process >>
The above-described display transition of the task trigger area 484 is realized by a program executed by a CPU (not shown) in the UI control device 180 of the display 130 shown in FIG. Hereinafter, as an example of such a program, a control structure of a program for reading a document whose display transition is shown in FIG. 10 will be described with reference to FIG. This program is started by the user operating the read start key 600 (see FIG. 10) in the task trigger area 484. Prior to this, the task trigger area 484 is displayed on the left side of FIG.

  Referring to FIG. 11, this program is started at step 700, and is executed when step 700 for confirming whether or not there is an original on the tray of the original reading apparatus and when the existence of the original cannot be confirmed, And step 702 which requests the user to check whether or not there is a document and returns control to step 700.

  When the document can be confirmed in step 700, the control proceeds to step 704. In step 704, as shown in the center of FIG. 10, a reading stop key 610 is displayed instead of the reading start key 600. The reading stop key 610 is displayed at the same position, the same shape, and the same size as the reading start key 600. In step 704, the display of the clear all key 602 is changed from the gray-out to the normal display, indicating that the clear all key 602 is valid. The black and white copy start key 604 and the color copy start key 606 are in an invalid display state.

  In step 706, one page of the original is read. At this time, the UI control device 180 sends a signal to the CPU 300 indicating that a document reading instruction has been issued. In response to this signal, the CPU 300 operates the document reading unit 102 to start reading the document. In step 708, the read image is stored in the hard disk 302 of FIG.

  Thereafter, in step 710, it is determined whether or not there has been an operation to cancel reading. That is, it is determined whether or not the reading stop key 610 shown in the center of FIG. If the determination is affirmative, control proceeds to step 718. In step 718, document reading stop processing is performed, and control returns to step 700. The document reading stop process is a process of returning the entire state of the image forming apparatus 100 to the state immediately before the last document reading (or additional reading of a document) is instructed.

  If the determination in step 710 is negative, control proceeds to step 712. In step 712, it is determined whether or not the clear all key 602 has been operated. If the determination is positive, control proceeds to step 720. In step 720, not only the read original data but also the original reading interruption process that clears everything including the setting is executed. After this, control returns to step 700.

  If the determination in step 712 is negative, control proceeds to step 714. In step 714, it is determined whether the read page is the last page. If the determination is negative, control returns to step 706. If the determination in step 714 is affirmative, control proceeds to step 716.

  In step 716, a display transition from the center of FIG. That is, instead of the reading stop key 610, an additional reading key 612 having the same size and the same display form is displayed at the same position. The clear all key 602, the monochrome copy start key 604, and the color copy start key 606 are all valid. Thereafter, control proceeds to step 722 shown in FIG.

  In step 722, it is determined whether or not the color copy start key 606 has been operated. If the determination is affirmative, control proceeds to step 724. If the determination is negative, control proceeds to step 730.

  In step 724, the additional read key 612 is disabled and grayed out. The clear all key 602 remains valid. Instead of the monochrome copy start key 604 and the color copy start key 606, a copy stop key is displayed at the same position as these so as to overlap them (not shown in FIG. 10). Thereafter, in step 726, a process for outputting the document read so far in color is performed. Finally, the process of returning the display of the task trigger area 484 to the left side of FIG. That is, in step 728, the read start key 600 is enabled, the clear all key 602 is disabled, the monochrome copy start key 604 and the color copy start key 606 are both enabled, and the copy stop key is erased.

  On the other hand, when the determination at step 722 is negative, at step 730, it is determined whether the monochrome copy start key 604 has been operated. When the determination is positive, control proceeds to step 732. If the determination is negative, control proceeds to step 736.

  In step 732, as in step 724, the additional read key 612 is disabled, the clear all key 602 is enabled, and a copy stop key is displayed instead of the black and white copy start key 604 and the color copy start key 606. Thereafter, in step 734, a process for outputting the original image read and accumulated so far in black and white is performed. Thereafter, control proceeds to step 728 described above.

  If the determination in step 730 is negative, it is determined in step 736 whether or not the additional reading key 612 has been operated. If the determination is positive, control proceeds to step 738. If the determination is negative, control proceeds to step 740.

  In step 738, a reading stop key is displayed at the same position as the additional reading key 612. The clear all key 602 is validated. Both the monochrome copy start key 604 and the color copy start key 606 are valid. Thereafter, control proceeds to step 706 in FIG.

  If the determination in step 736 is negative, a determination is made in step 740 as to whether or not the clear all key 602 has been operated. When the determination is positive, control proceeds to step 742. If the determination is negative, control returns to step 722.

  In step 742, all the document image data read so far is cleared, and the control advances to step 728.

《Copy processing》
The display transition of the task trigger area 484 during the copy process is as follows. Referring to FIG. 13, at the start of copying, read start key 600, clear all key 602, black and white copy start key 604, and color copy start key 606 are displayed in task trigger area 484. When the user operates the black and white copy start key 604, as shown in the center of FIG. 13, instead of the black and white copy start key 604 and the color copy start key 606 (so as to overlap them), a copy stop key 630 is displayed. When the copying is completed, an additional copy key 640 having the same position and shape as the copy cancel key 630 is displayed instead of the additional monochrome copy start key 632 and the additional color copy start key 634 shown in FIG. In this case, when the additional copy key 640 is operated, an additional copy is executed in the same copy mode as the copy mode of the first pressed key (monochrome copy start key 604 or color copy start key 606).

<< Program structure for realizing copy processing >>
A control structure of a program for copying an original without reading and storing the original as shown in FIG. 13 will be described with reference to FIG. First, the task trigger area 484 is in a state as shown on the left side of FIG.

  Referring to FIG. 14, this program starts when the user presses monochrome copy start key 604 or color copy start key 606 shown in FIG. First, in step 750, it is confirmed whether or not there is a document on the tray portion of the document reading unit. If it can be confirmed, the control proceeds to step 754, and if it cannot be confirmed, the control proceeds to step 752. In step 752, a message prompting the user to confirm whether or not the document has been placed on the tray is displayed, and control returns to step 750.

  In step 754, the display of the task trigger area 484 transitions to a state as shown in the center of FIG. That is, the reading start key 600 is invalid and grayed out. The clear all key 602 becomes valid. The black and white copy start key 604 and the color copy start key 606 are not visible on the screen, and a copy stop key 630 having a position and size that includes both is displayed. Thereafter, control proceeds to step 756. In step 756, one page of the original is read. In step 758, the read image is output on a recording sheet. When the black and white copy start key 604 is pressed and execution of this program is started, the image formed in step 758 is a black and white image. When the color copy start key 606 is pressed and execution of this program is started, the image formed in step 758 is a color image.

  Thereafter, in step 760, it is determined whether or not a copy cancel operation has been performed. That is, it is determined whether or not the copy cancel key 630 shown in the center of FIG. 13 has been pressed. If the determination is affirmative, control proceeds to step 770. In step 770, document reading stop processing is performed, and control returns to step 700.

  If the determination in step 760 is negative, control proceeds to step 762. In step 762, it is determined whether or not the clear all key 602 has been operated.

  If the determination in step 762 is affirmative, control proceeds to step 768. In step 768, all the settings are cleared, the reading start key 600 is validated, and the clear all key 602 is invalidated. Both the monochrome copy start key 604 and the color copy start key 606 are validated. If the copy cancel key 630 and the additional copy key 640 are displayed, they are deleted. Thereafter, the execution of this program ends, and control returns to the parent routine.

  If the determination in step 762 is negative, control proceeds to step 764. In step 764, it is determined whether the copied page is the last page. If the determination is negative, control returns to step 756. If the determination in step 764 is affirmative, control proceeds to step 766.

  In step 766, the read start key 600 that has been invalidated is validated, and the clear all key 602 is also validated. The copy cancel key 630 is deleted, and the additional copy key 640 is displayed in a display form similar to these so that the black and white copy start key 604 and the color copy start key 606 overlap. After step 768, execution of this program ends and control returns to the parent routine.

<When sending a facsimile>
FIG. 15 illustrates the display transition of the task trigger area 484 during facsimile transmission. Referring to the lower left of FIG. 15, at the beginning of facsimile transmission, reading start key 600 and clear all key 602 and transmission start key 650 are displayed in task trigger area 484. The clear all key 602 is grayed out as in FIG.

  When the user operates the transmission start key 650, facsimile transmission is started. Before actually starting transmission, it is determined whether or not a valid destination is input. If a valid destination is not input, the display of the task trigger area 484 changes as shown in the upper left of FIG. . That is, instead of the transmission start key 650, a destination input key 652 that is a message for prompting input of an appropriate destination is displayed at the same position, the same shape and size as the transmission start key 650. The transmission start key 650 is invalidated. Therefore, facsimile transmission is temporarily impossible.

  When the user inputs a valid destination, the destination input key 652 is deleted and the transmission start key 650 is validated as shown in the lower left of FIG.

  It is assumed that the user operates the transmission start key 650 when a valid destination is specified. As shown in the center of FIG. 15, the read start key 600 is not operable and is grayed out. The transmission start key 650 is invalidated, and instead of the transmission start key 650, a transmission stop key 654 having the same shape is displayed at the same position. The transmission stop key 654 is for canceling facsimile transmission and has a function reverse to that of the transmission start key 650. Therefore, in the present embodiment, the transmission stop key 654 is displayed in the same display form as the transmission start key 650.

  When the facsimile transmission is completed, the reading start key 600 can be operated again as shown in the lower right of FIG. Further, the transmission stop key 654 is deleted, and an additional transmission key 656 having the same shape is displayed at the same position instead of the transmission stop key 654. The additional transmission key 656 is a key operated when an additional document is transmitted to the same transmission destination as the previous facsimile transmission. That is, the function of the additional transmission key 656 is different from the transmission start key 650 but is very similar. Therefore, in the present embodiment, additional transmission key 656 is displayed in the same display form as transmission start key 650.

<< Program structure for realizing facsimile transmission processing >>
Referring to FIG. 16, the program for realizing the transition of the display of task trigger area 484 in the facsimile transmission shown in FIG. 15 has the following control structure. First, it is determined whether or not the transmission start key has been operated (step 900). If the determination is negative, a transmission condition setting process is executed in step 920, and step 900 is repeated again.

  If the determination in step 900 is affirmative, it is determined in step 902 whether a valid destination is set. If the determination is affirmative, control proceeds to step 904, and if negative, control proceeds to step 922.

  In step 922, a transition from the lower left to the upper left task trigger area 484 in FIG. 15 occurs. That is, the read start key 600 is validated. The clear all key 602 is also activated. Instead of the transmission start key 650, a destination input key 652 having the same size is displayed at the same position. Subsequently, in step 924, the destination is set by the user. In step 926, it is determined whether a valid destination has been entered, and steps 924 and 926 are repeated until a valid destination is entered. If there is a valid destination input, the destination input key 652 is erased in step 928 and the transmission start key 650 is displayed. That is, the task trigger area 484 has a display form as shown in the lower left of FIG. Thereafter, control returns to step 900.

  On the other hand, if the determination in step 902 is affirmative, in step 903, the read start key 600 is invalidated. The clear all key 602 is activated. Overlaying the transmission start key 650, a transmission stop key 654 having the same position and the same size is displayed. In subsequent step 904, reading of the document to be transmitted is started. In step 906, the read image is transmitted by facsimile to the transmission destination. In the following step 908, it is determined whether or not the transmission stop key 654 has been operated. If the determination is affirmative, control proceeds to step 916, otherwise control proceeds to step 910.

  In step 916, reading cancellation processing is executed, and the execution of this program ends.

  On the other hand, in step 910, it is determined whether or not the clear all key 602 has been operated. If the determination is affirmative, control proceeds to step 918, otherwise control proceeds to step 912.

  In step 918, the reading interruption process is executed, and the execution of this program is terminated.

  On the other hand, in step 912, it is determined whether or not the original image read in step 904 is the final original image. If the determination is affirmative, control proceeds to step 914, otherwise control proceeds to step 904, and the next original is read. In step 914, the read start key 600 is validated. The clear all key 602 is activated. The transmission stop key 654 is deleted, and instead, the additional transmission key 656 having the same position and the same size as the transmission stop key 654 is displayed, and the execution of the program is terminated.

[Operation]
The image forming apparatus 100 operates as follows. In the following description, only the part related to the display transition of the task trigger area 484 will be described.

<Scanning Documents>
Referring to FIG. 10, in task trigger area 484, read start key 600, clear all key 602, monochrome copy start key 604, and color copy start key 606 are displayed. Of these, the clear all key 602 is disabled and grayed out.

  Assume that the user places a document on the document tray of the document reading unit 102 and presses the read start key 600. Execution of the program shown in FIG. 11 is started. The determination in step 700 is affirmative. In step 704, a reading stop key 610 is displayed instead of the reading start key 600, and the clear all key 602 is activated. The monochrome copy start key 604 and the color copy start key 606 are not changed. The reading stop key 610 is displayed in the same display form as the reading start key 600. In this way, instead of the read start key 600, the read stop key 610 is displayed in the same table form as the read start key 600, so that the user can use the function of the read stop key 610 as the function of the read start key 600. Can be easily understood. Therefore, if the user wants to cancel the reading of the document for some reason, the canceling operation can be performed immediately.

  In step 706, one page of the document image is read and stored in the hard disk 302 in step 708. When the user does not operate the reading stop key 610 or the clear all key 602, the processing of steps 706, 708, 710, 712 and 714 is repeated until the last page. When all the originals have been read, the determination in step 714 is affirmative. In step 716, an additional read key 612 is displayed instead of the read stop key 610. The clear all key 602, the monochrome copy start key 604, and the color copy start key 606 are validated. The additional reading key 612 is displayed in the same display form as the reading start key 600. Therefore, the user can easily understand that the function of the additional reading key 612 is related to the function of the reading start key 600. When it is desired to perform additional reading, the user can immediately perform processing necessary for that (operation of the additional reading key 612).

  Thereafter, when the user operates the additional reading key 612, the reading stop key 610 is displayed in place of the additional reading key 612 in step 738 through the paths of steps 722, 730, and 736 shown in FIG. The clear all key 602 is valid. The monochrome copy start key 604 and the color copy start key 606 are also valid. As a result, the entire display of the task trigger area 484 is as shown in the center of FIG.

-Monochrome printing When a series of document reading is completed, the task trigger area 484 is displayed on the right side of FIG. 10 (step 716 in FIG. 11). Here, it is assumed that the user operates the monochrome copy start key 604. Then, the additional read key 612 is invalidated in step 732 through steps 722 and 730 in FIG. The clear all key 602 is validated. Instead of the black and white copy start key 604 and the color copy start key 606, the same copy stop key 630 as that shown in the center of FIG. 13 is displayed. The monochrome copy start key 604 and the color copy start key 606 are not displayed on the screen. Thereafter, in step 734, monochrome output processing of the document image read so far is executed. In step 728, the reading start key 600 is displayed, the clear all key 602 is enabled, and the monochrome copy start key 604 and the color copy start key 606 are enabled. As a result, the display of the task trigger area 484 returns to the state shown on the left side of FIG. Since the copy cancel key 630 as shown in the center of FIG. 13 is displayed at the same position as the black and white copy start key 604 and the color copy start key 606, the user needs to cancel the output. In such a case, the processing (operation of the copy cancel key 630) for that can be performed immediately.

-Color printing On the other hand, when a series of document reading is finished and the display of the task trigger area 484 is in the state shown on the right side of FIG. 10 (step 716 in FIG. 11), the user presses the color copy start key 606 It is assumed that it has been operated. Control then proceeds from step 722 to step 724 in FIG. In step 724, the additional read key 612 is disabled. The clear all key 602 is valid. Instead of the black and white copy start key 604 and the color copy start key 606, the same copy stop key 630 as that shown in the center of FIG. 13 is displayed. Therefore, in this case as well, when the monochrome copy start key 604 is operated, if the user wants to stop the output for some reason, the user can immediately perform the processing necessary for that (operation of the copy stop key 630). it can.

  In the document reading process, when the monochrome copy start key 604 or the color copy start key 606 is operated, the display of the task trigger area 484 returns to the state shown on the left side of FIG. That is, when the clear all key 602 is operated, the monochrome copy start key 604 is operated, or the color copy start key 606 is operated, the additional read key 612 displayed in the task trigger area 484 is deleted, and the read start key is displayed. 600 is displayed. On the contrary, if these keys are not operated, the additional reading key 612 is not erased. In this case, it can be said that these keys are keys that cancel the state in which additional reading can be performed. Since the additional reading key 612 is suddenly erased, there is an effect that the user is not confused.

《Copy processing》
The transition of the task trigger area 484 during the copy process is as shown in FIG. In the initial copy screen, the task trigger area 484 is in the state shown on the left side of FIG. Here, it is assumed that the user places a document on the tray of the document reading unit 102. At this point, the program whose control structure is shown in FIG. 7 is executed. If the necessary paper is not replenished to the paper cassette 240 (NO in step 540), the task trigger area 484 is in the state shown in the center of FIG. The shortage of paper becomes an obstacle during image formation. Therefore, the copy process cannot be started. Since the out-of-paper key 608 is displayed at the same position as the black and white copy start key 604 and the color copy start key 606, the user can immediately understand that paper replenishment is necessary. When the user replenishes the sheet, the determination at step 540 in FIG. 7 is YES, and the process at step 542 is executed. As a result, the display of the task trigger area 484 returns to the state shown on the right side of FIG. 6, and if there is toner, copying can be started.

  If there is no toner, a program whose control structure is shown in FIG. 9 is executed.

  Referring to FIG. 9, when there is neither black toner nor color toner, display of task trigger area 484 as shown in the lower right of FIG. 8 is realized through steps 560, 568 and 572. Since the black toner no key 624 and the color toner no key 622 are displayed at the same position and the same size as the black and white copy start key 604 and the color copy start key 606, the user needs to replenish black toner and color toner. Can be understood immediately.

  When there is no black toner and there is color toner, the display shown in the upper right of FIG. 8 is realized through the paths of steps 560, 568 and 570 in FIG. In this case, since the black toner-free key 620 is displayed at the same position as both the black and white copy start key 604 and the color copy start key 606 and the size that covers both, the user immediately determines that black toner should be displayed. Understandable.

  When black toner is present and color toner is absent, the display of the task trigger area 484 in the lower left of FIG. 8 is realized through the paths of steps 560, 562, and 564 of FIG. Instead of the color copy start key 606, the no color toner key 622 is displayed at the same position and in the same size and shape, so that the user can immediately understand that the color toner should be replenished.

  When both black toner and color toner are present, the display of the task trigger area 484 in the upper left of FIG. 8 is realized through the paths of steps 560, 562, and 566 of FIG. Since the monochrome copy start key 604 and the color copy start key 606 are displayed, the user can easily understand that both can be executed.

  If copying is possible, the user operates the monochrome copy start key 604 or the color copy start key 606 here. Then, the display of the task trigger area 484 is as shown in the center of FIG. That is, the copy stop key 630 is displayed at the same position as the black and white copy start key 604 and the color copy start key 606 so as to overlap them (steps 750 and 754 in FIG. 14). Therefore, when it is necessary to cancel the copy due to some circumstances, the user can immediately know that the copy cancel key 630 should be operated, and can immediately execute the operation. If the user operates the copy cancel key 630, the determination in step 760 of FIG. 14 is YES, and a copy cancel operation is executed in step 770. The same applies when the clear all key 602 is operated (steps 762 and 764). However, when the clear all key 602 is operated, all the settings of the image forming apparatus 100 are cleared.

  If the copy cancel key 630 is not operated, the processes in steps 756, 758, 760, and 762 in FIG. 14 are repeated for the number of documents. When the image of the last document is read, the determination in step 764 is affirmative, and control proceeds to step 766. In step 766, the read start key 600 is validated. The clear all key 602 is also valid. Instead of the reading stop key 610 shown in the center of FIG. 13, an additional copy key 640 shown on the right side of FIG. 13 is displayed. As a result, the state of the task trigger area 484 changes to that shown on the right side of FIG.

  Referring to the right side of FIG. 13, the additional copy key 640 is displayed so as to cover both the black and white copy start key 604 and the color copy start key 606 in substantially the same position. Therefore, when an additional copy is necessary, the user can immediately execute a process necessary for that (operation of the additional copy key 640).

<< Facsimile transmission >>
In the case of facsimile transmission, the initial state of the task trigger area 484 is as shown in the lower left of FIG. Assume that the user places a document on the image forming apparatus 100 and operates the transmission start key 650. If a valid destination is not set (NO in step 902 of FIG. 16), the display of the task trigger area 484 changes to that shown in the upper left of FIG. 15 (step 922). Instead of the transmission start key 650, the destination input key 652 is displayed at the same position and the same size, so that the user can easily understand that the destination should be input. When the user inputs a valid destination (YES in step 926), the display of task trigger area 484 returns to that shown in the lower left of FIG. 15 (step 928).

  Here, when the user presses transmission start key 650, the determination results in steps 900 and 902 in FIG. Since the transmission stop key 654 having the same size is displayed at the same position as the transmission start key 650 (step 903), if it becomes necessary to cancel the facsimile transmission for some reason, the user presses the transmission stop key 654. It can be operated immediately.

  As described above, according to image forming apparatus 100 according to the present embodiment, when a key (button) for issuing an instruction to start some processing is operated, another key related to the processing is placed at the same position as that key (button). Another key for instructing the process (interruption or stop of the process) or the like is displayed. The other keys are displayed in the same color (for example, red). As a result, the user can immediately perform a necessary operation for the process instructed to start. In addition, when the process to be instructed cannot be executed for some reason, the message about the cause or countermeasure is in the same position as the key (button) to instruct the instruction in the same display form (shape, configuration, design, etc.) Is displayed. Note that messages displayed at this time (out of toner, out of paper, no address input, etc.) are displayed in the same color (for example, orange). As a result, necessary processing can be performed before the start of processing, so that processing can be performed smoothly.

  In the above-described embodiment, an example in which out of paper is displayed in the task trigger area 484 has been described. However, the event to be displayed in the task trigger area 484 is not limited to this. For example, the same display can be realized for a paper jam state at the time of copying.

  In the above embodiment, the black toner no key 624 and the color toner no key 622 are displayed on the black and white copy start key 604 and the color copy start key 606. Moreover, since the black toner-free key 624 and the color toner-free key 622 are translucent, the user can confirm on which key they are displayed. Of course, the present invention is not limited to such an embodiment, and the black toner-free key 624 and the color toner-free key 622 may be opaque.

  Further, in the above embodiment, for example, even when there is no black toner and there is color toner, copying is not possible. However, since black can be expressed by color toner, the color copy start key 606 can be validated even when there is no black toner.

  In the above-described embodiment, a software key is taken as an example. However, it will be apparent to those skilled in the art that the present invention is not limited to such embodiments and is generally applicable to UI components that can be used as a trigger for some processing.

  As described above, a display operation device according to one aspect of the present invention includes a display-integrated operation panel having a display surface, and a first user interface (UI) that can accept an operation by a user on the display surface. ) In response to detecting the user's operation by the first UI component display means for displaying the image of the component and the first UI component displayed on the display surface by the first UI component display means. And a second UI component display means for displaying a second UI component including a message related to the event causing the failure on the first UI component. The first UI component is a key for instructing the start of processing associated with the first UI component.

  Preferably, the second UI part is displayed so as to cover at least a part of the first UI part or to overlap with the first UI part.

  More preferably, the message included in the second UI component is a message related to the cause or countermeasure of the event that causes the failure.

  The display operation device may be attached to an image processing device that uses toner. The first UI component display means includes means for displaying on the display surface an image formation start button capable of accepting an operation by the user for starting processing for forming an image using toner. . The operation disabling unit is configured to start image formation in response to a toner shortage detecting unit for detecting a shortage of toner used for image formation by the image processing apparatus and a toner shortage detecting unit detecting a shortage of toner. The second UI component may include supply message display means for displaying a message for prompting toner supply on the display surface so as to cover at least a part of the button.

  The toner shortage detection means may include means for separately detecting the shortage of black and white toner and the shortage of color toner used for image formation. The replenishment message display means responds to the detection of black and white toner shortage or color toner shortage or both by the toner shortage detection means, and black and white toner replenishment, color toner replenishment, or black and white toner and color toner replenishment. Message display means for each toner may be included for displaying on the display surface a display prompting replenishment as a second UI component so as to cover at least a part of the image formation start button.

  The first UI component may include a first button for instructing start of image formation using black and white toner, and a second button for instructing start of image formation using color toner. In this case, the toner message display means covers the second button when the shortage of color toner is detected so as to cover at least a part of the first button when the shortage of black and white toner is detected. A message for prompting toner replenishment is displayed on the display surface as a second UI component so as to cover at least a part.

  The display operation device may be attached to an image processing device that uses a medium. The first UI component display means includes means for displaying on the display surface an image formation start button capable of accepting an operation by the user for starting processing for forming an image on the recording medium. In this case, the operation disabling unit includes a failure detection unit for detecting a failure occurring in the replenishment of the recording medium of the image processing apparatus, and an image formation start button in response to the detection of the failure by the failure detection unit. The second UI component may include a failure elimination message display means for displaying on the display surface a message that prompts the elimination of the failure that has occurred in the recording medium.

  The image formation start button may include a first button and a second button that can be operated by the user to instruct to form an image using black and white toner and color toner on the recording medium, respectively. In this case, the failure elimination message display means displays the second UI component so as to cover at least a part of both the first and second buttons.

  The display operation device may be attached to an image processing device that transmits image data via communication means. In this case, the first UI component display means displays an image transmission start button capable of accepting an operation by the user for starting processing for transmitting an image to a designated destination via the communication means. Including means. The operation disabling unit responds to a failure detection unit for detecting a failure that an appropriate destination is not designated when an image is transmitted by the image processing apparatus, and a failure detected by the failure detection unit. In addition, as a second UI component, destination input message display means for displaying on the display surface a message prompting input of an appropriate destination of the image is included so as to cover at least a part of the image transmission start button.

  According to another aspect, an image processing apparatus according to the present invention is connected to any of the display operation devices described above, an image generation device for generating image data, a display operation device, and an image generation device, An image processing unit that processes image data generated by the image generation device based on an output instruction from the display operation device.

  According to still another aspect, a control method according to the present invention is a control method for a display operation device including a display-integrated operation panel having a display surface. This control method includes a first UI component display step for displaying an image of a first user interface (UI) component that can accept an operation by a user on a display surface, and a first UI component display step. In response to the detection of the user's operation by the first UI component displayed on the display surface, a process activation step for activating a process associated with the first UI component, and activation by the process activation step In response to detecting occurrence of an event that is a failure of processing to be performed, a second UI component that displays a second UI component that includes a message regarding the event of the failure on the first UI component Display step. The first UI component is a key for instructing the start of processing associated with the first UI component.

  The embodiment disclosed herein is merely an example, and the present invention is not limited to the above-described embodiment. The scope of the present invention is indicated by each claim of the claims after taking into account the description of the detailed description of the invention, and all modifications within the meaning and scope equivalent to the wording described therein are included. Including.

100 Image forming apparatus 130 Display 140 Display operation unit 484 Task trigger area 600 Read start key 602 Clear all key 604 Black and white copy start key 606 Color copy start key 608 Out of paper key 610 Read stop key 612 Additional read key 620 No black toner key 622 No color toner key 624 No black toner key 630 Copy stop key 640 Additional copy key 650 Transmission start key 652 Destination input key 654 Transmission stop key 656 Additional transmission key

Claims (4)

A display-integrated operation panel having a display surface;
A first UI component display means for displaying an image of a first user interface (UI) component capable of accepting an operation by a user on the display surface;
In response to detection of a user operation by the first UI component displayed on the display surface by the first UI component display means, a process associated with the first UI component is started. Process starting means for
In response to the detection of the occurrence of an event as a failure of the process to be started by the processing start means, by replacing the first UI component, a second UI component comprising a message about events to be the fault Second UI component display means for displaying
The display operation device, wherein the first UI component is a key for instructing start of processing associated with the first UI component. The display operation device according to claim 1, wherein the message included in the second UI component is a message related to a cause or countermeasure of the event that causes the failure. The display operation device according to claim 1 or 2 ,
An image generation device for generating image data;
An image processing apparatus, comprising: an image processing unit that is connected to the display operation device and the image generation device, and that processes image data generated by the image generation device based on an output instruction from the display operation device. A control method of a display operation device including a display-integrated operation panel having a display surface,
A first UI component display step for displaying an image of a first user interface (UI) component capable of accepting an operation by a user on the display surface;
In response to detection of a user operation by the first UI component displayed on the display surface in the first UI component display step, a process associated with the first UI component is started. A process startup step to
In response to detecting the occurrence of an event that is a failure of the process to be activated in the process activation step, a second UI component that includes a message relating to the event that becomes the failure is replaced with the first UI component. A second UI component display step for displaying,
The control method, wherein the first UI component is a key for instructing the start of processing associated with the first UI component.

Images