JPH0298692A - Method of selecting procedure and procedure execution monitor - Google Patents

Abstract

PURPOSE: To improve ability of a procedure selection computer by providing a spectrum information means which supplies, in response to observation of a device, spectrum diagnosis information. CONSTITUTION: A plant instrumentation 12 is monitored by meter position, a blink-warning lamp and a state display device such a CRT display and a plant computer 18 which controls a display 20. The plant computer 18, for display on a CRT type procedure display I/O unit 24 which is a means for procedure display and monitoring, supplies a procedure selection computer 22 with data. An operator 26 which utilizes procedure display operates a plant control part 28, so that the state of a plant 10 is changed into a desired direction. By supplying the data from a spectrum analysis device 16 and a pyrometer 18 and the data from an image processing computer 30 which monitors the plant state display part 20 with a camera 32, the ability of procedure computer 22 is raised.

Description

DETAILED DESCRIPTION OF THE INVENTION The present invention is directed to a method and apparatus for monitoring the execution of procedures. The invention also particularly relates to an apparatus for using optically derived inputs to select a preferred course of action to be performed by a human in an environment where the human is required to make a series of judgments, and in particular: Apparatus uses an optically derived input to activate a procedure selection system for selecting, via the optically derived input, an appropriate procedure for treatment based on a detected event. .

A computer-based system for initiating the execution of procedures associated with the operation of complex processes is disclosed in U.S. Pat.
, 815,014 and 4,803,039.

In this system, the plant is used to generate data that is used by the system to assess the condition of complex processes and to select appropriate courses of action to recommend to operators in response to deviations from normal conditions. Much reliance has been placed on the use of electrical or electronic signals generated by instrumentation. This system is limited in use in plants lacking adequate signals from instrumentation. Such systems also have difficulty accessing electrical signals destined for plant computers that cannot provide digital output to other computers or are limited by protocol constraints. I have a problem with that. Furthermore, electrical or electronic signals that are isolated in nuclear reactor systems that are under protection or accident conditions are often not readily available to such computer-based systems. Additionally, computer-based procedural systems often have only one type of sensor used in any given process capable of generating electrical or electronic output, making it impossible to generate multiple indications of system status. It is.

It is an object of the present invention to provide a system and method for monitoring procedure execution when operating a complex plant.

Another object of the invention is to supplement the information provided by the plant computer with information based on an analysis of the spatially distributed electromagnetic spectrum, which is not normally available to the plant operator.

Yet another object of the invention is the procedure i! ! The objective is to provide a procedure execution and monitoring system that can be separated from the data sources needed to drive the selection system.

Another object of the present invention is to directly monitor the physical location of an object rather than monitoring the output of a sensor that provides a report on the physical location.

Yet another object of the invention is to monitor readings that are not normally accessible to operators, such as instruments located at off-site locations.

An additional object of the invention is to track the physical trajectory of an object and select a procedure if the trajectory deviates.

Another object of the present invention is to use light to monitor a process that is subject to interruption.

Yet another object of the invention is to monitor the gas or liquid atmosphere of a controlled process.

Yet another object of the invention is to monitor the relative and absolute amounts of detectable nuclear emissions from materials in intimate communication with the core of a nuclear reactor, such as secondary coolant, and to -a of a type indicating the failure of the primary barrier to the release of the substance and, with the agreement of the operator, indicating the need for initiating procedures to prevent or minimize the extent of such release into the environment; In order to identify the presence of nuclear isotopes and their approximate concentration, a conventional CRT (cathode ray tube) is analyzed by a multi-channel analyzer connected to a gamma or X-ray spectrometer.
The objective is to monitor the visible representation of the gamma-ray and x-ray spectra generated by the

The above objects may be achieved by an apparatus for providing optically derived input to a computer-based procedure performance monitoring and guidance system. The spectrum analyzer receives spectra from the fluid source that are used to make decisions as to whether to trigger a procedure to correct the detected anomaly. A pyrometer monitors the process temperature and triggers a procedure if the temperature deviates from normal conditions. An image processing system monitors conditions, lamps, gauges, valve positions, and other visible information. Compare symptomatic features from the system with reference features to determine whether a procedure should be triggered or not. When a procedure is triggered, the operator monitors the procedure and determines the state of the plant according to the procedure. The optical interface and procedure computer, on the other hand, monitor changes or fluctuations in plant conditions and invoke other procedures as necessary to confirm the plant's response to the operator's control actions.

The present invention has the advantage of reducing or alleviating the burden placed on plant operators associated with monitoring annunciators or status lights and other types of visual indicators.

The invention also has the advantage of allowing for retrofitting of procedure selection and monitoring systems to existing plants.

Furthermore, the present invention has the advantage of providing a system that can be completely isolated from electrical feedback and electrical faults.

The invention will become more readily apparent from the following description of a preferred embodiment, illustrated in the accompanying drawings.

The present invention is directed to a combined image recognition, spectral analysis and computer-based procedure execution monitoring and guidance system, as shown in FIG. In this system, a human and a computer monitor a common source of information and simultaneously perform knowledge-based (by the human) and rule-based (by the computer) evaluations of that information to determine the appropriate course of action. Identification can significantly enhance the complementary relationship between operators and computer-based monitoring equipment in managing complex processes. By using spectral data collected simultaneously with the optical image data and computer analysis of these data, the system can expand the database to include nuclear information as well as temperature and chemical composition information. This facilitates monitoring and guiding the execution of procedures to correct abnormal conditions in complex processes such as drug manufacturing.

As shown in FIG. 1, a plant 10 (equipped with:
It is monitored not only by standard plant metering equipment 2 but also by one or more pyrometers (spectral information means) 14 and spectral analyzers (spectral information means) 16. Plan 1 - Gauges 2 are monitored by a plant computer 18 that controls meter positions, flashing indicator lamps, and status indicators or displays 20 such as CRT (cathode ray tube) displays. Some of the status display information does not pass through the computer 18 and therefore cannot be used by the computer 22, which is the procedure display and monitoring means, via the computer 18. No. 4, cited herein by reference.
, No. 815,014 and No. 4,803,039, the plant computer 18 has a CRT-type procedure display input/use which is procedure display and monitoring means, as shown by dotted lines. crab knit 24
Data is provided to a procedure selection computer 22 which selects procedures for the display above. Note that the broken line indicates that the data path between the plant computer 18 and the procedure selection computer 22 is optional in the case of the present invention. The present invention uses a spectrum analyzer 16 to change the state of the plant IO in a desired direction.
and an image processing computer (spectral information means) that monitors the plant status display unit 20 using data from the pyrometer 18 and a camera (spectral information means) 32.
It is contemplated that the capability of the procedure selection computer 22 will be enhanced by providing data from the procedure selection computer 30. The addition of these optical data sources enhances the ability of the procedure selection computer to monitor plant 10, select the appropriate procedure, and ensure that the procedure is effective. The above-mentioned U.S. patent specification describes a plant metering device 2.
, plant computer 18, plant status display section 20
, a procedure selection computer 22, a procedure display input/output unit I.24 and a plant control unit 2 are described in detail. Appropriate spectrum analyzer 1
6 is Fullerton, California (Ful 1cr)
Beckman Industries (13e) located in
ek+anIndustries), model DU
Series spectrophotometer (Model DU 5eri
es 5pectrophoLoa+eter). The spectra generated by the spectral analyzer 16 are from Aldrich Chemical Company.
can be compared to one of over 90,000 standard spectra available from any). A suitable pyrometer 4 is also available from Omega Engineering, Stamford, Conn., USA.
This pyrometer is suitable for measuring the temperature of remote objects. Other instruments that derive data from other parts of the electromagnetic spectrum may also be used, such as x-ray and gamma-ray detectors.

In other words, any device that can examine the spatially independent electromagnetic spectrum and provide data useful for diagnosing the process may be used. An image processing system, including a suitable camera 32 and an image processing computer 30, is manufactured by Versebtics, Inc., Knoxville, Tennessee, USA.
erceptics Corporation) from “
The procedure selection computer 22, suitable procedure selection software, and procedure display input/input unit 24 are available from the applicant as the "CONPRO" system.

According to the present invention, an optical image recognition system and/or an optical spectrum analysis device is associated or linked with an on-line computer-based procedure execution system. The optical image recognition device scans a visual display of information regarding a particular parameter, such as the pressure displayed on a remote meter or the position of an electrical circuit breaker, indicating the state phase of a complex process;
The optically captured information is converted into a set of functions (a set of numerical or logical values of variables) that is stored in the database of the procedure selection system. The optical spectrum analyzer scans the electromagnetic radiation emitted by the process environment and/or the process itself and converts the captured optical spectrum information into corresponding numerical or logical variable values that are stored in a database.

The procedure selection system computer then passes the selected information from the database through a series of diagnostic logic devices to evaluate the state of the process being monitored and diagnose the cause of the state change, as previously determined. Selects an appropriate course of action to be taken in response to the current process state from a set of procedures, and informs the human operator 26, via the procedure display input/use unit 24, of the results of the evaluation. Presents a summary of essential information, a course of action recommendation, and a request for operator response to the recommendation. Any event that is observable by a human involved in a complex process and that cannot be seen by humans but is “observable” by the optical elements of a system.
Various aspects of the process, along with information electrically or electronically derived from available process instrumentation, are stored in the database of the procedure selection system to guide human execution of procedures that are currently appropriate. Used for monitoring and guiding.

Image recognition systems provide online optical monitoring of analog and digital meters, level displays, annunciators, circuit breaker status indicators, etc., and the absolute or relative physical location of specific objects, including liquid levels in tanks. Alternatively, it can be applied to optical monitoring of locations and optical tracking of trajectories of specific objects. Also, if the CR already exists in the central computer,
It is also possible to optically monitor the information displayed on the T or its equivalent for later use in the system.

By using a color camera, information that appears in a particular color can also be identified and captured in a database.

In this way, the dependence on electrically or electronically derived information and its associated constraints makes it possible to optically obtain the data driving virtually all systems in a variety of applications. localized to the level where it is possible.

That is, optical scanning devices can be used in complex processes (building maintenance and environmental control, food processing, power generation, chemical processing).
Observing a series of meters at a control station for complex processes such as Alternatively, the optical scanning device may be provided with a procedure performance monitoring device (i.e., changing the format or extent of data collection does not result in a change in the procedure to be followed). "Detect the relative positions of objects that can be information on whether to do the following and take any other countermeasures if this is not the case. By using fiber optics to convey on-line optical information to the scanning device, the system allows positional relationships in remote or inconvenient locations that cannot be easily or conveniently accessed by the operator. can be monitored. Furthermore, the optical scanning device is capable of detecting successive positions of a moving object or object.

0 then the trajectory can be determined based on that,
This trajectory information can be fed into procedure selection software (which already knows the trends) and used to determine the state of the moving object and recommend the course of action to be taken.

Optical spectrum analyzers are used for the measurement of local temperatures and the detection of local heat sources according to the optical pyrometer principle and for the determination of the presence of fluids or liquids and their concentrations or processes according to the optical spectrometer principle in special applications. It can be applied to the detection and measurement of nuclear isotopes in the region. By exciting solids or liquids with a suitable energy source (e.g. electric spark or laser), the use of spectral analyzers can be extended to the determination of chemical composition and the detection of impurities in solids and liquids. It is. Alternatively or simultaneously, the spectral analyzer can be extended to measure the concentration of specific nuclear isotopes. The information obtained from optical spectral analysis enriches the databases used by procedure selection systems in evaluating the conditions of complex processes such as oil refining, pharmaceutical manufacturing, automated welding, nuclear power plant operation, etc. It can be used to.

The software of the procedure selection computer 22 could be modified to periodically initiate the spectral analyzer sample, the pyrometer sample and the image processing computer sample; FIG. 2 shows the image processing computer sample. FIG. 3 is a flow diagram of a routine that can be incorporated into the software of a procedure selection computer to initiate a procedure and trigger or initiate an appropriate procedure based on the analysis. The program shown in FIG. 2 could be activated periodically, based on clock interrupts or automatically during periodic data capture cycles of the procedure selection computer. initiates image capture by the image processing computer 30 by transmitting a signal to the image processing computer 30 via the interface (step 40). The beginning of image capture also begins the classification of features by the image processing computer 30. In this functional classification, depending on the type of function being classified, the position of the target or object, whether the part of the image has greater brightness than other parts of the image (for example, lighting of a lamp), etc. and other information related to the image. Once this image acquisition and classification has begun, computer 22 must determine whether the image acquisition and classification process is complete (step 42). If not, wait until the image capture process is complete (step 44) 6 Also, at this point, the procedure selection computer 22 may perform other processes or determine that image capture and functional classification are complete. An image processing computer 30 representing
It is also possible to wait for an interrupt from.

Once the classification is complete, the features are loaded into a common memory (step 46) and then compared to a known already existing feature set (step 48). This comparison can be a simple matrix-type data comparison when the function set classification indicates whether a warning lamp is on or not, or it can be based on more elaborate specialized system rules. It may be a comparison. Although many specialized systems are available for performing such rule-based comparisons, a preferred system is the PDS (Process Diagnostic System) available from the applicant; a detailed description of this PDS system is provided below. is disclosed in U.S. Pat. No. 4,649,515, and an example of the same system used to diagnose mechanical malfunctions is disclosed in U.S. Pat. No. 4,644,479. There is. Furthermore, these U.S. Patents Nos. 4 and 6
No. 49,515 and No. 4,644,479 are incorporated herein by reference. Once the comparison has been made, a determination is made as to whether a match has occurred (step 50); if a match has occurred, the procedure corresponding to the matched feature set is selected by the procedure selection computer 22.
and is displayed on the display unit 24 to the operator 28. Steps 54 and 5 of FIG.
6, the feature set comparison pointer is incremented until there are no more feature sets to compare. Step 58~
At 64, the feature set pointer is reset, it is determined whether all images have been captured and classified, and the image capture pointer is reset.

When pyrometer 14 is being used to scan plant 10, the program shown in the flowchart of FIG. 3 is executed by procedure selection computer 22. In this process, the procedure selection computer 2
2 samples the output of the selected pyrometer 14 via a conventional digital input/output interface and stores the sample in common memory of the procedure selection computer 22 (step 70). If the pyrometer reading exceeds the corresponding threshold, appropriate related procedures are activated (step 74). For example, pyrometer 14 could monitor the bearing temperature of a water pump. Furthermore, it is also possible to set several threshold values or to set several ranges. In steps 76-80, the pyrometer and threshold pointers are incremented and reset.

FIG. 4 shows a program for performing spectrum analysis by the spectrum analyzer 16.

This routine is very similar to the routine shown in FIG. The computer 22 is connected to the spectrum analyzer 16
Spectrum sampling by one of the analyzers is started (step 90). If the spectral analyzer 16 is capable of performing spectral analysis from several different sources, commands can be generated that indicate which sources to sample. If each spectral analyzer 16 is capable of analyzing only one source, a command can be generated indicating which analyzer 16 to start. Once the analysis process is finished, after waiting (step 94), the spectral 6 Then, as already mentioned, the spectra and svectorular, as to whether there is an exact match or not,
(step 98). For this purpose, comparisons can also be carried out using specialized systems as described above. If a match exists (step 10
0), appropriate related procedures are initiated (step 102), steps 104-114 control the incrementing and resetting of pointers for spectral comparison and sampling initiation.

The present invention can be used as an alarm response system in a power plant where alarm information is presented to an operator 26 in a control room via a flashing lamp annunciator on an information panel or a status display 20. In this application, the alarm information required by the procedure selection computer 22 may be obtained from, for example, a single monitor (
or several television cameras 32 and collectively displayed on the alarm display section 20. In this case, the only wiring required to support the information gathering system is power and signal conductor wiring to the television camera 32. Image processing computer 30 scans the electronic image of the alarm display collected by camera 32 to determine at intermittent time intervals which locations on the alarm display are illuminated. It should be noted here that the image recognition device does not need to have the ability to read the description associated with the illuminated alarm.

This is because the information conveyed by each annunciator can be determined directly from the relative spatial position of the annunciators. At a suitably fast and easily achievable scanning rate, the sequence or order in which the annunciators are activated in response to a transient event or plant disturbance can be determined. The information provided to the computer 22 includes only the location of the individual annunciators on the status display 20 and the order of state changes of the individual annunciators.
2 passes this information through a predetermined logical chain to diagnose the nature and cause of the disturbance, select appropriate related procedures from computer memory or peripheral storage, and implement the corresponding alarm response by the control room operator. Monitor and support the execution of procedures. In this regard, U.S. Patent Box 4,80
It is described in the specification of No. 3,039.

As an example of the actual functioning of the alarm response system described above, consider the following hypothetical sequence of events. For example, suppose a failure occurs in the control channel in the level control system of steam generator A as a result of a failure in the electronic transmitter of the level signal. Failure of such a sensor or electronic transmitter causes the steam generator A feedwater flow controller to immediately experience a mismatch between the feedwater flow rate and the steam flow rate, causing an increase in the feedwater flow rate. The first indication in the control room of such a disturbance is ``Steam generator A iQ constant level deviation'' and a change in the status of the notification lamp (change from dark to illuminated). Immediately, the "Steam generator input flow mismatch, feed water flow rate is greater than steam flow rate" notification lamp switches from dark to lit.
, n > lights up ° ° and then "notification lamp (p, q
Detects an alarm condition in the sequence ``Lights On''. If not addressed, the sensor failure described above will result in a high steam generator level turbine trip of approximately 80% level. The logic of the system is “Alarms (m, n) lit’°, °゛Alarms (p,, q> lit”)
This sequence is identified as a sign of malfunction of the feed water flow controller (lt+1I61 device) of steam generator A, and an appropriate alarm response procedure is selected and executed. In the first step in this procedure, operator 26:
Instructions may be provided to compare the readings of the three level indicators on the suspect steam generator to determine whether the disturbance is due to a sensor failure or a controller failure. The corresponding display generated by the computer 22 system is shown in FIG. In this display, operator 2
6's attention is directed to specific meters and selection switches on the plant control 28 that provide the information needed for the next diagnostic step, and specific quality information regarding meter readings and selection switch settings. You will be asked to respond in time. When the operator enters an answer (in this case "Y") via the touch screen or keyboard on the monitor display to respond to the displayed question, the procedure selection computer 22 selects the next step in the logic chain. Shifting to the treatment step, the display shown in FIG. 6 is generated.

This display includes a detailed diagnosis of the cause of the disturbance, a list of emergency alerts that will be activated if the situation is not corrected, and recommendations for obvious actions to take to correct the situation. After executing the command according to the action recommendations, the user finally enters “Co” which indicates completion of what is required in the second display, and the alarm lamps obtained in the most recent optical scan of the pipe. Using the updated information, a third display as shown in FIG. 7 is generated by the system. “Steam generator level (S
Note that the width of the ``/G LEV)'' bar is decreasing, indicating that the severity of the problem is decreasing.

If the optical scanning system is provided with the ability to scan the control panel of the plant controller 28 and the information panel of the status display 20, the image processing computer 30 determines the position of the associated meters and selection switches. By reading (i.e. reading the angular position of the dial and indicator or pointer at a particular position on the control embankment) °, °reading amount'
° to the computer 22, where the position data will be converted into the required numerical and logical data, in which case the computer 22 will be able to perform all necessary operations without requiring operator input. After making a thorough diagnosis,
6. Once the necessary actions have been completed, the display shown in FIG. 9 will be generated instead of the sequential display shown in FIG. , will confirm that the disturbance has been removed and that the plant is returning to normal operating conditions.

An example of the functioning of the system during a preset procedure for starting up a water pump is shown in FIGS. 10 and 11. More specifically, FIG. 10 shows the procedure for starting the water pump, and the first two steps in the procedure are shown in FIG.
One step has been executed, and the third step is the action to be performed now.

At the time of starting the main feed pump, the feed pump bearing temperature must also be monitored; this caution message:
It appears in the upper part of the display screen as shown in FIG. When this caution message appears, the system continuously monitors the water pump bearing temperature with the pyrometer 14 as the pump startup procedure continues. FIG. 11 shows that the third and fourth steps for starting the water pump have been completed and that the system is currently in the fifth step. At this point, computer 22 has detected that the pump bearings have reached a critical temperature threshold and requires that the bearings be checked for oil immediately. This second message is generated in a highlighted color compared to the caution message 6 For example, a caution message is generated in yellow on the display input/output unit 24 and an emergency treatment message is generated in red. I could do that. After the operator 26 confirms that the bearing is lubricated, the bearing temperature detected by the pyrometer 14 will drop back to normal and the action and caution messages will disappear from the start-up procedure screen. Dew.

Many features and advantages of the invention are apparent from the above detailed description. It is intended that all such features and advantages be embraced by the present invention insofar as they come within the spirit and scope of the invention. Furthermore, since numerous modifications and substitutions will readily occur to those skilled in the art, the present invention is not limited to the precise structure and operation shown and described; All suitable modifications and equivalent substitutions may be made within the scope of the invention.6 For example, the present invention may monitor a golfer's practice swings at the position of the arms, head, and legs. It could also be realized as an optical image recognition and small computer procedure synthesis system such as a ``sports practice coach system'' that recommends adjustments to the player's posture and improves flight distance or accuracy. The system of the present invention in a facility could benefit from spectroscopic analysis capabilities and prevent the release of harmful chemicals; the system could also monitor meteorological parameters such as wind speed and direction to inform plant operators. This could provide information about the distance and speed at which contamination spreads.

[Brief explanation of the drawing]

FIG. 1 is a block diagram illustrating the configuration and components of a system according to a preferred embodiment of the present invention; FIG. 2 is a flow chart diagram illustrating image capture and analysis and invocation of procedures based on the analysis; FIG. Flowchart diagram showing the pyrometer analysis startup sequence, FIG. 4 is a flowchart diagram showing the spectrum processing procedure startup, FIGS. 5 to 7, and FIG.
9, 10 and 11 are diagrams showing the procedures taken by the operator and the monitoring responses of the procedure selection computer 22. 10...Nuclear power plant (equipment) 14...Pyrometer (spectrum information means) 1B...Spectrum analysis device (spectrum information means) 22...Procedure selection computer (procedure display and monitoring means) 24... Procedure display input/output unit (procedure display and monitoring means) 26... Operator 30... Image processing computer (spectral information means) FIG, 1 FIG, 5 FIG, 6 FIG, 9 FIG, 10

Claims (1)

[Scope of Claims] 1) A procedure execution monitoring device comprising procedure display and monitoring means for selecting a procedure in response to diagnostic information and monitoring the execution of the procedure, comprising: displaying spectral diagnostic information in response to observation of the device; A procedure execution monitoring device having spectral information means for providing. 2) A method for procedural selection of a power plant, comprising: (a) scanning said power plant to provide electrical spectrum information; (b) comparing said electrical spectrum information with reference information; and (c) determining said electrical spectrum. A procedure selection method for a power plant, comprising the steps of: selecting a corresponding procedure when information and the reference information match; and (d) displaying this procedure to an operator.