EP2586539B1

EP2586539B1 - Apparatus and method for upgrading the camera of a sorting / scanning system with backwards compatibility

Info

Publication number: EP2586539B1
Application number: EP12189918.1A
Authority: EP
Inventors: David Lowell Bowne; Shahrom Kiani; Carlos Macia; Russell W. Guenthner
Original assignee: Bull HN Information Systems Inc
Current assignee: Bull HN Information Systems Inc
Priority date: 2011-10-25
Filing date: 2012-10-25
Publication date: 2017-06-07
Anticipated expiration: 2032-10-25
Also published as: EP2586539A3; EP2586539A2

Description

This application claims priority to a United States Provisional Patent Application 61/551,174 Filed October 25, 2011 titled "SORTING / SCANNING SYSTEM CAMERA UPGRADE APPARATUS WITH BACKWARDS COMPATIBILITY" with first named inventor David Lowell Bowne, La Crosse, WI(US).

BACKGROUND OF THE INVENTION

The present invention relates generally to mail processing, and more particularly to a method, system and program product for providing backwards compatibility when replacing a camera subsystem with a newer camera subsystem in standard automated mail sorting equipment such as a Multi-Line Optical Character Recognition (MLOCR) mail sorter.
As automated mail sorting equipment ages the need to replace key components that may have become obsolete or reached the end of their useful life becomes a potential issue. One such component is the camera subsystem that is used to scan images of mail items. A camera subsystem typically connects to various other components of the mail sorting equipment such as the tachometer, the system control computer and the image processing subsystem etc. Replacing a camera subsystem, or just the camera with an equivalent model may not be possible or may be very expensive, because an equivalent subsystem, or an exact replacement model camera may not be available. In any sorting system utilizing a camera, the camera is a key component of the system and may serve as the basis for all sorting by the machine, with the camera utilized in performing address recognition, bar code recognition, or other processing based upon an image of the item to be sorted as "seen" through the lens of the camera, and then captured in digital form for digital processing.
WO 03/066244 A1 discloses a modular document sorting apparatus and method. A plurality of modules are functionally connected to one another to enable them to scan documents for information and sort the documents according to the scanned information. Each module performs at least one function. Functions can include, feeding documents into the apparatus, singulating documents, transporting documents through at least a portion of the apparatus, scanning documents, printing on documents and sorting documents according to scanned information. Each module may be powered by a separate power supply. A single on/off switch can controls a plurality of modules.
GB 2433172 A discloses a modular surveillance camera kit which includes a group of camera heads each having a respective set of performance characteristics and common electrical and mechanical connectors. A group of system controllers each has a respective set of performance characteristics and common electrical and mechanical connectors. A group of communications modules each has a respective set of performance characteristics and common electrical and mechanical connectors. Each of the communications modules is coupled to a system interface. A surveillance camera system may be assembled in a selected one of a plurality of possible combinations by selecting one of the group of camera heads, one of the group of system controllers and one of the group of communications modules such that the selected system controller electrically and mechanically interconnects the selected camera head and the selected communications module.
US 2008/117581 A1 discloses a laptop computer. The laptop computer comprises a processor, a memory, a graphics controller, a display panel and a display housing. The display housing is for holding the display panel. The display housing has an opening for fixing a replaceable camera module or a replaceable cover module selectively. When the replaceable camera module is fixed to the opening, the replaceable camera module is electrically connected with the graphics controller and provides pixel data. The graphics controller then drives the display panel to display the pixel data.

BRIEF SUMMARY OF THE INVENTION

The invention is defined by the independent claims. The dependent claims define advantageous embodiments.
Directly replacing an obsolete, aging, or broken camera subsystem in sorting equipment with a new camera subsystem may not be possible, or may become a costly proposition because of lack of compatibility of new camera components with the rest of the components that are already in place in the sorting equipment. Newly available cameras may typically provide higher resolution images than older cameras, and may also present data in a different analog or digital format, or utilize different physical connectors, or use electrical signals in a different way, at different voltage or current levels, or may differ in many ways that would be well known or understandable to one familiar or skilled in the art of electronics and / or video cameras.
The present invention in several illustrated embodiments is directed towards replacing a "legacy" (original equipment) camera subsystem with a new camera or camera subsystem, and adapting the new camera to work in the legacy (old) environment.
Such replacement when utilizing a new higher resolution camera with possibly better optics or lighting or other improvements may for example further provide for better images, improved recognition of addresses or bar codes, improved speed of processing, or other similar and general improvements.
It is therefore an advantage to provide a method and / or apparatus that allows for replacing a camera subsystem of standard sorting equipment, such as mail sorting equipment with newer camera technology, or a different model camera while continuing to allow for and to provide specifically for utilization of significant portions or even all of the older equipment and subsystems within the sorting system. Installation of a new camera may further enable improving the performance, and / or adding features and other equipment to the original sorting system.
For example, a higher resolution camera may provide for improved recognition of written, encoded, or printed addresses, or allow for use of better or alternative algorithms for recognizing written, encoded, or printed addresses on a mail item being sorted.
Introduction of a new technology into a complex system such as mail sorting equipment may present a risk of impacting the current (legacy) operation and / or algorithms of the equipment. Accordingly, a further advantage of the method and apparatus of the present invention is minimizing the impact of introducing such new camera technology into such sorting equipment, and for allowing for fallback utilizing legacy pieces of an existing piece of sorting equipment in the event of failure or incorrect operation of new equipment installed in the sorting system beyond that of the camera itself.
The current or prior art mode of operation includes processing images of mail items captured with a legacy camera at an existing resolution, 212 dots per inch (dpi) (for example). These will be referred to as "legacy images" and are handled by the same legacy components that already exist in the standard mail sorting equipment.
In the same context, the new mode of operation includes processing images of mail items captured with a new camera, typically at a higher resolution, 256 dpi or higher, for example, and also allowing for a new camera with the same resolution as the old, but with possibly a different format for output of scan or video data. These will be referred to as "high resolution images" and are handled by a new set or group of components that are added to the standard mail sorting equipment. It will be appreciated that both modes of operation utilized by such mail sorting equipment share the same goal: processing images of mail items to automatically read the mailing address and sort the items accordingly. The new mode of operation provides higher performance by taking advantage of higher resolution images and a new set of components that provide additional functionality such as multiple binarization algorithms, more accurate region of interest detectors, etc.
Accordingly, the method and / or apparatus the present invention fulfills the need for minimizing the impact of replacing legacy camera technology with newer technology achieved by providing backwards compatibility with existing equipment and system programming. In addition, further illustrated embodiments of the method and / or apparatus may also provide for improved performance in operation of a sorting machine while allowing for reduction in cost of an upgrade by utilizing existing components.
Additionally, the method and apparatus of the present invention allows standard mail sorting equipment to fall or revert back to its previous mode of operation in the event of a failure in the newer camera subsystem during operation. That is, where newer features or equipment were added during a camera or camera subsystem upgrade, these features and / or operation of the new equipment could be disabled in case of problems, thus allowing the sorting equipment to revert to a prior mode of operation while still utilizing the new camera or camera subsystem, this prior mode possibly affording better reliability, testing, or compatibility with prior operation and / or other equipment. The method and apparatus of the invention described herein according to one illustrated embodiment relies on the addition of a new camera system including or being connected to an adaptor card apparatus in a manner wherein the new camera system provides as outputs both "legacy images" and "high resolution images". As described herein, the adaptor card apparatus of the illustrated embodiment may be implemented as a printed circuit board (PCB) having one (1) input connection such as CamLink or Gigabit Ethernet connected to a new high resolution camera and two (2) output connections, one connected to the new components of the mail sorting equipment in the form of a pass-through connection such as CamLink or Gigabit Ethernet carrying "high resolution images" and a second output connection to the legacy components of the mail sorting equipment, and utilizing the same format and optionally the connection mechanism as previously utilized. In at least one embodiment, the output connection may take the form of a connection such as Low-voltage Differential Signaling (LVDS) used for carrying "legacy images". The adaptor card apparatus of the illustrated embodiment, utilizing dual image data paths, is able to provide backwards compatibility with the legacy components as well as optional connection to the newer components or equipment while providing a fall back mechanism in the event of a failure occurring in the new components.
In addition, a further illustrated embodiment of the method and apparatus of the present invention described herein also includes a mechanism or arrangement for synchronizing and pairing a "legacy image" with its "high resolution image" counterpart when both images are received by the new components during the new mode of operation. A "legacy image" may carry important information, such as the mail item identification tag or (i.e. a unique tag that automated mail sorting equipment creates to track each mail item during processing), which can only be provided by the legacy image processing subsystem components. Therefore, this information is not readily available to its "high resolution image" counterpart since this high resolution image bypasses the standard processing step performed by the legacy components. Images processed by the "legacy" equipment and programming may not produce the same number of output "files" or data and / or the data may come out of the legacy system equipment and the legacy program process may occur in a different order than which it went in. Therefore, there is need for the new components to provide a mechanism or arrangement for synchronizing or associating these image pairs in order to obtain the potentially very much needed information from the "legacy image". The synchronization and pairing method and mechanism of this further illustrated embodiment thus provides backwards compatibility with the legacy components since information such as the mail item identification tag may be essential in completing the sorting of a mail item, and this capability may not be provided by the new camera subsystem in equivalent form or in the same sequence.
The synchronization method which pairs a legacy image with its high resolution image is included in the further illustrated embodiment for those situations where capture, processing, and storage of the legacy image may occur independently of the capture, processing, and storage of the high resolution image. For example, mail items scanned by the legacy system may not result in production of a legacy images for every mail item, and legacy images may not be produced in the same order as the mail items are scanned. Thus, this further illustrated embodiment of the method and apparatus of the present invention provides an alternative mechanism for relating or associating each legacy image with a high resolution image.
As discussed above and in greater detail herein, according to one or more illustrated embodiments of the method and apparatus of the present invention, automated mail sorting equipment is able to be upgraded with a new camera subsystem that includes a new camera and an adaptor card apparatus. According to the teachings of the present invention, as part of this upgrade, automated mail sorting equipment is also outfitted with a new set of components that include new image processing subsystem components to take advantage of the features provided by the new camera subsystem, such as higher resolution images. During the upgrade, the input port of the adaptor card is connected to the new camera via an interface connection such as CamLink or Gigabit Ethernet. One of the output ports of the adaptor card is connected to the legacy image processing subsystem components via an interface such as LVDS. The second output port of the adaptor card apparatus is also connected to the new image processing subsystem components via an interface connection such as CamLink or Gigabit Ethernet. In this configuration of the illustrated embodiment, the adaptor card apparatus receives "high resolution images" from the new camera subsystem and transmits these "high resolution images" to the new image processing subsystem components. In parallel, the adaptor card apparatus "down-samples" (converts) the "high resolution images" received from the new camera subsystem to a resolution that matches the image resolution of the legacy camera subsystem being replaced, thus converting them into "legacy images", and transmits those "legacy images" to the legacy image processing subsystem components. The adaptor card apparatus receives a single high resolution image data stream from the new camera subsystem and generates two image data streams from it, a low resolution stream thereby maintaining compatibility with the legacy components and a high resolution stream to support the operation of the new components.
During operation before a "legacy image" is sent to the legacy components, the adaptor card apparatus of the illustrated embodiment encodes a unique image identification number into a digital signature, such as a barcode format such as a 2-state, 4-state or any other linear or two dimensional barcode symbology and superimposes the digital signature on an area of the "legacy image", such as the lower right corner, the right edge or a combination thereof, that is likely to minimize obstructing or overwriting important mail item information. In the case of a linear barcode, such barcode can be superimposed vertically (in a "ladder-like" fashion), horizontally (in a "picket fence-like" fashion) or both. The selected digital signature is designed to optimize its chances of surviving the image processing operations such as binarization or cropping that are typically performed by the legacy image processing subsystem components. For example, if the bars of a barcode are designed too thin or too short they may get interpreted as background noise and removed during the image binarization operation (i.e. when an image is converted from color or gray-scale to black and white). The reason for including both a vertical and a horizontal copy of a linear barcode is to minimize the chances of the legacy image processing subsystem components obliterating or partially removing the barcode.
Likewise, before a "high resolution image" is sent to the new components, the adaptor card apparatus encodes into the first few bytes of the "high resolution image", using an alphanumeric character representation system such as American Standard Code for Information Interchange (ASCII), the same unique image identification number that was used to encode the digital signature of its "legacy image" counterpart. Since a "high resolution image" is not processed by the legacy image processing subsystem components there is no danger of the legacy binarization task or operation removing the alphanumeric characters. In this case, the new image processing subsystem components are designed or implemented to recognize "high resolution images" and extract the unique image identification number from the images before they are converted from color or gray-scale to black and white. It will be recognized by those skilled in the art that other methods for encoding and extracting a unique image identification number could be devised.
From the above, it is seen that the upgraded automated mail sorting equipment is thus able to operate in two modes. One mode, referred as the "new mode of operation", takes full advantage of the new camera subsystem as well as the new set or group of components added to the standard mail sorting system to process the images and sort the mail items. The other mode, referred as the "fallback mode of operation", or "legacy operation", incorporates and utilizes the new camera subsystem, but still utilizes or relies on "original" legacy components to process the images and sort the mail items.
Under and during the "new mode of operation", the new camera subsystem of the illustrated embodiment transmits "legacy images" to the legacy image processing subsystem components for processing and "high resolution images" to the new image processing subsystem components for processing. The tasks performed by the legacy components may include a binarization step to convert the image from color or gray-scale to black and white. When the automated mail sorting equipment is operating in this mode, the new set of components receive from the legacy components the "legacy images" including any available important information such as the mail item identification tag. Likewise, the new components also receive directly from the adaptor card apparatus the "high resolution images". A major task or operation/function performed by the new set of components includes processing "legacy images" to locate and read the digital signature that was superimposed on the images by the adaptor card apparatus. The purpose of this digital signature reading task is to decode the unique image identification number associated with each image. Another major task or operation performed by the new set or group of components includes processing "high resolution images" to extract from them the unique image identification number that was encoded in the first few bytes of each image by the adaptor card apparatus. Next, an image pairing task or operation performed by the adapter card apparatus utilizes the information read from the digital signature of "legacy images" and the information extracted from the first few bytes of "high resolution images" to associate or relate pairs of low and high resolution images that correspond to the same sorted physical mail item. Once the image pairs are associated, all the information about the image that was available only to the "legacy images" is also now made available to the "high resolution images". Therefore, the adapter card apparatus is able to associate an important piece of information such as the mail item identification tag with the "high resolution image" and be made known during the subsequent processing of this image. This enables the adapter card apparatus to successfully sort a mail item using the new "high resolution image". Under the "new mode of operation" standard automated mail sorting equipment has the option of utilizing either image (i.e. "legacy" or "high resolution") during the subsequent sorting process.
In a still further illustrated embodiment of the method and apparatus of the present invention, the "fallback mode of operating" is invoked when a failure is detected in any of the new set of components that can prevent the system from using "high resolution images" and the new set of components to successfully sort mail items. In this mode, the mail sorting system reverts back to only utilizing "legacy images" and legacy components to sort mail items. That is, when this happens, the new set of components and the "high resolution images" are not utilized. Instead, the legacy components utilize or rely on the "legacy images" that they receive from the adaptor card to complete or perform the task or operation of sorting mail items. The "legacy images" contain everything that is needed to successfully sort in this mode of operation. There is no need to decode the unique image identification number from the digital signature that was superimposed on "legacy images" by the adaptor card apparatus since it is no longer necessary to pair "legacy images" with "high resolution images". In fact, the only difference between this mode of operating and the legacy mode of operation (i.e. before the upgrade took place) is that the "legacy images" are now being provided by a new camera subsystem that will likely show improved performance from higher quality optics, better illumination, larger field of view, etc. Therefore, even when the upgraded system falls back to a legacy mode of operation, the standard mail sorting equipment still can provide the benefits obtained from utilizing a better camera subsystem.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The invention is better understood by reading the detailed description of the invention in conjunction with the accompanying drawings:

FIG. 1 illustrates typical Mail Sorter Equipment of the prior art;
FIG. 2 illustrates Mail Sorting Equipment upgraded utilizing apparatus and / or method according to at least one illustrated embodiment of the present invention;
FIG. 3 illustrates upgraded Mail Sorting Equipment according to one or more embodiments including image stamp and image correlation apparatus and / or method for relating legacy images with images at a second resolution;
FIG. 4 illustrates an arrangement of upgraded Mail Sorting Equipment according to the present invention including image stamp and image correlation apparatus and / or method for relating legacy images with images at a second resolution, with the pairing of legacy images and images at the second resolution performed in an alternative arrangement / ordering of the system;
FIG. 5 illustrates the "tagging" or "stamping" of a legacy image illustrated at 212 dpi with a POSTNET Barcode for correlation with a corresponding higher resolution image as illustrated in FIG. 6;
FIG. 6 illustrates a 256 dpi image taken with the new higher resolution camera and marked with an image identification code, for correlation with a corresponding lower resolution image as illustrated in FIG. 5 according to the teachings of the
present invention; and,
FIG. 7 illustrates the relating of legacy images to high resolution images utilizing an image id tag that is embedded within a legacy image according to the teachings of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

Figure 1 illustrates typical mail sorting equipment 100. Mail Items 120 to be scanned for sorting are passed in front of a camera 110 in a step labeled Mail Item Scan 121. The camera provides image data 130 to image data processing equipment 150, the image data processing equipment also optionally serving to utilize the camera with a camera controls interface 140 as necessary to capture images from the camera. The image data processing equipment 150 utilizes the images captured from the camera and sends signals 160 to one or more sorting apparatus 170. Sorted mail items 123 are illustrated as leaving the sorting apparatus, and optional data regarding the mail items and / or the sorting process / results is labeled as Mail Item Legacy Data 180.
Figure 2 illustrates an "upgraded" mail sorter 200 in at least one illustrated embodiment of the present invention. The "legacy" camera 110 of Figure 1 is replaced with a new model camera 210, which scans mail items or takes pictures of mail items at a higher resolution or with a different output format than the legacy camera. For example, the new model camera takes pictures at a resolution of 256 dots per inch (dpi), or greater, and replaces the legacy camera which took pictures at 212 dpi. The higher resolution may provide for potentially better recognition and processing of addresses written on the mail item and captured during the mail item scan 221. The higher resolution image from the camera 231 may not however be compatible in terms of resolution or signal type or connector styling with the existing (legacy) equipment. Therefore, in order to maintain utilization of other "legacy" components in the sorting machine, it is an advantage of the present invention to provide for hardware and control to provide adapted controls and signals to replace those controls and signals previously associated with the legacy camera. That is, it is an advantage to provide an adaptor apparatus 201 that translates the format and connections of the new model camera 210 to a format and connections compatible with those previously provided 140 by the "old" or legacy camera, and after the update those new signals and controls 240 will replace those previously connected to the legacy camera, but will be in the same format and utilize the same hardware connection 140 as those utilized, before the update, for connection to the "rest" of the sorting machinery.
With further reference to Figure 2, signals at a higher resolution or alternate format 231 than the original signals from the old or legacy" camera (reference 131 in Figure 1) are processed by an image format conversions apparatus 241, reduced in resolution to the original "legacy" resolution (if needed), and provided as a signal in the original legacy format (and optionally resolution) 230. Depending on possible differences between the camera being replaced and the new camera, conversion of one or more control signals 242 from "new" controls or new control formats 241 to "legacy controls" or legacy control format 240 may also optionally be provided, or be necessary.
The upgrade adaptor 201 thus provides as output from the image format conversion 241 signals at the legacy resolution and format for connection 130 to the legacy image data processing equipment 150 (already in place). The connection 140 of adapted controls 240 is also provided, if necessary to the legacy image data processing equipment 150. The legacy image data processing equipment 150 then provides sorting controls 160 to the legacy mechanical sorting apparatus 160 which sorts scanned mail items 122 and provides sorted mail items 123.
It also may or may not be advantageous to provide for some processing of the new resolution higher resolution image 231 in parallel with the image format conversion before the image is transmitted as a higher resolution signal 232 to new image data processing equipment 250. New image data processing equipment provides new mail item data 280. In one or more embodiments, new processing of the higher resolution image data is provided for potential improvement in speed or accuracy in development of the sorting controls.
FIG. 3 illustrates Mail Sorting Equipment that has been upgraded with a new higher resolution camera and which further includes apparatus, controls, and or control programming which creates an image stamp and related image correlation data for tracking and relating a specific legacy (low resolution) image with a high resolution image. This provides a means for relating low resolution "legacy" images with one or more high resolution images of a mail item in order to relate those images after they emerge from two separate paths of processing. This is necessary since images may or may not emerge from processing elements in the order in which they entered, and also because the legacy data processing may not provide any means of identifying specific images in a manner that relates them to an incoming order.
The Machine Interface Module 380/ Open Recognition Controller 381 / Open Recognition System 382 (MIM/ORC/ORS) box, in general terms, functions so as to receive images and returns sorting results 390 (i.e., where the mail piece should be sorted to). The MIM/ORC/ORS box may optionally support a plurality of mail sorters at a site and typically connects to them over a TCP/IP connection. The MIM/ORC/ORS box provides for connection to both "legacy" Address Recognition System 372 / Video Controller Unit (ARS, VCCU) and "new" components (OIPS 351) on each mail sorter.
Figure 4 illustrates of an alternative arrangement of components in another illustrated embodiment of the present invention. In Figure 4 the pairing or correlation (or relating) of legacy images and "new" images (higher resolution images) is done as part of the apparatus and control labeled Open Image Processing System 451, which is somewhat different than the Open Image Processing System 351 of Figure 3. In the arrangement illustrated in Figure 4, the legacy images are paired immediately after legacy Address Recognition utilizing the same information normally sent to the Video Controller Unit 373, with the information captured from the TCP/IP connection between the ARS and VCCU with a TCP/IP "sniffer". This allows paired binary images 455 to be sent to the MIM/ORC/ORS 381/382/483 apparatus and controls with the ORS (Open Recognition System) 483 in this arrangement not required to perform the Image ID correlation.
Figure 5 provides illustration of an exemplary PostNet Barcode 520 and in expanded form 521. This is an exemplary encoding provided as illustration of a stamped image placed at a location on the "legacy" image of a mail item, that is, added to the legacy image in an unobtrusive or non-interfering location. In this example the PostNet Barcode is 428 pixels by 16 pixels 520, and is placed in the lower right corner of the legacy image after capture of the image by the new camera and also after (or during) conversion of the high resolution captured image to the legacy resolution. The individual pixels of an exemplary PostNet Barcode are shown for three of the "bars" 522, 523, and 524 of the BarCode. This barcode is later used to relate the legacy images to the original high resolution images, after the legacy images have proceeded through any legacy processing.
Figure 6 provides illustration of a digital ID 620 added to a high resolution image 600 at an exemplary resolution of 256 dots per inch. The digital id added to the high resolution image provides one exemplary method of identifying a high resolution image and then relating it to a low resolution "legacy" image as illustrated in Figure 5. The digital ID 620 is illustrated in Figure 6 as being decoded to a numeric value of "30:31:34:35:36:37:38:39:30". The digital ID is exemplary and other methods of relating or identifying a high resolution image to an identifying number or name could be devised by one skilled in the art of computer programming, or sorting machine design.
FIG. 7 illustrates, as part of an illustrated embodiment of the present invention, the relating of legacy images to high resolution images utilizing an image id tag that is embedded within a legacy image, with the image id tag being recognized and associated with one or more high resolution images by that tag. A plurality of legacy images 375 is illustrated with several specific legacy images 710, 711, 712, 713, and 714 depicted as being processed by the Open Recognition System (ORS) 483. Each of the legacy images 710-714 has embedded in the image an image id tag, which in this example is a number that can be used to identify and relate from a plurality of high resolution images 232 specific high resolution images 720, 721, 722, 723, and 724 those images associated or related to each specific legacy image.
This illustrated embodiment of the present invention deals with two different ID tags. One set of ID tags could be called "image ID tags" and these are used to pair and synchronize the images. The other ID tag could be referred to as a "mail ID tag" and this tag is created by the legacy data processing equipment and is used to uniquely identify a mail piece. For example, an "image ID tag" of 014567890 allows us to associate a legacy image to multiple new images and all those images would essentially represent scans of "mail ID tag" 1230000012. The only way for a new image to obtain this "mail ID tag" is to get it from its legacy image counterpart (it is part of the legacy image data packet).
In this example, legacy image 710 is found to be associated with high resolution image 720. The high resolution images 720-724 are depicted as "entering" the Open Recognition System in a different order than the legacy images 710-714. The Open Recognition System uses the ID tag to find the relation between new images (high resolution) and legacy images by finding those with the same ID tag. That is, when the legacy images are "stamped" with an embedded ID tag, the new images are tagged in the same way so that the new image in some way identifies itself as being associated with the ID tag. This can be, for example, by a file naming convention, by utilizing a database that associates information with each high resolution file or other ways that might be readily determined by one skilled in the art of computer programming or sorting system design.
Because of the new components with higher resolution image, and optionally better binarization, and algorithms, the MIM/ORC/ORS is able to derive more and more accurate sorting results while still providing for usability within existing mail sorting equipment, and providing for potentially much lower cost in upgrading a system by allowing legacy components to continue to be utilized.
The new camera system typically may further provide better illumination (LED versus halogen) generating cleaner images as well as higher resolution images.
The OIPS not only benefits from receiving higher resolution images from the camera, but it also generates multiple and better binarized images. The legacy components (ARS), on the other hand, typically had only one binarizer and had trouble processing certain types of images (because it would run out of time).
Therefore, the MIM/ORC/ORS box, after the upgrade, will receive cleaner and better binarized images from the OIPS. The MIM/ORC/ORS may also still receive legacy images and has the option of using those if needed.
In an illustrated embodiment of the present invention the approach provides for leveraging all existing technology and allowing for introduction of a new camera and processing components in a parallel flow of higher resolution images, captured with the new camera using better illumination and binarized with updated state-of-the-art binarization engines.
In at least one embodiment, a new camera interfaces to a translator device that receives a Camera Link® 256 DPI gray-scale video stream input from the new camera and passes this native input through to an Open Image Processing System (OIPS). At the same time, the translator also down-samples and normalizes the received input feeding a 212 DPI gray-scale video stream to the existing LVDS Frame Grabber maintaining the current data rates.
The translator functions in a dual role. It receives a Camera Link® input from the new camera and passes through this native input to the OIPS computer. In addition, it translates the Camera Link® input to the legacy LVDS input required by the existing (legacy) frame grabber, while maintaining current image resolution (212 DPI) and data rates. Since the Translator is feeding two versions of the same gray-scale image received from the Camera to two different systems, these images must be properly tagged so that they can be associated and synchronized. It is important to highlight in this illustrated embodiment that the translator uniquely stamps every image before it is fed to the "legacy" Frame Grabber and to the "new" OIPS. This technique allows the Open Recognition System (ORS) to correlate the binarized images after they are received on its end. This correlation provides for association of one or more high-resolution images with the ID Tag that is assigned to the low-resolution image. Once the legacy and new images have been correlated and the ID tags from the legacy images have been associated with the new images, the legacy images may be discarded by the ORS. Alternatively, legacy binary images can be used in a waterfall model if it is found that they contribute to the improvement of the overall recognition rate.
The translator adds a manufactured 16 scan (pixels) wide image snippet to the beginning of every gray-scale image after it is down-sampled to 212 dpi. This digital ID will contain 9 digits encoded in a POSTNET or similar barcode. Using for example a POSTNET barcode, the ID consists of 9 digits + 1 check digit, or 50 bars + 2 frame bars (leading & trailing long bars). The 9-digit ID contains (for example): a 3 digit MLOCR ID, and a 6 digit mail piece identification number. In the exemplary case of a POSTNET barcode, the manufactured image snippet consists of: a bottom border (8 white pixels thick), left and right borders (4 white pixels wide), and, 52 short or long bars and spaces in between, as follows: a short bar - 4 x 4 black pixels, a long bar - 4 x 8 black pixels, and a space - 4 x 8 white pixels.
The Translator board tags new images in the 256 dpi form with a digital ID by encoding a 9-digit ASCII value within the first few bytes of a 256-dpi image. The first two digits will represent the MLOCR ID and the remaining seven digits will uniquely identify the mail piece, as shown in Figure 6.
In another illustrated embodiment of the present invention, upgrading of the legacy camera with a new camera also enables and provides for adding multiple and improved binarizers as part of the new image processing equipment. The reason for using multiple binarizers or sometimes using multiple instances of the same binarizer with different configuration settings is to take advantage of the overlap in performance that they may provide. For example, some binarizers are better at binarizing Christmas mail (possibly with red or green envelopes for example) than others. Other binarizers are better at binarizing windowed envelopes. In addition, different binarizers crop images differently as well. Some do better with handwritten characters. By having several binarized images of the same mail piece available, a system can try one image first and switch to a different image if the first one did not yield any results. All binarizers inside the new image processing equipment would typically work from the same input high resolution image. The legacy binarizer inside the legacy ARS will only work on the low resolution image, and therefore the introduction of a new high resolution camera in place of a low resolution camera provides for potentially improved sorting by the use of multiple binarizers working on the high resolution image.
The output of a binarizer is always a "binary" image (black and white), but the content of the binary file will vary based on what the algorithm did to the input image. In some cases the binarization effect is even noticeable to the naked eye if one were to display the various versions of the binarized images on a computer monitor. A legacy binarizer may be slow and limited by the CPU performance of the legacy computer it runs on. Because of this, there may be images that only get partially binarized, potentially truncating the address block. Those images will result in mail pieces being rejected by the sorter. The present invention enables adding improvements to the image processing hardware and software by allowing both high and low resolution images by new / legacy equipment (respectively) and in parallel, and also to utilize improved processor speeds that were not available when the legacy equipment was designed. This potentially enables the binarizers inside the new image processing equipment to perform much faster, which is better, and in addition to have the advantage of working on a better input image.

Claims

A scanning system adaptor apparatus for use in repairing or upgrading a scanning and sorting system by replacing a legacy camera originally within the scanning and sorting system with a new higher resolution camera, the scanning and sorting system useful for performing a sorting task such as the scanning and sorting a large plurality of items to be scanned and sorted, each item with an address label that is utilized as a basis for order of the sorting, the sorting equipment including legacy image processing equipment for processing legacy format images sent from the legacy camera in a legacy data format and resolution, the scanning system adaptor apparatus comprising:
a) a first connector providing for connection of the new higher resolution camera to the adaptor apparatus and for providing through this connection higher resolution image data from the new higher resolution camera to the adaptor apparatus;

b) an image format conversion apparatus for converting the higher resolution image data received from the new higher resolution camera into reduced resolution legacy compatible images, the format of the reduced resolution compatible images being compatible for processing by the legacy image data processing equipment; and,

c) a second connector for connection of the adaptor apparatus to the legacy image processing system and enabling sending of the reduced resolution legacy compatible images from the adaptor apparatus to the legacy image processing system.
The apparatus of Claim 1 wherein the scanning system adaptor apparatus further includes an image stamping apparatus that generates and embeds within the reduced resolution legacy compatible images an image identification tag that uniquely identifies each of these images in relation to each of the items being scanned and sorted.
The apparatus of Claim 1 wherein the scanning system adaptor apparatus further includes a third connector that provides higher resolution output data that is directly related or equivalent to the higher resolution image data received from the higher resolution camera.
The apparatus of Claim 1 wherein the system adaptor apparatus further includes a third connector for providing as output from the system adaptor apparatus, the captured higher resolution images of scanned input items.
The apparatus of Claim 2 wherein the scanning system adaptor apparatus further comprises:
a) a tag generating apparatus that generates a plurality of higher resolution image identification tags that relate or associate one or more of the plurality of the higher resolution images with corresponding one or more of the legacy compatible digital images, each legacy compatible digital image including an embedded low resolution image identification tag; and,

b) one or more further connectors connected to provide as output, the captured higher resolution images of scanned input items, and their higher resolution image identification tags received from the tag generating apparatus.
The scanning system adaptor apparatus of Claim 2 further including a mechanism connected for disabling the generation and embedding of low resolution image identification tags within the legacy compatible digital images.
The scanning system adaptor apparatus of Claim 5 further including a new feature disabling mechanism that enables disabling of the generation and embedding of low resolution image identification tags within the legacy compatible digital images.
A method of replacing or upgrading a legacy camera in an existing scanning system, the legacy camera including a legacy camera output, the existing scanning system including legacy image processing equipment for processing images received from the legacy camera in a legacy data format and resolution, the method comprising the steps of:
a) installing in the existing system in place of the legacy camera, a new camera, the new camera for providing scanned item images of items provided as input to the scanning system, the scanned item images being at a higher resolution or different data format than those previously provided by the legacy camera;

b) installing in the existing system a new camera upgrade adaptor apparatus, the upgrade adaptor apparatus including translator apparatus for conversion of scanned item images to adapted legacy output images, the adapted legacy output images being provided on an adapted output connector made compatible, by the translator apparatus, in data format and in electrical format for connection in place of an output from the original legacy camera; and,

c) connecting the new camera to the upgrade adaptor apparatus;

d) connecting the adapted output connector of the upgrade adaptor apparatus to the legacy image processing equipment in place of the original connection from the legacy camera output.
The method of Claim 8 further comprising operatively connecting a tag generating apparatus with the new camera, the tag generating apparatus generates and embeds within each of a plurality of the adapted legacy output images a low resolution image identification tag that identifies each of the plurality of adapted legacy output images.