JP4042015B2 - Character synthesis output device and method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a character composition output apparatus and method, and in particular, can be applied to a self-operated image output device installed in a storefront, an amusement facility, or the like, and synthesizes a desired character from an input image. The present invention relates to a character composition output apparatus and method.
[0002]
[Prior art]
It includes an image input unit such as a flatbed scanner, a film scanner, or a memory card input unit for inputting image data. The image data input from the image input unit is combined with a template prepared in advance. 2. Description of the Related Art Image output devices that output are conventionally known. In this type of image output device, an input device for character information such as a touch panel or a keyboard is provided, and input characters are combined with an image and output.
[0003]
In addition to the above-mentioned input device as means for inputting character information, Japanese Patent Laid-Open No. 8-153158 uses a standard form in which a predetermined character entry area is defined, and handwritten characters are written in the character entry area. This is configured to be read by an image scanner. In Japanese Patent Laid-Open No. 5-217018, an automatic character recognition device (OCR: Optical Character Recognition) is used to automatically recognize characters written on paper, and an unrecognizable code is assigned to unrecognizable characters. It is to be assigned. In addition, JP-A-9-330093 discloses means for receiving character data in the form of radio waves (broadcast signals) and converting the received data into sound.
[0004]
[Problems to be solved by the invention]
However, a method of inputting a character by providing a touch panel on the screen of a display device such as a CRT (cathode ray tube) display or a liquid crystal display and selecting the alphabet or 50 sounds displayed on the screen one by one is complicated. . In particular, Japanese kana-kanji conversion operation is complicated, and it is difficult for those who are not used to key operation. Also, when using a keyboard, a space is required for installing the keyboard on the operation surface of the image output device. To place keys in a limited space, the number of keys must be reduced and input is possible. There is a disadvantage that character types are limited. In general, the keyboard operation is complicated, and it is difficult for an unfamiliar person to perform an input operation.
[0005]
The present invention has been made in view of such circumstances, and does not require a dedicated character input device, can achieve space saving, and anyone can easily input a desired character and a character composition output device and character composition An object is to provide an output method.
[0006]
[Means for Solving the Problems]
  In order to achieve the above object, a character synthesis output device according to claim 1 of the present application is an image input means for reading an image represented on an image original by converting it into an electrical signal by an image sensor, and is represented on the character original. As shown in the character manuscript, an image input unit which is also used as a character input unit for reading a character, a character recognizing unit for recognizing a character from image data obtained by reading the character manuscript by the image input unit, and A recognition determination unit that determines whether or not all characters have been recognized by the character recognition unit, and a character read from the character document is converted into a font prepared in advance based on the character recognition of the character recognition unit. Character data generation means for generating character information for synthesis and characters obtained based on reading of the character original by the image input means A combination processing means for combining the information and the input image obtained via the image input means, and if the character recognition means determines that all characters have been recognized, the character data generation means When the character information converted into the font is combined with the input image and the recognition determining means determines that there is an unrecognizable character, the character data generating means generates the character data. Prohibiting and combining processing means for combining image data of a character document read by the image input means with the input image, output means for outputting a composite image obtained by the combining processing means, and at least one composition template A template storage unit storing template data to be displayed, and selecting the composition template from the template storage unit A template selection means, wherein a character entry area is preset in the composition template, and the composition processing means comprises a composition template selected by the template selection means, the character information, and the input image. The character size is automatically adjusted so that the entire character information obtained based on the reading of the character original by the image input means fits in the character entry area. It is configured to be combined with the input image together with the template.The
[0007]
According to the present invention, the image input means for reading an image original and inputting image data is shared as a character input means, and by using this means, a handwritten character original or an existing character original is read. Easy to enter text information. The input image and characters are synthesized by the synthesis processing means and output from the output means. Thereby, a dedicated character input device can be omitted, and even a person who is not used to key operations can easily obtain a character composite image.
[0008]
  A character synthesis output device according to the present invention is claimed in this application.2In addition to the above configuration, when reading a text document by the image input unit, the setting is made so that the number of colors and / or the resolution of the image input unit is reduced compared to the case of reading the image document.ReadRead control means for executing the insertion process may be added.
[0009]
  According to this aspect, when reading an image original, the number of colors and the resolution are set to high values in order to improve the image quality, and when reading a character original, the setting is switched to a lower value. Thereby, the reading speed can be increased.
[0012]
According to the character composition output device having such a configuration, it is possible to input characters using an external device (for example, a mobile phone, a portable information terminal, etc.) familiar to the user. The input characters are combined with the input image by the combining processing unit and output from the output unit. Thereby, a dedicated character input device can be omitted, and the user can easily obtain a character composite image by operating an external device familiar with the operation.
[0013]
  Claim of this application3The character composition output device according to claim 1Or 2And a template updating means for adding and updating the template for synthesis stored in the template storage unit.
  Claim of this application4The character composition output device according to claim 13The template storage unit includes a non-background template in which only a character entry area is set.
[0014]
  According to another aspect of the present invention, there is provided a character composition output device.5As shown in FIG. 4, the image input unit, the synthesis processing unit, the output unit, the image display unit, and the operation unit are configured as an integrated apparatus integrally incorporated in a housing.
  In addition, the claims of the present application6As shown in FIG. 4, this character composition output device has a charge input unit for inputting a charge set according to the output form from the output means, and operates based on the charge input to the charge input unit. Used as an output service device.
[0015]
  As the operation means, the present claim7As shown in FIG. 4, there is an aspect constituted by a touch panel arranged on the screen of the image display means. As the image input means, claims of the present application8As shown in FIG. 1, there is an aspect constituted by a flat bed scanner device. As the output means, the claims of the present application9As shown in FIG. 2, there is a mode in which a printer is used.
[0016]
  Claim of this application10The character composition output method according to the present invention includes an image input step of reading an image represented on an image original by converting it into an electrical signal by an image input unit having an image sensor, and a character input unit including the image input unit having the image sensor. As a character input step, the character input step of reading the character represented in the character document by the image input unit, the character recognition step of recognizing the character from the image data obtained by reading the character document by the image input unit, A recognition determination step for determining whether or not all characters shown in the character document have been recognized in the character recognition step, and characters read from the character document are prepared in advance based on the character recognition. A character data generating step for generating character information for synthesis by converting into a font; and a character document by the image input means When combining the character information obtained based on the reading and the input image obtained via the image input means, and when the determination that all characters have been recognized in the recognition determination step When the character information converted into the font in the character data generation step is combined with the input image, and in the recognition determination step, it is determined that there is an unrecognizable character, the character data generation step A composition processing step for prohibiting generation of character data and composing image data of a character document read by the image input means with the input image; and an output step for outputting a composite image obtained in the composition processing step; From the template storage unit in which template data indicating one synthesis template is stored. A template selection step for selecting a template, a character entry area is preset in the composition template, and the composition processing step includes the composition template selected in the template selection step, the character information, A step of combining the input image and automatically adjusting the size of the character so that the entire character information obtained based on the reading of the character original by the image input means fits in the character entry area; And a step of combining the input image together with the combining template..
UpIn the character composition output method,11In the character input step, when the character original is read by the image input means, the read processing is performed by changing the setting of the number of colors and / or the resolution of the image input means to be less than when the image original is read. May be executed.
[0017]
BookClaim12The character composition output method according to claim10 or 11The method further comprises a template updating step of adding and updating the synthesis template stored in the template storage unit.
[0018]
DETAILED DESCRIPTION OF THE INVENTION
Preferred embodiments of a character composition output device and method according to the present invention will be described below in detail with reference to the accompanying drawings.
FIG. 1 is an external perspective view of an image output apparatus to which the present invention is applied. As shown in the figure, the image output apparatus 10 includes a flat bed scanner 12, a display device 14, a floppy disk drive 16, a memory card insertion unit 18, a film scanner 20, printers 22 and 23, and the like. Each of these elements is integrated into the housing 25 to form one device.
[0019]
The flat bed scanner 12 is also used as an image input unit and a character input unit. Although the detailed structure of the flat bed scanner 12 is not shown, the flat bed scanner 12 includes a glass plate on which a document is placed, a light source for illumination, an image sensor that converts an optical image into an electric signal, and light from the document as the image. And a reduction optical system that leads to the sensor. When inputting an image from a photograph (image document) or inputting characters from a handwritten character document or the like, the holding cover 26 of the flatbed scanner 12 is opened and the photograph or handwritten character document is placed on the glass plate. Etc. and scan it.
[0020]
The display device 14 includes a CRT display or a liquid crystal display, and a touch panel 28 is provided on the display unit. Various operations of this system are performed using the touch panel 28, and operations can be advanced by simply touching buttons according to an operation guide displayed on the screen.
The floppy disk drive 16 is provided as one of image input means. Image data created by a personal computer or the like is recorded on a floppy disk, and the floppy disk drive 16 is used when inputting image data from the floppy disk.
[0021]
The memory card insertion unit 18 is also provided as one of the image input means. By mounting image data recorded on a recording medium of a predetermined format, such as a PC card or smart media, in the memory card insertion unit 18 so as to correspond to image data captured by a digital camera or the like, the recording medium The image data can be directly read from and printed out. The form of the recording medium is not particularly limited, and various forms such as a flash memory card, an IC card, a floppy disk, a magneto-optical disk (MO), and a stick memory are possible, and a driver corresponding to the form of the recording medium Is provided.
[0022]
The film scanner 20 is a means for inputting an image from a cartridge film compatible with the 24 mm new photo system (APS). By mounting the developed negative film together with the cartridge in a predetermined insertion portion, the film is automatically loaded, and the film image is converted into electronic image data by an image sensor (not shown). A film scanner corresponding to a 35 mm film or other film may be provided.
[0023]
The printers 22 and 23 correspond to image output means, and the upper part of the figure is an A5 / A6 size printer, and the lower part is a printer for sealing. The printers 22 and 23 are thermoautochrome (TA) printers, and continuous paper wound in a roll is used as the recording paper. In addition to plain paper, an adhesive layer is formed on one side of the paper, and a TA paper dedicated to sealing in which the adhesive layer is covered with release paper is used. After the printing is finished, the paper cutting means cuts the paper into a predetermined paper size, and the finished printed matter is discharged from either or both of the printers 22 and 23.
[0024]
The apparatus shown in FIG. 1 is installed, for example, in a shop or the like, and is used as a printing machine that provides a print service by self-operation. When providing a print service, the user inserts a charge from the coin insertion slot 30 according to the charge set for each type of print, and follows the operation guide on the screen of the display device 14 in order to provide the flatbed scanner 12. An image is input from an image input means such as a user, a composition template is selected, and characters are input according to a procedure described later. In this way, a template and characters for synthesis are synthesized on the input image, and the synthesized image is printed out. In addition, the code | symbol 32 in FIG. 1 is a change return port.
[0025]
FIG. 2 is a block diagram showing a system configuration of the image output apparatus shown in FIG. As shown in the figure, the image processing control unit 40 includes a SCSI interface unit 42, a memory 43, a hard disk drive 44, a modem 45, a central processing unit (CPU) 46, a touch panel control unit 47, and a display control unit 48. These circuit units (42 to 48) are connected to a bus 49. The CPU 46 performs various calculations and determinations, and also serves as a control unit that controls each circuit unit.
[0026]
The image processing control unit 40 is connected to the flat bed scanner 12 and the printers 22 and 23 via the SCSI interface unit 42. Although not shown in FIG. 2, the film scanner 20, a PC card / smart media driver, and the like are also connected to the image processing control unit 40 via the SCSI interface unit 42.
[0027]
The display device 14 is controlled by the display control unit 48. The touch panel 28 is controlled by a touch panel control unit 47.
The hard disk drive 44 stores a control program of the present system and a plurality of composition template data (template data). The template for synthesis includes a template without a template image (that is, a template without a background). In such a non-background template, only an area (character entry area) where characters are synthesized is set. Note that the data of the template for synthesis can be added and updated (updated) using a CD-ROM, a communication function, or the like.
[0028]
The image output apparatus 10 can be connected to a public line via a modem 45, and can receive data from a cellular phone (not shown) or can transmit data to a network server or other external apparatus. .
Next, the operation of the image output apparatus configured as described above will be described.
FIG. 3 is a flowchart showing the procedure of the handwriting synthesis process. As shown in the figure, when the process starts, first, the CPU 46 sets the image scan resolution and the number of colors of the flatbed scanner 12 to predetermined conditions suitable for reading a photographic image according to the control program (step S310). In this case, for example, 600 dpi and full color 24 bits (16.77 million colors) are set.
[0029]
Next, a reading operation of the photograph placed on the glass plate of the flat bed scanner 12 (scanning of the input image) is executed (step S312). Next, a synthesis template selection screen is displayed on the screen of the display device 14 (step S314). The user selects a desired template by operating the touch panel 28 while viewing the screen.
[0030]
When the synthesis template is selected, the image scan resolution and the number of colors of the flatbed scanner 12 are changed to predetermined conditions suitable for reading a handwritten character document (step S316). In this case, for example, it is set to 72 dpi and 8 bits (256 colors). Here, the user replaces the original of the flatbed scanner 12 and sets the character original on which the handwritten characters are represented on the glass plate.
[0031]
The document size of the handwritten document can be any document size smaller than the reading size of the flatbed scanner 12, and includes an automatic document size recognition unit that automatically recognizes the document size. For example, the automatic recognition of the document size is performed as follows. That is, at the time of shipment from the factory or when the system is started, the surface of the holding lid 26 of the flat bed scanner 12 is input as image data, and the read value is stored. When the document scan is executed, the stored value and the image data read in the document scan are compared, and an area different from the stored value is cut out as a document image area, so that the document size can be automatically recognized. .
[0032]
After the handwritten character original is prepared for reading, the character original reading operation is executed (step S318). At this time, since the number of colors of the scanner and the resolution are set to be smaller than those at the time of reading the image original, the scanning speed is increased.
When the reading of the text document is completed, it is determined whether or not the OCR process is executed (S320), and the process branches according to the determination. That is, when the user desires to synthesize the contents of handwritten characters as they are in the input image, the user operates the touch panel 28 to select invalidity of the OCR function. If the user desires to synthesize a character converted into a font (font) prepared in advance in the present system, the user touches the touch panel 28 and selects whether the OCR function is valid. Note that a plurality of types of fonts may be prepared and configured so that the user can freely select them.
[0033]
When it is determined that the OCR is not to be executed based on the selection result of the user (NO determination), the content read in the character document scan is displayed on the screen of the display device 14 to prompt the user to confirm (step S322). . When the user inputs an approval instruction, an input image, a composition template, and character composition processing are executed (step S330).
[0034]
As shown in FIG. 4, the composition template 52 is preliminarily set with an image fitting area 56 into which the input image 54 is fitted and a character entry area 58, and the characters of the handwritten document 60 read from the flatbed scanner 12. The columns are sized (resized) so that no characters are lost in the character entry area 58 and then combined with the input image 54 together with the combining template 52. Then, the image obtained by the synthesis is printed (step S332).
[0035]
On the other hand, when it is determined in step S320 that OCR is to be executed (YES determination), character recognition processing is executed based on the content read in the character document scan (step S324). Then, it is determined whether or not all characters have been recognized (step S326). If all characters can be recognized, the recognition result is displayed on the screen to prompt the user to confirm (step S328). When the user inputs an approval instruction, a composition process for characters converted into a predetermined font based on the input image, the composition template, and the character recognition is executed (step S330). Then, the composite image is printed (step S332).
[0036]
If there is a character that cannot be recognized by even one character in step S326, a warning to that effect is given, and the process proceeds to step S322 to prompt confirmation by displaying the contents of the read handwritten character as it is. If the user approves, the handwritten character composition process is performed and printing is executed. In this way, when there is a character that cannot be recognized by OCR, the entire character string is synthesized as a handwritten character, so that only the unrecognizable portion is not replaced with an unnatural substitute symbol or the like.
[0037]
In the above description, a case where a handwritten character document is read has been described as an example, but handwritten illustrations and pictures can also be input by a method similar to this.
Next, other means for inputting characters will be described.
As described with reference to FIG. 2, the image output apparatus 10 includes the modem 45 and can be connected to the public line 50. The image output apparatus 10 has a predetermined telephone number or e-mail address. A user inputs characters to the image output device 10 from an external device (hereinafter referred to as a user terminal) such as a mobile phone or a portable information terminal (not shown), and the character data is converted to the telephone number or the e-mail address. Characters can be input by transmitting.
[0038]
When receiving image data via the public line 50, the image output device 10 decodes the character code and expands it into a character information string. Then, the character information string is synthesized in a predetermined character entry area 58 in the synthesis template 52. The image obtained by the synthesis is printed by a printer and printed out.
FIG. 5 shows a flowchart of the operation procedure. As shown in the figure, when the process starts, first, the CPU 46 sets the image scan resolution and the number of colors of the flatbed scanner 12 to predetermined conditions suitable for reading a photographic image according to the control program (step S510). In this case, for example, 600 dpi and full color 24 bits (16.77 million colors) are set.
[0039]
Next, a reading operation of the photograph placed on the glass plate of the flat bed scanner 12 (scanning of the input image) is executed (step S512). Next, a synthesis template selection screen is displayed on the screen of the display device 14 (step S514). While viewing the screen, the user operates the touch panel 28 to select a desired template.
[0040]
When the selection of the template for synthesis is completed, a character data transmission request message is then presented on the screen of the display device 14 to instruct the user to perform a character data transmission operation (step S516). For example, a “telephone number” and / or “e-mail address” to which character data is to be sent is displayed on the screen of the display device 14 to prompt the image output device 10 to send character data.
[0041]
The user operates the user terminal that he / she is familiar with to transmit desired character data (step S518). When character information is transmitted from the telephone, specific numbers, symbols, or combinations thereof are associated with specific characters, symbols, character strings, and the like, similar to pagers.
The image output apparatus 10 receives the character data transmitted from the user terminal (step S520), and expands the received code into a character string (step S522). Then, the character size is adjusted according to the size of the character entry area 58 of the composition template 52, and the character string is combined with the input image together with the composition template (step S524). The image obtained by the synthesis process is printed out (step S526).
[0042]
In the above-described embodiment, an example in which an image in which characters are combined is printed out by the printers 22 and 23 has been described as an example, but means for outputting a combined image is not limited to a printer. For example, as another aspect of the output means, a means for writing data indicating an image obtained by the synthesis to a removable medium (a portable external recording medium) may be used, or the data may be uploaded to a server or the like via a network. Data transfer means (communication means) may also be used.
[0043]
【The invention's effect】
As described above, according to the character composition output apparatus and method of the present invention, the image input means for inputting image data is shared as the character input means, and handwritten character originals and existing characters are used by using this means. Since the document is read and the character information is input, a dedicated character input device can be omitted, and even a person who is not used to key operations can easily obtain a character composite image. This eliminates the need for kana-kanji conversion operation and enables input of characters by one's own handwriting.
[0044]
In particular, when reading a character document, the number of colors and / or resolution is reduced and the reading speed is increased. In addition, in a mode in which automatic character recognition means is added, if character recognition fails, character conversion of the entire character string is stopped, so that only part of the character string does not become unreadable.
Furthermore, according to the character composition output device of the present invention, a communication device that can be connected to a communication line is provided so that data can be received from an external device (for example, a mobile phone, a portable information terminal, etc.) via the communication line. Therefore, it is possible to easily obtain a character composite image by operating an external device familiar to the user.
[0045]
Further, according to the present invention, the layout of the color and size of characters can be freely changed according to the user's preference.
[Brief description of the drawings]
FIG. 1 is an external perspective view of an image output apparatus to which the present invention is applied.
2 is a block diagram showing a system configuration of the image output apparatus shown in FIG.
FIG. 3 is a flowchart showing a procedure for handwritten character synthesis processing;
FIG. 4 is an explanatory diagram showing a state in which handwritten characters are combined with an image into an image.
FIG. 5 is a flowchart showing a composition processing procedure when character input is performed by communication from a user terminal.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 10 ... Image output device (character composition output device), 12 ... Flat bed scanner (image input means, character input means), 14 ... Display device (image display means), 16 ... Floppy disk drive (image input means), 22, DESCRIPTION OF SYMBOLS 23 ... Printer (output means) 25 ... Housing | casing 28 ... Touch panel (operation means), 30 ... Coin slot (charge insertion part), 40 ... Image processing control part, 44 ... Hard disk drive (template storage part), 45 ... Modem (communication device), 46 ... CPU (combination processing means, reading control means, character recognition means, recognition determination means, data decoding means), 52 ... composition template, 58 ... character entry area

Claims (12)

An image input means for converting an image represented on the image original into an electric signal by an image sensor and reading the image; and an image input means which is also used as a character input means for reading a character represented on the text original;
Character recognition means for recognizing characters from image data obtained by reading a character document by the image input means;
Recognition determination means for determining whether or not the character recognition means has recognized all the characters shown in the character document;
Character data generation means for generating character information for synthesis by converting characters read from the character document into a font prepared in advance based on character recognition by the character recognition means;
Combining processing means for synthesizing character information obtained based on reading of a character document by the image input means and an input image obtained via the image input means, wherein character recognition is performed on all characters by the recognition determining means. When it is determined that the character is generated, the character data converted by the character data generation unit is combined with the input image, while the recognition determination unit determines that there is an unrecognizable character. In this case, composition processing means for prohibiting generation of character data by the character data generation means, and combining image data of a character document read by the image input means with the input image;
Output means for outputting a composite image obtained by the composite processing means;
A template storage unit in which template data indicating at least one composition template is stored;
Template selection means for selecting the template for synthesis from the template storage unit,
The composition template has a character entry area set in advance,
The synthesis processing means is a means for synthesizing the synthesis template selected by the template selection means with the character information and the input image, and obtained based on the reading of the character original by the image input means. A character composition output device configured to automatically adjust the size of characters so that the entire character information fits in the character entry area and to compose the input image together with the composition template. .   When a text document is read by the image input means, a reading control means is added to execute a reading process by changing the setting to a setting in which the number of colors and / or resolution of the image input means is reduced compared to when reading an image original. The character composition output device according to claim 1. The template storage section adds the stored synthesis templates, the character synthesis output device according to claim 1 or 2, further comprising a template updating means for updating. The template storage unit, a character synthesized output device according to any one of claims 1 to 3, characterized in that it comprises a non-background template only character entry area is set. The character composition output device is an integrated device in which the image input means, the composition processing means, the output means, the image display means, and the operation means are integrally incorporated in a housing. The character composition output device according to any one of claims 1 to 4 . A charge input unit that inputs a charge set according to an output form from the output means, and is used as an output service providing device that operates based on charge input to the charge input unit. The character composition output device according to claim 5 . It said operating means characters combined output device according to claim 5 or 6, characterized in that it is constituted by a touch panel disposed on a screen of said image display means. Wherein the image input means, the character synthesis output device according to any one of claims 1 7, characterized in that the flat bed scanner unit. And the output means, the character synthesis output device according to any one of claims 1 8, characterized in that a printer. An image input step of converting an image represented on the image original into an electric signal by an image input means having an image sensor and reading the image;
A character input step of using the image input means having the image sensor as a character input means, and reading the characters shown in the character document by the image input means,
A character recognition step for recognizing characters from image data obtained by reading a character document by the image input means;
A recognition determination step for determining whether or not the characters can be recognized in the character recognition step for all the characters shown in the character document;
A character data generation step of converting character read from the character document into a font prepared in advance based on the character recognition and generating character information for synthesis;
It is a step of combining character information obtained based on reading of a character document by the image input means and an input image obtained via the image input means, and character recognition can be performed for all characters in the recognition determination step. If the character data converted into the font in the character data generation step is combined with the input image, while the recognition determination step determines that there is an unrecognizable character. Is a composition processing step for prohibiting the generation of character data in the character data generation step, and combining the image data of the character document read by the image input means with the input image;
An output step of outputting a composite image obtained in the composite processing step;
A template selection step of selecting the template for synthesis from a template storage unit in which template data indicating at least one template for synthesis is stored;
The composition template has a character entry area set in advance,
The synthesis process step is a step of synthesizing the synthesis template selected in the template selection step, the character information, and the input image,
Automatically adjusting the character size so that the entire character information obtained based on the reading of the character original by the image input means fits in the character entry area;
And a step of synthesizing the input image together with the synthesizing template. In the character input step, when the character original is read by the image input unit, the reading process is executed by changing the setting to a setting in which the number of colors and / or resolution of the image input unit is reduced as compared with the case of reading the image original. The character composition output method according to claim 10 , wherein: The character synthesis output method according to claim 10 or 11 , further comprising a template update step of adding and updating a template for synthesis stored in the template storage unit.

Images