JP2015126494A - Image processing device, image processing system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device which can record a plurality of pieces of destination information extracted from image data on a recording paper in a predetermined order.SOLUTION: An information processing device includes: acquisition means (S12) of acquiring image data including a plurality of pieces of destination data by making a destination copy in which a plurality of destination images each representing a destination of a delivery are recorded to be read; extraction means (S13) of extracting key information recorded in a predetermined position of the destination copy from the image data; grouping means (S15) of grouping the plurality of pieces of destination image data into a first group or a second group based on the key information; and output means (S16, S21) of outputting recording instructions to make the destination images represented by the destination image data to be recorded on recording papers different from each other in the order of the destination image data belonging to the first group to the destination image data belonging to the second group.

Description

  The present invention relates to an information processing apparatus that acquires image data from an external apparatus and records an image extracted from the image data on a recording sheet on an external apparatus.

  2. Description of the Related Art Conventionally, there is known a server device that acquires image data from a reading device and instructs the recording device to record an image extracted from the image data on a recording sheet. For example, in Patent Document 1, information read in a sender card, an address card, and an address book card that associates the sender card and the address card is read by a reading device, and the obtained image is assigned to an allocation area. A technique for recording a postal address on a recording device has been proposed.

JP 2001-217966 A

  It is conceivable to post the postcards on which the address is printed after sorting by address. For example, it is conceivable that the sender writes a handwritten message on the communication side of one of the sorted groups, and posts the message without writing a message on the other group. Further, for example, it is conceivable to sort into the city and the outside and post it to each of the posting openings. However, since a configuration for easily printing addresses is not defined in Patent Document 1, the user needs to sort a large number of postcards while looking at the printed addresses and considering which group they belong to.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to enable a plurality of pieces of destination information extracted from image data to be recorded on each recording sheet in an order that reduces the labor of sorting. It is to provide a processing apparatus.

  The information processing apparatus described in the present specification includes a communication unit that communicates with an external device, and a control unit. The control unit generates image data including a plurality of destination image data generated by reading a destination document on which a plurality of destination images each representing a destination of a delivery item are recorded, and indicating each of the plurality of destination images. Acquisition means for acquiring from an external device through the communication unit, extraction means for extracting key information recorded at a predetermined position of the destination document from the image data, and the key information extracted by the extraction means Based on the classification means for classifying each of the plurality of destination image data into a first group or a second group, the destination image data belonging to the first group, and the destination image data belonging to the second group in this order. A recording instruction for recording the destination images indicated by the destination image data on different recording papers through the communication unit And an output means for outputting.

  According to the information processing apparatus described in this specification, a plurality of pieces of destination information extracted from image data can be recorded on each recording sheet in an order that reduces the labor of sorting.

FIG. 1 is a schematic diagram of an information processing system 100 in the embodiment. FIG. 2 is a flowchart showing the operation of the information processing system 100. 3A is a flowchart of destination image data analysis processing, FIG. 3B is a flowchart of sender image data analysis processing, and FIG. 3C is a flowchart of destination image data classification processing. FIG. 4 shows an example of the destination sheet 70, where (A) shows a state before the destination information is entered, and (B) shows a state after the destination information is entered. FIG. 5 shows an example of the sender sheet 80, where (A) shows a state before the sender information is entered, and (B) shows a state after the sender information is entered. FIG. 6 is a diagram showing postcards 91 to 93 in which a destination image and a sender image are recorded. FIG. 7 is an example of a print end screen, where (A) is a display example in step S18, and (B) is a display example in step S23. FIG. 8 is a schematic diagram illustrating another example of the information processing system 100.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it is needless to say that the embodiment of the present invention can be changed as appropriate without departing from the gist of the present invention.

  FIG. 1 is a schematic diagram of an information processing system 100 in the present embodiment. An information processing system 100 shown in FIG. 1 includes a multifunction machine 10 and an information processing apparatus 50. The multifunction device 10 and the information processing apparatus 50 can communicate with each other via the communication network 102. Although the specific example of the communication network 102 is not specifically limited, For example, wired LAN (abbreviation of Local Area Network), wireless LAN, WAN (abbreviation of Wide Area Network), or these combination may be sufficient.

[Multifunction machine 10]
As shown in FIG. 1, the multifunction machine 10 includes a printer unit 11, a scanner unit 12, a display unit 23, an operation unit 24, a communication unit 25, a CPU 27, a storage unit 28, and a communication bus 29. Is mainly provided. Each component constituting the multifunction machine 10 is connected to each other via a communication bus 29. The multifunction machine 10 is an example of an image processing apparatus or an external apparatus.

  The printer unit 11 executes print processing for recording an image indicated by image data acquired from an external device on a recording sheet. The printing method of the printer unit 11 is not particularly limited. For example, a known method such as an ink jet method or an electrophotographic method can be adopted. The printer unit 11 is an example of a recording device or a recording unit. The scanner unit 12 executes a scan process for reading an image recorded on a recording sheet and generating image data. The scanner unit 12 is an example of a reading device or a reading unit. The multifunction machine 10 may further include a copy function for recording an image indicated by the image data generated by the scanner unit 12 on a recording sheet by the printer unit 11, a FAX function for performing FAX transmission / reception, and the like. .

[Display unit 23]
The display unit 23 includes a display screen that displays various types of information. Although the specific configuration of the display unit 23 is not particularly limited, for example, a liquid crystal display (abbreviation of Liquid Crystal Display), an organic EL display (abbreviation of Organic Electro-Luminescence Display), or the like can be employed. The display unit 23 is an example of a display device.

[Operation unit 24]
The operation unit 24 detects a user operation for selecting an object displayed on the display screen of the display unit 23. Specifically, the operation unit 24 includes, for example, a push button, and outputs various operation signals associated with the pushed push button to the CPU 27. Further, the operation unit 24 may include a film-like touch sensor superimposed on the display screen of the display unit 23. That is, the display unit 23 may be configured as a touch panel display. For the touch sensor, a known method such as a capacitance method or a resistance film method can be adopted.

  The “object” refers to an image that can be selected by the user operating the operation unit 24. As an example, the object is a character string displayed on the display unit 23. One of the objects is highlighted when the direction key of the operation unit 24 is pressed, and the object is highlighted by pressing the enter button of the operation unit 24. A light-displayed object may be selected. As another example, the object when the operation unit 24 is a touch panel is an icon, a button, a link, or the like displayed on the display unit 23, and the object displayed at the tap position may be selected.

[Communication unit 25]
The communication unit 25 is an interface for communicating with an external device through the communication network 102. That is, the multifunction machine 10 outputs various data or various information to the information processing apparatus 50 through the communication unit 25, and acquires various data or various information from the information processing apparatus 50 through the communication unit 25.

[CPU 27]
A CPU (abbreviation of Central Processing Unit) 27 controls the overall operation of the multifunction machine 10. The CPU 27 acquires and executes various programs, which will be described later, from the storage unit 28 based on the operation signal output from the operation unit 24 and various information or various data acquired from the information processing apparatus 50 through the communication unit 25. That is, the CPU 27 and the storage unit 28 constitute an example of a control unit.

[Storage 28]
The storage unit 28 includes a program storage area 28A and a data storage area 28B. In the program storage area 28A, an OS (abbreviation of Operating System) 30 and an image processing program 31 are stored. Note that the image processing program 31 may be a single program or an aggregate of a plurality of programs. The same applies to the information processing program 61 described later. Data or information necessary for executing the image processing program 31 is stored in the data storage area 28B.

  Note that “data” and “information” in this specification are common in that they are bits or bit strings that can be handled by a computer. “Data” refers to data that can be handled by the computer without taking into account the meaning of each bit. On the other hand, “information” refers to information that the operation of the computer branches depending on the semantic content indicated by each bit. Furthermore, the “instruction” is a control signal for prompting the destination apparatus to perform the next operation, and may include information or itself has a property as information. There is also.

  In addition, even if the format (for example, text format, binary format, flag format, etc.) is changed for each computer, “data” and “information” have the same data and information as long as they are recognized as the same meaning content. Are treated as For example, information indicating “two” is stored as text information “0x32” in ASCII code in one computer, and binary format information “10” in binary notation in another computer. May be.

  However, the distinction between the above “data” and “information” is not strict, and exceptional handling is allowed. For example, data may be temporarily treated as information, or information may be temporarily treated as data. Also, what is handled as data in a certain device may be handled as information in another device. Furthermore, information may be extracted from the data, or data may be extracted from the information.

  The storage unit 28 includes, for example, RAM (abbreviation of Random Access Memory), ROM (abbreviation of Read Only Memory), EEPROM (abbreviation of Electrically Erasable Programmable Read-Only Memory), and HDD (abbreviation of HardDr) 27 (HDD). It is configured by a buffer or the like or a combination thereof. The storage unit 28 may be a computer-readable storage medium. A computer-readable storage medium is a non-transitory medium. Non-transitory media include recording media such as CD-ROM and DVD-ROM in addition to the above examples. On the other hand, electrical signals that carry programs downloaded from servers on the Internet are not included in non-transitory media.

  The program stored in the program storage area 28A is executed by the CPU 27. However, in this specification, the operation of each program may be described with the CPU 27 omitted. That is, in the following description, the description that “the program A executes the process A” may indicate that “the CPU 27 executes the process A described in the program A”. The same applies to the information processing apparatus 50 described later.

  The OS 30 provides an API (abbreviation for Application Programming Interface) for controlling the printer unit 11, the scanner unit 12, the display unit 23, the operation unit 24, the communication unit 25, and the like that are hardware constituting the multifunction peripheral 10. It is a basic program. In other words, each of the above programs controls each hardware by calling an API provided by the OS 30. However, in this specification, the operation of each program will be described with the OS 30 omitted. That is, in the following description, the description “the program B controls the hardware C” may refer to “the program B controls the hardware C through the API of the OS 30”. The same applies to the information processing apparatus 50 described later.

[Information processing apparatus 50]
As shown in FIG. 1, the information processing apparatus 50 mainly includes a display unit 53, an operation unit 54, a communication unit 55, a CPU 57, a storage unit 58, and a communication bus 59. The display unit 53, the operation unit 54, the communication unit 55, the CPU 57, the storage unit 58, and the communication bus 59 included in the information processing device 50 are the display unit 23, the operation unit 24, the communication unit 25, and the CPU 27 included in the multifunction machine 10. Since it is common with the storage unit 28 and the communication bus 29, the description thereof will be omitted. The information processing device 50 is a server device on the Internet, for example.

  The program storage area 58A of the storage unit 58 stores the OS 60 and the information processing program 61. The data storage area 58B stores layout information indicating the layout of a destination sheet 70 and a sender sheet 80 described later. The layout information is information indicating the position and size of each entry area included in the destination sheet 70 and the sender sheet 80.

[Operation of Information Processing System 100]
The operation of the information processing system 100 in the present embodiment will be described with reference to FIGS. The information processing system 100 according to the present embodiment causes the scanner unit 12 to read the destination sheet 70 illustrated in FIG. 4B and the sender sheet 80 illustrated in FIG. 5B, and image data generated by the scanner unit 12. A process for recording the destination image and the sender image extracted from the postcards 91, 92, and 93 shown in FIG. 6 is executed. The postcards 91 to 93 are examples of deliverables, the destination sheet 70 is an example of a destination original, and the sender sheet 80 is an example of a sender original.

  First, the image processing program 31 of the multifunction machine 10 causes the scanner unit 12 to execute scan processing for the destination sheet 70 and the sender sheet 80 set in the scanner unit 12 by the user (S11). For example, the scanner unit 12 reads an image recorded on a destination sheet 70 shown in FIG. 4B to generate destination sheet data. Similarly, the scanner unit 12 reads an image recorded on the sender sheet 80 shown in FIG. 5B, for example, and generates sender sheet data. Then, the image processing program 31 outputs the destination sheet data and the sender sheet data generated by the scanner unit 12 to the information processing apparatus 50 through the communication unit 25.

  Note that the number of destination sheets 70 read in step S11 is not limited to one, and may be a plurality. In addition, the image processing program 31 may generate one destination sheet data including images recorded on a plurality of destination sheets 70, or may generate destination sheet data for each destination sheet 70. The same applies to the sender sheet 80. Further, the destination sheet data and the sender sheet data may be generated as one image data, or may be generated as separate image data. The destination sheet data and the sender sheet data are examples of image data.

  The address sheet 70 shown in FIG. 4A includes a plurality of address entry areas 71, 72, 73, a sender specifying area 74, a communication surface image specifying area 75, and a plurality of marks 76, 77, 78. include. However, the number of destination entry areas 71 to 73 is not limited to the example of FIG. The same applies to the marks 76-78.

  The address entry areas 71 to 73 are areas for entering address information (hereinafter, referred to as “address information”) to be recorded on the address faces of the postcards 91 to 93, for example. In the address entry area 71, a zip code entry area 71A for entering the zip code of the address, an address entry area 71B for entering the address of the address, a name entry area 71C for entering the name of the address, and unused information are entered. And a non-use information entry area 71D. The non-use information is information indicating that the destination information entered in the destination entry area 71 is not recorded on the address side of the postcard 91. In the present embodiment, when the destination information entered in the destination entry area 71 is not used, the “L” symbol is entered in the non-use information entry area 71D.

  The sender specifying area 74 is an area in which information for specifying one of a plurality of sender information recorded on the sender sheet 80 (hereinafter referred to as “sender specifying information”) is entered. The communication surface image specifying area 75 is an area in which information for specifying an image recorded on the communication surface of the postcards 91 to 93 (hereinafter referred to as “image specifying information”) is entered. In the present embodiment, an example is described in which numbers such as “1”, “2”, and “3” are used as sender identification information. However, the present invention is not limited to this, and may be an alphabet or the like. The same applies to the image specifying information. In addition, in the destination sheet 70 shown in FIG. 4A, the sender identification information entered in the sender identification area 74 is used in common for the three address entry areas 71-73. However, the present invention is not limited to the above example, and a sender specifying area 74 may be provided for each of the address entry areas 71 to 73. The same applies to the communication surface image specifying area 75.

  The postal code entry area 71A, the address entry area 71B, and the name entry area 71C shown in FIG. 4A are identified by broken lines on the destination sheet 70, but the identification method of each area is not limited to this. The same applies to the address entry areas 72 and 73, the sender specifying area 74, and the communication surface image specifying area 75. The same applies to the sender sheet 80 shown in FIG.

  The marks 76 to 78 are for causing the information processing apparatus 50 to recognize that the sheet is the destination sheet 70. The marks 76 to 78 in the present embodiment are black circles. In the destination sheet 70 of the present embodiment, the mark 76 is arranged at the upper left corner, the mark 77 is arranged at the lower left corner, and the mark 78 is arranged at the lower right corner. The marks 76 to 78 are used to correct the tilt when the destination sheet 70 is read by the scanner unit 12 in a tilted state. A virtual straight line connecting the center position of the mark 76 and the center position of the mark 77 coincides with the short direction of the destination sheet 70. On the other hand, the virtual straight line connecting the center position of the mark 77 and the center position of the mark 78 coincides with the longitudinal direction of the destination sheet 70.

  A sender sheet 80 shown in FIG. 5A includes a plurality of sender entry areas 81, 82, 83 and a plurality of marks 86, 87, 88. The sender entry areas 81 to 83 are areas for entering sender information recorded in the postcards 91 to 93 (hereinafter referred to as “sender information”). The sender entry area 81 includes a postal code entry area 81A, an address entry area 81B, and a name entry area 81C. Note that the sender identification information “1”, “2”, and “3” entered in the destination sheet 70 indicate “sender 1”, “sender 2”, and “sender 3” of the sender sheet 80, respectively. “Sender 1”, “Sender 2”, and “Sender 3” of the sender sheet 80 function as sender identification information.

  The marks 86 to 88 are used for causing the information processing apparatus 50 to recognize that the sheet is the sender sheet 80 and correcting the inclination when the sender sheet 80 is read. The marks 86 to 88 in the present embodiment are black circles. In the sender sheet 80 of the present embodiment, the mark 86 is arranged at the upper right corner, the mark 87 is arranged at the lower right corner, and the mark 88 is arranged at the lower left corner. Further, a virtual straight line connecting the center position of the mark 86 and the center position of the mark 87 coincides with the short direction of the sender sheet 80. On the other hand, a virtual straight line connecting the center position of the mark 87 and the center position of the mark 88 coincides with the longitudinal direction of the sender sheet 80.

  The shapes of the marks 76 to 78 are not limited to black circles, and may be any shape that does not cause confusion with characters and the like written on the destination sheet 70. The same applies to the marks 86-88. Further, the arrangement of the marks 76 to 78 on the destination sheet 70 may be any arrangement as long as it is different from the arrangement of the marks 86 to 88 on the sender sheet 80. That is, the marks 76 to 78 and 86 to 88 may have a predetermined shape and be arranged at predetermined positions.

  The image processing program 31 performs, for example, print processing for recording the image shown in FIG. 4A on a recording sheet in response to the operation of the user instructing the output of the destination sheet 70 being detected by the operation unit 24. It may be executed by the printer unit 11. The same applies to the sender sheet 80. Note that “according to” in the present specification indicates that the processing described after the character string is executed when the condition described before the character string is satisfied. Note that the timing at which the process is executed may be after the condition is satisfied, and is not necessarily immediately after the condition is satisfied.

  The address sheet 70 shown in FIG. 4B is, for example, in the address entry areas 71 to 73, the sender specifying area 74, and the communication surface image specifying area 75 of the address sheet 70 shown in FIG. Various information is entered by the user. Similarly, the sender sheet 80 shown in FIG. 5 (B) is, for example, one in which sender information is entered by hand in the sender entry areas 81 to 83 of the sender sheet 80 shown in FIG. 5 (A). is there.

  The information processing program 61 of the information processing apparatus 50 acquires the destination sheet data and the sender sheet data from the multifunction machine 10 through the communication unit 55. The CPU 57 of the information processing apparatus 50 that acquires image data in step S12 is an example of an acquisition unit. Next, the information processing program 61 executes a destination image data analysis process in response to the acquisition of the destination sheet data from the multifunction machine 10 through the communication unit 55 (S13). The destination image data analysis process is a process of extracting various types of information from each of a plurality of destination image data included in the destination sheet data. The destination image data analysis process will be described in detail with reference to FIG.

  First, the information processing program 61 corrects the angle of the image indicated by the destination sheet data (S31). Specifically, the information processing program 61 identifies the positions of the marks 76 to 78 by analyzing the destination sheet data. Then, the information processing program 61 rotates the image so that a virtual straight line passing through the centers of the marks 76 and 77 is directed in the vertical direction, and a virtual straight line passing through the centers of the marks 77 and 78 is directed in the horizontal direction. Note that the following processing is performed on the image rotated in step S31.

  Next, the information processing program 61 extracts a plurality of destination image data from the destination sheet data based on the layout information of the destination sheet 70 stored in the data storage area 58B (S32). The destination image data indicates images of the destination entry areas 71 to 73 shown in FIG. 4B (hereinafter referred to as “destination images”). That is, the destination image is an image representing the destinations of the postcards 91 to 93. In step S32, the information processing program 61 extracts three destination image data.

  Next, the information processing program 61 analyzes the destination image data indicating the destination image in the destination entry area 71 to extract the unused information entry area 71D included in the destination image. Then, the information processing program 61 extracts the zip code included in the destination image in the destination entry area 71 in response to the fact that the unused information entry area 71D is blank (S33: Yes) (S34). Specifically, the information processing program 61 acquires a 7-digit number string from the image included in the postal code entry area 71A by OCR (abbreviation of Optical Character Recognition).

  Further, the information processing program 61 extracts, for example, the sender specifying information (S35) included in the sender specifying area 74 and the image specifying information (S36) included in the communication surface image specifying area 75 by the same method as in step S34. To do. Since the sender specifying information and the image specifying information in the present embodiment are associated with the three destination images in common, steps S35 to S36 may be executed only once. The zip code, sender identification information, and image identification information extracted in steps S34 to S36 are examples of key information. The CPU 57 of the information processing apparatus 50 that executes the processes of steps S32 to S36 is an example of an extracting unit. The same applies to steps S43 and S44 described later.

  On the other hand, the information processing program 61 discards the destination image data in response to the fact that “Le” is included in the unused information entry area 71D (S33: No) (S37). Then, the information processing program 61 executes the processing of steps S33 to S37 for all the destination image data extracted in step S32, and ends the destination image data analysis processing (S38: No).

  Returning to FIG. 2, the information processing program 61 executes the sender image data analysis process in response to the acquisition of the sender sheet data from the multifunction machine 10 through the communication unit 55 (S14). The sender image data analysis process is a process of extracting various types of information from each of a plurality of sender image data included in the sender sheet data. The sender image data analysis processing will be described in detail with reference to FIG. Note that the specific processing in steps S41 to S44 in FIG. 3B is common to steps S31, S32, S35, and S36 in FIG. Further, the execution order of the destination image data analysis process and the sender image data analysis process is not limited to the example of FIG. 2, and may be executed in reverse order or in parallel.

  First, the information processing program 61 corrects the angle of the image indicated by the sender sheet data according to the positions of the marks 86 to 88 (S41). Next, the information processing program 61 extracts one or more sender image data from the sender sheet data (S42). The sender image data indicates an image of each of the sender entry areas 81 to 83 shown in FIG. 5B (hereinafter referred to as “sender image”). That is, the sender image is an image representing the sender of the postcards 91 to 93. Next, the information processing program 61 extracts the zip code (S43) and the sender identification information (S44) from each of the sender images extracted in step S42, and ends the sender image data analysis process (S45: No).

  Returning to FIG. 2, the information processing program 61 executes destination image data classification processing (S15). The destination image data classification process is a process of classifying the plurality of destination image data extracted in step S32 of FIG. 3A into any of a plurality of predetermined groups. The CPU 57 of the information processing apparatus 50 that executes the process of step S15 is an example of a classification unit. The destination image data classification process will be described in detail with reference to FIG.

  First, the information processing program 61 compares the upper 3 digits of the postal code extracted from each destination image in step S34 with the upper 3 digits of the specific postal code (S51). In the present embodiment, the postal code extracted from the sender image specified by the sender specifying information “1”, that is, the sender image of “sender 1” is set as the specific postal code. Then, the information processing program 61 classifies the destination image data in which the upper three digits of the postal code match the specific postal code (S51: Yes), into the first group (S52). On the other hand, the information processing program 61 classifies the destination image data in which the upper three digits of the postal code are different from the specific postal code (S51: No), into the second group.

  In the present embodiment, the above processing is executed on the three destination image data extracted in step S32, whereby the destination image data in the destination entry areas 71 and 73 is classified into the first group, and the destination entry area 72 is displayed. Destination image data is classified into the second group. Then, the information processing program 61 ends the destination image data classification process in response to the classification of all the destination image data (S54: No).

  Further, the information processing program 61 changes the layout of the destination image data and the sender image data according to the layout of the postcards 91 to 93. Specifically, the information processing program 61 converts the destination image of the destination entry area 71 into a partial image showing the postal code entry area 71A, a partial image showing the address entry area 71B, and a partial image showing the name entry area 71C. Divide into Similarly, the information processing program 61 divides the sender image in the sender entry area 81 into a partial image showing the postal code entry area 81A, a partial image showing the address entry area 81B, and a partial image showing the name entry area 81C. To do. Then, the information processing program 61 enlarges or reduces each partial image as necessary, and generates image data indicating an image in which the partial image is arranged in a predetermined layout. As a result, in step S17, which will be described later, the destination image and the sender image are recorded in a layout that matches the postcard 91. The same applies to postcards 92 and 93.

  Returning to FIG. 2, the information processing program 61 outputs a first recording instruction to the multifunction machine 10 through the communication unit 55 (S <b> 16). The first recording instruction is an instruction to record the destination image indicated by each of the destination image data belonging to the first group and the sender image associated with the destination image on the address side of the postcard. The first recording instruction includes destination image data belonging to the first group, sender image data associated with each destination image data, and an end flag. The first recording instruction includes destination image data and sender image data after layout change. In the end flag, “ON” is set when the recording instruction is the last recording instruction, and “OFF” is set when the recording instruction is not the last recording instruction. In the present embodiment, “OFF” is set to the end flag of the first recording instruction.

  When there are a plurality of destination image data belonging to the first group, the information processing program 61 may output one first recording instruction including all the destination image data, or the first information for each destination image data. The recording instruction may be repeatedly output. The CPU 57 of the information processing apparatus 50 that executes the process of step S16 is an example of an output unit. The same applies to step S21 described later.

  The image processing program 31 of the multifunction machine 10 executes the print processing in accordance with the first recording instruction to the printer unit 11 in response to obtaining the first recording instruction from the information processing apparatus 50 through the communication unit 25 (S16). (S17). As shown in FIG. 6A, the image processing program 31 in the present embodiment prints the destination image in the destination entry area 71 and the sender image in the sender entry area 81 with respect to the address face of the postcard 91. 11 to record. Further, as shown in FIG. 6C, the image processing program 31 sends the destination image in the destination entry area 73 and the sender image in the sender entry area 81 to the printer unit 11 with respect to the address face of the postcard 93. Let me record.

  The first recording instruction may include location information indicating the location of each data instead of the destination image data and the sender image data. That is, the destination image data and the sender image data after the layout change may be stored in the data storage area 58B of the information processing apparatus 50 or a server apparatus on the Internet. The location information may be, for example, a URL (abbreviation of Uniform Resource Locator) format. Then, the image processing program 31 may acquire the destination image data and the sender image data indicated by the location information through the communication unit 25 in response to the acquisition of the first recording instruction.

  Next, the image processing program 31 displays the print end screen of the first group on the display unit 23 (S18) in response to the end of the print processing according to the first recording instruction (S17). FIG. 7A is an example of a print end screen displayed on the display unit 23 in step S18. The print end screen shown in FIG. 7A includes a message notifying that all destination images belonging to the first group have been recorded on the postcard, a “continue” button, and a “cancel” button. The “continue” button and the “cancel” button are included in the print end screen when the print processing according to the recording instruction in which “OFF” is set in the end flag is ended.

  The image processing program 31 outputs a continuation instruction to the information processing apparatus 50 through the communication unit 25 in response to an operation of tapping the “continue” button detected by the operation unit 24 (S19: Yes) (S20). The continuation instruction is an instruction for causing the information processing apparatus 50 to transmit the next recording instruction. That is, the tap of the “Continue” button is an example of inputting a continuation instruction. On the other hand, the image processing program 31 skips steps S20 to S23 and performs the processing shown in FIG. 2 in response to an operation of tapping the “cancel” button being detected by the operation unit 24 (S19: No). finish.

  The information processing program 61 of the information processing apparatus 50 outputs a second recording instruction to the multifunction device 10 through the communication unit 55 in response to obtaining the continuation instruction from the multifunction device 10 through the communication unit 55 (S21). . The second recording instruction is an instruction to record the destination image indicated by each of the destination image data belonging to the second group and the sender image associated with the destination image on the address side of the postcard. The second recording instruction includes destination image data belonging to the second group, sender image data associated with each destination image data, and an end flag. In the second embodiment, “ON” is set as the end flag of the second recording instruction.

  In response to the acquisition of the second recording instruction from the information processing apparatus 50 through the communication unit 25 (S21), the image processing program 31 of the multifunction machine 10 executes the printing process according to the second recording instruction to the printer unit 11. (S22). As shown in FIG. 6B, the image processing program 31 in the present embodiment prints the destination image in the destination entry area 72 and the sender image in the sender entry area 81 with respect to the address face of the postcard 92. 11 to record.

  Next, the image processing program 31 displays the second group print end screen on the display unit 23 in response to the end of the print processing in accordance with the second recording instruction (S22) (S23). FIG. 7B is an example of a print end screen displayed on the display unit 23 in step S23. The print end screen shown in FIG. 7B includes a message notifying that all destination images belonging to the second group have been recorded on the postcard, and an “OK” button. The “OK” button is included in the print end screen when the print process according to the recording instruction in which “ON” is set in the end flag is ended. Then, the image processing program 31 ends the process illustrated in FIG. 2 in response to the operation of tapping the “OK” button being detected by the operation unit 24.

[Operational effects of this embodiment]
According to the present embodiment, among destination images included in the destination sheet 70, destination images belonging to the first group are continuously recorded on the postcards 91 and 93, and thereafter, destination images belonging to the second group are recorded on the postcard 92. To be recorded. For example, as in this embodiment, postcards 91 and 93 that are sent to the same city by classifying the destination image data according to whether the upper three digits of the postal code match the postal code of “Sender 1”. Therefore, it is possible to reduce the time and labor of the user who sorts the postcard 92 out of the city.

  Further, according to the present embodiment, since the characters handwritten on the destination sheet 70 and the sender sheet 80 are recorded on the postcards 91 to 93, the postcards 91 to 93 having individuality can be obtained. Furthermore, since the name, address, etc. are not read by OCR, it is possible to prevent incorrect destination information and sender information from being recorded in the postcards 91-93.

  Furthermore, according to the present embodiment, after the printing process according to the first recording instruction, the print end screen is displayed on the display unit 23, and the “continue” button is tapped by the user, and the second recording instruction is followed. Print processing is executed. Thereby, the user can clearly recognize the boundary between the postcards 91 and 93 in which the destination images belonging to the first group are recorded and the postcard 92 in which the destination images belonging to the second group are recorded. However, the present invention is not limited to this, and the information processing program 61 of the information processing apparatus 50 uses all the destination image data belonging to the first group and the second group and the destination image indicated by the destination image data as a postcard. A recording instruction including information indicating the recording order may be output to the multi-function device 10 through the communication unit 55.

  Needless to say, the number of postal codes to be compared in step S51 is not limited to three. That is, the information processing program 61 classifies destination image data in which the upper n digits (n is a natural number equal to or less than 7) of the postal code match the specific postal code into the first group, and sets destination image data different from the specific postal code. What is necessary is just to classify | categorize into a 2nd group. Further, in the present embodiment, an example has been described in which the postal code of “sender 1” specified by the sender specifying information entered in the destination sheet 70 is the specific postal code, but is not limited thereto. For example, an area for entering a specific zip code may be provided on the destination sheet 70.

  In this embodiment, the example in which the destination image data is classified into two groups depending on whether the upper three digits of the postal code match the specific postal code has been described. However, the present invention is not limited to this. For example, the destination image data that matches the upper n digits of the postal code may be classified so as to belong to the same group. As a result, postcards for each region are collected and output from the multifunction device 10. Further, by setting n = 1, a plurality of postcards sorted by zip code are output from the multifunction device 10. In these cases, extraction of the specific zip code can be omitted.

  The key information is not limited to the zip code. For example, the destination image data may be classified using the sender specifying information as key information. For example, the information processing program 61 classifies the destination image data associated with the sender information “1” into the first group, and classifies the destination image data associated with the sender identification information “2” into the second group. The destination image data associated with the sender identification information “3” may be classified into the third group. Similarly, the destination image data may be classified using the image specifying information as key information. Thereby, when each sender writes a handwritten message after address printing, or when a communication surface image is printed after address printing, the labor of sorting can be reduced.

  It is to be noted that OCR can be obtained by using, as key information, information existing in a predetermined position of the destination sheet 70 such as a zip code, sender identification information, or image identification information, and including numbers and alphabets. The false positive rate can be reduced. However, examples of key information are not limited to these. For example, the destination image data may be classified using the title given at the end of the name included in the destination image as key information. That is, the information processing program 61 classifies the destination image data whose last character of the character string included in the name entry area is “sama” into the first group, and the destination image data that is “teacher” into the second group. The destination image data that is “Chan” may be classified into the third group. As described above, by limiting the positions to be extracted and the candidate characters, the false recognition rate by OCR can be reduced even for kana characters and kanji.

  Further, according to the present embodiment, the sender image specified by the sender specifying information is recorded on the postcards 91 to 93 together with the destination image, so that the burden on the user can be further reduced. In the present embodiment, the sender image is recorded on the address face of the postcards 91 to 93. However, the present invention is not limited to this, and the sender image may be recorded on the communication face. On the other hand, if it is not necessary to record the sender image in steps S17 and S22, the reading of the sender sheet 80 and the sender image data analysis process (S14) in step S11 can be omitted.

  Further, what is recorded together with the destination image is not limited to the sender image. For example, the communication surface image specified by the image specifying information may be recorded on the postcards 91 to 93 together with the destination image. The acquisition destination of the communication surface image data indicating the communication surface image is not particularly limited, but for example, the following method can be considered. As an example, in step S11, the image processing program 31 may cause the scanner unit 12 to read a communication surface image sheet on which a communication surface image is drawn, and generate communication surface image data. Then, the information processing program 61 may acquire communication surface image data from the multifunction machine 10 through the communication unit 55. As another example, the information processing program 61 selects communication surface image data specified by image specifying information from communication surface image data stored in the data storage area 58B or a server device connected via the communication network 102. You may get it.

  Moreover, although this embodiment demonstrated the example which records a destination image on the address surface of the postcards 91-93, it is not limited to this. For example, the destination image may be recorded on an envelope or a Christmas card. Further, the destination image may not be recorded on the delivery item itself. For example, the destination image may be recorded on a destination label which is an example of recording paper. The destination label on which the destination image is recorded may be attached to the surface of a postcard, envelope, parcel or the like by the user. However, the delivery in this specification refers to physical “things” such as the above-mentioned postcards, envelopes, Christmas cards, and parcels, and does not include e-mails transmitted and received through the communication network 102.

  Further, the information processing apparatus 50 may be a single apparatus or an aggregate of a plurality of apparatuses connected via the communication network 102. And each process shown by FIG. 2 may be shared by the said some apparatus. In the present embodiment, the example in which the processing illustrated in FIG. 2 is executed by the information processing program 61 of the information processing apparatus 50 has been described, but the present invention is not limited to this. That is, part and all of the processing shown in FIG. 2 may be executed by the image processing program 31 of the multifunction machine 10.

  Further, in the present embodiment, the example in which the processing illustrated in FIG. 2 is executed by direct communication between the multifunction machine 10 and the information processing apparatus 50 has been described. Other devices may intervene. For example, the multifunction machine 10 and the information processing apparatus 50 may communicate via a smartphone, a tablet terminal, a PC (abbreviation of Personal Computer), or the like. A smartphone, a tablet terminal, or a PC is an example of a relay device or an external device. Note that “the MFP 10 and the information processing apparatus 50 communicate directly” means that a network device such as a gateway server, a router, or a hub is interposed between the MFP 10 and the information processing apparatus 50. I do not disturb.

  In this embodiment, the example of the multifunction machine 10 including the printer unit 11 and the scanner unit 12 has been described. However, the present invention is not limited to this. For example, the reading device that reads the images recorded on the destination sheet 70 and the sender sheet 80 and the recording device that records the images on the postcards 91 to 93 in accordance with the first recording instruction and the second recording instruction are different devices. It may be. For example, when a smartphone is interposed between the multifunction machine 10 and the information processing apparatus 50, the destination sheet data and the sender sheet data are obtained by photographing the destination sheet 70 and the sender sheet 80 with a camera mounted on the smartphone. May be generated. The smartphone transmits the generated destination sheet data and sender sheet data to the information processing apparatus 50 and relays the first recording instruction and the second recording instruction transmitted from the information processing apparatus 50 to the multi-function peripheral 10. Also good.

  Further, as illustrated in FIG. 8, the information processing system 100 may further include a smartphone 103 and a server device 104 in addition to the multifunction device 10 and the information processing device 50. Although not shown in FIG. 8, the multifunction machine 10, the information processing apparatus 50, the smartphone 103, and the server apparatus 104 are connected to each other through the communication network 102. Further, a specific example of the server device 104 is not particularly limited. For example, a known service such as “Google (registered trademark) Cloud Platform” can be used.

  In the information processing system 100 configured as described above, the information processing apparatus 50 acquires destination sheet data and sender sheet data from the smartphone 103 via the communication unit 55. Next, the information processing apparatus 50 performs the processes of steps S13 to S15. Then, the information processing apparatus 50 outputs each recording instruction to the server device 104 through the communication unit 55 in the order of the first recording instruction and the second recording instruction. The information processing apparatus 50 acquires an identifier for identifying the multifunction machine 10 from the smartphone together with the destination sheet data and the sender sheet data, and outputs the identifier to the server apparatus 104 in a recording instruction. The server device 104 stores the recording instruction acquired from the information processing system 100 in the storage unit.

  On the other hand, the multifunction device 10 repeatedly inquires the server device 104 at predetermined time intervals through the communication unit 25 as to whether or not a recording instruction including the identifier of the multifunction device 10 is stored in the storage unit. Then, in response to the recording instruction including the identifier of the own apparatus being stored in the storage unit of the server apparatus 104, the multifunction machine 10 acquires the recording instruction from the server apparatus 104 through the communication unit 25, and performs print processing. Run. Also with the above configuration, a plurality of destination images can be recorded on a postcard in a predetermined order.

  Further, in the MFP 10 and the information processing apparatus 50 according to each embodiment, the various programs stored in the program storage areas 28A and 58A of the storage units 28 and 58 are executed by the CPUs 27 and 57, whereby the control unit of the present invention. An example in which each process executed by is implemented has been described. However, the configuration of the control unit is not limited to this, and part or all of the configuration may be realized by hardware such as an integrated circuit (also referred to as an IC (Integrated Circuit)).

  Furthermore, the present invention may be realized not only as the multifunction machine 10 or the information processing apparatus 50 but also as a program that causes the multifunction machine 10 or the information processing apparatus 50 to execute processing. Then, the program may be provided by being recorded on a non-transitory recording medium. The non-transitory recording medium may include a storage unit mounted on a server device that can be connected to the MFP 10 or the information processing device 50 via the communication network 102 in addition to a CD-ROM, a DVD-ROM, or the like. And the program memorize | stored in the memory | storage part of the server apparatus may be delivered via the communication networks 102, such as the internet, as the information or signal which shows the said program.

DESCRIPTION OF SYMBOLS 10 ... MFP 12 ... Scanner part 23, 53 ... Display part 24, 54 ... Operation part 25, 55 ... Communication part 27, 57 ... CPU
28, 58 ... storage unit 31 ... image processing program 50 ... information processing device 61 ... information processing program

Claims (11)

A communication unit that communicates with an external device;
A control unit, and
The controller is
Image data including a plurality of destination image data, each of which is generated by reading a destination document in which a plurality of destination images each representing a destination of a delivery item is recorded, and each of the plurality of destination images is externally transmitted through the communication unit. Obtaining means for obtaining from the device;
Extraction means for extracting key information recorded at a predetermined position of the destination document from the image data;
Classification means for classifying each of the plurality of destination image data into a first group or a second group based on the key information extracted by the extraction means;
Through the communication unit, a recording instruction for recording the destination images indicated by the destination image data on different recording sheets in order of the destination image data belonging to the first group and the destination image data belonging to the second group. And an output unit that outputs the information to an external device. The destination manuscript includes a postal code entry area in which the postal code of the destination is entered,
The extraction means extracts the zip code entered in the zip code entry area corresponding to each of the plurality of destination images as the key information,
The classification means includes the upper n (n is a natural number of 7 or less) digits of the postal code,
Classifying the destination image data matching a specific zip code into the first group;
The information processing apparatus according to claim 1, wherein the destination image data different from the specific zip code is classified into the second group. The acquisition means acquires the sender image data generated by reading a sender document on which a sender image representing a sender of a delivery is recorded from an external device through the communication unit,
The sender manuscript includes a postal code entry area in which the postal code of the sender is entered,
The information processing apparatus according to claim 2, wherein the extraction unit extracts the postal code entered in the postal code entry area as the specific postal code from the sender image data. The destination manuscript includes a sender specifying area in which sender specifying information specifying one of a plurality of senders is entered.
The extraction means extracts the sender specifying information written in the sender specifying area corresponding to each of the plurality of destination images as the key information,
The classification means includes
Classifying the destination image data whose sender identification information is a first value into the first group;
The information processing apparatus according to claim 1, wherein the destination image data whose sender identification information is a second value is classified into the second group.   The output means outputs the recording instruction to record a plurality of the destination images and the sender image associated with the destination images on one recording sheet to an external device through the communication unit. The information processing apparatus described. The destination manuscript includes a name entry area in which the name of the destination is entered,
The extraction means extracts characters existing at the end of the character string written in the name entry area corresponding to each of the plurality of destination images as the key information,
The classification means includes
Classifying the destination image data in which the characters have a first title into the first group;
The information processing apparatus according to claim 1, wherein the destination image data in which the character is a second title is classified into the second group. The destination document includes a communication surface image specifying area in which image specifying information for specifying a communication surface image recorded on the communication surface of the delivery is entered,
The extraction means extracts the image specifying information entered in the communication surface image specifying area corresponding to each of the plurality of destination images as the key information,
The classification means includes
Classifying the destination image data whose image specifying information is a first value into the first group;
The information processing apparatus according to claim 1, wherein the destination image data in which the image specifying information is a second value is classified into the second group.   The output means outputs the recording instruction for recording the delivery object on the delivery object to the external device through the communication unit, and records the plurality of destination images and the communication surface image associated with the destination images. The information processing apparatus described. The recording instruction is
A first recording instruction for recording the destination image indicated by each of the destination image data belonging to the first group on each recording sheet;
A second recording instruction for recording the destination image indicated by each of the destination image data belonging to the second group on each recording sheet,
The output means includes
Outputting the first recording instruction to an external device through the communication unit;
9. The apparatus according to claim 1, wherein the second recording instruction is output to the external device through the communication unit in response to a continuation instruction for requesting transmission of the second recording instruction being acquired from the external device through the communication unit. The information processing apparatus described in 1. A reading unit that reads an image recorded on a document and generates image data;
A recording unit for recording images on recording paper;
A control unit, and
The controller is
Generation means for generating image data including a plurality of destination image data indicating each of the plurality of destination images by causing the reading unit to read a destination document on which a plurality of destination images each representing a destination of a delivery item are recorded. When,
Extraction means for extracting key information recorded at a predetermined position of the destination document from the image data;
Classification means for classifying each of the plurality of destination image data into a first group or a second group based on the key information extracted by the extraction means;
Recording means for causing the recording unit to record the destination images indicated by the destination image data on different recording sheets in the order of the destination image data belonging to the first group and the destination image data belonging to the second group. And an information processing system. A program executable by a computer having a communication unit that communicates with an external device,
The program
Image data including a plurality of destination image data, each of which is generated by reading a destination document in which a plurality of destination images each representing a destination of a delivery item is recorded, and each of the plurality of destination images is externally transmitted through the communication unit. Obtained from the device,
Key information recorded at a predetermined position of the destination document is extracted from the image data;
Classifying each of the plurality of destination image data into a first group or a second group based on the extracted key information;
Through the communication unit, a recording instruction for recording the destination images indicated by the destination image data on different recording sheets in order of the destination image data belonging to the first group and the destination image data belonging to the second group. A program for causing the computer to execute processing to be output to an external device.

Images