JP6720734B2 - Image processing apparatus and image processing program - Google Patents

Description

The present invention relates to an image processing device and an image processing program.

Patent Document 1 has an object to provide an image forming apparatus capable of printing information that is highly convenient for a user when printing a captured image captured by an image capturing apparatus. The image forming apparatus capable of communicating with the information management server apparatus in which the name information is stored in association with the area information, adds the latitude and longitude data of the point where the captured image is captured to the image data of the captured image. When the print instruction of the image file is input, the latitude and longitude data is acquired from the image file and transmitted to the information management server device. The information management server device corresponds to the transmitted latitude and longitude data. When the shooting location name information associated with the area information is acquired, the captured image is printed on the surface of the recording paper based on the image data included in the image file of the print instruction, and based on the acquired shooting location name information. It is disclosed that the characters representing the name of the place are printed on the back surface of the recording paper.

JP, 2005-115705, A

Titles are added to photo data.
By the way, the photograph data is often accompanied by photographing date and time and photographing place information. According to the technique described in Patent Document 1, it is possible to obtain a shooting place name from the shooting place information and print characters representing the shooting place name on the back surface of the recording paper. However, it is not possible to extract event information and person names.
Therefore, it is an object of the present invention to provide an image processing apparatus and an image processing program in which at least one of a place name, event information, and a person's name is added to photograph data.

The gist of the present invention for achieving such an object resides in the inventions of the following items.
According to the first aspect of the present invention, first extracting means for extracting a shooting date and time attached to the photograph data and a place name corresponding to the shooting place information from outside, and event information corresponding to the shooting date and time from the schedule information. A second extracting unit for extracting the person name corresponding to the place name from the address book; and at least one of the place name, the event information, and the person name, An image processing apparatus comprising: an addition unit that adds the photograph data and an output unit that outputs the photograph data.

According to a second aspect of the present invention, the photograph data is analyzed, and when a person or a room is photographed in the photograph data, the extraction results of the second extracting means and the third extracting means are added to the adding means. The image according to claim 1, further comprising: a first control unit for passing, wherein the adding unit adds one or more of the extraction results passed by the first control unit to the photograph data. It is a processing device.

According to a third aspect of the present invention, the third extracting means searches the photograph data for a photograph corresponding to a person in the address book when the place name cannot be extracted by the first extracting means. The image processing apparatus according to claim 1 or 2 , wherein the person name photographed in the photograph data is extracted by.

In the invention of claim 4 , when the date and time associated with the extracted person name and the shooting date and time correspond, the third extracting means extracts event information of the date and time corresponding to the person name. The image processing device according to any one of 1 to 3 .

According to a fifth aspect of the present invention, a computer externally extracts a shooting date and time attached to the photo data and a place name corresponding to the shooting place information, and an event corresponding to the shooting date and time from the schedule information. Any one of the place name, the event information, and the person name, second extracting means for extracting information, third extracting means for extracting a person name corresponding to the place name from an address book, The above is an image processing program for causing the addition means for adding to the photograph data and the output means for outputting the photograph data.

According to the image processing device of the first aspect, at least one of a place name, event information, and a person name is added to the photograph data.

According to the image processing apparatus of the second aspect, when the person or the room is photographed in the photograph data, one or more of the event information and the person's name is added to the photograph data.

According to the image processing apparatus of the third aspect , when the place name cannot be extracted by the first extracting unit, the person name photographed in the photograph data is extracted.

According to the image processing apparatus of the fourth aspect , when the date and time associated with the extracted person name corresponds to the shooting date and time, the event information of the date and time corresponding to the person name is extracted.

According to the image processing program of claim 5 , at least one of a place name, event information, and a person name is added to the photograph data.

It is a conceptual module block diagram about the structural example of this Embodiment. It is explanatory drawing which shows the system structural example using this Embodiment. It is a flowchart which shows the example of a process by this Embodiment. It is a flowchart which shows the example of a process by this Embodiment. It is a flowchart which shows the example of a process by this Embodiment. It is explanatory drawing which shows the example of a process by this Embodiment. It is explanatory drawing which shows the example of a process by this Embodiment. It is a flowchart which shows the example of a process by this Embodiment. It is a flowchart which shows the example of a process by this Embodiment. It is explanatory drawing which shows the example of a process by this Embodiment. It is a block diagram showing an example of hardware constitutions of a computer which realizes this embodiment.

Hereinafter, an example of a preferred embodiment for realizing the present invention will be described with reference to the drawings.
FIG. 1 is a conceptual module block diagram of a configuration example of this embodiment.
Note that a module generally refers to a logically separable software (computer program), hardware, or other component. Therefore, the module in the present embodiment refers not only to the module in the computer program but also to the module in the hardware configuration. Therefore, the present embodiment is directed to computer programs for causing them to function as modules (a program for causing a computer to execute each procedure, a program for causing a computer to function as each means, and a function for causing a computer to have each function. And a system and method for realizing the above. However, for convenience of description, “store”, “store”, and similar words are used. However, when these embodiments are computer programs, these words are stored in a storage device or stored. It means that the device is controlled so as to be stored. Further, the modules may correspond to the functions one-to-one, but in the implementation, one module may be configured by one program, or a plurality of modules may be configured by one program, or conversely one module. May be composed of a plurality of programs. Further, the plurality of modules may be executed by one computer, or one module may be executed by the plurality of computers in a distributed or parallel environment. Note that one module may include another module. In addition, hereinafter, the term “connection” is used not only for physical connection but also for logical connection (data transfer, instruction, reference relationship between data, etc.). The term “predetermined” means that it is determined before the target processing, not only before the processing according to the present embodiment starts but also after the processing according to the present embodiment starts. Also, if it is before the target processing, it is used with the intention of being determined according to the situation/state at that time or according to the situation/state up to that point. When there are a plurality of “predetermined values”, they may be different values, or two or more values (including, of course, all values) may be the same. In addition, the description "if A, do B" is used to mean "determine whether or not it is A, and if it is A, do B". However, the case where it is unnecessary to determine whether or not it is A is excluded.
Further, the system or device is configured by connecting a plurality of computers, hardware, devices, etc. by a communication means such as a network (including one-to-one correspondence communication connection), and also one computer, hardware, device The case where it is realized by etc. is also included. "Device" and "system" are used as synonymous terms. As a matter of course, the "system" does not include what is merely a social "mechanism" (social system) that is an artificial arrangement.
In addition, when performing multiple processes in each module or in each module, the target information is read from the storage device, the processing result is written to the storage device after performing the process. is there. Therefore, the description of reading from the storage device before processing and writing to the storage device after processing may be omitted. Note that the storage device here may include a hard disk, a RAM (Random Access Memory), an external storage medium, a storage device via a communication line, a register in a CPU (Central Processing Unit), and the like.

The image processing apparatus 100 according to the present embodiment adds a title to photograph data, and as shown in the example of FIG. 1, an external information acquisition processing module 110, a schedule book search processing module 120, an address book search. It has a processing module 130, a title generation processing module 140, a print data transmission processing module 150, and a control module 160.
When organizing printed photos at a later date, the date printed may be referred to as information other than images. However, only the printed date makes the shooting location, event name, etc. ambiguous with the passage of time, and it becomes difficult to remember what kind of photograph it is and it becomes difficult to organize the photographs. It is desirable to automatically generate information other than the date and print it at the time of printing, assuming that image data before printing will be discarded in the future.
A camera with a GPS (Global Positioning System) function has become widespread, and at the time of shooting, shooting date and time and shooting location information can be recorded as Exif (Exchangeable image file format) information together with photographic data (image). Since the shooting location is numerical data of latitude and longitude, it is not convenient for the user to print it as it is when printing. Further, it is not convenient to convert the latitude and longitude into a simple address and print it.
In the present embodiment, the data used by a specific individual accesses the personal management mobile terminal (address book function, schedule book function), and the data accessed by all users is external (for example, on the Internet) public data. To use. This eliminates the need to store personal information in a storage location accessible by multiple users. Also, the user authentication function is not required, and as a result, user registration is not required.
Further, in the present embodiment, even when the image data does not include GPS information or the like, the personal schedule book is also the search target for the event name, and therefore, a mechanism for acquiring the event name from the shooting date and time is provided. By accessing the information of personal management, the event name that is more convenient for the photographer is generated, and the event name is printed at the time of printing, so even if there is no photo data in the future It can be useful for organizing.

As a specific example, the following is performed.
The common data of "all users" is acquired from the Internet search service, and the data related to a specific user is the schedule management software (may be the schedule management service etc.) owned by each user, or the address management software ( Data may be retrieved from the address management service or the like).
To create a title for a photo, obtain data from the Internet, a personally managed schedule book, and an address book so that the title will be more desired by the user, and combine that information to create an image title, It is printed together with the image as additional information at the time of printing.

The external information acquisition processing module 110 is connected to the information storage device 170. The external information acquisition processing module 110 stores, from the external information storage device 170, a shooting date and time (year, month, day, hour, minute, second, second or less, or a combination thereof) attached to the photograph data. A place name corresponding to the shooting place information is extracted. Specific examples of place names include facility names and building names. Event information may be extracted in addition to the place name. In addition, an event refers to an event, and is an event that brings together people. For example, there are exhibitions, lectures, and performances. As the event information, specifically, there is an event name.
Note that the photographic data includes, for example, data captured by a camera provided in the image processing apparatus 100, data received from an external device, a hard disk (built in the image processing apparatus 100, or via a network). (Including those that are connected to each other), etc., and the like. The image may be a binary image or a multivalued image (including a color image). The received image may be a single image or a plurality of images.
The schedule book search processing module 120 extracts event information corresponding to the shooting date and time from the schedule information. Specifically, the event information is acquired from the personal schedule book on the condition of the shooting date and time.

The address book search processing module 130 extracts the person name corresponding to the place name from the address book. Specifically, the person name of the person with the matching address is acquired from the personal address book on the condition of the shooting location.
When the external information acquisition processing module 110 cannot extract the place name, the address book search processing module 130 searches the photograph data for a photograph corresponding to the person in the address book, and captures the photograph data. You may make it extract the name of the person. Examples of photographs corresponding to a person include a facial photograph. As a result of the search, when the same image as the photograph corresponding to the person in the address book is present in the photograph data, it is determined that the person is photographed, and the person name of the person may be extracted. It should be noted that "searching" means that a photograph corresponding to a person in the address book may be searched for in the photograph data, or an image of the photographed person in the photograph data may be matched to be searched from the address book. You may acquire the person of face data.
Further, when the date and time associated with the extracted person name and the shooting date and time correspond, the address book search processing module 130 may extract the event information of the date and time corresponding to the person name. As the correspondence here, in addition to the case where they match, the case where the difference is included within a predetermined range may be included. In addition, the month and day may match (not including the year match). For example, birthdays, wedding anniversaries, etc.

The title generation processing module 140 adds one or more of a place name, event information, and a person name as a title to the photograph data. Further, the shooting date and time, address, etc. may be added.
Further, the title generation processing module 140 may receive a correction by a user operation. Then, the correction content may be machine-learned. This makes it possible to generate a more convenient title without the user having to make corrections each time.
Regarding the title format, the shooting date, person name, place name, order of event information, and display/non-display of each item may be customizable.
The print data transmission processing module 150 is connected to the print processing module 195 of the image forming apparatus 190. The print data transmission processing module 150 outputs the photo data to the print processing module 195 for printing. The print data is delivered to the image forming apparatus 190 via a communication line (for example, Wi-Fi, wired LAN, etc.), a memory, or the like.

The control module 160 controls modules in the image processing apparatus 100.
The control module 160 analyzes the photograph data, and when the person or the room is photographed in the photograph data, the title generation processing module 140 determines the extraction result by the schedule book search processing module 120 and the address book search processing module 130. You may hand it over to.
Then, the title generation processing module 140 may add any one or more of the extraction results passed by the control module 160 to the photograph data.
The control module 160 analyzes the photographic data, and if the person other than the person and the room is photographed in the photographic data, passes the extraction result by the external information acquisition processing module 110 to the title generation processing module 140. Good.
Then, the title generation processing module 140 may add the extraction result (place name) passed by the control module 160 to the photograph data.
Further, the control module 160 may perform the processing in the order of the external information acquisition processing module 110, the schedule book search processing module 120, and the address book search processing module 130, or may perform another processing order. For example, the schedule book search processing module 120 and the external information acquisition processing module 110 may be arranged in this order, or only the external information acquisition processing module 110, the schedule book search processing module 120, and the address book search processing module 130 may be arranged. In particular, regarding the extraction of event information, if any module extracts the event information, the processing by other modules may be omitted.

The information storage device 170 is connected to the external information acquisition processing module 110 of the image processing apparatus 100. The information storage device 170 stores the latitude and longitude and the place name in association with each other, and can retrieve the place name from the latitude and longitude. For example, a map management system on the Internet is applicable.
The image forming apparatus 190 has a print processing module 195. The image forming apparatus 190 is, for example, a printer, a multi-function peripheral (an image processing apparatus having any two or more functions such as a scanner, a printer, a copying machine, and a fax).
The print processing module 195 is connected to the print data transmission processing module 150 of the image processing apparatus 100. The print processing module 195 receives the photo data (image data and title) to which the title is added from the image processing apparatus 100, and adds the title to the image data and prints it according to the print setting set by the user. The title may be added at a predetermined position in the image data (for example, in the lower right corner) or on the back surface of the printing paper.

The image processing apparatus 100 may also have a camera function. In that case, the shooting date and time and shooting location information (latitude, longitude) are recorded when the camera shoots. Then, the image processing apparatus 100 may have a management function of a personal address book and a personal schedule book.
The form of the image processing apparatus 100 may be a PC (for example, a desktop PC, a notebook PC, or the like), a mobile terminal (for example, a tablet terminal, a mobile phone such as a smartphone, or the like), or the like. When the image processing apparatus 100 is a mobile terminal or a PC having a camera function, the word “shoot” is used synonymously with “scan”.

FIG. 2 is an explanatory diagram showing a system configuration example using this embodiment.
The image processing device 100, the information storage device 170A, the information storage device 170B, the information storage device 170C, and the image forming device 190 are connected to each other via a communication line 290. The communication line 290 may be wireless, wired, or a combination thereof. For example, the communication infrastructure may be the Internet, an intranet, or the like. Further, the function of the image processing apparatus 100 may be realized as a cloud service.
For example, in order to add a title to the photo data taken by the camera of the image processing apparatus 100, the information storage device 170, the address book in the image processing apparatus 100, and the schedule information are used to create an image of the photo data with the title. Printing is performed by the forming device 190.

FIG. 3 is a flowchart showing a processing example according to this embodiment.
In step S302, JPG data, which is an example of photograph data, is acquired. The JPG data is composed of image data and Exif information. For example, it may be JPG data captured by the camera of the image processing apparatus 100 or JPG data acquired from another image processing apparatus 100.

In step S304, a process of acquiring information from the Internet (information storage device 170) is performed. That is, the address, the facility name, the event name, and the event detailed information are acquired from the latitude and longitude.
For example, if you convert from latitude and longitude to an address, from that address to a facility name, from that facility name and shooting date to an event name, and from that event name and time to detailed event information, Good.
Note that the detailed processing content of step S304 will be described later using the example of FIG.

In step S306, the inside of the personal management schedule book (calendar) is searched. That is, the event name is acquired from the shooting date and time.
For example, the shooting date and time may be converted into an event name.
Note that the detailed processing content of step S306 will be described later using the example of FIG.

In step S308, the address book of the personal management is searched. That is, the person and the person-related information are acquired.
For example, an address is converted to a name in the address book, a person photographed in a photo is converted to a name in the address book, and a person and a date are converted to information indicating whether they are birthdays, such as age and school year. You may do so.
The detailed processing content of step S308 will be described later using the example of FIG.

In step S310, a title is automatically generated from the place name, the name, the event name and the like.
The detailed processing contents of step S310 will be described later using the example of FIG.
In step S312, the image and title are printed.

FIG. 4 is a flowchart showing a processing example according to this embodiment.
In step S402, an address is acquired from the Exif GPS information (latitude, longitude).
For example, reverse geocoding processing is performed. That is, the latitude and longitude are converted into an address. For this processing, a Ministry of Land, Infrastructure, Transport and Tourism site or the like can be used. For example, the latitude and longitude are converted into “Yokohama City XX Ward XX Town XX Chome”.

In step S404, the facility name is acquired from the address.
For example, an address is converted into a facility name. You can search using map databases on the Internet. For example, "Yokohama City XX Ward XX Town Xchome X" is converted to "Yokohama City XX Elementary School".

In step S406, the home page related to the facility name is searched (so-called official website, etc.).
For example, the facility site is searched by the facility name. You can search using a search service on the Internet. For example, "Yokohama City Ox Elementary School" is converted into "http://www.XXX...".

The processing of steps S408 to S410 is processing related to event search.
In step S408, the name of the event held on the shooting day at the facility is searched.
For example, an event name (facility site or the like) is searched based on the facility name and the shooting date. For example, "Yokohama Municipal XX Elementary School" is converted to "Yokohama Municipal XX Elementary Athletic Meet" from the shooting date.

In step S410, detailed information on the event name performed during the shooting time is searched.
For example, the detailed information of the event is searched from the event name and the shooting time.
Further, in addition to the information on the home page on the Internet, a sheet of paper (for example, a program of an athletic meet) as additional information may be scanned to perform character recognition processing for reference. For example, "Yokohama Municipal Ox Elementary School Athletic Meet" and the shooting time are converted into "Yokohama Municipal Ox Elementary School Athletic Meet 5th grade elementary school 100m run".
In step S412, the value acquired in the above process is set as the event name.

FIG. 5 is a flowchart showing a processing example according to this embodiment.
If the event information cannot be obtained in step S304, the schedule book of personal management may be searched. In the present process shown in the example of FIG. 5, the schedule book is searched from the shooting date and time, so that the event name can be specified even when there is no shooting place.
Even if the event information can be acquired in step S304, if the event name can be acquired by this processing shown in the example of FIG. 5, a more personal event name has priority and may be replaced.

The process of step S502 is a process related to detailed event information registration.
In step S502, for example, a sheet of external information (for example, an athletic meet program (brochure) or the like) is scanned, character recognition processing is performed, format conversion processing for a schedule book is performed, and the sheet is inserted into a personal management schedule book. It is supposed to be possible. Of course, it may be registered in the schedule book manually by the user.

The process of step S504 is a process related to personal event search.
In step S504, an event scheduled at the shooting date and time is acquired from the events in the schedule book. For example, the event information is extracted as "Sato's birthday party".
In step S506, the value acquired in the above process is set as the event name.

FIG. 6 is an explanatory diagram showing a processing example according to the present embodiment. The process of the flowchart shown in the example of FIG. 5 will be described more specifically.
The schedule data group 600 includes schedule data 610 and schedule data 620. For example, the schedule data 610 includes “schedule name: birthday party of Mr. XX” and “time zone: 13:00 to 15:00”. For example, the schedule data 620 includes “schedule name: year-end party @○×” and “time zone: 17:00 to 21:00”.
The schedule including the shooting time (shooting date/time 650) is searched for in the shooting date schedule (schedule data group 600), and if there is a corresponding schedule, the schedule name (event information 660) is used as the event name. Here, the event name is "○○'s birthday party".

FIG. 7 is an explanatory diagram showing a processing example according to the present embodiment. Another specific example of the process of the flowchart shown in the example of FIG. 5 will be described.
For example, the athletic meet program (pamphlet) is scanned, character recognition processing is performed, format conversion for the schedule book is performed, and athletic meet program information 740 is generated. This athletic meet program information 740 is added to the personal schedule book (schedule data group 700) as a schedule.
The schedule data group 700 includes schedule data 710 and schedule data 720. For example, the schedule data 710 includes “schedule name: 100m competition (small 5)” and “time zone: 10:00 to 10:20”. For example, the schedule data 720 includes “scheduled name: cavalry battle (small 5, small 6)” and “time zone: 14:00 to 14:20”.
The schedule including the shooting time (shooting date/time 750) is searched for in the schedule of the shooting date (schedule data group 700), and if there is a corresponding schedule, the schedule name (event information 760) is used as the event name. In this case, the event name is "mountain battle (small 5, small 6)".

FIG. 8 is a flowchart showing a processing example according to this embodiment.
In step S802, it is determined whether or not the address can be acquired by the process in step S304 (information acquisition process from the Internet). If the address can be acquired, the process proceeds to step S804. Otherwise, the process proceeds to step S806.
The process of step S804 is a process related to person search (a process of obtaining a name from an address) from a shooting location.
In step S804, the address acquired in the processing in step S304 (information acquisition processing from the Internet) is searched from the address book, and the person related to the address is specified.

The process of step S806 is a process related to person search (process of obtaining a name from a face image) from photographed data.
In step S806, the person to be photographed is searched from the photograph in the address book, and the matching person is specified.

In step S808, the value acquired in the above processing (step S804 or step S806) is set as the person name.
The process of step S810 is a process related to the person-to-be-photographed related information (a process of acquiring detailed data of the person from the name).
In step S810, the related data of the person is acquired. For example, "address, date of birth, face photograph, etc." is acquired as the related data of "Mr. Sato".

The process of step S812 is a process regarding confirmation of the relationship between the person and the shooting date. For example, it is acquired that the shooting date is Sato's birthday. That is, it is determined from the name and the shooting date whether the shooting date is a birthday.
In step S814, if the person and the shooting date are related, the related event name is set. For example, if the shooting date is a person's birthday, it is set to be "XX's birthday of XX". If there is no relevance, only "Mr.

FIG. 9 is a flowchart showing a processing example according to this embodiment.
The process of step S902 is a process related to date setting.
In step S902, the shooting date is set as the date.
The process of step S904 is a process related to person setting.
In step S904, if the person can be identified by the processing in step S308, the person is set. If not specified, the person name is empty.

The process of step S906 is a process related to event setting.
In step S906, the process of step S304, the process of step S306, and the process of step S308 are performed in this order, and when the event can be identified, the process ends. The identified event is the event name.
In step S908, "date, person name, facility name, and event name" are used as the title of the photograph and printed on the photograph. For example, a title is generated such as “2015/09/18 Sato ◯×Yokohama Municipal ◯×Elementary school athletic meet, 5th grade elementary school 100m run”.

FIG. 10 is an explanatory diagram showing a processing example according to the present embodiment.
The image processing apparatus 1000 corresponds to the image processing apparatus 100. The title automatic generation processing printing software 1050 corresponds to the external information acquisition processing module 110, the schedule book search processing module 120, the address book search processing module 130, the title generation processing module 140, the print data transmission processing module 150, and the control module 160. To do.
The title automatic generation processing printing software 1050 acquires the Exif information 1015 from the image data 1010 (including the Exif information 1015).
The title automatic generation processing printing software 1050 searches the schedule book software 1020, the address book software 1030, and the information storage device 170 using the Exif information 1015 or the image data 1010, and generates a title. Then, the title is combined with the image data 1010.
Then, the title automatic generation processing print software 1050 issues a print instruction to the image forming apparatus 190. The image forming apparatus 190 prints the printed matter 1090.

An example of the hardware configuration of the image processing apparatus according to the present embodiment will be described with reference to FIG. The configuration shown in FIG. 11 is configured by a personal computer (PC) or the like, for example, and shows a hardware configuration example including a data reading unit 1117 such as a scanner and a data output unit 1118 such as a printer.

The CPU (Central Processing Unit) 1101 includes various modules described in the above embodiments, that is, the external information acquisition processing module 110, the schedule book search processing module 120, the address book search processing module 130, the title generation processing module 140, It is a control unit that executes processing according to a computer program that describes the execution sequence of each module such as the print data transmission processing module 150, the control module 160, and the print processing module 195.

A ROM (Read Only Memory) 1102 stores programs used by the CPU 1101 and calculation parameters. A RAM (Random Access Memory) 1103 stores programs used during execution of the CPU 1101 and parameters that change appropriately during the execution. These are connected to each other by a host bus 1104 including a CPU bus and the like.

The host bus 1104 is connected to an external bus 1106 such as a PCI (Peripheral Component Interconnect/Interface) bus via a bridge 1105.

A pointing device 1109 such as a keyboard 1108 and a mouse is a device operated by an operator. The display 1110 is a liquid crystal display device, a CRT (Cathode Ray Tube), or the like, and displays various information as text or image information. Further, a touch screen or the like having both functions of the pointing device 1109 and the display 1110 may be used.

A HDD (Hard Disk Drive) 1111 has a built-in hard disk (which may be a flash memory or the like), drives the hard disk, and records or reproduces a program or information executed by the CPU 1101. The hard disk stores shooting date/time, shooting place information, place name, event information, person name and the like. Further, various other data, various computer programs, etc. are stored.

The drive 1112 reads out the data or program recorded in the removable recording medium 1113 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and uses the data or program in the interface 1107 or the external bus 1106. , A bridge 1105, and a RAM 1103 connected via a host bus 1104. The removable recording medium 1113 can also be used as a data recording area.

The connection port 1114 is a port for connecting the external connection device 1115, and has a connection unit such as USB and IEEE1394. The connection port 1114 is connected to the CPU 1101 and the like via the interface 1107, the external bus 1106, the bridge 1105, the host bus 1104, and the like. The communication unit 1116 is connected to a communication line and executes data communication processing with the outside. The data reading unit 1117 is, for example, a scanner and executes a document reading process. The data output unit 1118 is, for example, a printer, and executes document data output processing.

Note that the hardware configuration of the image processing apparatus shown in FIG. 11 shows one configuration example, and the present embodiment is not limited to the configuration shown in FIG. 11, and executes the modules described in this embodiment. Any configuration is possible. For example, some of the modules may be configured with dedicated hardware (for example, an application specific integrated circuit (ASIC)), and some of the modules are in an external system and are connected by a communication line. Alternatively, a plurality of systems shown in FIG. 11 may be connected to each other through a communication line so that they cooperate with each other. Moreover, in particular, in addition to personal computers, it is incorporated in portable information communication devices (including mobile phones, smartphones, mobile devices, wearable computers, etc.), information appliances, robots, copiers, fax machines, scanners, printers, multi-function machines, etc. May be.

The program described may be stored in a recording medium and provided, or the program may be provided by communication means. In that case, for example, the program described above may be regarded as an invention of “a computer-readable recording medium in which the program is recorded”.
The "computer-readable recording medium recording the program" means a computer-readable recording medium in which the program is recorded, which is used for installing, executing, distributing the program, and the like.
The recording medium is, for example, a digital versatile disc (DVD), which is a standard defined by the DVD Forum, such as "DVD-R, DVD-RW, DVD-RAM, etc." or DVD+RW. Standards such as "DVD+R, DVD+RW", compact discs (CD), read-only memory (CD-ROM), CD recordable (CD-R), CD rewritable (CD-RW), Blu-ray discs ( Blu-ray (registered trademark) Disc), magneto-optical disk (MO), flexible disk (FD), magnetic tape, hard disk, read only memory (ROM), electrically erasable and rewritable read only memory (EEPROM (registered trademark) )), flash memory, random access memory (RAM), SD (Secure Digital) memory card, and the like.
The whole or part of the program may be recorded in the recording medium and stored or distributed. In addition, by communication, for example, a wired network used for a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), the Internet, an intranet, an extranet, or the like, or wireless communication. It may be transmitted using a transmission medium such as a network or a combination thereof, or may be carried on a carrier wave.
Further, the above program may be a part or all of another program, or may be recorded in a recording medium together with a separate program. Further, the data may be recorded separately on a plurality of recording media. Further, it may be recorded in any form as long as it can be restored, such as compression or encryption.

Reference numeral 100... Image processing device 110... External information acquisition processing module 120... Schedule book search processing module 130... Address book search processing module 140... Title generation processing module 150... Print data transmission processing module 160... Control module 170... Information storage device 190... Image forming apparatus 195... Print processing module 290... Communication line

Claims (5)

A first extracting means for extracting a place name corresponding to the shooting date and time and shooting place information attached to the photograph data from the outside;
Second extraction means for extracting event information corresponding to the shooting date and time from the schedule information;
Third extraction means for extracting a person name corresponding to the place name from the address book;
An adding unit for adding one or more of the place name, the event information, and the person name to the photograph data;
An image processing apparatus comprising: an output unit that outputs the photograph data. A first control means for analyzing the photograph data and, when a person or a room is photographed in the photograph data, passing the extraction results of the second extracting means and the third extracting means to the adding means. Further equipped,
The adding means adds any one or more of the extraction results passed by the first control means to the photographic data.
The image processing apparatus according to claim 1. When the place name cannot be extracted by the first extracting means, the third extracting means captures the photograph data by searching the photograph data for a photograph corresponding to a person in the address book. The name of the person
The image processing apparatus according to claim 1 or 2. When the date and time associated with the extracted person name corresponds to the shooting date and time, the third extracting means extracts event information of the date and time corresponding to the person name,
The image processing apparatus according to any one of claims 1 to 3. Computer,
A first extracting means for extracting a place name corresponding to the shooting date and time and shooting place information attached to the photograph data from the outside;
Second extraction means for extracting event information corresponding to the shooting date and time from the schedule information;
Third extraction means for extracting a person name corresponding to the place name from the address book;
An adding unit for adding one or more of the place name, the event information, and the person name to the photograph data;
An image processing program for functioning as output means for outputting the photograph data.

Images