JP2009089014A - Image communication system, mail-relay apparatus, mobile information terminal device, image transmission method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily perform operation, in a mobile information terminal device, for browsing a relatively large-sized high-definition image or transmitting the image, with it attached to an electronic mail. <P>SOLUTION: A mail-relay apparatus 200 connected via a transmission line to an original image storage device 100 for storing a high-definition image holds therein a sub image, corresponding to an original image and a thumbnail image corresponding to the sub image. The storage situation is updated together with the thumbnail image, as though the storage situation of the sub image is similar to a storage status of the original image. In the mobile information terminal device 401, the thumbnail image is held as though being similar to the storage situation of the thumbnail image in the mail-relay apparatus 200. According to the identification information of the thumbnail image, an image is captured from the mail-relay apparatus 200 and is browsed on the mobile information terminal device; furthermore, only the identification information is attached to electronic mail and transmitted, and after the mail-relaying apparatus, the electronic mail is transmitted again, with the image body attached thereto. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image communication system, a mail relay device, a portable information terminal device, an image transmission method, and a program.

Images taken by a camera (digital camera or video camera) or other externally acquired images are stored in an image storage device such as a home server or personal computer used in the home, and selectively read out at appropriate occasions. The handling of digital images, such as displaying them or printing them for viewing, is becoming more common in many homes.
On the other hand, such digital images have a resolution of megapixels or more as the resolution of cameras increases. In such a high-resolution image, since the file size for each image is enlarged, in handling when selecting what is to be displayed or printed from many accumulated images, or when transmitting or receiving It has reached a situation with various difficulties.

Various measures for overcoming such a situation have already been proposed as illustrated below.
One proposal relates to an image output system that displays stored images on a display or prints them out.
That is, thumbnail images corresponding to images acquired by shooting are generated, identification information is given to these thumbnail images and stored in the mobile phone, and the unreduced image to which the identification information is given is transmitted to the image output device. To do.

The image output apparatus receives and stores the image with the identification information added in this way. The user of the mobile phone displays the stored thumbnail image on the display of the mobile phone, selects the identification information given to the desired thumbnail image, and transmits it to the image output device. The image output apparatus receives this identification information, and outputs (displays or prints) the image to which the received identification information is added.
For selecting a desired image based on a thumbnail image and outputting (printing) the original image corresponding to the thumbnail image can be specified using identification information corresponding to the selected thumbnail image. However, it is disclosed to avoid the complexity of displaying a large number of high resolution images one by one and selecting a desired image from such display (see Patent Document 1).

  In addition, a thumbnail image of these images is created by an imaging device in which a plurality of images are stored in the memory of the device itself, and a file name is added to each thumbnail image and transmitted to the mobile phone. The telephone user displays a list of these thumbnail images and selects an image so that the original image corresponding to the thumbnail image is supplied from the imaging device that has received the notification regarding the selection to the receiving-side mobile phone. This technique has been proposed (see Patent Document 2).

In the proposal in Patent Document 2, the file name of one image selected from the thumbnail image list display on the mobile phone is transmitted to the image pickup device, and the image pickup device before the reduction corresponding to the thumbnail image of the received file name. The image information is transmitted to the mobile phone.
It is disclosed for the purpose of improving convenience by selecting any one of a number of images using thumbnail images having a small file size.

  In addition, even in communication between personal computers where the file size to be handled is not as restricted as that of a portable information terminal device, when sending an image attached to an e-mail, thumbnail images are stored from a database that organizes and holds a large number of images. There has also been proposed a technique in which original image data corresponding to a selected thumbnail image is attached to an e-mail and transmitted by selecting and specifying an image to be transmitted (Patent Document 3). reference).

Furthermore, when an image captured by a digital camera is uploaded to the electronic photo information browsing server, the electronic photo information browsing server recognizes the file format and displays the image in a JPEG (Joint There is also a proposal to construct a system for converting the image into a Photographic Experts Group) format and storing the converted image at a predetermined storage address.
In this proposal, the other party who wants to send an image from the portable information terminal device does not send the image attached to the e-mail, but transmits the storage address information corresponding to the image, and the other party accesses the storage address. A technique for enabling browsing of such images on the electrophotographic Internet or an intranet has also been proposed (see Patent Document 4).

  In addition, the portable information terminal device has a relatively small file size, and there are some models that cannot be displayed when the file size of the image data attached to the e-mail exceeds the specified file size. In order to deal with this problem, a mail relay device that relays an e-mail with an image attached thereto and transmits it to a destination is provided, and the mail relay device transmits in a mode according to the specification (capacity) of the destination portable information terminal device. However, a technique that enables reception of an image by the other party has also been proposed (see Patent Document 5).

In this proposal, if the destination mobile information terminal device can receive an e-mail attached with an image as it is, the original image is transmitted, while the destination mobile information terminal device If the attached e-mail cannot be received as it is, the e-mail is transmitted with the URL of the storage location in the mail relay apparatus for the image data representing the image attached to the mail body.
JP-A-2005-340998 (Claim 1, paragraphs 0043 to 0044, paragraph 0057, etc.) JP 2006-295957 A (paragraph 0093 etc.) JP 2003-91544 A (paragraphs 0136 to 0139) JP-A-2005-115963 (Claim 1, paragraphs 0014 to 0024, paragraphs 0040 to 0044, etc.) JP-A-2005-340998 (claim 4, paragraph 0002, paragraph 0051 to paragraph 0055, paragraph 0059 to paragraph 0063, etc.)

  However, the techniques disclosed in any of the above-mentioned patent documents also allow a user to select a specific image at any point in time from a large number of images stored in a device having an image storage function such as a so-called home server. For handling the image in such a manner that it is displayed on a display of a portable information terminal device or the like, or attached to an other party's portable information terminal device and sent as an e-mail, the operation for that is too complicated. .

For example, in the technique described in Patent Document 1, a desired image is selected from a large number of captured images stored in a digital camera having many captured images, and the original data of the selected image is displayed on a television monitor. There is disclosed a simple method for selecting a desired image when the image is supplied and displayed on the printer or supplied to the printer for printing.
As described above, the method disclosed in this document is such that a digital camera having a large number of photographed images is accessed from a mobile phone and selected using thumbnail images.

However, the generation of the thumbnail image itself is complicated, and so-called preliminary operation is too complicated, so there is a concern that the fundamental solution for simplifying the operation cannot be achieved when viewed generally. ing.
Further, in the technique described in Patent Document 2, a thumbnail image is used for an image selection operation. However, the original image is specified from the file name corresponding to the selected thumbnail image. Yes.

However, even with this technique, it is essential that thumbnail images of images to be selected at any given time are prepared, but the operation for preparing thumbnail images in this way is complicated. In general, it is hard to say that the simplification of operations has been sufficiently accomplished.
On the other hand, in Patent Document 3, when an image is attached to an e-mail and transmitted, the image is selected using a thumbnail image, and original image data corresponding to the thumbnail image is attached to the e-mail. Although the technology is disclosed, it is assumed that the communication is between personal computers.

For this reason, it is necessary to keep in mind the limitations on the file size that can be handled, such as when browsing images on a portable information terminal device, and images in emails between portable information terminal devices. There are no special considerations for similar issues when attaching.
Furthermore, as in the technique described in Patent Document 4, an image to be transmitted is uploaded to an electrophotographic information browsing server in advance, and JPEG that can be displayed on a web browser in the electrophotographic information browsing server. There is also a method of constructing a system that converts data into a format and stores it in a predetermined storage address.
However, in this method, an upload operation on the transmission side and a download operation for viewing target images on the reception side are essential.

In addition, although it is a technology that enables browsing of images on a terminal device on which no special display software is installed, the elimination of the complexity of operation by the user is not originally a problem, such a problem It is not mentioned in the solution.
In the technique described in Patent Document 5, a mail relay device that relays an e-mail with an image attached thereto and transmits it to a destination is provided. ) To enable reception of images at the other party.
However, the procedure related to the accumulation of images to be browsed in the mail relay device, the procedure of the browsing request to the mail relay device from the portable information terminal device applied to browsing is not disclosed in this document.

Therefore, the viewpoint is not directed to simplification of operations related to image browsing and transmission attached to an electronic mail in the portable information terminal device.
The present invention has been made in view of the situation as described above, an image browsing operation in a portable information terminal device, an operation of attaching an image to an e-mail and transmitting the image to a counterpart portable information terminal device, and An object of the present invention is to provide an image communication system, a mail relay device, a portable information terminal device, an image transmission method, and a program in which operations for organizing images in the portable information terminal device are simplified.

In order to solve the above-described problems, the present application proposes the following techniques.
That is, one aspect of the present invention is:
An original image storage device for storing an image acquired from the outside as an original image for a user, and image data representing the stored original image from the original image storage device are installed so as to be acquired through a transmission path in the original image storage device. A mail relay device that holds a duplicate image corresponding to the stored original image and a thumbnail image accompanied by identification information corresponding to the duplicate image, and relays an image transmission / reception by e-mail between portable information terminal devices; An image communication system configured to include:
The mail relay apparatus retains the duplicate image with an update of the corresponding thumbnail image possession status so that the possession status of the duplicate image in its own device matches the archive status of the original image in the original image storage device. The situation is updated, and a thumbnail image is supplied to one portable information terminal device handled by the user and transmitted from the one portable information terminal device to another portable information terminal device as an email attachment. Is selected by the thumbnail image, and when the identification information of the selected thumbnail image is received at the time of transmission, image data representing the corresponding duplicate image based on the received identification information is converted into the other image data. It is comprised so that it may transmit to a portable information terminal device.

  The image communication system as described above stores, for example, an image acquired from the outside, such as an image captured by a digital camera or an image acquired from a website via a network, as an original image (original for handling by the user) of the user. For example, an original image storage device such as a so-called home server, and image data representing the stored original image from the original image storage device can be obtained through a transmission path including a communication network, for example, and stored in the original image storage device. In addition, each of the duplicate images corresponding to each original image, and each thumbnail image associated with each identification image corresponding to each of these duplicate images, and relaying image transmission / reception by e-mail between portable information terminal devices And a relay device.

In this case, in particular, in the mail relay device, the holding status of the duplicate image matches the storage status of each original image in the original image storage device (typically, the holding status of the original image and the holding status of the duplicate image). The so-called similar state) is updated with the update of the holding status of each corresponding thumbnail image.
The mail relay apparatus further supplies a thumbnail image to one portable information terminal device handled by the user, and the holding status of the thumbnail image in the one portable information terminal device is similar to the holding status of the thumbnail image in the own device. Make a situation.

In the one portable information terminal device, when transmitting an image attached to an e-mail to another portable information terminal device that is a communication partner, the thumbnail image held by the device is viewed as a transmission target. Select an image.
When transmitting the image selected in this way, the identification information of the selected thumbnail image is issued from the one portable information terminal device and received by the mail relay device.
Based on the received identification information, the mail relay device transmits image data representing the duplicate image corresponding to the received identification information to the portable information terminal device of the other party.

The copy image holding status in the mail relay apparatus corresponds to the original image storage status in the original image storage apparatus, and thumbnail images corresponding to the respective duplicate images are prepared. Further, the thumbnail image holding status in the mail relay apparatus Since the possession status of the thumbnail image in one portable information terminal device handled by the user is the same, it is easy to handle without requiring a complicated operation for transmitting the image via the mail relay device. .
That is, the user side is not particularly conscious that the image is transmitted via the mail relay device, and the operation of selecting and displaying the image with reference to the thumbnail image and attaching to the e-mail is performed. This is almost the same as the conventional operation for handling the original image and the duplicate image, and there is no sense of incongruity in handling.

Meanwhile, another aspect of the present invention is:
An original image storage device that stores an image acquired from the outside as an original image for a user and an information communication system that is configured to exchange information through the transmission path and configure the image communication system together with the original image storage device. Image data representing the stored original image is obtained from the storage device through the transmission path, and each duplicate image corresponding to each original image and each thumbnail image accompanied with identification information corresponding to each duplicate image are held. And a mail relay device that relays image transmission / reception by e-mail between portable information terminal devices,
A storage unit that holds images, and an update of the holding state of each corresponding thumbnail image so that the holding state of the duplicate image in the storage unit matches the storage state of each original image in the original image storage device. An update unit that updates the possession status of the duplicate image, a thumbnail image supply unit that supplies a thumbnail image to one portable information terminal device handled by the user, and another portable information terminal device from the one portable information terminal device When an image transmitted as an attachment to an e-mail is selected by the thumbnail image, and identification information of the selected thumbnail image is received at the time of transmission, the thumbnail image identified by the received identification information And an e-mail relay unit that transmits image data representing the duplicate image corresponding to the other portable information terminal device. To.

The above-mentioned mail relay apparatus stores, for example, a so-called original image (original for handling by the user) of an image acquired from the outside, such as an image acquired by a digital camera or an image acquired from a website via a network. An image communication system is configured together with an original image storage device such as a home server.
The mail relay device also acquires image data representing the stored original image from the original image storage device through a transmission path including, for example, a communication network, and corresponds to each duplicate image corresponding to each original image and each duplicate image. Each thumbnail image with its own identification information is held, and transmission / reception of images by electronic mail between the portable information terminal devices is relayed, and transmission / reception of images by electronic mail between the portable information terminal devices is relayed.

In the mail relay apparatus as described above, the possession status of the duplicate image in its own device corresponds to the archive status of the original image in the original image storage device, and thumbnail images corresponding to each duplicate image are prepared, and further, The possession status of thumbnail images is the same as the possession status of thumbnail images in one portable information terminal device handled by the user.
For this reason, it is possible to select and display an image with reference to a thumbnail image and transmit it attached to an e-mail without requiring a complicated operation for transmitting the image via the mail relay device. The operation becomes simple and easy to handle.

The mail relay device adopts a mode in which the updating unit controls the updating of the holding status of the duplicate image at a predetermined spontaneous timing with the updating of the holding status of the thumbnail image in the storage unit. obtain.
In the mail relay apparatus according to this aspect, by the action of the update unit, the image storage status is repeatedly updated at a spontaneous timing so that the status of holding the duplicate image in the own device becomes a status corresponding to the storage status of the original image in the image storage device. The thumbnail image holding status is also updated following the update of the duplicate image holding status.
The mail relay apparatus side takes the lead in reliably maintaining the duplicate image possession status and thumbnail image possession status.

On the other hand, in the mail relay apparatus, the update unit is in accordance with a command from the original management apparatus to update the holding state of the duplicate image with the update of the holding state of the thumbnail image in the storage unit. A mode of performing control so as to be performed at timing may be employed.
In the mail relay apparatus according to this aspect, due to the action of the update unit, a follow-up according to a command from the image storage apparatus so that the possession state of the duplicate image in the own apparatus becomes a state corresponding to the storage state of the original image in the image storage apparatus. The image storage status is repeatedly updated at an appropriate timing, and the thumbnail image holding status is also updated following the update of the duplicate image holding status.
While simplifying the handling, the duplicate image possession status and thumbnail image possession status are updated at a timing commensurate with the current operation status of the image storage device.

In addition, the mail relay device has the thumbnail image supply unit configured so that the possession status of the thumbnail image in the one portable information terminal device handled by the user matches the possession status of the thumbnail image in the storage unit. The portable information terminal device may be controlled to supply image data representing the thumbnail image held in the storage unit.
In the mail relay device according to this aspect, the thumbnail image supply unit operates so that the thumbnail image possession status in one portable information terminal device handled by the user matches the thumbnail image possession status in the storage unit. Image data representing thumbnail images held in the storage unit is supplied to one portable information terminal device.

Since the possession status of the thumbnail image in one portable information terminal device handled by the user matches the possession status of the thumbnail image in the mail relay device, the user refers to the thumbnail image in the portable information terminal device at hand, and displays the thumbnail. The above duplicate image corresponding to the image can be handled.
Furthermore, the mail relay device may take a form in which the thumbnail image supply unit controls the supply of image data representing the thumbnail image to the one portable information terminal device at a predetermined spontaneous timing.

In the mail relay device of this aspect, due to the operation of the thumbnail image supply unit, the possession status of the thumbnail image in one portable information terminal device at hand of the user matches the possession status of the thumbnail image in the mail relay device. The mail relay device side takes the lead and is reliably updated.
On the other hand, in the mail relay device, the thumbnail image supply unit supplies image data representing a thumbnail image to the one portable information terminal device at a driven timing according to a command from the one portable information terminal device. Thus, it is possible to adopt a mode of controlling.

In the mail relay device of this aspect, due to the operation of the thumbnail image supply unit, the possession status of the thumbnail image in one portable information terminal device at hand of the user matches the possession status of the thumbnail image in the mail relay device. It is updated at a driven timing according to a command from the one portable information terminal device.
While simplifying the handling, the thumbnail image holding status is updated at a timing commensurate with the current usage status of the portable information terminal device.

Meanwhile, yet another aspect of the present invention is:
An original image storage device for storing an image acquired from the outside as an original image for a user, and image data representing the stored original image from the original image storage device are installed so as to be acquired through a transmission path in the original image storage device. A mail relay device that holds duplicate images corresponding to the stored original images and thumbnail images accompanied by identification information corresponding to these duplicate images, and relays the transfer of images by e-mail between portable information terminal devices; A portable information terminal device compatible with an image communication system configured to include:
A thumbnail image storage unit that holds thumbnail images, and a thumbnail image possession status in the thumbnail image storage unit that is supplied with image data representing a thumbnail image from the mail relay device is a thumbnail image possession status in the mail relay device And a control unit that controls the holding status of thumbnail images so as to match.

  This portable information terminal device stores, for example, an image acquired from the outside such as an image captured by a digital camera or an image acquired from a website via a network as an original image (original for handling by the user) of the user. An original image storage device such as a home server, and image data representing the stored original image from the original image storage device can be acquired through a transmission path including a communication network, for example, and stored in the original image storage device Mail relay device that holds each duplicate image corresponding to the original image and each thumbnail image with its own identification information corresponding to each of the duplicate images and relays the transfer of images by e-mail between portable information terminal devices It is suitable for the image communication system comprised including.

In this portable information terminal device, the control unit manages the holding status of thumbnail images in the thumbnail image storage unit, and the holding status of thumbnail images in the thumbnail image storage unit matches the holding status of thumbnail images in the mail relay device. To be controlled.
This control is executed under the management of the control unit so as to receive the supply of image data representing a thumbnail image from the mail relay apparatus and update the possession status of the thumbnail image in the thumbnail image storage unit, for example.

On the user side using this portable information terminal device, the thumbnail image holding status in the portable information terminal device matches the thumbnail image holding status in the mail relay device. It is easy to handle images with reference to
That is, from the user side, selecting and displaying an image with reference to a thumbnail image, and attaching to an e-mail are substantially the same as the previous operations for handling an original image and a duplicate image. There is no sense of incongruity above.

  In addition, when the portable information terminal device transmits an image attached to an e-mail from the portable information terminal device as its own device to another portable information terminal device applied to the image communication system, When the image to be transmitted is selected by the thumbnail image held in the thumbnail image storage unit, the identification information of the thumbnail image used for selection of the image from its own device to the mail relay device Can be controlled so as to be transmitted without the image data of the thumbnail image itself.

  In the portable information terminal device according to this aspect, an image attached to the e-mail from the portable information terminal device that is the device itself to another portable information terminal device that is applied to the image communication system is transferred to the mail relay device by the action of the control unit. When transmitting via the image information, the identification information of the thumbnail image used for selecting the image can be transmitted without the image data of the thumbnail image itself to the mail relay device. In comparison, it is possible to identify an image to be transmitted with identification information having a much smaller amount of information, and wireless communication between portable information terminal devices (from the portable information terminal device of the transmission source to the mail relay device) The risk of squeezing resources in a part of the section is reduced.

Meanwhile, yet another aspect of the present invention is:
An original image storage device that stores an image acquired from the outside as an original image for a user and an information communication system that is configured to exchange information through the transmission path and configure the image communication system together with the original image storage device. Image data representing the original image stored from the storage device is acquired through the transmission path, and a duplicate image corresponding to the original image and each thumbnail image with identification information corresponding to the duplicate image are held and a portable information terminal An image transmission method using a mail relay device that relays transfer of images by electronic mail between devices,
In the mail relay device, the status of holding the duplicate image is updated with the update of the holding status of the corresponding thumbnail image so that the status of holding the duplicate image matches the storage status of each original image in the original image storage device. An update step, a thumbnail image supply step for supplying a thumbnail image to one portable information terminal device handled by the user, and an electronic mail attached to the other portable information terminal device from the one portable information terminal device. Image data representing the duplicate image corresponding to the thumbnail image identified by the received identification information when the image is selected by the thumbnail image and the identification information of the selected thumbnail image is received at the time of transmission And e-mail relaying step for transmitting to the other portable information terminal device.

  In the image transmission method as described above, for example, an image acquired from the outside such as an image captured by a digital camera or an image acquired from a website via a network is stored as an original image (original in the subjectivity of the user) of the user. An original image storage device such as a home server, and image data representing the stored original image from the original image storage device can be acquired through a transmission path including a communication network, for example, and stored in the original image storage device Mail relay device that holds each duplicate image corresponding to the original image and each thumbnail image with its own identification information corresponding to each of the duplicate images and relays the transfer of images by e-mail between portable information terminal devices And used.

In this case, in particular, in the mail relay apparatus, so that the possession status of the duplicate image matches the archive status of each original image in the original image storage device (the so-called similarity between the keep status of the original image and the possession status of the duplicate image). Update the possession status of the duplicate image with the update of the possession status of each corresponding thumbnail image.
The mail relay apparatus further supplies a thumbnail image to one portable information terminal device handled by the user, and the holding status of the thumbnail image in the one portable information terminal device is similar to the holding status of the thumbnail image in the own device. Make a situation.

  Further, an image to be transmitted as an e-mail attached to another portable information terminal device is selected by the thumbnail image in the one portable information terminal device, and identification information of the selected thumbnail image is selected in the one portable information terminal at the time of transmission. When sent from the information terminal device and received by the mail relay device, the mail relay device transmits image data representing the corresponding duplicate image to the other portable information terminal device based on the received identification information.

The copy image holding status in the mail relay apparatus corresponds to the original image storage status in the original image storage apparatus, and thumbnail images corresponding to the respective duplicate images are prepared. Further, the thumbnail image holding status in the mail relay apparatus Since the possession status of thumbnail images in one portable information terminal device handled by the user is the same, handling is easy without requiring a complicated operation for transmitting images via the mail relay device. .
In other words, the user handling the portable information terminal device is not particularly aware that the image is transmitted via the mail relay device, and the image selection with reference to the thumbnail image is displayed and attached to the e-mail. This operation is almost the same as the previous operation for handling the original image and the duplicate image, and there is no sense of incongruity in handling.

Yet another aspect of the present invention is:
Corresponding to the original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage device that stores the image acquired from the outside as the original image in the user Instruction to update the storage state of thumbnail images from a mail relay apparatus that holds duplicate images and thumbnail images with identification information corresponding to these duplicate images and relays the transfer of images by e-mail between portable information terminal devices , A procedure for requesting the mail relay device for data for updating the holding status of thumbnail images in the portable information terminal device, and a thumbnail image supplied from the mail relay device in response to the request Based on the data for updating the possession status, the thumbnail image of the portable information terminal device That includes a procedure for updating the chromatic status, which is a program characterized.
According to the above-described program, the thumbnail image holding status in the portable information terminal device is reliably updated in response to the thumbnail image storage state update command issued from the mail relay device.

Yet another aspect of the present invention is:
Corresponding to the original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage device that stores the image acquired from the outside as the original image in the user The portable information terminal device to a mail relay device that holds duplicate images and thumbnail images accompanied by identification information corresponding to the duplicate images and relays image transmission / reception between the portable information terminal devices by electronic mail And a procedure for requesting data for updating the thumbnail image possession status to the latest one, and when receiving data for updating the thumbnail image possession status to the latest one from the mail relay apparatus, based on the data Updating the possession status of thumbnail images in the portable information terminal device to the latest one. Is a program characterized by Dale.
According to the above program, the possession status of the thumbnail image in the portable information terminal device is surely triggered by the data request for updating the possession status of the thumbnail image led by the portable information terminal device to the latest one. Updated.

Yet another aspect of the present invention is:
Corresponding to the original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage device that stores the image acquired from the outside as the original image in the user Portable information terminal using a mail relay device that holds duplicate images and thumbnail images accompanied by identification information corresponding to these duplicate images and relays the transfer of images by electronic mail between portable information terminal devices A program for sending e-mail from a device,
A procedure for accepting an e-mail transmission operation, a procedure for identifying an image attached to an e-mail that is the object of the transmission operation, and an identification information of a thumbnail image corresponding to the identified image is attached to the e-mail And a procedure for transmitting an electronic mail to which the identification information is attached.

  According to the above program, the identification information of the thumbnail image corresponding to the image attached to the e-mail is attached to the e-mail, and the image to be transmitted and the thumbnail image itself are represented in the middle section to the mail relay device. It can be transmitted without data. For this reason, the risk of pressing resources in wireless communication between portable information terminal devices (part of a section from the portable information terminal device that is the transmission source to the mail relay device) is reduced.

Yet another aspect of the present invention is:
Corresponding to the original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage device that stores the image acquired from the outside as the original image in the user Instruction to update the storage state of thumbnail images from a mail relay apparatus that holds duplicate images and thumbnail images with identification information corresponding to these duplicate images and relays the transfer of images by e-mail between portable information terminal devices , A procedure for requesting the mail relay device for data for updating the holding status of thumbnail images in the portable information terminal device, and a thumbnail image supplied from the mail relay device in response to the request Based on the data for updating the possession status, the thumbnail image of the portable information terminal device A procedure for updating the presence status, a procedure for accepting an operation for sending an e-mail, a procedure for identifying an image attached to an e-mail that is the object of the sending operation, and a thumbnail image corresponding to the identified image A program comprising: a procedure for attaching identification information to an electronic mail; and a procedure for transmitting an electronic mail to which the identification information is attached.

According to the above-described program, the thumbnail image holding status in the portable information terminal device is reliably updated in response to the thumbnail image storage state update command issued from the mail relay device.
In addition, the identification information of the thumbnail image corresponding to the image attached to the e-mail is attached to the e-mail, and an intermediate section to the mail relay device is accompanied by data representing the image to be transmitted and the thumbnail image itself. Without transmission.
For this reason, the risk of pressing resources in wireless communication between portable information terminal devices (part of a section from the portable information terminal device that is the transmission source to the mail relay device) is reduced.

Yet another aspect of the present invention is:
Corresponding to the original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage device that stores the image acquired from the outside as the original image in the user The portable information terminal device to a mail relay device that holds duplicate images and thumbnail images accompanied by identification information corresponding to the duplicate images and relays image transmission / reception between the portable information terminal devices by electronic mail And a procedure for requesting data for updating the thumbnail image possession status to the latest one, and when receiving data for updating the thumbnail image possession status to the latest one from the mail relay apparatus, based on the data A procedure for updating the possession status of the thumbnail image in the portable information terminal device to the latest one, A procedure for accepting an operation of sending a mail, a procedure for identifying an image attached to an e-mail that is the object of the operation for sending, and attaching identification information of a thumbnail image corresponding to the identified image to the e-mail And a program for transmitting an electronic mail to which the identification information is attached.

According to the above program, the possession status of the thumbnail image in the portable information terminal device is surely triggered by the data request for updating the possession status of the thumbnail image led by the portable information terminal device to the latest one. Updated.
In addition, the identification information of the thumbnail image corresponding to the image attached to the e-mail is attached to the e-mail, and an intermediate section to the mail relay device is accompanied by data representing the image to be transmitted and the thumbnail image itself. Without transmission. For this reason, the risk of pressing resources in wireless communication between portable information terminal devices (part of a section from the portable information terminal device that is the transmission source to the mail relay device) is reduced.

Yet another aspect of the present invention is:
Corresponding to the original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage device that stores the image acquired from the outside as the original image in the user Portable information terminal using a mail relay device that holds duplicate images and thumbnail images accompanied by identification information corresponding to these duplicate images and relays the transfer of images by electronic mail between portable information terminal devices A program for browsing images on a device,
A procedure for receiving an image browsing operation, a procedure for displaying browsing candidates as thumbnail images, a procedure for requesting data representing an image corresponding to one thumbnail image selected from the browsing candidates to the mail relay device, And a procedure for displaying the image based on data representing the image supplied from the mail relay apparatus in response to the request.

  According to the above program, a desired image can be selected based on a small thumbnail image with respect to the amount of information, and only the selected image is acquired from the relay device and displayed on the portable information terminal device. Even in portable information terminal devices that can be browsed and have severe restrictions on the amount of information that can be handled, browsing is effectively comparable to browsing many images as if they were held as browsing targets. A wide range of target options is realized.

Yet another aspect of the present invention is:
Corresponding to each original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage for storing the image acquired from the outside as the original image in the user The corresponding duplicate images and the respective thumbnail images with their own identification information corresponding to the respective duplicate images are held together in a folder for those images, and by e-mail between the portable information terminal devices A program for organizing images in an image portable information terminal device using a mail relay device that relays the transfer of images,
A procedure for requesting the mail relay device to update the folder and the thumbnail image corresponding to the folder to the latest data, and the mail relay device to update the folder and the corresponding thumbnail image A program for receiving data for updating to a new one, and a procedure for updating the holding status of folders and thumbnail images to the latest based on the received data. is there.
According to the above program, even in a portable information terminal device in which operations for folder creation etc. are extremely complicated or difficult, by introducing a folder created outside via a mail relay device , You can organize images using folders.

  According to the present invention, it is possible to simplify an operation for browsing an image on a portable information terminal device, an operation for attaching an image to an e-mail and transmitting the image to an opponent's portable information terminal device, and an operation for organizing images. The illustrated image communication system, mail relay device, image transmission method, and program are realized.

Hereinafter, the present invention will be clarified by describing embodiments of the present invention in detail with reference to the drawings.
(Outline of image communication system as embodiment)
FIG. 1 is a conceptual diagram showing an image communication system as an embodiment of the present invention.
The illustrated image communication system 10 includes, for example, an original image storage device 100 that is a so-called home server, and a mail relay device 200 that is an ASP server, a mail server, or the like connected to the original image storage device 100 through a transmission path. Consists of including.

The original image storage device 100 stores, for example, an image acquired from the outside, such as a photographed image by the digital camera 310 or an image acquired from a website via a network, as an original image (original for handling by the user).
The mail relay apparatus 200 is connected to the original image storage apparatus 100 through a transmission path including, for example, a communication network, and is installed so that image data representing the original image stored in the original image storage apparatus 100 can be acquired through this transmission path. Has been.

In the mail relay apparatus 200 according to the present embodiment, as will be described later, each duplicate image corresponding to each original image stored in the original image storage apparatus 100 and its own identification information corresponding to each duplicate image are accompanied. Each thumbnail image is held, and the transmission / reception of images by e-mail between the portable information terminal devices (only two units 401 and 402 are described for convenience of explanation) is relayed.
The portable information terminal device is a mobile phone, a PDA (Personal Digital Assistant), or the like, and it does not matter whether a camera is provided in any of them.

In particular, the mail relay apparatus 200 is accompanied by updating the corresponding holding status of the corresponding thumbnail image so that the holding status of the duplicate image in the own device matches the storage status of each original image in the original image storage device 100. Update the duplicate image holding status.
Here, “to match the storage status of each original image in the original image storage device 100” typically means that all the duplicates corresponding to the original exist in the storage status of the original image and the holding status of the duplicate image. In addition, it means that the definition and other attributes of each individual image substantially match, that is, a so-called similar state, but the technical idea of the present invention is not necessarily like this. It is not limited to a simple example.

For example, among the original images stored in the original image storage device 100, the case where some of the images specifically intended by the user are substantially in agreement with the storage status of the duplicate images is also included. Is done.
In short, for each original image that is handled by the user according to the technique of the present invention, the duplicate image corresponding to these original images (whether or not the attribute details are the same kind) This means that the existing situation should be maintained.

  Also, the generation of the thumbnail image corresponding to the duplicate image (and thus corresponding to the original image) is generated and held in the mail relay apparatus 200 by a known method. However, processing up to the generation of thumbnail images may be performed in the original image storage device 100, and these thumbnail images may also be supplied to the mail relay device 200 through the transmission path described above.

When a change occurs in the storage state of the original image, the possession state of the duplicate image is also updated following the change, and the corresponding thumbnail images are also updated accordingly. Various specific methods are conceivable for this purpose, but the original image storage apparatus 100 and the mail relay apparatus 200 can be designed to satisfy the required specifications.
The mail relay apparatus 200 further supplies a thumbnail image to the portable information terminal device 401 handled by the user, so that the status of holding the thumbnail image in the portable information terminal device 401 is the same as the status of holding the thumbnail image in the own device. To do.

In the portable information terminal device 401, when transmitting an image attached to an e-mail to another portable information terminal device 402 as a communication partner, the user sees a thumbnail image held by the portable information terminal device 401 and transmits it. Select the target image.
Identification information corresponding to the selected thumbnail image is transmitted from the portable information terminal device 401 and received by the mail relay device 200 when the image selected in this way is transmitted.

The mail relay apparatus 200 attaches image data representing a duplicate image corresponding to the received identification information to the electronic mail based on the received identification information, and transmits the electronic mail to the portable information terminal apparatus 402 of the other party.
The possession status of the duplicate image in the mail relay apparatus 200 corresponds to the archive status of the original image in the original image storage apparatus 100, and thumbnail images corresponding to the respective duplicate images are prepared. The holding status and the holding status of the thumbnail image in the portable information terminal device 401 handled by the user are the same.

For this reason, the user is not particularly conscious of transmitting an image via the mail relay apparatus 200, and does not require a complicated operation.
Therefore, on the user side using the portable information terminal device 401, the possession status of the thumbnail image in the portable information terminal device 401 matches the possession status of the thumbnail image in the mail relay device 200. It is easy to select and display images with reference to thumbnail images and attach them to e-mails.
That is, from the user side, selecting and displaying an image with reference to a thumbnail image, and attaching to an e-mail are substantially the same as the previous operations for handling an original image and a duplicate image. There is no sense of incongruity above.

(Configuration and operation of mail relay device)
FIG. 2 is a conceptual diagram showing a configuration of a mail relay apparatus that is a component of the image communication system 10 of FIG.
In FIG. 2, the relay device 200 manages the storage device 210 as a storage unit for holding an image and the respective units to be described later, and updates the holding status of the duplicate image with the updating of the holding status of the thumbnail image. And a system controller 220 that functions as an updating unit.
In the storage device 210, a duplicate image holding unit 211 and a thumbnail image holding unit 212 are set.
The duplicate image holding unit 211 holds a duplicate image as described above, and the thumbnail image holding unit 212 holds a thumbnail image corresponding to each duplicate image held in the duplicate image holding unit 211.

The storage device 210 is connected to the system controller 220 by a bus 220B.
Based on data representing each duplicate image held in the duplicate image holding unit 211 of the storage device 210, each thumbnail image corresponding to the duplicate image is converted into a thumbnail image generating unit 230, a portable information terminal device 401 handled by the user (FIG. 1). ), A thumbnail image supply unit 240 for supplying a thumbnail image, an image attachment unit 250 for attaching and retransmitting the image data of the duplicate image specified by the identification information corresponding to the thumbnail image to the relay email, and the relay email Is accompanied by identification information for identifying the attached image by the thumbnail image, the thumbnail identification information decoding unit 260 for decoding the identification information, and relaying the e-mail (regardless of the presence or absence of the data of the attached image) An e-mail relay unit 270 having a basic function, a thumbnail image representing an attached image from the relayed e-mail Thumbnail identification information separation unit 280 for separating identification information to be identified, communication network interface unit 291 for exchanging information with portable information terminal devices (FIG. 1: 401, 402), and original image storage such as a home server In addition, an Internet interface unit 292 for exchanging information with an external device (FIG. 1: 100) and other devices via the Internet is connected to the bus 220B so as to operate under the control of the system controller 220.

The system controller 220 holds the duplicate image so that the duplicate image holding state in the duplicate image holding unit 211 in the storage device 210 matches the storage state of each original image in the original image storage device 100 (FIG. 1). Update.
For example, the status of holding a duplicate image is updated by, for example, accessing the original image storage device 100 continuously in a predetermined cycle through the Internet interface unit 292, monitoring the storage status of the original image in the original image storage device 100, and as an original image. For the newly added image, the image data is acquired, and if necessary, the attribute details are processed and stored in the duplicate image holding unit 211 as corresponding duplicate image data.

For the image deleted from the original image, the corresponding duplicate image may be deleted. However, in some cases, it is not essential to maintain a state similar to the original image until the deleted image is deleted. .
For each duplicate image, a thumbnail image corresponding to the duplicate image is generated in the thumbnail image generation unit 230, and as a result, the possession state of the thumbnail image is updated so as to follow the update of the possession state of the duplicate image.

The system controller 220 also supplies thumbnail images to the portable information terminal device 401 handled by the user through the communication network interface unit 291 and a wireless transmission path connected thereto.
Further, when the mail relay apparatus 200 relays an electronic mail transmitted from the portable information terminal apparatus 401 to another portable information terminal apparatus 402, an image transmitted attached to the electronic mail is displayed in the portable information terminal apparatus 401. When the thumbnail image is selected (specified), the following control is performed.

That is, when the e-mail relay unit 270 relays the e-mail, the thumbnail identification information separation unit 280 separates the identification information of the thumbnail image sent along with the e-mail, and further, the thumbnail identification information decoding unit At 260, the contents are decoded.
By the decoding in the thumbnail identification information decoding unit 260, the thumbnail image identified by the identification information received and separated as described above, and thus the duplicate image corresponding to the thumbnail image is specified.
The system controller 220 performs processing of attaching image data representing the duplicate image specified as described above to an email that is relayed and re-transmitted by the image attachment unit 250 (the email relay unit 270), Control is performed so as to transmit to portable information terminal device 402.

  As described above, the e-mail relay operation is transmitted by the e-mail relay unit 270 as an attachment to an e-mail from the portable information terminal device 401 to another portable information terminal device 402 under the control of the system controller 220. When the image is selected by the thumbnail image and the identification information of the selected thumbnail image is received when the e-mail is transmitted, the duplicate image corresponding to the thumbnail image identified by the received identification information is displayed. This is executed by performing a predetermined function such as transmitting image data to be represented to the portable information terminal device 402.

  The mail relay apparatus 200 of FIG. 2 substantially matches (corresponds to) the original image storage status in the original image storage apparatus 100 in the original image storage apparatus 100 (the secondary image storage unit 211 of the storage device 210). In addition, thumbnail images corresponding to each duplicate image are prepared, and the possession status of the thumbnail images is similar to the possession status of the thumbnail images in the portable information terminal device 401 handled by the user (similar). It will be a thing.

For this reason, it is possible to select and display an image with reference to a thumbnail image and send it attached to an e-mail without requiring a complicated operation for transmitting the image via the mail relay device. The operation is simple and easy to handle.
In the mail relay device, the control unit controls the update of the holding status of the duplicate image, for example, repeatedly at a predetermined spontaneous timing with the updating of the holding status of the thumbnail image in the storage unit. Can be taken.

Further, as described above, in the mail relay apparatus 200, the operation of the system controller 220 voluntarily causes the possession state of the duplicate image in the own apparatus to be in a state corresponding to the original image storage state in the image storage apparatus 100. The image storage status is repeatedly updated at the timing, and the thumbnail image holding status is also updated following the update of the duplicate image holding status.
Accordingly, the possession status of the duplicate image and the possession status of the thumbnail image are reliably updated by the mail relay apparatus acting on the initiative.

On the other hand, the mail relay apparatus 200 has an Internet interface unit from the original management apparatus 100 in which the system controller 220 updates the holding state of the duplicate image with the update of the holding state of the thumbnail image in the storage device 212. It is possible to adopt a mode in which a command through 292 is received and control is performed so that image data is repeatedly updated at a driven timing according to the received command.
In the case of adopting such an aspect, while simplifying the handling, the possession status of the duplicate image and the possession status of the thumbnail image are updated at a timing commensurate with the current operation status of the original image storage device 100. obtain.

  The system controller 220 of the mail relay apparatus 200 also performs the portable information so that the possession status of the thumbnail image in the portable information terminal device 401 handled by the user matches the possession status of the thumbnail image in the thumbnail image holding unit 212 of the storage device 210. A mode of controlling the terminal device 401 to supply image data representing the thumbnail image held in the thumbnail image holding unit 212 may be adopted.

In this case, the image data representing the thumbnail image is supplied under the control of the system controller 220 under the control of the system controller 220, for example, repeatedly or continuously at a predetermined cycle or when an update request is issued from the portable information terminal device 401. It is executed by sending it to the portable information terminal device 401 through the unit 291.
Details of the configuration and operation of the portable information terminal device 401 will be described later. The possession status of the thumbnail image in the portable information terminal device 401 matches the possession status of the thumbnail image in the mail relay device 200 by the thumbnail image data sent at a predetermined timing (for example, periodically) as described above. Be controlled.

Therefore, the user can handle the above-described duplicate image corresponding to the thumbnail image with reference to the thumbnail image in the portable information terminal device 401 at hand.
In this case, the mail relay apparatus 200 may adopt a mode in which the system controller 220 performs control such that supply of image data representing a thumbnail image to the portable information terminal apparatus 401 is repeatedly performed at a predetermined spontaneous timing, for example.
In the mail relay apparatus 200 of this aspect, by the action of the system controller 220, the possession status of the thumbnail image in the portable information terminal device 401 at the user's hand matches the possession status of the thumbnail image in the mail relay apparatus 220. The mail relay device side takes the lead and is reliably updated. For this reason, the handling effort is further simplified.

On the other hand, the mail relay apparatus 200 is driven by the system controller 220 according to a command from the portable information terminal device 401 received through the communication network interface unit 291 to supply image data representing a thumbnail image to the portable information terminal device 401. It is possible to adopt a mode of performing control so as to be performed at a specific timing.
In the mail relay device 200 of this aspect, the thumbnail image possession status in the portable information terminal device 401 is changed from the thumbnail image possession status in the mail relay device 200 by the action of the system controller 220 that responds to a command from the portable information terminal device 401. It is updated at a driven timing according to a command from the portable information terminal device 401 so as to match.
In the case of such an aspect, while handling is simplified, the thumbnail image holding status is updated at a timing commensurate with the current usage status of the portable information terminal device 401.

(Configuration and operation of portable information terminal device)
FIG. 3 is a conceptual diagram showing a configuration of a portable information terminal device 401 as one embodiment of the present invention.
Although the configuration of the portable information terminal device 401 in FIG. 1 is shown in FIG. 3, the portable information terminal device 402 is required to have a function of receiving an e-mail attached with image data. It is not essential to have the same configuration as the portable information terminal device 401. Of course, the same configuration as the portable information terminal device 401 may be used.
The portable information terminal device 401 is an image communication system 10 that includes the original image storage device 100 described with reference to FIG. 1 and the mail relay device 200 described with reference to FIGS. 1 and 2. It has specifications as a camera-equipped mobile phone suitable for use.

3 includes a storage unit 410 that is a storage device including a thumbnail image storage unit 411, and a system controller 420 that functions as a control unit that controls each unit as will be described later.
The thumbnail image storage unit 411 holds a thumbnail image corresponding to each duplicate image in the mail relay apparatus 200 described above.
The storage device 410 is connected to the system controller 420 by a bus 420B.
A wireless communication unit 430 of a known mode including an RF circuit unit (not shown) for allowing the portable information terminal device 401 to communicate with an external device through the antenna 431 is provided.
The thumbnail image data supplied from the mail relay apparatus 200 in FIG. 2 as described above is also received by the wireless communication unit 430 and stored in the thumbnail image storage unit 411 of the storage device 410.

An audio processing unit 440 that processes an audio signal transmitted and received through the wireless communication unit 430 is provided, and an audio input unit 441 that is a microphone and an audio output unit 442 that is a speaker are connected to the audio processing unit 440 to perform an audio call. Is configured to be possible.
In this example, the portable information terminal device 401 has specifications as a camera-equipped mobile phone. For this reason, the portable information terminal device 401 includes a known camera unit 450 including an optical system, an image sensor, and the like, a compression process related to a video signal acquired by the camera unit 450, and a decompression process for compressed image data stored in the storage unit 410 An image processing unit 460 that performs other image processing is provided.

A display unit 470 for displaying characters, images, and other various displays, and an operation unit 480 configured with various operation keys are also provided as usual.
In the above configuration, in the portable information terminal device 401, the system controller 420 serving as a control unit manages the thumbnail image holding status in the thumbnail image storage unit 411, and the thumbnail image storage status in the thumbnail image storage unit 411 is illustrated. The mail relay apparatus 200 (its thumbnail image holding unit 212) described with reference to FIG. 1 and FIG.

In this control, under the management of the system controller 420, image data representing a thumbnail image sent from the mail relay apparatus 200 is received by the wireless communication unit 430 via the wireless communication network, and the thumbnail image storage unit 411 holds the thumbnail image. The situation is executed such that it is updated at a predetermined timing (for example, periodically).
On the user side using the portable information terminal device 401, the possession status of the thumbnail image in the portable information terminal device 401 matches the possession status of the thumbnail image in the mail relay device 200. It is easy to select and display images with reference to thumbnail images and attach them to e-mails.

That is, from the user side, selecting and displaying an image with reference to a thumbnail image, and attaching to an e-mail are substantially the same as the previous operations for handling an original image and a duplicate image. There is no sense of incongruity above.
When this portable information terminal device 401 transmits an image attached to an e-mail from the portable information terminal device 401 as its own device to another portable information terminal device (402) applied to the image communication system 10 of FIG. When the image to be transmitted is selected by the thumbnail image held in the thumbnail image storage unit 411, the system controller 420 provides the image to the mail relay device 200 for selection of the image. It is possible to adopt a mode in which the identification information of the thumbnail image is controlled to be transmitted without the image data of the thumbnail image itself.

  When an image is transmitted from the portable information terminal device 401 having such a mode to the other party's portable information terminal device 402 via the mail relay device 200, the identification information of the thumbnail image used for selection of the image is used as the thumbnail image itself. Therefore, it is possible to specify an image to be transmitted with identification information that has a much smaller amount of information in comparison with image information. This can reduce the risk of squeezing resources in wireless communication between portable information terminal devices (part of a section from the portable information terminal device that is the transmission source to the mail relay device).

On the other hand, when an image captured by the camera unit 450 provided in the portable information terminal device 401 is stored in the storage unit 410 by selecting a definition mode in which the image file size is not excessive. It is also possible to send the image itself (image data) by attaching it to a mail as usual.
In addition, the camera unit 450 in the portable information terminal device 401 can also capture images with megapixel-class definition.
Images captured in such a high-definition mode are temporarily stored in the original image storage device 100 in the same manner as the handling of captured images by the digital camera 310 described with reference to FIG. Just like the original image described above, the image can be transmitted by a simple method using the mail relay apparatus 200.

(Update of thumbnail image storage status in portable information terminal device)
FIG. 4 is a flowchart showing the update operation of the thumbnail image storage state in one embodiment of the portable information terminal device of FIG. This operation is performed by a system controller 420 that operates based on an application program acquired by the portable information terminal device 401 by downloading through the wireless communication unit 430. It is carried out by operating as follows.

In the above embodiment, the thumbnail image storage state is updated every time a periodic command is received from the mail relay apparatus 200, for example.
The wireless communication unit 430 waits for an instruction to update the thumbnail image storage state from the mail relay device 200 (step S401: No), and when the update instruction is received (step S401: Yes), the mobile phone The system controller 420 of the information terminal device 401 supplies data to the mail relay device 200 to update the thumbnail image holding status in the thumbnail image holding unit 212 in the storage device 210 of the mail relay device 200 to the latest one. Is transmitted through the wireless communication unit 430 (step S402).

  In response to the request in step S402, the system waits for arrival of update data regarding the thumbnail image holding status from the mail relay apparatus 200 (step S403: No), and when update data arrives (step S403: Yes). Then, the thumbnail image holding state in the thumbnail image holding unit 411 is updated using the update data (step S404).

In the above description, for example, the waiting time in step S401 and step S403 is taken to be limited to a predetermined time, but these are conventional means and detailed description thereof is omitted.
As described above, in this embodiment, the thumbnail image holding state in the thumbnail image holding unit 411 is updated in response to a command from the mail relay apparatus 200. In other words, the thumbnail image holding status on the portable information terminal device 401 side is reliably executed by the leading action of the mail relay device 200.

Further, the operation described with reference to the flowchart of FIG. 4 can be repeatedly executed in response to, for example, a periodic update command regarding the thumbnail image possession status from the mail relay apparatus 200.
Further, the operation of FIG. 4 is performed as one subroutine in a series of procedures for attaching an image to an e-mail and transmitting it as described later with reference to the flowchart of FIG. 6, or alternatively, referring to the flowchart of FIG. As will be described later, in a series of procedures for displaying an image selected based on display of browse candidate images by thumbnail images, this can be executed as one subroutine.

(Update of thumbnail image storage state in another embodiment of the portable information terminal device)
FIG. 5 is a flowchart showing the update operation of the thumbnail image storage state in another embodiment of the portable information terminal device of FIG. In the embodiment of FIG. 5 as well, the corresponding is connected by the bus 420B under the control of the system controller 420 that operates based on the application program acquired by the portable information terminal device 401 by downloading through the wireless communication unit 430. The point that is achieved by the operation of each part in a predetermined manner is the same as in the embodiment of FIG.

However, the embodiment of FIG. 5 adopts a mode in which the thumbnail image storage state update operation is performed at a spontaneous timing in the portable information terminal device without waiting for a command from the mail relay device 200.
When the operation is started after the power is turned on, data for updating the possession status of thumbnail images to the latest one is requested to the mail relay apparatus 200 through the wireless communication unit 430 based on a command from the system controller 420. (Step S501).

  Next, in response to the request in step S501, the mail relay apparatus 200 waits for data indicating the thumbnail image possession status at the current time point on the portable information terminal apparatus 401 side (step S502). (Step S502: Yes), the mobile information terminal device 401 transmits data representing the current state of the thumbnail image to the mail relay device 200 (step S503).

  Based on the data indicating the current status of holding the thumbnail image transmitted in step S503, the mail relay apparatus 200 waits for a response indicating whether the thumbnail image holding status needs to be updated within a certain time (step S503). If there is a response (step S504: Yes) and the response is a response indicating that it is necessary to update the holding status of the thumbnail image (step S505: Yes), the response is accompanied by the response in step S504. The data for updating the thumbnail image holding status to the latest one is received (step S506), and the thumbnail image holding status is updated to the latest one based on the data received in step S506 (step S507). The process ends.

On the other hand, when it is a response indicating that it is not necessary to update the possession status of the thumbnail image in step S505 (step S505: No), the processing is ended as it is.
In the above description, for example, the standby time in step S502 and step S504 is limited to a predetermined time. However, these are conventional means, and detailed description thereof is omitted.

As described above, in this embodiment, the update of the thumbnail image holding status in the thumbnail image holding unit 411 is performed spontaneously by the portable information terminal device 401 acting as a lead. Therefore, the thumbnail image holding status is updated at a timing commensurate with the operating status of the portable information terminal device 401.
Further, the operation described with reference to the flowchart of FIG. 5 can be repeatedly executed by being activated by, for example, a periodic update data request regarding the thumbnail image possession status from the portable information terminal device 200.

  Further, the operation of FIG. 5 is executed as one subroutine in a series of procedures for attaching an image to an e-mail and transmitting it as described later with reference to the flowchart of FIG. 6, or alternatively, the flowchart of FIG. As will be described later with reference to this, a series of procedures for displaying an image selected based on the display of the browse candidate image by the thumbnail image can be executed as one subroutine.

(Mail transmission operation in portable information terminal device)
FIG. 6 is a flowchart showing a mail transmission operation in portable information terminal device 401.
This operation is also executed by operating the corresponding units under the control of the system controller 420 in the portable information terminal device 401.
Waiting for the user's operation to send an e-mail to the operation unit 480 (step S601: No), and receiving an e-mail sending operation (step S601: Yes), it is determined whether an image is attached to the e-mail to be sent (Step S602).
When it is determined in step S602 that an image is attached to the e-mail to be transmitted (step S602: Yes), it is determined whether or not the thumbnail image possession status has been updated to the latest status at that time. (Step S603).

The determination in step S603 is performed based on, for example, an update history of the thumbnail image holding status remaining in the memory of the system controller 420 or the storage unit 410.
If it is determined in step S603 that the thumbnail image possession status has already been updated to the latest status at this time (step S603: Yes), the image recognized as being attached to the e-mail in step S602 is identified. To do.
Next, it is determined whether there is a thumbnail image corresponding to the image recognized in step S602 (that is, held in the thumbnail image holding unit 411 of the storage unit 410) (step S605).

If it is determined in step S605 that a thumbnail image corresponding to the image attached to the e-mail exists (step S605: Yes), identification information representing the thumbnail image is attached to the e-mail (step S606).
Next, in step S606, the electronic mail attached with identification information representing the thumbnail image of the transmission target image is transmitted to the mail relay apparatus through the wireless communication unit 430 (step S607).
The operation on the side of the mail relay device 200 that relays the electronic mail transmitted in step S607 is as described above with reference to FIGS.

On the other hand, when it is determined in step S603 that the thumbnail image possession status has not been updated to the latest status at this time (step S603: No), the procedure for updating the thumbnail image possession status to the latest (subroutine) ) Is executed (step S608).
The processing procedure in the subroutine of step S608 is as described with reference to the flowchart of FIG. 4 or FIG. By executing this subroutine, the thumbnail image possession status is updated to the latest status at this point, and the process proceeds to step S604 described above.

If it is determined in step S605 that there is no thumbnail image corresponding to the image attached to the e-mail (step S605: No), the image attached to the e-mail is provided in the portable information terminal device 401. It is determined whether or not the image captured by the camera unit 450 is received (step S609).
If it is determined in step S609 that the image attached to the e-mail is an image taken by the camera unit 450 provided in the portable information terminal device 401 (step S609: Yes), the file size of the image is set in the e-mail. It is determined whether or not it is suitable for attachment and transmission (step S610).

When it is determined in step S610 that the file size of the image is suitable for transmission by attaching to an e-mail (step S610: Yes), the corresponding photographed image (main body) is attached to the e-mail. (Step S611), the process proceeds to the above-described Step S607, the electronic mail is transmitted, and the process is terminated.
When it is determined in step S609 that the image to be attached to the e-mail is not a photographed image by the camera unit 450 in the portable information terminal device 401 (step S609: No), the selection of the attached image is normal due to an erroneous operation. It is highly probable that an abnormality has occurred, such as no image being selected or any image that is not originally handled.

Further, when it is determined in step S610 that the file size of the image is not suitable for transmission attached to an e-mail (step S610: No), such a state has occurred in the user. Need to be notified.
Accordingly, when the determinations in steps S609 and S610 are negative, in any case, a warning display indicating that the above-described abnormality has occurred is displayed on the display unit 470 of the portable information terminal device 401. (Step S612), and the process ends.

(Browsing images on a portable information terminal)
FIG. 7 is a flowchart showing an operation when browsing the image selected based on the display of the thumbnail image on the portable information terminal device.
This operation is also executed by operating the corresponding units under the control of the system controller 420 in the portable information terminal device 401.
Waiting for an image browsing operation on the operation unit 480 (step S701: No) and accepting an image browsing operation (step S601: Yes), whether or not the thumbnail image possession status has been updated to the latest status at that time. Is determined (step S702).

The determination in step S702 is performed based on, for example, an update history of the thumbnail image holding status remaining in the memory of the system controller 420 or the storage unit 410.
If it is determined in step S702 that the thumbnail image possession status has already been updated to the latest status at this time (step S702: Yes), the browse candidate image is displayed on the portable information terminal device 401 in step S703. The thumbnail image is displayed on the part 470 (step S703).
Based on this thumbnail image, it waits for the selection of the image to be viewed (step S704: No), and when the image to be viewed is selected (step S704: Yes), the system controller Under the control of 420, a transmission request for image data corresponding to the selected thumbnail image is issued to the mail relay apparatus 200 through the wireless communication unit 430 (step S705).

In response to the transmission request in step S705, it waits for the image data to be received from the mail relay apparatus 200 (step S706: No). When the image data is received (step S706: Yes), this reception is performed. Based on the image data thus obtained, an image is displayed on the display unit 470 of the portable information terminal device 401 (step S707).
On the other hand, when it is determined in step S702 that the thumbnail image possession status has not been updated to the latest status at this time (step S702: No), the procedure for updating the thumbnail image possession status to the latest (subroutine). Is executed (step S708).

The processing procedure in the subroutine of step S708 is as described with reference to the flowchart of FIG. 4 or FIG. By executing this subroutine, the thumbnail image possession status is updated to the latest status at this point, and the process proceeds to step S703 described above.
As described above, in the present invention, the original image storage device 100, the mail relay device 200, and the portable information terminal device 401 cooperate with each other so that the storage state of the original image in the original image storage device 100 is a so-called situation. Formed in the status of holding duplicate images in the mail relay apparatus 200, and for each duplicate image, thumbnail images thereof are generated, and the status similar to the status of holding the thumbnail images in the mail relay apparatus 200 is similar to the portable information terminal. Formed in the device.

In recent years, even in a portable information terminal device, it is becoming possible to shoot at a high definition of megapixel level by the camera unit. However, the means for organizing captured images have various limitations such as ability and operability that cannot be compared with a personal computer or the like.
In short, it is common to handle captured images from a portable information terminal device in a single folder with a specific title. To organize, the procedure becomes overly complicated or it is difficult to do so.
However, if the technique of the present invention is applied, it is possible to categorize captured images in the portable information terminal device into folders and organize them relatively easily.

Next, the arrangement of such captured images in the portable information terminal device will be described with reference to the drawings.
(Organization of images in portable information terminal devices)
FIG. 8 is a sequence chart when the original image storage device 100, the mail relay device 200, and the portable information terminal device 401 cooperate in the system of FIG. 1 to organize the captured images in the portable information terminal device. .
The user creates a plurality of folders in order to organize each image (image file) stored in the original image storage device 100. These folders may be configured with a hierarchical structure in some cases.

As described above, the original image storage device 100 is a personal computer or the like that constitutes a home server. However, as described above, the creation of a folder as described above is extremely easy.
The mail relay apparatus 200 repeats the original image in the storage device 210 of its own device in order to form a storage state of the duplicate image similar to the storage state of the original image in the original image storage device 100 at an appropriate timing such as repeating at a constant cycle. The storage status in the storage device 100 is inquired.
As a part of this inquiry, transmission of data representing the folder creation status is requested (step S801).

In response to the request in step S801, data representing the creation status of the folder in the original image storage device 100 is sent to the mail relay device 200 (step S802). A folder similar to the folder in is created, and the duplicate image is divided into folders in the same manner as the original image.
The arrangement status of duplicate images as described above is similarly performed for thumbnail images corresponding to the duplicate images.

  When the portable information terminal device 401 requests the mail relay device 200 for information on the correspondence status between the folder and the thumbnail image as described above (step S803), the mail relay device 200 that has received the request stores the information stored in its own device. Information representing a situation in which thumbnail images formed in the device are organized into folders is returned to the portable information terminal device 401 (step S804).

In the portable information terminal device that has obtained the data representing the situation in which the thumbnail images are organized into folders in step S804, based on this data, the same folders as those in the thumbnail image organization status in the mail relay device 200 are transplanted. The thumbnail images are held in a situation similar to that in the mail relay apparatus 200.
In this way, in the portable information terminal device 401, a folder created in the original image storage device 100 is formed in the storage unit 410 of the own device, not by an operation on the own device, and thereafter, the portable information terminal device 401 Images taken by the camera unit 450 can also be organized using this folder.

FIG. 9 is a flowchart showing the operation of the portable information terminal device in the sequence chart of FIG.
The operation in this case in the portable information terminal device 401 is also executed by each corresponding unit performing a predetermined function under the control of the system controller 420.
In FIG. 9, based on a command from the system controller 420, the wireless relay unit 430 requests the mail relay apparatus 200 for data for updating each folder and the corresponding thumbnail image holding status to the latest one. (Step S901).

  Next, in response to the request in step S901, the mail relay apparatus 200 waits for a request for data indicating the current state of the folder on the portable information terminal apparatus 401 side and the corresponding thumbnail image holding status ( When this request arrives (Step S902: No) (Step S902: Yes), the portable information terminal device 401 indicates to the mail relay device 200 the folder of the thumbnail image at the current time point and the possession status of the corresponding thumbnail image. Data is transmitted (step S903).

  Based on the data representing the current status of the thumbnail image transmitted at step S903, the mail relay apparatus 200 has a certain response indicating whether or not it is necessary to update the status of the folder and the corresponding thumbnail image. Waiting in time (step S904: No), when there is a response (step S904: Yes), and the response is a response indicating that it is necessary to update the holding status of the folder and the corresponding thumbnail image (step S905) : Yes), and receives data for updating the holding status of the folder and the thumbnail image corresponding to the folder in response to the response in step S904 (step S906), and depending on the data received in step S906 Update the folder and thumbnail image holding status to the latest one (step S907), To terminate the management.

On the other hand, when the response received in step S905 is a response indicating that there is no need to update the possession status of the thumbnail image (step S905: No), the process ends as it is.
In the above description, for example, the waiting time in step S902 and step S904 is limited to a predetermined time, but these are conventional means, and detailed description thereof is omitted.

As described above, in this embodiment, the update of the holding status of the folder and the thumbnail image corresponding to the folder in the thumbnail image holding unit 411 is spontaneously performed by the portable information terminal device 401 acting in an initiative. Therefore, the holding status of the folder and the corresponding thumbnail image is updated at a timing commensurate with the operating status of the portable information terminal device 401.
Further, a state in which thumbnail images are organized into folders in a manner as arbitrarily created by the user with the original image storage device 100 is realized without performing operations for creating folders and the like on the portable information terminal device 401 side. .
In addition, the folder once created in this way can be used for organizing images captured and acquired by the camera unit 450 of the portable information terminal device 401 and is extremely convenient for handling images. Thus, the portable information terminal device 401 and the image communication system are realized.

  The present invention stores an image acquired from the outside as an original image for a user, for example, an original image storage device such as a personal computer functioning as a home server, and an image representing the stored original image from the original image storage device Each duplicate image corresponding to each original image stored so as to be able to acquire data through a transmission path and stored in the original image storage device, and each thumbnail image with their own identification information corresponding to each duplicate image are held. In addition, an image communication system, a mail relay device, an image transmission method, and portable information that include a mail relay device such as a server computer that relays transmission / reception of images by e-mail between portable information terminal devices The present invention can be applied to a program for operating a terminal device.

It is a conceptual diagram showing the image communication system as embodiment of this invention. It is a conceptual diagram showing the structure of the mail relay apparatus which comprises the component of the image communication system of FIG. It is a conceptual diagram showing the structure of the portable information terminal device as one embodiment of this invention. It is a flowchart showing the operation | movement in one Example of the portable information terminal device of FIG. It is a flowchart showing the update operation of the preservation | save state of the thumbnail image in the other Example of the portable information terminal device of FIG. It is a flowchart showing the mail transmission operation | movement in a portable information terminal device. It is a flowchart showing operation | movement in the case of browsing the image selected based on the display of a thumbnail image with a portable information terminal device. 2 is a sequence chart in a case where the original image storage device, the mail relay device, and the portable information terminal device cooperate in the system of FIG. 1 to organize captured images in the portable information terminal device. It is a flowchart showing operation | movement of the portable information terminal device in the sequence chart of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Image communication system 100 ... Original image storage apparatus 200 ... Mail relay apparatus 210 ... Storage apparatus 211 ... Duplicate image holding part 212 ... Thumbnail image holding part 220 ... System controller 220B ... Bus 230 ... Thumbnail image generation part 240 ... Thumbnail image Supply unit 250 ... Image attachment unit 260 ... Thumbnail identification information decoding unit 270 ... E-mail relay unit 280 ... Thumbnail identification information separation unit 291 ... Communication network interface unit 292 ... Internet interface unit 310 ... Digital cameras 400, 401, 402 ... Mobile information Terminal device 410 ... storage unit 411 ... thumbnail image storage unit 420 ... system controller 420B ... bus 430 ... wireless communication unit 431 ... antenna 440 ... audio processing unit 441 ... audio input unit 442 ... audio output unit 450 ... camera unit 46 ... image processing section 470 ... display unit 480 ... the operation unit

Claims (17)

An original image storage device for storing an image acquired from the outside as an original image for a user, and image data representing the stored original image from the original image storage device are installed so as to be acquired through a transmission path in the original image storage device. A mail relay device that holds a duplicate image corresponding to the stored original image and a thumbnail image accompanied by identification information corresponding to the duplicate image, and relays an image transmission / reception by e-mail between portable information terminal devices; An image communication system configured to include:
The mail relay apparatus retains the duplicate image with an update of the corresponding possession status of the thumbnail image so that the possession status of the duplicate image in the own apparatus matches the archive status of the original image in the original image storage apparatus. The situation is updated, and a thumbnail image is supplied to one portable information terminal device handled by the user and transmitted from the one portable information terminal device to another portable information terminal device as an email attachment. When an image to be selected is selected by the thumbnail image and identification information of the selected thumbnail image is received at the time of transmission, image data representing the corresponding duplicate image based on the received identification information is converted to the other image data. An image communication system configured to transmit to a portable information terminal device. An original image storage device that stores an image acquired from the outside as an original image for a user and an information communication system that is configured to exchange information through the transmission path and configure the image communication system together with the original image storage device. Image data representing the stored original image is obtained from the storage device through the transmission path, and each duplicate image corresponding to each original image and each thumbnail image accompanied with identification information corresponding to each duplicate image are held. And a mail relay device that relays image transmission / reception by e-mail between portable information terminal devices,
A storage unit that holds images, and an update of the holding state of each corresponding thumbnail image so that the holding state of the duplicate image in the storage unit matches the storage state of each original image in the original image storage device. An update unit that updates the possession status of the duplicate image, a thumbnail image supply unit that supplies a thumbnail image to one portable information terminal device handled by the user, and another portable information terminal device from the one portable information terminal device When an image transmitted as an attachment to an e-mail is selected by the thumbnail image, and identification information of the selected thumbnail image is received at the time of transmission, the thumbnail image identified by the received identification information And an e-mail relay unit that transmits image data representing the duplicate image corresponding to the other portable information terminal device. Mail relay device that.   3. The update unit according to claim 2, wherein the update unit controls to update the holding state of the duplicate image at a predetermined spontaneous timing with the update of the holding state of the thumbnail image in the storage unit. The mail relay device described.   The update unit controls to update the holding status of the duplicate image with the update of the holding status of the thumbnail image in the storage unit at a driven timing according to a command from the original management apparatus. The mail relay apparatus according to claim 2.   The thumbnail image supply unit is configured for the one portable information terminal device so that the possession status of the thumbnail image in the one portable information terminal device handled by the user matches the possession status of the thumbnail image in the storage unit. 3. The mail relay apparatus according to claim 2, wherein control is performed so as to supply image data representing a thumbnail image held in the storage unit.   6. The mail relay device according to claim 5, wherein the thumbnail image supply unit controls the supply of image data representing a thumbnail image to the one portable information terminal device at a predetermined spontaneous timing.   The thumbnail image supply unit controls to supply image data representing a thumbnail image to the one portable information terminal device at a driven timing in accordance with a command from the one portable information terminal device. The mail relay device according to claim 5. An original image storage device for storing an image acquired from the outside as an original image for a user, and image data representing the stored original image from the original image storage device are installed so as to be acquired through a transmission path in the original image storage device. A mail relay device that holds duplicate images corresponding to the stored original images and thumbnail images accompanied by identification information corresponding to these duplicate images, and relays the transfer of images by e-mail between portable information terminal devices; A portable information terminal device compatible with an image communication system configured to include:
A thumbnail image storage unit that holds thumbnail images, and a thumbnail image possession status in the thumbnail image storage unit that is supplied with image data representing a thumbnail image from the mail relay device is a thumbnail image possession status in the mail relay device A portable information terminal device comprising: a control unit that controls a holding state of thumbnail images so as to match.   When the control unit transmits an image attached to an e-mail from the mobile information terminal device as its own device to another mobile information terminal device applied to the image communication system, the image to be transmitted is When the thumbnail image stored in the thumbnail image storage unit is selected by the thumbnail image, the identification information of the thumbnail image used for the selection of the image from the own device to the mail relay device is displayed as the image data of the thumbnail image itself. The portable information terminal device according to claim 8, wherein the portable information terminal device is controlled to transmit without accompanying. An original image storage device that stores an image acquired from the outside as an original image for a user and an information communication system that is configured to exchange information through the transmission path and configure the image communication system together with the original image storage device. Image data representing the original image stored from the storage device is acquired through the transmission path, and a duplicate image corresponding to the original image and each thumbnail image with identification information corresponding to the duplicate image are held and a portable information terminal An image transmission method using a mail relay device that relays transfer of images by electronic mail between devices,
In the mail relay device, the status of holding the duplicate image is updated with the update of the holding status of the corresponding thumbnail image so that the status of holding the duplicate image matches the storage status of each original image in the original image storage device. An updating step for updating, a thumbnail image supplying step for supplying a thumbnail image to one portable information terminal device handled by the user, and transmission from the one portable information terminal device to another portable information terminal device as an email attachment When the image to be selected is selected by the thumbnail image and the identification information of the selected thumbnail image is received at the time of transmission, the duplicate image corresponding to the thumbnail image identified by the received identification information is represented. An e-mail relaying step for transmitting image data to the other portable information terminal device. Image transmission method for.   Corresponding to the original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage device that stores the image acquired from the outside as the original image in the user Instruction to update the storage state of thumbnail images from a mail relay apparatus that holds duplicate images and thumbnail images with identification information corresponding to these duplicate images and relays the transfer of images by e-mail between portable information terminal devices , A procedure for requesting the mail relay device for data for updating the holding status of thumbnail images in the portable information terminal device, and a thumbnail image supplied from the mail relay device in response to the request Based on the data for updating the possession status, the thumbnail image of the portable information terminal device Programs and procedures for updating the chromatic situation, characterized in that it contains.   Corresponding to the original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage device that stores the image acquired from the outside as the original image in the user The portable information terminal device to a mail relay device that holds duplicate images and thumbnail images accompanied by identification information corresponding to the duplicate images and relays image transmission / reception between the portable information terminal devices by electronic mail And a procedure for requesting data for updating the thumbnail image possession status to the latest one, and when receiving data for updating the thumbnail image possession status to the latest one from the mail relay apparatus, based on the data Updating the possession status of thumbnail images in the portable information terminal device to the latest one. A program characterized by Dale. Corresponding to the original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage device that stores the image acquired from the outside as the original image in the user Portable information terminal using a mail relay device that holds duplicate images and thumbnail images accompanied by identification information corresponding to these duplicate images and relays the transfer of images by electronic mail between portable information terminal devices A program for sending e-mail from a device,
A procedure for accepting an e-mail transmission operation, a procedure for identifying an image attached to an e-mail that is the object of the transmission operation, and an identification information of a thumbnail image corresponding to the identified image is attached to the e-mail And a program for transmitting an electronic mail to which the identification information is attached.   Corresponding to the original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage device that stores the image acquired from the outside as the original image in the user Instruction to update the storage state of thumbnail images from a mail relay apparatus that holds duplicate images and thumbnail images with identification information corresponding to these duplicate images and relays the transfer of images by e-mail between portable information terminal devices , A procedure for requesting the mail relay device for data for updating the holding status of thumbnail images in the portable information terminal device, and a thumbnail image supplied from the mail relay device in response to the request Based on the data for updating the possession status, the thumbnail image of the portable information terminal device A procedure for updating the presence status, a procedure for accepting an operation for sending an e-mail, a procedure for identifying an image attached to an e-mail that is the object of the sending operation, and a thumbnail image corresponding to the identified image A program comprising: a procedure for attaching identification information to an e-mail; and a procedure for transmitting an e-mail with the identification information attached.   Corresponding to the original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage device that stores the image acquired from the outside as the original image in the user The portable information terminal device to a mail relay device that holds duplicate images and thumbnail images accompanied by identification information corresponding to the duplicate images and relays image transmission / reception between the portable information terminal devices by electronic mail And a procedure for requesting data for updating the thumbnail image possession status to the latest one, and when receiving data for updating the thumbnail image possession status to the latest one from the mail relay apparatus, based on the data A procedure for updating the possession status of the thumbnail image in the portable information terminal device to the latest one, A procedure for accepting an operation of sending a mail, a procedure for identifying an image attached to an e-mail that is the object of the operation for sending, and attaching identification information of a thumbnail image corresponding to the identified image to the e-mail And a program for transmitting an electronic mail to which the identification information is attached. Corresponding to the original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage device that stores the image acquired from the outside as the original image in the user Portable information terminal using a mail relay device that holds duplicate images and thumbnail images accompanied by identification information corresponding to these duplicate images and relays the transfer of images by electronic mail between portable information terminal devices A program for browsing images on a device,
A procedure for receiving an image browsing operation, a procedure for displaying browsing candidates as thumbnail images, a procedure for requesting data representing an image corresponding to one thumbnail image selected from the browsing candidates to the mail relay device, A program for displaying the image based on data representing the image supplied from the mail relay apparatus in response to the request. Corresponding to each original image stored in the original image storage device installed so that the image data representing the stored original image can be acquired through the transmission path from the original image storage for storing the image acquired from the outside as the original image in the user The corresponding duplicate images and the respective thumbnail images with their own identification information corresponding to the respective duplicate images are held together in a folder for those images, and by e-mail between the portable information terminal devices A program for organizing images in an image portable information terminal device using a mail relay device that relays the transfer of images,
A procedure for requesting the mail relay device to update the folder and the thumbnail image corresponding to the folder to the latest data, and the mail relay device to update the folder and the corresponding thumbnail image A program comprising: a procedure for receiving data for updating to a new one; and a procedure for updating the holding status of folders and thumbnail images to the latest based on the received data.

Images