JP2006293912A - Information display system, information display method and portable terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information display system which can display inherent information near each face image even when face images of a plurality of persons are present in an image being taken, and allows the relation between the person and the inherent information to be intuitively understood. <P>SOLUTION: A face image of a person is extracted from a moving image being taken and displayed on a cell phone, and is transmitted to a server, which is collated with a previously registered face image. Inherent information (name etc. ) on a person corresponding to the face image having matched in the collation is acquired to be transmitted, to the cell phone. The inherent information is displayed near a corresponding face image in the moving image being taken and displayed on the cell phone. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention extracts, for example, a human face image from a moving image captured and displayed by a mobile terminal device such as a mobile phone and transmits it to the host device, and collates it with a face image registered in advance in the host device. The unique information of the person corresponding to the face image that matches the collation is transmitted to the mobile terminal device, and the unique information is displayed in the vicinity of the corresponding face image in the moving image captured and displayed by the mobile terminal device. The present invention relates to an information display system, an information display method, and the information display system and portable terminal device used for the information display method.

Conventionally, for example, an image of a person photographed with a mobile phone is transmitted to a server and registered together with attribute information, and the attribute information of the image stored in the memory in the mobile phone is transmitted as a search key from the mobile phone to the server. The server searches the stored image for an image having substantially the same attribute information as the transmitted attribute information, transmits the searched image to the mobile phone, and displays it on the display unit of the mobile phone There is known an image search system that can be used (see, for example, Patent Document 1).
JP 2004-178018 A

  However, in the above-described conventional image search system, for example, a face image of a person extracted from a moving image captured by a mobile terminal device is transmitted to a server and collated with a face image already registered on the server side. When the unique information obtained by the collation is transmitted to the mobile terminal device and the unique information is displayed in the moving image captured and displayed by the mobile terminal device, there are the following problems.

  (1) When there are a plurality of face images in the image being photographed, it is difficult to intuitively understand to whom the unique information belongs unless the unique information is displayed in the vicinity of each face image.

  (2) When a person is moving during communication with the server or during face image collation at the server, it is difficult to display unique information in the vicinity of the face image.

Therefore, the present invention can display unique information in the vicinity of each face image even when there are a plurality of face images in the photographed image, and intuitively who the unique information is for. It is an object of the present invention to provide an information display system, an information display method, and a portable terminal device that can be understood.
In addition, the present invention provides an information display system, an information display method, and a mobile terminal device that can display unique information in the vicinity of a face image even when a person has moved before the unique information is acquired. The purpose is to do.

  The information display system according to the present invention includes a storage unit that stores a face image acquired from a person registered in advance and unique information in association with each other, an imaging unit that captures a moving image including at least the person, and an imaging unit. Display means for displaying the captured moving image, face extracting means for extracting the face image of the person from the moving image photographed by the photographing means, face image extracted by the face extracting means, and storage in the storage means A collation unit that collates the face image that has been determined and determines whether or not a face image that has a predetermined relationship with the extracted face image exists in the storage unit; When it is determined that a face image that has a predetermined relationship with the extracted face image exists in the storage unit, the specific information corresponding to the face image is acquired from the storage unit. Acquisition means, and unique information display control means for controlling to display the unique information acquired by the unique information acquisition means in the vicinity of the corresponding face image in the image displayed by the display means. .

  The information display system of the present invention includes a mobile terminal device carried by a user and a host device capable of communicating with the mobile terminal device, and the mobile terminal device includes a moving image including at least a person. Photographing means for photographing the image, display means for displaying a moving image photographed by the photographing means, face extracting means for extracting a face image of a person from the moving image photographed by the photographing means, and the face extracting means A first transmission unit that adds an identifier to the extracted face image and transmits the extracted face image to the host device. The host device associates the face image acquired from the person registered in advance with the unique information. A storing unit that stores the face image transmitted by the first transmitting unit of the portable terminal device together with an identifier added thereto; and a first receiving unit that receives the face image. The face image received by the means is collated with the face image stored in the storage means, and a face image having a predetermined relationship with the extracted face image exists in the storage means If it is determined that a face image in which a predetermined relationship is established between the matching unit for determining whether or not the face image extracted by the matching unit exists in the storage unit, the face image corresponds to the face image. Unique information acquisition means for acquiring unique information from the storage means, and unique information acquired by the unique information acquisition means with an identifier substantially the same as the identifier received by the first reception means added thereto A second transmission means for transmitting to the portable terminal device, the portable terminal device further receiving the unique information transmitted by the second transmission means of the host device together with an identifier added thereto. And a unique information display control for controlling to display the unique information received by the second receiving means in the vicinity of the face image of the corresponding identifier in the image displayed by the display means. Means.

  The information display method of the present invention includes a mobile terminal device carried by a user and a host device capable of communicating with the mobile terminal device, and the mobile terminal device captures a moving image including at least a person. A shooting step; a display step for displaying the moving image shot in the shooting step in the portable terminal device; and a face for extracting a human face image from the moving image shot in the shooting step in the portable terminal device. An extraction step; a first transmission step in which an identifier is added to the face image extracted in the face extraction step and transmitted to the host device in the portable terminal device; and the first transmission in the host device. A first receiving step for receiving the face image transmitted in the step together with an identifier added thereto; The face image received in the first receiving step is collated with the face image acquired from the person registered in advance and the face image stored in the storage means storing the unique information in association with each other. A collation step for determining whether or not a face image having a predetermined relationship with the extracted face image exists in the storage unit; and in the host device, the extraction is performed by the collation step. A unique information acquisition step of acquiring unique information corresponding to the face image from the storage means when it is determined that a face image having a predetermined relationship with the face image exists in the storage means; In the apparatus, the identifier substantially identical to the identifier received by the first reception step is added to the unique information acquired by the unique information acquisition step. A second transmitting step for transmitting to the portable terminal device; a second receiving step for receiving, in the portable terminal device, the unique information transmitted in the second transmitting step together with an identifier added thereto; A unique information display control step for controlling to display the unique information received in the second reception step in the vicinity of the face image of the corresponding identifier in the image displayed in the display step in the terminal device; is doing.

  Furthermore, the portable terminal device of the present invention is a portable terminal device that is carried by a user and can communicate with a host device that is a host, and a photographing means for photographing a moving image including at least a person, and photographing by the photographing means Display means for displaying the captured moving image, face extracting means for extracting a human face image from the moving image photographed by the photographing means, and adding an identifier to the face image extracted by the face extracting means Transmitting means for transmitting to the host device, receiving means for receiving the unique information of the person corresponding to the face image transmitted from the host device and transmitted by the transmitting means, and the unique information received by the receiving means Specific information display control means for controlling to display in the vicinity of the corresponding face image in the image displayed by the display means.

According to the present invention, it is possible to display unique information in the vicinity of each face image even when there are a plurality of face images in the photographed image, and intuitively who the unique information is for. Information display system, information display method, and portable terminal device can be provided.
In addition, according to the present invention, an information display system, an information display method, and a mobile terminal device that can display unique information in the vicinity of a face image even when a person has moved before the unique information is acquired. Can provide.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 schematically shows a configuration of an information display system according to the present embodiment. In FIG. 1, the information display system includes a mobile phone 10 as a mobile terminal device carried by a user, and a server 20 as a host device that can communicate with the mobile phone 10.

  A cellular phone 10 includes a digital camera (hereinafter simply referred to as a camera) 11 as a photographing unit, an operation unit 12 such as a keyboard, a liquid crystal display unit (hereinafter simply referred to as a display unit) 13 as a display unit, and a storage unit. And a communication unit 15 as a transmission unit and a reception unit, and a control unit 16 as a control unit for controlling them.

The camera 11 captures a desired moving image (or still image) and converts it into color image data. The camera 11 has a zoom function with a predetermined magnification, and includes, for example, a CCD type color digital camera.
The operation unit 12 and the display unit 13 perform display and input related to general operations as a mobile phone. The display unit 13 also displays an image photographed by the camera 11.

The memory 14 stores various information used for processing of the control unit 16. The memory 14 has a face image management table 17 as face image management means. In the face image management table 17, for example, as shown in FIG. 2, a unique identifier, position information of the face image, and a name as unique information are stored correspondingly.
The communication unit 15 communicates with the mobile phone line 30 during a call using the mobile phone 10, transmission / reception of mail, Internet communication, or the like.

  The control unit 16 is mainly composed of, for example, a CPU (Central Processing Unit) and controls the entire processing in the mobile phone 10. The control unit 16 also includes an image processing unit 18 that functions as a face extraction unit, a face image tracking unit, a face image management unit, and a unique information display control unit.

The server 20 includes a memory 21 as a storage unit, a communication unit 22 as a transmission unit and a reception unit, and a control unit 23 as a control unit for controlling them.
The memory 21 stores various information (programs and the like) necessary for control by the control unit 23. Further, the memory 21 has a database 24 as storage means. For example, as shown in FIG. 3, the database 24 stores a face image acquired from a person registered in advance and unique information in association with each other. Here, as the unique information, information on the name of the person corresponding to the face image, for example, a name is used in this embodiment.

The communication unit 22 communicates with the mobile phone line 30 when communicating with the mobile phone 10.
The control unit 23 is configured mainly by a CPU (Central Processing Unit), for example, and controls the entire processing in the server 20. In addition, the control unit 23 includes an image processing unit 25 that functions as a collation unit and unique information acquisition unit.

Next, the flow of operation in such a configuration will be described.
First, the initial setting will be described. In the server 20, for example, as shown in FIG. 3, a face image acquired from a person registered in advance in the database 24 and unique information (name) are registered (stored) in association with each other.

Next, face image extraction processing and face image transmission processing in the mobile phone 10 will be described with reference to the flowchart shown in FIG.
First, a moving image including at least a person is photographed by the camera 11 (step S1). Next, the image processing unit 18 extracts a human face image from the captured moving image (step S2). Here, the process of step S2 corresponds to the face extracting means in the present invention.
The face image extraction processing can be realized by, for example, a face position extraction method described in Japanese Patent Application Laid-Open No. 2004-185611. Briefly describing this face position extraction method, digital data of the values of each pixel in a target image area including a human face area is prepared, and six rectangular shapes are sequentially formed in the target image area. The position of the eyebrow candidate point is extracted by a filtering process using the combined eyebrow detection filter, and the target image is cut out with a predetermined size centered on the position of the extracted eyebrow candidate point. The face position is extracted by selecting a true candidate point from among the candidate points. For details, refer to the publication.

Next, the image processing unit 18 determines whether or not the extracted face image is the face image of the person being tracked (step S3), and if it is not the face image of the person being tracked, the face image management table 17 in the memory 14 is determined. The unique identifier and the position information of the face image are additionally stored (step S4). As the unique identifier, for example, an ID number assigned to each person from which a face image is extracted is used. Next, the image processing unit 18 tracks the person of the extracted face image (step S5). Here, the process of step S5 corresponds to the person tracking means in the present invention.
The person tracking process can be realized by, for example, a moving object tracking apparatus described in Japanese Patent Laid-Open No. 4-261290. Briefly describing this moving object tracking device, a change area of a moving object is extracted using an input time-series continuous image, rectangular information including the extracted change area is obtained, and this obtained The rectangular information is enlarged to rectangular information having a predetermined magnification, and a moving object is obtained by performing image processing on a corresponding region of an input time-series image based on the enlarged rectangular information. For details, see the publication. Next, the image processing unit 18 adds the identifier corresponding to the extracted face image and transmits it to the server 20 from the communication unit 15 (step S6). Here, the processing in step S6 corresponds to the first transmission means in the present invention. If the result of determination in step S3 is a face image of the person being tracked, the image processing unit 18 updates the position of the corresponding face image in the face image management table 17 to the position from which the latest face image was extracted (step S3). S7).

  When a plurality of face images are extracted, the process of FIG. 4 is repeatedly performed for each face image. After all the face images have been processed as shown in FIG. 4, unnecessary data (data that has not been newly added or updated) in the face image management table 17 is deleted.

Next, the face image matching process and the unique information acquisition process in the server 20 will be described with reference to the flowchart shown in FIG.
First, the image processing unit 23 receives a face image with an identifier transmitted from the mobile phone 10 in step S6 from the communication unit 22 (step S11). Here, the processing in step S11 corresponds to the first receiving means in the present invention.

  Next, the image processing unit 23 collates the received face image with the face image stored in the database 24 in the memory 21 (step S12), and a predetermined relationship is established between the received face image. It is determined whether there is a face image in the database 24, for example, a face image that matches the received face image in this embodiment (step S13). Here, the processing in steps S12 and S13 corresponds to the collating means in the present invention.

  If the result of determination in step S <b> 13 is that a face image that matches the received face image exists in the database 24, the image processing unit 23 acquires unique information (name) corresponding to the matching face image from the database 24. (Step S14). Here, the process of step S14 corresponds to the unique information acquisition means in the present invention.

  Next, the image processing unit 23 adds the acquired unique information to the identifier that is substantially the same as the identifier received in step S11, for example, the identifier received in step S11 in this embodiment, and adds the identifier to the communication unit 22. Is transmitted to the mobile phone 10 (step S15), and the process ends. Here, the processing in step S15 corresponds to the second transmission means in the present invention.

  As a result of the determination in step S13, if there is no face image that matches the received face image in the database 24, the image processing unit 23 is information indicating that the identifier received in step S11 is not matched. For example, the information “cannot be verified” is added and transmitted from the communication unit 22 to the mobile phone 10 (step S16), and the process is terminated.

Next, the storage process of the specific information in the mobile phone 10 will be described with reference to the flowchart shown in FIG.
First, the image processing unit 18 uses the collation result information transmitted from the server 20 (the unique information with the identifier transmitted at step S15 or the information with the identifier transmitted at step S16 “unmatchable”) as a communication unit. 15 (step S21). Here, the processing of step S21 corresponds to the second receiving means in the present invention.

Next, the image processing unit 18 adds the received verification result information to the corresponding identifier position in the face image management table 17 (step S22). For example, when the received collation result information is unique information with an identifier transmitted in step S15, the received unique information (name) is added (added) to the face image having the corresponding identifier as shown in FIG. To do. If the received collation result information is the information “identification impossible” with the identifier transmitted in step S16, the received information “collation is impossible” is added to the face image having the corresponding identifier as shown in FIG. (to add. Next, a captured image and unique information display process in the mobile phone 10 will be described with reference to a flowchart shown in FIG.
First, the image processing unit 18 displays a moving image captured by the camera 11 on the display unit 13 (step S31). Here, the process of step S31 corresponds to the display means in the present invention.

Next, the image processing unit 18 displays the unique information in the face image management table 17 in the vicinity of the face image of the corresponding identifier in the image displayed on the display unit 13 (step S32). Here, the processing in step S32 corresponds to the unique information display control means in the present invention.
FIG. 8 shows an example of a display screen on the display unit 13. In the figure, reference numerals 31 to 35 indicate persons photographed and displayed, and reference numerals 41 to 43 indicate unique information (names) displayed in the vicinity of the face images of the persons 31 to 33. In the example of FIG. 8, the persons 34 and 35 are in the case where the collation result is “cannot be collated” or the unique information (name) has not yet been acquired, and therefore the unique information is not displayed. Absent.
Note that the processing of FIG. 7 is performed at predetermined time intervals.

As described above, according to the above embodiment, the face image of the person extracted from the moving image captured by the mobile phone is transmitted to the server and collated with the face image already registered on the server side. The unique information obtained by the collation can be transmitted to the mobile phone, and the unique information can be displayed in the moving image photographed and displayed by the mobile phone. In this case, even when there are a plurality of face images in the image being photographed, the unique information can be displayed in the vicinity of each face image, and it is intuitively understood to whom the unique information belongs.
Also, since the person is tracked from the captured moving image and the face image of the person being tracked is managed, the person being photographed is communicating with the mobile phone and the server, or the face image on the server is verified. Even when moving during the process, the unique information can be reliably displayed in the vicinity of the face image.

  In the above-described embodiment, a case has been described in which a server having a database in which face images and unique information are registered is provided separately from the mobile phone, and face image matching processing and unique information acquisition processing are performed in the server. However, the present invention is not limited to this, and a database in which face images and unique information are registered is provided in the mobile phone, and face image matching processing and unique information acquisition processing are performed in the mobile phone. The same applies. This eliminates the need for a server.

  In the above-described embodiment, the case where the mobile terminal device is a mobile phone has been described. However, the present invention is not limited to this, and for example, a mobile terminal device referred to as a PDA is similarly used. Applicable.

1 is a block diagram schematically showing a configuration of an information display system according to an embodiment of the present invention. The figure which shows an example of a face image management table. The figure which shows an example of a database. The flowchart explaining the face image extraction process and face image transmission process in a mobile telephone. The flowchart explaining the face image collation process and specific information acquisition process in a server. The flowchart explaining the preservation | save process of the specific information in a mobile telephone. 10 is a flowchart for explaining a display process of a captured image and unique information in the mobile phone. The figure which shows an example of the display screen in a display part.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Mobile phone (mobile terminal device), 20 ... Server (host device), 30 ... Mobile phone line, 11 ... Camera (photographing means), 12 ... Operation part, 13 ... Liquid crystal display part (display means), 14 ... Memory (Storage means), 15 ... communication part (transmission means, reception means), 16 ... control part (control means), 21 ... memory (storage means), 22 ... communication part (transmission means, reception means), 23 ... control part (Control means).

Claims (11)

Storage means for storing a face image acquired from a person registered in advance and unique information in association with each other;
Photographing means for photographing a moving image including at least a person;
Display means for displaying a moving image photographed by the photographing means;
Face extraction means for extracting a human face image from a moving image photographed by the photographing means;
The face image extracted by the face extraction means and the face image stored in the storage means are collated, and a face image having a predetermined relationship with the extracted face image is stored in the storage means. Collating means for determining whether or not it exists,
When it is determined that a face image having a predetermined relationship with the extracted face image is present in the storage unit by the collating unit, unique information corresponding to the face image is acquired from the storage unit. Specific information acquisition means;
Unique information display control means for controlling to display the unique information acquired by the unique information acquisition means in the vicinity of the corresponding face image in the image displayed by the display means;
An information display system comprising: Storage means for storing a face image acquired from a person registered in advance and unique information in association with each other;
Photographing means for photographing a moving image including at least a person;
Display means for displaying a moving image photographed by the photographing means;
Face extraction means for extracting a human face image from a moving image photographed by the photographing means;
A person tracking means for tracking a person whose face image is extracted by the face extraction means in the moving image photographed by the photographing means;
Face image management means for managing a face image of a person tracked by the person tracking means;
The face image extracted by the face extraction means and the face image stored in the storage means are collated, and a face image that has a predetermined relationship with the extracted face image is stored in the storage means. Collating means for determining whether or not it exists,
When it is determined that a face image having a predetermined relationship with the extracted face image is present in the storage unit by the collating unit, unique information corresponding to the face image is acquired from the storage unit. Specific information acquisition means;
Unique information display control means for controlling the unique information acquired by the unique information acquisition means to be displayed in the vicinity of the corresponding face image in the image displayed by the display means based on the management content of the face image management means. When,
An information display system comprising: A mobile terminal device carried by the user and a host device capable of communicating with the mobile terminal device;
The portable terminal device
Photographing means for photographing a moving image including at least a person;
Display means for displaying a moving image photographed by the photographing means;
Face extraction means for extracting a human face image from a moving image photographed by the photographing means;
First transmitting means for adding an identifier to the face image extracted by the face extracting means and transmitting the face image to the host device;
The host device is
Storage means for storing a face image acquired from a person registered in advance and unique information in association with each other;
First receiving means for receiving the face image transmitted by the first transmitting means of the portable terminal device together with an identifier added thereto;
The face image received by the first receiving means is collated with the face image stored in the storage means, and a face image that establishes a predetermined relationship with the extracted face image is the storage means. Collation means for determining whether or not it exists in
When it is determined that a face image having a predetermined relationship with the extracted face image is present in the storage unit by the collating unit, unique information corresponding to the face image is acquired from the storage unit. Specific information acquisition means;
Second transmission means for transmitting the unique information acquired by the unique information acquisition means to the portable terminal device with an identifier substantially the same as the identifier received by the first reception means added thereto. And
The portable terminal device further includes:
Second receiving means for receiving the unique information transmitted by the second transmitting means of the host device together with an identifier added thereto;
Characteristic information display control means for controlling to display the unique information received by the second receiving means in the vicinity of the face image of the corresponding identifier in the image displayed by the display means. Information display system. A mobile terminal device carried by the user and a host device capable of communicating with the mobile terminal device;
The portable terminal device
Photographing means for photographing a moving image including at least a person;
Display means for displaying a moving image photographed by the photographing means;
Face extraction means for extracting a human face image from a moving image photographed by the photographing means;
A person tracking means for tracking a person whose face image is extracted by the face extraction means in the moving image photographed by the photographing means;
Face image management means for managing a face image of a person tracked by the person tracking means;
First transmitting means for adding an identifier to the face image extracted by the face extracting means and transmitting the face image to the host device;
The host device is
Storage means for storing a face image acquired from a person registered in advance and unique information in association with each other;
First receiving means for receiving the face image transmitted by the first transmitting means of the portable terminal device together with an identifier added thereto;
The face image received by the first receiving means is collated with the face image stored in the storage means, and a face image that establishes a predetermined relationship with the extracted face image is the storage means. Collation means for determining whether or not it exists in
When it is determined that a face image having a predetermined relationship with the extracted face image is present in the storage unit by the collating unit, unique information corresponding to the face image is acquired from the storage unit. Specific information acquisition means;
Second transmission means for transmitting the unique information acquired by the unique information acquisition means to the portable terminal device with an identifier substantially the same as the identifier received by the first reception means added thereto. And
The portable terminal device further includes:
Second receiving means for receiving the unique information transmitted by the second transmitting means of the host device together with an identifier added thereto;
Unique information for controlling to display the unique information received by the second receiving means in the vicinity of the face image of the corresponding identifier in the image displayed by the display means based on the management content of the face image managing means An information display system comprising display control means.   The information display system according to any one of claims 1 to 4, wherein the unique information is information related to a person's name corresponding to a corresponding face image.   5. The information display system according to claim 3, wherein the portable terminal device is a cellular phone. A portable terminal device carried by the user and a host device capable of communicating with the portable terminal device;
In the mobile terminal device, a shooting step of shooting a moving image including at least a person;
In the mobile terminal device, a display step for displaying the moving image photographed in the photographing step;
In the mobile terminal device, a face extraction step of extracting a person's face image from the moving image photographed in the photographing step;
In the portable terminal device, a first transmission step of transmitting the face image extracted in the face extraction step to the host device with an identifier added thereto,
In the host device, a first reception step of receiving the face image transmitted in the first transmission step together with an identifier added thereto;
In the host device, the face image received in the first receiving step, the face image acquired from the person registered in advance and the face image stored in the storage means storing the unique information in association with each other. A collation step of collating and determining whether or not a face image having a predetermined relationship with the extracted face image exists in the storage unit;
In the host device, when it is determined that a face image having a predetermined relationship with the face image extracted by the collating step exists in the storage unit, the unique information corresponding to the face image is A unique information acquisition step acquired from the storage means;
In the host device, the unique information acquired in the unique information acquisition step is added to the identifier substantially the same as the identifier received in the first reception step and transmitted to the portable terminal device. Sending step;
In the mobile terminal device, a second reception step of receiving the unique information transmitted in the second transmission step together with an identifier added thereto;
A unique information display control step for controlling to display the unique information received in the second reception step in the vicinity of the face image of the corresponding identifier in the image displayed in the display step in the portable terminal device; ,
An information display method characterized by comprising: A portable terminal device carried by the user and a host device capable of communicating with the portable terminal device;
In the mobile terminal device, a shooting step of shooting a moving image including at least a person;
In the mobile terminal device, a display step for displaying the moving image photographed in the photographing step;
In the mobile terminal device, a face extraction step of extracting a person's face image from the moving image photographed in the photographing step;
In the mobile terminal device, a person tracking step of tracking a person whose face image is extracted by the face extracting means in a moving image shot by the shooting means;
In the portable terminal device, a face image management step for managing a face image of a person tracked by the person tracking step;
In the portable terminal device, a first transmission step of transmitting the face image extracted in the face extraction step to the host device with an identifier added thereto,
In the host device, a first reception step of receiving the face image transmitted in the first transmission step together with an identifier added thereto;
In the host device, the face image received in the first receiving step, the face image acquired from the person registered in advance and the face image stored in the storage means storing the unique information in association with each other. A collation step of collating and determining whether or not a face image having a predetermined relationship with the extracted face image exists in the storage unit;
In the host device, when it is determined that a face image having a predetermined relationship with the face image extracted by the collating step exists in the storage unit, the unique information corresponding to the face image is A unique information acquisition step acquired from the storage means;
In the host device, the unique information acquired in the unique information acquisition step is added to the identifier substantially the same as the identifier received in the first reception step and transmitted to the portable terminal device. Sending step;
In the mobile terminal device, a second reception step of receiving the unique information transmitted in the second transmission step together with an identifier added thereto;
In the portable terminal device, the unique information received in the second receiving step is displayed in the vicinity of the face image of the corresponding identifier in the image displayed by the display step based on the management content of the face image management step. A unique information display control step for controlling
An information display method characterized by comprising: A portable terminal device carried by a user and capable of communicating with a host device that is a host,
Photographing means for photographing a moving image including at least a person;
Display means for displaying a moving image photographed by the photographing means;
Face extraction means for extracting a human face image from a moving image photographed by the photographing means;
Transmitting means for adding the identifier to the face image extracted by the face extracting means and transmitting it to the host device;
Receiving means for receiving the unique information of the person corresponding to the face image transmitted by the transmitting means, transmitted from the host device;
Unique information display control means for controlling the unique information received by the receiving means to be displayed in the vicinity of the corresponding face image in the image displayed by the display means;
A portable terminal device comprising: A portable terminal device carried by a user and capable of communicating with a host device that is a host,
Photographing means for photographing a moving image including at least a person;
Display means for displaying a moving image photographed by the photographing means;
Face extraction means for extracting a human face image from a moving image photographed by the photographing means;
A person tracking means for tracking a person whose face image is extracted by the face extraction means in the moving image photographed by the photographing means;
Face image management means for managing a face image of a person tracked by the person tracking means;
Transmitting means for adding an identifier to the face image extracted by the face extracting means and transmitting it to the host device;
Receiving means for receiving the unique information of the person corresponding to the face image transmitted by the transmitting means, transmitted from the host device;
Unique information display control means for controlling the unique information received by the receiving means to be displayed in the vicinity of the face image of the corresponding identifier in the image displayed by the display means based on the management content of the face image managing means. When,
A portable terminal device comprising:   11. The mobile terminal device according to claim 9, wherein the mobile terminal device is a mobile phone.

Images