JP2015056772A - Image processing device, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform proper processing while content of an image to be disclosed is considered.SOLUTION: A mobile terminal 100 comprises: a subject determination section 7b for determining whether or not an image of a specific subject which is stored in a storage section 6 is included in a disclosure target image to be disclosed in a browsable state through a predetermined communication network N; and a first processing content determination section 7d for determining processing content for the disclosure target image on the basis of related information stored in a storage section which associates with the image of the specific subject and a disclosure level indicating the range in which the disclosure target image is permitted to be disclosed to the outside, when it is determined that the image of the specific subject is included.

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

  2. Description of the Related Art Conventionally, when a captured image is disclosed to the outside via a communication network, a technique for setting a disclosure level indicating a range in which disclosure is permitted for an image is known in advance (see, for example, Patent Document 1).

JP 2007-235239 A

  However, in the case of the above-mentioned patent document 1, since the disclosure level of the image is set by specifying the imaging mode associated with the disclosure level in advance, it may be set depending on the content of the captured image. There is a problem that the disclosure level of the user is different from that desired by the user.

  The present invention has been made in view of such problems, and an object of the present invention is to provide an image processing apparatus, an image processing method, and a program capable of performing appropriate processing in consideration of the contents of an image to be disclosed. Is to provide.

In order to solve the above problems, an image processing apparatus according to the present invention provides:
Storage means for associating and storing an image of a specific subject and related information related to the specific subject; acquisition means for acquiring a disclosure target image that can be disclosed in a viewable state via a predetermined communication network; Determining means for determining whether the image to be disclosed acquired by the acquiring means includes an image of the specific subject stored in the storage means; and the specific subject by the determining means If the image is included, the related information stored in the storage means in association with the image of the specific subject, and a range in which the disclosure target image is allowed to be released to the outside. And determining means for determining the processing content for the image to be disclosed based on the disclosed level.

The image processing method according to the present invention includes:
An image processing method using an image processing apparatus including a storage unit that stores an image of a specific subject and related information related to the specific subject in association with each other, and is viewable via a predetermined communication network A process of acquiring a disclosure target image that can be disclosed to the public, a process of determining whether or not the acquired disclosure target image includes an image of the specific subject stored in the storage unit, When it is determined that an image of a specific subject is included, the related information stored in the storage unit in association with the image of the specific subject and the disclosure target image are allowed to be released to the outside. And a process of determining a processing content for the image to be disclosed based on a disclosure level indicating a range to be performed.

The program according to the present invention is
An object to be disclosed that can be disclosed in a state where a computer of an image processing apparatus including a storage unit that stores an image of a specific subject and related information related to the specific subject in association with each other can be browsed via a predetermined communication network An acquisition unit that acquires an image, a determination unit that determines whether the image of the specific subject stored in the storage unit is included in the disclosure target image acquired by the acquisition unit, and the determination unit If it is determined that the image of the specific subject is included, the related information stored in association with the image of the specific subject in the storage unit and the disclosure target image to the outside are disclosed. Based on a disclosure level indicating a range in which the image is permitted, and functioning as a determination unit that determines the processing content for the disclosure target image.

  According to the present invention, appropriate processing can be performed in consideration of the contents of an image to be disclosed.

It is a figure which shows typically the portable terminal of Embodiment 1 to which this invention is applied. It is a block diagram which shows schematic structure of the portable terminal of FIG. It is a figure which shows typically an example of the face registration table memorize | stored in the portable terminal of FIG. It is a figure which shows typically an example of the 1st process content table memorize | stored in the portable terminal of FIG. 3 is a flowchart illustrating an example of an operation related to a public image transmission process by the mobile terminal of FIG. 1. It is a block diagram which shows schematic structure of the portable terminal of Embodiment 2 to which this invention is applied. It is a figure which shows typically an example of the 2nd process content table memorize | stored in the portable terminal of FIG. It is a flowchart which shows an example of the operation | movement which concerns on the public image transmission process by the portable terminal of FIG.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

[Embodiment 1]
FIG. 1 is a diagram schematically illustrating a mobile terminal 100 according to a first embodiment to which the present invention is applied, and FIG. 2 is a block diagram illustrating a schematic configuration of the mobile terminal 100.
As shown in FIG. 1, the mobile terminal 100 of the present embodiment is connected to a server (external device) 200 via a predetermined communication network N (see FIG. 2) so that information communication is possible.

Here, the server 200 has a function of opening a Web page (for example, an information sharing page) on the Internet as a Web (World Wide Web) server, for example. Specifically, the server 200 responds to access from the mobile terminal 100 or another user's terminal with respect to the terminal, for example, page information and content information (for example, various SNS (Social Networking Service) Web pages). , Image information) and the like. The server 200 receives content information such as various image information transmitted from each terminal and publishes it on a Web page.
That is, the content information published on the web page established by the server 200 is in a state that can be browsed by a user of a terminal that can access the web page via the communication network N. Then, content information transmitted from the server 200 in response to access from each terminal is received and acquired by the terminal, so that the content information is shared by a plurality of terminals that have acquired the content information.

  The server 200 may have any configuration as long as it is configured from a computer connectable to the communication network N, and detailed description thereof is omitted.

As illustrated in FIG. 2, the mobile terminal 100 includes a central control unit 1, a memory 2, an imaging unit 3, an imaging control unit 4, an image data generation unit 5, a storage unit 6, and a disclosure target processing unit 7. A display unit 8, a display control unit 9, a transmission / reception unit 10, a communication control unit 11, an operation input unit 12, and the like.
The central control unit 1, the memory 2, the imaging unit 3, the imaging control unit 4, the image data generation unit 5, the storage unit 6, the disclosure target processing unit 7, the display control unit 9, the transmission / reception unit 10, and the communication control unit 11 Are connected via a bus line 13.

  The mobile terminal 100 includes, for example, a smartphone, an imaging device, a mobile station used in a mobile communication network such as a mobile phone or a PHS (Personal Handy-phone System), a PDA (Personal Data Assistants), and the like.

  The central control unit 1 controls each unit of the mobile terminal 100. Specifically, the central control unit 1 includes a CPU (Central Processing Unit; not shown) that controls each part of the mobile terminal 100, and performs various control operations according to various processing programs (not shown) for the mobile terminal 100. Do.

  The memory 2 is composed of, for example, a DRAM (Dynamic Random Access Memory) or the like. The memory 2 stores a buffer memory that temporarily stores data processed by the central control unit 1 and the like, a working memory such as the central control unit 1, and various programs and data related to the functions of the mobile terminal 100. A program memory (not shown).

The imaging unit 3 includes a lens unit 3a and an electronic imaging unit 3b.
The lens unit 3a includes a plurality of lenses such as a zoom lens and a focus lens.
The electronic imaging unit 3b is composed of, for example, an image sensor such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS), and converts an optical image that has passed through various lenses of the lens unit 3a into a two-dimensional image signal. To do.
In addition, although illustration is abbreviate | omitted, the imaging part 3 may be provided with the aperture_diaphragm | restriction which adjusts the quantity of the light which passes the lens part 3a.

The imaging control unit 4 controls the imaging of the subject by the imaging unit 3. That is, the imaging control unit 4 includes a timing generator, a driver, and the like, although not illustrated. Then, the imaging control unit 4 scans and drives the electronic imaging unit 3b with a timing generator and a driver, converts the optical image into a two-dimensional image signal with the electronic imaging unit 3b at a predetermined period, and the electronic imaging unit 3b. The frame image is read out from the imaging area for each screen and is output to the image data generation unit 5.
In addition, the imaging control unit 4 performs adjustment control of imaging conditions of the subject such as AF (automatic focusing process), AE (automatic exposure process), AWB (automatic white balance), and the like.

  The image data generation unit 5 appropriately adjusts the gain for each color component of RGB with respect to the analog value signal of the frame image transferred from the electronic image pickup unit 3b, and then samples and holds it by a sample hold circuit (not shown). The digital signal is converted into digital data by a / D converter (not shown), color processing including pixel interpolation processing and γ correction processing is performed by a color process circuit (not shown), and then a digital luminance signal Y and color difference signal Cb , Cr (YUV data).

  Then, the image data generation unit 5 sequentially outputs the generated YUV data of each frame image to the memory 2 and stores it in the memory 2.

  The storage unit 6 stores a storage medium 6a, a face registration table 6b, and a first processing content table 6c.

  The storage medium 6a is composed of, for example, a nonvolatile memory (flash memory) or the like, and is an image encoded in a predetermined compression format (for example, JPEG format) by an encoding unit (not shown) of the image data generation unit 5. Store the data.

The face registration table (storage means) 6b stores an image of a specific subject (face image) and related information related to the specific subject in association with each other (see FIG. 3).
That is, the face registration table 6b stores a face image including a face and person-related information (for example, gender, age, human relationship, etc.) associated with a person who has the face of the face image in association with each other. Specifically, the face registration table 6b includes information for identifying a storage address, image data of a face image including a face, information indicating the gender of a person having a face in the face image, and an adult or minor. Is stored in association with information representing the age that defines whether the terminal is relevant, human relationship information that represents the human relationship with the user of the terminal body, and a public setting flag that defines whether the terminal is open or not (ON / OFF). .

For example, as shown in FIG. 3, the storage address “0” stores information such as male, 30 years old (aged), and public setting flag “ON” in association with the face image of the user of the terminal body. ing. The storage address “1” stores information such as female, 28 years old (adult), and public setting flag “ON” in association with the face image of the user's family. The storage address “2” stores information such as male, age 24 (adult), and public setting flag “ON” in association with the face image of the friend of the user.
Note that the face registration table 6b illustrated in FIG. 3 is an example and is not limited thereto, and the human relationship information and the like can be arbitrarily changed as appropriate.

The first processing content table 6c is a table used for determining the content of image processing for a disclosure target image by a first processing content determination unit 7d (described later) (see FIG. 4).
That is, the first processing content table 6c stores the disclosure level content indicating the range that is allowed to be disclosed to the outside, the attribute of the person related to the disclosure target image, and the image processing content for the disclosure target image in association with each other. ing.

  The contents of the public level include, for example, “public to all” in which all persons are made public (without disclosure), and “direct friends” in which the public is limited to the user's direct friends. , "Friends of friends" that limit the release destination to the friends of the user's friends, "Circle friends" that limit the release destination to friends of the community to which the user belongs or is related, such as circles, “Parents” that are limited to their parents, “only me” that limits the disclosure destination to the user itself, “hidden to a specific person” that does not specify a specific person as the disclosure destination, and the like.

  For example, “self”, “female”, “male”, “underage”, and the like are classified into large categories as attributes of the person related to the disclosure target image. Among these, in the case where the attribute of the person related to the disclosure target image is “self”, that is, the user himself / herself, the attribute is further classified according to gender. In addition, if the attribute of the person related to the image to be disclosed is “female”, “male”, “minor”, it is further classified according to “family”, “friend”, “friend family” .

Examples of the contents of the image processing for the disclosure target image include “no processing” that does not apply any processing to the disclosure target image, and “skin-beautification processing” that adjusts the skin color and brightness of the face of the person in the disclosure target image. “Illustration-like processing” or the like that processes the face of a person in the image to be disclosed into an illustration.
In the first processing content table 6c shown in FIG. 4, “illustration-like processing” is abbreviated as “illustration-like”.

Specifically, for example, as illustrated in FIG. 4, the first processing content table 6 c defines image processing content for the disclosure target image according to the disclosure level content and the attribute of the person related to the disclosure target image. Yes. That is, the image processing content for the disclosure target image is defined in consideration of the human relationship with the user of the terminal body, for example.
Note that the first processing content table 6c illustrated in FIG. 4 is an example and is not limited thereto. The content of the disclosure level, the attributes of the person related to the disclosure target image, the image processing content for the disclosure target image, and the like are as follows. It can be arbitrarily changed as appropriate.

  That is, when the content of the disclosure level is “public to all”, “illustration-like processing” is associated as the image processing content regardless of the attribute of the person related to the disclosure target image.

In addition, when the content of the public level is “direct friend” and “friend of friend” and the attribute of the person related to the image to be published is “self (male)”, “unprocessed” is associated as the image processing content. On the other hand, when the attribute of the person related to the disclosure target image is “self (female)”, “skin processing” is associated as the image processing content.
In addition, when the public level content is “direct friend” and “friend friend” and the attribute of the person related to the public image is “the family of the person (regardless of gender or minor)” “Illustration processing” is associated with the image processing content.
Moreover, the contents of the public level are “direct friend” and “friend of friend”, and the attributes of the person related to the public image are “self (female)”, “friend (female)”, and “family of friends” In the case of “(woman)”, “skin processing” is associated as the image processing content.
In addition, the contents of the public level are “direct friend” and “friend of friend”, and the attributes of the person related to the image to be disclosed are “self (male)”, “friend (male and minor)”, “friend's In the case of “family (male and minor)”, “no processing” is associated as the image processing content.

In addition, when the content of the disclosure level is “Circle friends” and the attribute of the person related to the disclosure target image is “self (male)”, the image processing content is associated with “no processing”, while When the attribute of the person related to the target image is “self (female)”, “skin processing” is associated as the image processing content.
Furthermore, the content of the public level is “Circle friends”, the attribute of the person related to the public image is “Person's family (whether or not gender minor)”, “Friend family (gender or minor) "No matter whether or not)", "illustration-like processing" is associated as the image processing content.
In addition, when the content of the disclosure level is “Circle friend”, and the attribute of the person related to the disclosure target image is “Principal (female)”, “Friend (female)”, “Beautiful skin processing” is associated as the image processing content. In the case of “a friend's family (regardless of gender or minor)”, “illustration processing” is associated with the image processing content.
Also, if the content of the public level is “Circle friends” and the attribute of the person related to the public image is “Friend (male)” or “Minor (friend)”, “Unprocessed” is supported as the image processing content It is attached.

Further, when the content of the disclosure level is “parents” and the attribute of the person related to the disclosure target image is “self (male)”, “unprocessed” is associated as the image processing content, while the disclosure target image When the attribute of the person related to is “self (female)”, “skin treatment” is associated as the image processing content.
Furthermore, when the content of the disclosure level is “parent” and the attribute of the person related to the image to be disclosed is “female (family, friend, family of friends)”, “skin treatment” is associated as the image processing content. On the other hand, if the attribute of the person related to the image to be disclosed is “male (family, friend, family of friends)” or “minor (family, friend, family of friends)”, the image processing content “Unprocessed” is associated.

  When the content of the disclosure level is “only me”, “no processing” is associated as the image processing content regardless of the attribute of the person related to the disclosure target image.

  In addition, when the content of the disclosure level is “hidden for a specific person”, “illustration processing” is associated as the image processing content regardless of the attribute of the person related to the disclosure target image.

The disclosure target processing unit 7 includes an image acquisition unit 7a, a subject determination unit 7b, a disclosure level setting unit 7c, a first processing content determination unit 7d, an image processing unit 7e, and the like.
Each unit of the disclosure target processing unit 7 is configured by, for example, a predetermined logic circuit, but the configuration is an example and is not limited thereto.

The image acquisition unit 7a acquires a disclosure target image.
That is, the image acquisition unit (acquisition means) 7a acquires a disclosure target image that can be disclosed in a viewable state via a predetermined communication network N. Specifically, the image acquisition unit 7a acquires a copy of image data of a predetermined resolution of an image captured by the imaging unit 3 and generated by the image data generation unit 5 from the memory 2 as a disclosure target image. The image acquisition unit 7a acquires a copy of any image data selected based on a predetermined operation of the operation input unit 12 by the user from among the image data stored in the storage medium 6a. To do.

The subject determination unit 7b determines whether a face image is included in the disclosure target image.
That is, the subject determination unit (determination unit) 7b includes the face image (image of a specific subject) stored in the face registration table 6b of the storage unit 6 in the disclosure target image acquired by the image acquisition unit 7a. Judge whether or not. Specifically, the subject determination unit 7b performs predetermined face detection processing on the image data of the disclosure target image, and determines whether or not the detected face image is registered in the face registration table 6b.
Since the face detection process is a known technique, detailed description thereof is omitted here.

The disclosure level setting unit 7c sets the disclosure level of the disclosure target image.
That is, the disclosure level setting unit (setting unit) 7c sets in advance a disclosure level indicating a range in which disclosure of the disclosure target image is permitted. Specifically, when the subject determination unit 7b determines that an image (for example, a face image) of a specific subject is included, the disclosure level setting unit 7c stores the specification in the face registration table 6b of the storage unit 6. Based on the person related information stored in association with the subject image of the subject, a disclosure level indicating a range in which the disclosure target image is permitted to be released to the outside is set.
For example, the public level setting unit 7c refers to the face registration table 6b in the storage unit 6 and relates to person related information (for example, age, gender, human relationship) associated with the face image included in the public image. Information). Then, the public level setting unit 7c sets the public level based on a predetermined operation of the operation input unit 12 by the user from among various public levels associated with the specified person related information. For example, the display control unit 9 displays various public levels associated with the specified person-related information on the display unit 8, and the public level setting unit 7c is based on a predetermined operation of the operation input unit 12 by the user. To set the desired level of disclosure.
The public level setting unit 7c may set the public level desired by the user based on a predetermined operation of the operation input unit 12 by the user when the person related information is not specified.

The first processing content determination unit 7d determines the content of the image processing for the disclosure target image.
That is, the first processing content determination unit (determination unit) 7d determines that the subject determination unit 7b includes an image (for example, a face image) of a specific subject, the face registration table 6b of the storage unit 6 On the basis of the person related information stored in association with the image of the specific subject and the disclosure level indicating the range in which the disclosure target image is permitted to be released to the outside. Determine the content of the image processing. Specifically, the first processing content determination unit 7d determines the content of the image processing for the disclosure target image by the image processing unit 7e based on the disclosure level set by the disclosure level setting unit 7c.
For example, when the person-related information in the face registration table 6b includes information (for example, the person, family, etc.) representing the human relationship with the user of the terminal body, the first processing content determination unit 7d Referring to the 1 processing content table 6c, the content of the image processing (for example, the face area in the image) (for example, the face area in the image) according to the person related information (especially information representing human relations) and the disclosure level. (Illustration processing, skin treatment processing, etc.) are determined. Here, for example, when the person-related information in the face registration table 6b includes information representing a woman as a gender, the face image detected from within the disclosure target image is associated with information representing a woman. The first processing content determination unit 7d determines the content (for example, skin beautification processing) of the image processing for the face area in the disclosure target image according to the disclosure level set by the disclosure level setting unit 7c.

The image processing unit (processing unit) 7e performs predetermined image processing on the disclosure target image.
That is, for example, the image processing unit 7e performs predetermined skin processing processing for adjusting the skin color and brightness of the face of the subject, art conversion processing for converting the image into an illustration-like processing, etc. Apply image processing to add visual effects.
Here, image processing such as skin beautification processing and art conversion processing is processing for processing the disclosure target image into images having various visual effects. Specifically, for example, it is realized by processing substantially similar to processing using known image processing-related software, and by changing hue, saturation, brightness, etc. in the HSV color space, and using various filters. Although it is performed, since it is a well-known technique, detailed description is abbreviate | omitted.

  The display unit 8 is composed of, for example, a liquid crystal display panel, and displays an image (for example, a live view image) captured by the imaging unit 3 based on a video signal from the display control unit 9 on a display screen.

The display control unit 9 performs control to read out display image data temporarily stored in the memory 2 and display it on the display unit 8.
Specifically, the display control unit 9 includes a VRAM (Video Random Access Memory), a VRAM controller, a digital video encoder, and the like. The digital video encoder reads the luminance signal Y and the color difference signals Cb and Cr read from the memory 2 and stored in the VRAM (not shown) under the control of the central control unit 1 through the VRAM controller. Are read out at a predetermined playback frame rate (for example, 30 fps), and a video signal is generated based on these data and output to the display unit 8.

The transmitter / receiver unit 10 performs a call with an external user of an external device connected via the communication network N.
Specifically, the transmission / reception unit 10 includes a microphone 10a, a speaker 10b, a data conversion unit 10c, and the like. The transmission / reception unit 10 performs A / D conversion processing on the user's transmission voice input from the microphone 10a by the data conversion unit 10c and outputs the transmission voice data to the central control unit 1. Under the control, voice data such as received voice data outputted and inputted from the communication control unit 11 is D / A converted by the data conversion unit 10c and outputted from the speaker 10b.

The communication control unit 11 transmits and receives data via the communication network N and the communication antenna 11a.
That is, the communication antenna 11a is connected to a predetermined communication method (for example, W-CDMA (Wideband Code Division Multiple Access) method, GSM (Global System)) used by the mobile terminal 100 for communication with a radio base station (not shown). for Mobile Communications (registered trademark) system, etc.). The communication control unit 11 transmits / receives data to / from the radio base station via the communication antenna 11a through a communication channel set in the communication method according to a communication protocol corresponding to a predetermined communication method. That is, based on the instruction signal output and input from the central control unit 1, the communication control unit 11 communicates with an external user of the communication partner (for example, the server 200) with an external user of the external device. Send and receive audio during a call and send and receive e-mail data.
Specifically, in a state where the mobile terminal 100 is connected to the server 200 that publishes the image in a state where the image can be browsed via a predetermined communication network N, the communication control unit (transmission unit) 11 includes the image processing unit 7e. The image data of the disclosure target image (including the unprocessed disclosure target image) subjected to the predetermined image processing is transmitted to the server 200 in association with the disclosure level.

  Note that the configuration of the communication control unit 11 is an example and is not limited thereto, and can be arbitrarily changed as appropriate. For example, although not shown, a wireless LAN module is mounted and an access point (Access Point) is provided. It is good also as a structure which can access the communication network N via this.

The communication network N is, for example, a communication network that connects the mobile terminal 100 to an external device via a wireless base station, a gateway server (not shown), or the like.
The communication network N is a communication network constructed using, for example, a dedicated line or an existing general public line, and various line forms such as a LAN (Local Area Network) and a WAN (Wide Area Network) are applied. Is possible. The communication network N includes, for example, various communication network networks such as a telephone line network, ISDN line network, dedicated line, mobile communication network, communication satellite line, CATV line network, IP network, VoIP (Voice over Internet Protocol). ) Gateways, Internet service providers, etc. are included.

The operation input unit 12 is for inputting various instructions to the terminal body.
Specifically, the operation input unit 12 executes a shutter button related to a subject photographing instruction, up / down / left / right cursor buttons and a determination button related to a selection instruction of a mode, a function, etc., making / receiving a call, sending / receiving an e-mail, etc. Various buttons (not shown) such as communication-related buttons related to instructions and numeric buttons and symbol buttons related to text input instructions are provided.
When various buttons are operated by the user, the operation input unit 12 outputs an operation instruction corresponding to the operated button to the central control unit 1. The central control unit 1 causes each unit to execute a predetermined operation (for example, imaging of a subject, incoming / outgoing calls, transmission / reception of an e-mail, etc.) according to an operation instruction output from the operation input unit 12 and input.

  The operation input unit 12 may include a touch panel provided integrally with the display unit 8, and an operation instruction corresponding to the predetermined operation is given to the central control unit based on a predetermined operation of the touch panel by the user. 1 may be output.

<Public image transmission processing>
Next, the public image transmission processing by the mobile terminal 100 will be described with reference to FIG.
FIG. 5 is a flowchart illustrating an example of an operation related to the public image transmission process.

  As shown in FIG. 5, first, the image acquisition unit 7a of the disclosure target processing unit 7 acquires a disclosure target image that can be disclosed in a viewable state via a predetermined communication network N (step S1). Specifically, the image acquisition unit 7a reads any one of the image data selected based on a predetermined operation of the operation input unit 12 by the user among the image data stored in the storage medium 6a, Acquired as image data of an image to be disclosed.

Next, the subject determination unit 7b performs predetermined face detection processing on the image data of the disclosure target image acquired by the image acquisition unit 7a (step S2), and the detected face image is registered in the face registration table 6b. It is determined whether or not it has been performed (step S3).
If it is determined that the detected face image is registered in the face registration table 6b (step S3; YES), the public level setting unit 7c associates with the face image detected in the face registration table 6b. It is determined whether or not the public setting flag stored in the above is “ON” (step S4).

When it is determined in step S4 that the disclosure setting flag is “ON” (step S4; YES), the disclosure level setting unit 7c is stored in association with the detected face image in the face registration table 6b. The person-related information is specified, and the desired disclosure level designated based on the predetermined operation of the operation input unit 12 by the user is set among various disclosure levels associated with the specified person-related information. (Step S5).
On the other hand, when it is determined in step S4 that the disclosure setting flag is not “ON” (step S4; NO), the disclosure target processing unit 7 skips each processing after step S5 and performs the disclosure image transmission processing. Terminate.

  If it is determined in step S3 that the detected face image is not registered in the face registration table 6b (step S3; NO), the disclosure level setting unit 7c performs a predetermined operation of the operation input unit 12 by the user. The user-specified release level designated based on the above is set (step S6).

  When the disclosure level is set in the process of step S5 or step S6, the first processing content determination unit 7d determines the image processing content for the disclosure target image, and the image processing unit 7e Then, predetermined image processing is performed (step S7). Specifically, the first processing content determination unit 7d refers to the first processing content table 6c, and determines the face area in the disclosure target image according to the disclosure level and the person related information set by the disclosure level setting unit 7c. The content of the image processing for (for example, no processing, illustration-like processing, skin beautification, etc.) is determined. Then, the image processing unit 7e performs image processing according to the determined content of the image processing on the disclosure target image.

Then, the communication control unit 11 associates the image data of the disclosure target image subjected to the predetermined image processing by the image processing unit 7e with the set disclosure level, and transmits the image data to the server 200 via the predetermined communication network N. (Step S8).
Thereby, the public image transmission process is terminated.

  In the server 200, when the image data of the disclosure target image transmitted from the portable terminal 100 is received, the disclosure target image is disclosed on the Web page in a manner corresponding to the disclosure level.

As described above, according to the mobile terminal 100 of the present embodiment, an image of a specific subject stored in the storage unit 6 is displayed as a disclosure target image that can be disclosed in a state that can be browsed via a predetermined communication network N. When it is determined that the image includes a face image (for example, a face image), the related information stored in the storage unit 6 in association with the image of the specific subject and the disclosure target image are allowed to be released to the outside. Since the processing content for the disclosure target image is determined based on the disclosure level indicating the range to be performed, appropriate processing can be performed on the disclosure target image in consideration of the disclosure level. In particular, by determining the content of the image processing for the publication target image, a predetermined visual effect can be given to the publication target image, and depending on the publication level, the publication target image is released as it is without being processed. It is possible to suppress the occurrence of inconvenience.
In addition, since the disclosure level of the disclosure target image is set based on the related information stored in the storage unit 6 in association with the image of the specific subject, the disclosure level is set appropriately in consideration of the contents of the disclosure target image. It is possible to make it difficult to cause a deviation from the public level desired by the user as compared to the case where the public level is set in advance such as before imaging. At this time, a user-desired public level can be set based on a predetermined operation of the operation input unit 12 by the user.
As described above, the disclosure level can be appropriately set in consideration of the contents of the disclosure target image, and appropriate processing can be performed on the disclosure target image in consideration of the disclosure level.

Further, when a face image is included in the disclosure target image, the disclosure target image is disclosed based on person-related information (for example, gender, age, human relationship, etc.) related to the person having the face of the face image. Since the level is set, the disclosure level can be set more appropriately in consideration of the person related to the face image included in the disclosure target image.
Specifically, when the person-related information includes information representing “female” as the gender of the person who has the face of the face image, the information related to the face area in the disclosure target image is set according to the set disclosure level. Since the content of the image processing is determined, for example, it is possible to appropriately suppress the occurrence of inconvenience due to the disclosure of the image to be disclosed without being processed by performing a skin beautification processing or the like on the face region. it can. Further, when the person-related information includes information indicating the human relationship with the user of the terminal body, the image processing for the face area in the disclosure target image is performed according to the information indicating the human relationship and the set release level. Since the contents are determined, for example, it is possible to appropriately suppress the occurrence of inconvenience due to the disclosure of the image to be disclosed as it is without being processed by processing the face area into an illustration.

  Furthermore, since the image to be published that has been subjected to image processing is transmitted to the server 200, when the server 200 publishes the image in a viewable state via the predetermined communication network N, the contents of the image to be published are considered. It is possible to publish a disclosure target image that has been subjected to appropriate image processing in consideration of the disclosure level at the appropriate disclosure level.

[Embodiment 2]
Hereinafter, the mobile terminal 100A according to the second embodiment will be described.
The mobile terminal 100A of the second embodiment has substantially the same configuration as the mobile terminal 100 of the first embodiment except for the details described below, and detailed description thereof is omitted.

FIG. 6 is a block diagram showing a schematic configuration of a mobile terminal 100A according to the second embodiment to which the present invention is applied.
The mobile terminal 100A according to the second embodiment determines the content of the transmission process of the disclosure target image to the server 200 based on the set disclosure level. Specifically, as shown in FIG. 6, the storage unit 6 stores a second processing content table 6d in addition to the storage medium 6a and the face registration table 6b. Moreover, the disclosure target processing unit 7 includes a second processing content determination unit 7f in addition to the image acquisition unit 7a, the subject determination unit 7b, and the disclosure level setting unit 7c.

  The central control unit 1, the memory 2, the imaging unit 3, the imaging control unit 4, the image data generation unit 5, the display unit 8, the display control unit 9, the transmission / reception unit 10, the communication control unit 11, and the operation input unit 12 are The configuration is substantially the same as that provided in the mobile terminal 100 of Embodiment 1, and a detailed description thereof is omitted here.

The second processing content table 6d is a table used to determine the content of the disclosure target image transmission processing by a second processing content determination unit 7f (described later) (see FIG. 7).
In other words, the second processing content table 6d is a content of a disclosure level indicating a range in which disclosure to the outside is permitted, a person attribute relating to a disclosure target image, and transmission of a disclosure target image to an external device (for example, the server 200). The processing contents are stored in association with each other.

  The contents of the disclosure level (disclosure range) and the attributes of the person related to the disclosure target image are substantially the same as the contents defined in the first processing content table 6c of the first embodiment, and detailed description thereof is omitted.

  Examples of the transmission processing content of the disclosure target image include “transmission permitted” for transmitting the disclosure target image to the server 200 and “transmission impossible” for not transmitting the disclosure target image to the server 200.

Specifically, for example, as shown in FIG. 7, in the second processing content table 6d, the transmission processing content of the disclosure target image is defined according to the disclosure level content and the attribute of the person related to the disclosure target image. Yes. That is, the contents of the transmission process of the disclosure target image are defined in consideration of the human relationship with the user of the terminal body, for example.
Note that the second processing content table 6d illustrated in FIG. 6 is an example and is not limited to this. The details of the disclosure level, the attributes of the person related to the disclosure target image, the transmission processing content of the disclosure target image, and the like are as follows. It can be arbitrarily changed as appropriate.

  That is, when the content of the disclosure level is “public to all” and the attribute of the person related to the disclosure target image is “self (regardless of gender)”, “transmission is permitted” is associated as the transmission processing content. When the attribute of the person related to the disclosure target image is “female”, “male”, or “minor”, “transmission impossible” is associated as the transmission processing content.

  Further, when the content of the disclosure level is “direct friend”, “transmission is possible” is associated as the transmission processing content regardless of the attribute of the person related to the disclosure target image.

  In addition, when the public level content is “friend of friend” and the attribute of the person related to the public image is other than “female (family)” or “minor (family)”, “transmission is possible” is set as the transmission processing content. It is associated. Also, if the content of the public level is “friend of friend” and the attribute of the person related to the image to be disclosed is “female (family)”, “minor (family)”, “transmission impossible” is supported as the transmission processing content It is attached.

Also, when the public level content is “Circle friends” and the attribute of the person related to the image to be published is “I am (regardless of gender)” or “Friends (regardless of gender, minor or not)” “Transmittable” is associated as the processing content.
Furthermore, the content of the public level is “Circle friends”, the attribute of the person related to the public image is “Family (gender, whether or not minor)”, “Friend family (gender, minor or not) No matter)), “transmission impossible” is associated as the transmission processing content.

  Further, when the content of the disclosure level is “parents”, “transmission is possible” is associated as the transmission processing content regardless of the attribute of the person related to the disclosure target image.

  When the content of the disclosure level is “only me”, “transmission is permitted” is associated as the transmission processing content regardless of the attribute of the person related to the disclosure target image.

  Further, when the content of the disclosure level is “hidden for a specific person”, “transmission impossible” is associated as the transmission processing content regardless of the attribute of the person related to the disclosure target image.

  The storage medium 6a and the face registration table 6b stored in the storage unit 6 have substantially the same configuration as that provided in the mobile terminal 100 of the first embodiment, and detailed description thereof is omitted here.

The second process content determination unit 7f determines the content of the transmission process of the disclosure target image.
That is, the second processing content determination unit (determination means) 7f is the content of the transmission process of the image to be disclosed to the server (external device) 200 by the communication control unit 11 based on the disclosure level set by the disclosure level setting unit 7c. To decide.
Specifically, for example, when the person related information in the face registration table 6b includes information (for example, the person himself / herself, family, etc.) representing the human relationship with the user of the terminal body, the second processing content determination unit 7f With reference to the second processing content table 6d of the storage unit 6, the content of the transmission process of the image to be disclosed (for example, transmission is possible or transmission is not possible) according to the person related information (particularly, information representing human relationships) and the disclosure level. Etc.).

  Note that the image acquisition unit 7a, the subject determination unit 7b, and the disclosure level setting unit 7c constituting the disclosure target processing unit 7 have substantially the same configuration as that provided in the mobile terminal 100 according to the first embodiment. Description is omitted.

<Public image transmission processing>
Next, the public image transmission process by the portable terminal 100A will be described with reference to FIG.
FIG. 8 is a flowchart illustrating an example of an operation related to the public image transmission process.

As illustrated in FIG. 8, the disclosure target processing unit 7 of the mobile terminal 100 </ b> A performs the processing of steps S <b> 1 to S <b> 6 in substantially the same manner as the public image transmission processing by the mobile terminal 100 of the first embodiment, and Set the publication level.
Subsequently, the second process content determination unit 7f determines the content of the disclosure target image transmission process (step S17). Specifically, the second processing content determination unit 7f refers to the second processing content table 6d and performs the transmission processing of the disclosure target image according to the disclosure level and the person related information set by the disclosure level setting unit 7c. The contents (for example, “transmission possible”, “transmission impossible”, etc.) are determined.

Then, the communication control unit 11 associates the image data of the disclosure target image whose “transmission is possible” is determined as the content of the transmission processing by the second processing content determination unit 7 f with the disclosure level, and passes through the predetermined communication network N. To the server 200 (step S18).
Thereby, the public image transmission process is terminated.

  In the server 200, when the image data of the disclosure target image transmitted from the mobile terminal 100A is received, substantially in the same manner as the disclosure image transmission processing of the first embodiment, the disclosure target image is set according to the disclosure level. It is published on the web page in a mode.

As described above, according to the mobile terminal 100A of the second embodiment, similarly to the mobile terminal 100 of the first embodiment, the disclosure level can be appropriately set in consideration of the contents of the disclosure target image. Compared with the case where the public level is set in advance such as before, it is possible to make it difficult to cause a deviation from the public level desired by the user. Furthermore, it is possible to perform appropriate processing on the disclosure target image in consideration of the set disclosure level. In particular, by determining the content of the transmission process of the disclosure target image to the server 200 based on the disclosure level, depending on the disclosure level, by limiting the transmission of the disclosure target image, the disclosure target image is disclosed as it is. Inconvenience can be suppressed.
As described above, the disclosure level can be appropriately set in consideration of the contents of the disclosure target image, and appropriate processing can be performed on the disclosure target image in consideration of the disclosure level.

The present invention is not limited to the first and second embodiments, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, in Embodiments 1 and 2 described above, a face image is illustrated as an image of a specific subject. However, the image is not limited to this example, and can be arbitrarily changed as appropriate. For example, the public image transmission processing of the first and second embodiments may be performed on a public target image including the automobile and the nameplate with a car and a nameplate as a specific subject.
Specifically, for example, when the number or owner of a car included in the disclosure target image is registered in advance in a registration table (not shown) of the storage unit 6, image processing is performed according to the number of the car. (For example, license plate mask processing, mosaic processing, etc.) and transmission processing content may be determined. Similarly, when the name and address of the nameplate included in the disclosure target image are registered in advance in the registration table (not shown) of the storage unit 6, the contents of the image processing (in accordance with the name and address of the nameplate) For example, nameplate mask processing, mosaic processing, etc.) and transmission processing contents may be determined.

  Further, in the first and second embodiments, the portable terminals 100 and 100A are illustrated as the image processing apparatus. However, the image processing apparatus is only an example, and is not limited thereto. If necessary, it can be arbitrarily changed.

In addition, in the first and second embodiments, the functions as an acquisition unit, a determination unit, and a determination unit are controlled by the image acquisition unit 7a under the control of the central control unit 1 of the mobile terminal 100 (100A). The configuration is realized by driving the subject determination unit 7b and the first processing content determination unit 7d (second processing content determination unit 7f). However, the configuration is not limited to this, and the CPU of the central control unit 1 A configuration realized by executing a predetermined program or the like may be employed.
That is, a program including an acquisition process routine, a determination process routine, and a determination process routine is stored in a program memory that stores the program. Then, the CPU of the central control unit 1 may function as a means for acquiring a disclosure target image that can be disclosed in a viewable state via a predetermined communication network by an acquisition processing routine. Further, the CPU of the central control unit 1 is caused to function as a means for determining whether or not the acquired disclosure target image includes the image of the specific subject stored in the storage means by the determination processing routine. May be. If the CPU of the central control unit 1 determines that the image of the specific subject is included by the determination processing routine, the related information stored in the storage unit in association with the image of the specific subject The function may be made to function as a means for determining the processing content for the publication target image based on the publication level indicating the range in which the publication target image is permitted to be released to the outside.

  Similarly, the setting means and the processing means may be realized by executing a predetermined program or the like by the CPU of the central control unit 1.

  Furthermore, as a computer-readable medium storing a program for executing each of the above processes, a non-volatile memory such as a flash memory or a portable recording medium such as a CD-ROM is applied in addition to a ROM or a hard disk. Is also possible. A carrier wave is also used as a medium for providing program data via a predetermined communication line.

Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
Storage means for storing an image of a specific subject and related information related to the specific subject in association with each other;
An acquisition means for acquiring an image to be disclosed that can be disclosed in a state that can be browsed via a predetermined communication network;
Determining means for determining whether or not the image of the specific subject stored in the storage means is included in the disclosure target image acquired by the acquiring means;
When it is determined by the determining means that the image of the specific subject is included, the related information stored in the storage means in association with the image of the specific subject and the outside of the image to be published A determination means for determining a processing content for the image to be disclosed based on a disclosure level indicating a range in which the disclosure is permitted.
An image processing apparatus comprising:
<Claim 2>
Further comprising setting means for presetting the disclosure level;
The image processing apparatus according to claim 1, wherein the determining unit determines a processing content for the disclosure target image based on a disclosure level set by the setting unit.
<Claim 3>
The image processing apparatus according to claim 2, wherein the setting unit sets the disclosure level based on the related information.
<Claim 4>
The image processing apparatus according to claim 2, wherein the setting unit sets the disclosure level based on a predetermined operation of the operation unit by a user.
<Claim 5>
Processing means for performing predetermined image processing on the publication target image;
The determining means includes
The image processing apparatus according to claim 4, wherein the content of image processing on the disclosure target image by the processing unit is determined based on the disclosure level.
<Claim 6>
The image of the specific subject is a face image including a face, and the related information includes information indicating the gender of the person having the face of the face image,
The determination unit determines the content of image processing for the face area in the disclosure target image according to the disclosure level set by the setting unit when the related information includes information representing a woman as the gender. The image processing apparatus according to claim 5.
<Claim 7>
The related information includes information representing the human relationship of the user of the device body,
The determining means determines the content of image processing for a face area in the disclosure target image according to information representing the human relationship included in the related information and a disclosure level set by the setting means. The image processing apparatus according to claim 6.
<Claim 8>
Transmitting means that is connected to an external device that publishes an image in a viewable state via the predetermined communication network, and that transmits an image subjected to image processing on the image to be disclosed by the processing means to the external device. The image processing apparatus according to claim 2, further comprising:
<Claim 9>
It is connected to an external device that publishes the image in a viewable state via the predetermined communication network, and further includes a transmission unit that transmits the image to be published to the external device.
The image processing apparatus according to claim 1, wherein the processing content for the disclosure target image determined by the determination unit is a transmission process of the disclosure target image to the external device by the transmission unit.
<Claim 10>
An image processing method using an image processing apparatus including a storage unit that stores an image of a specific subject and related information related to the specific subject in association with each other,
A process of acquiring an image to be published that can be published in a state that can be browsed via a predetermined communication network;
A process of determining whether or not the acquired image to be disclosed includes an image of the specific subject stored in the storage unit;
When it is determined that the image of the specific subject is included, the related information stored in association with the image of the specific subject in the storage unit and the disclosure target image are disclosed to the outside. A process for determining a processing content for the publication target image based on a disclosure level indicating an allowable range; and
An image processing method comprising:
<Claim 11>
A computer of an image processing apparatus comprising storage means for storing an image of a specific subject and related information related to the specific subject in association with each other,
Acquisition means for acquiring an image to be disclosed that can be disclosed in a state that can be viewed via a predetermined communication network;
Determining means for determining whether or not the image of the specific subject stored in the storage means is included in the disclosure target image acquired by the acquiring means;
When it is determined by the determining means that the image of the specific subject is included, the related information stored in the storage means in association with the image of the specific subject and the outside of the image to be published A determination means for determining a processing content for the image to be disclosed based on a disclosure level indicating a range in which disclosure to an image is permitted;
A program characterized by functioning as

100, 100A portable terminal 1 central control unit 6 storage unit 6b face registration table 6c first processing content table 6d second processing content table 7 disclosure target processing unit 7a image acquisition unit 7b subject determination unit 7c disclosure level setting unit 7d first processing Content determination unit 7e Image processing unit 7f Second processing content determination unit 11 Communication control unit 200 Server

Claims (11)

Storage means for storing an image of a specific subject and related information related to the specific subject in association with each other;
An acquisition means for acquiring an image to be disclosed that can be disclosed in a state that can be browsed via a predetermined communication network;
Determining means for determining whether or not the image of the specific subject stored in the storage means is included in the disclosure target image acquired by the acquiring means;
When it is determined by the determining means that the image of the specific subject is included, the related information stored in the storage means in association with the image of the specific subject and the outside of the image to be published A determination means for determining a processing content for the image to be disclosed based on a disclosure level indicating a range in which the disclosure is permitted.
An image processing apparatus comprising: Further comprising setting means for presetting the disclosure level;
The image processing apparatus according to claim 1, wherein the determining unit determines a processing content for the disclosure target image based on a disclosure level set by the setting unit.   The image processing apparatus according to claim 2, wherein the setting unit sets the disclosure level based on the related information.   The image processing apparatus according to claim 2, wherein the setting unit sets the disclosure level based on a predetermined operation of the operation unit by a user. Processing means for performing predetermined image processing on the publication target image;
The determining means includes
The image processing apparatus according to claim 4, wherein the content of image processing on the disclosure target image by the processing unit is determined based on the disclosure level. The image of the specific subject is a face image including a face, and the related information includes information indicating the gender of the person having the face of the face image,
The determination unit determines the content of image processing for the face area in the disclosure target image according to the disclosure level set by the setting unit when the related information includes information representing a woman as the gender. The image processing apparatus according to claim 5. The related information includes information representing the human relationship of the user of the device body,
The determining means determines the content of image processing for a face area in the disclosure target image according to information representing the human relationship included in the related information and a disclosure level set by the setting means. The image processing apparatus according to claim 6.   Transmitting means that is connected to an external device that publishes an image in a viewable state via the predetermined communication network, and that transmits an image subjected to image processing on the image to be disclosed by the processing means to the external device. The image processing apparatus according to claim 2, further comprising: It is connected to an external device that publishes the image in a viewable state via the predetermined communication network, and further includes a transmission unit that transmits the image to be published to the external device.
The image processing apparatus according to claim 1, wherein the processing content for the disclosure target image determined by the determination unit is a transmission process of the disclosure target image to the external device by the transmission unit. An image processing method using an image processing apparatus including a storage unit that stores an image of a specific subject and related information related to the specific subject in association with each other,
A process of acquiring an image to be published that can be published in a state that can be browsed via a predetermined communication network;
A process of determining whether or not the acquired image to be disclosed includes an image of the specific subject stored in the storage unit;
When it is determined that the image of the specific subject is included, the related information stored in association with the image of the specific subject in the storage unit and the disclosure target image are disclosed to the outside. A process for determining a processing content for the publication target image based on a disclosure level indicating an allowable range; and
An image processing method comprising: A computer of an image processing apparatus comprising storage means for storing an image of a specific subject and related information related to the specific subject in association with each other,
Acquisition means for acquiring an image to be disclosed that can be disclosed in a state that can be viewed via a predetermined communication network;
Determining means for determining whether or not the image of the specific subject stored in the storage means is included in the disclosure target image acquired by the acquiring means;
When it is determined by the determining means that the image of the specific subject is included, the related information stored in the storage means in association with the image of the specific subject and the outside of the image to be published A determination means for determining a processing content for the image to be disclosed based on a disclosure level indicating a range in which disclosure to an image is permitted;
A program characterized by functioning as

Images