JP7152687B2 - Display control device, display control method, program - Google Patents

Description

The present technology relates to a display control device, a display control method , and a program , and more particularly to a display control device, a display control method , and a program that enable easy selection of a background image that has been processed with a sense of unity.

Conventionally, a photo sticker creating device is known. A photo sticker creating apparatus photographs a user, makes the user edit the photographed image, and prints the edited image on sticker paper to provide the edited image. A photo sticker creating device is installed in an amusement facility or the like.

The flow of one game provided by the photo sticker creating device is that after taking a picture of the user in the shooting space as the subject, the user is moved to the editing space, and the image is displayed according to the operation performed in the editing space. After editing, the edited image is printed on sticker paper.

Japanese Unexamined Patent Application Publication No. 2002-100001 discloses a technique that enables selection of the type of processing to be performed on each of the captured images before capturing the fifth and sixth images. Shooting is performed in a state in which the captured image is always processed. The user takes a picture while viewing the processed image selected by the user.

JP 2015-121611 A

Usually, a background image, such as an image of a predetermined color or an image of a predetermined pattern, can be combined with the background of the person in the photographed image.

In the photo sticker creation device disclosed in Patent Document 1, it is possible to select a background image to be combined with each captured image on an editing screen after capturing. A background image cannot be selected for a captured image that has been selected and captured.

Therefore, the 1st to 4th images are images in which the unprocessed image is combined with the background of the subject, and the 5th and 6th images include the background of the subject. The entire image is processed. In particular, if different types of processing are selected for the fifth image and the sixth image, the sense of uniformity of the six shot images as a whole is lost.

The present technology has been developed in view of such a situation, and enables the user to easily select a background image that has been processed to give a sense of unity.

A display control device to which the present technology is applied includes a plurality of thumbnail images representing photographed images obtained by photographing a user as a subject, and a plurality of sample images representing background images to be combined with the respective photographed images. Information used for selecting the content of processing is displayed on the selection screen on which is displayed, and in response to the content of processing being selected using the information, the plurality of sample images are processed with the same content. A display control unit for switching to an image representing the applied background image is provided. The selection of the background image is performed by selecting the background image to be synthesized with each of the photographed images one by one, and the display control unit selects the background image to be synthesized with the predetermined photographed image. In this case, the processed sample image is displayed as it is even when the background image to be combined with the next captured image is selected.

In the present technology, a plurality of thumbnail images representing photographed images obtained by photographing a user as a subject and a plurality of sample images representing background images to be combined with the respective photographed images are displayed. Information used to select the content of processing is displayed on the screen. Further, in response to selection of the content of processing using the information, the plurality of sample images are switched to an image representing the background image processed with the same content. The selection of the background images is performed by selecting the background images to be combined with the respective captured images one by one. When the background image to be combined with the predetermined captured image is selected, the following The processed sample image is displayed as it is even when the background image to be combined with the photographed image is selected.

According to the present technology, it is possible to easily select a background image that has been processed to give a sense of unity.

It is a perspective view showing an example of composition of appearance of a photograph sticker production device of this art. It is a figure explaining a user's movement. It is a figure which shows the structural example of an imaging part. It is a figure which shows the structural example of a background part. FIG. 4 is a diagram showing a configuration example of an editing unit; FIG. 10 is a diagram showing a configuration example of the right side surface of the editing unit; It is a figure which shows the example of sticker paper. FIG. 4 is a diagram showing an example of a layer structure of an edited image; 2 is a block diagram showing a hardware configuration example of a photo sticker creating apparatus; FIG. 2 is a block diagram showing a functional configuration example of a photo sticker creating device; FIG. FIG. 11 is a block diagram showing a functional configuration example of an edit processing unit in FIG. 10; FIG. 11 is a flowchart for explaining photo sticker creation game processing; FIG. FIG. 13 is a flowchart for explaining editing processing performed in step S2 of FIG. 12; FIG. FIG. 10 is a diagram showing an example of a background selection screen; 15 is a diagram showing an enlarged display area of FIG. 14; FIG. FIG. 10 is a diagram showing a display example of a display area when a processing selection button is operated; FIG. 10 is a diagram showing another display example of the display area when the processing selection button is operated; FIG. 10 is a diagram showing an example of processing; FIG. 10 is a diagram showing an example of a combined image of processed background images; FIG. 10 is a diagram showing another example of a composite image of processed background images; FIG. 10 is a diagram showing another example of processing; FIG. 10 is a diagram showing an example of an edit screen; FIG. 10 is a diagram showing another display example of the background selection screen; FIG. 10 is a diagram showing another display example of the background selection screen; FIG. 10 is a diagram showing another display example of the background selection screen; FIG. 10 is a diagram showing another display example of the background selection screen; FIG. 10 is a diagram showing another display example of the background selection screen; FIG. 10 is a diagram showing another display example of the background selection screen; FIG. 11 is a diagram showing another example of an edit screen;

<Appearance configuration of photo sticker creation device>
FIG. 1 is a perspective view showing an example of the external configuration of a photo sticker creating apparatus 1. As shown in FIG.

The photo sticker creation device 1 is a game machine that provides captured images and edited images. A photo sticker creating apparatus 1 provides images to users by printing the images on sticker paper and transmitting the images to a server so that the images can be viewed on the user's portable terminal. . The photo sticker creating device 1 is installed in an amusement facility or store.

Users of the photo sticker creating apparatus 1 are mainly young women such as high school girls and college girls. In the photo sticker creating device 1, a plurality of users, mainly two or three, can enjoy the game per group. Of course, one user can also enjoy the game.

In the photo sticker creating apparatus 1, the user himself/herself becomes a subject and performs photographing work. Through editing work, the user combines an image for composition such as handwritten characters or a stamp image with an image selected from the photographed images obtained by photographing. As a result, the photographed image is edited into a colorful image. The user receives the seal paper on which the edited image, which is the edited image, is printed, and ends the series of games.

The photo sticker creation device 1 can be called a photo creation game machine that provides a photo creation game.

The photo sticker creating apparatus 1 is configured by installing a photographing unit 11 and an editing unit 12 in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected. The photographing unit 11 has a box-shaped housing large enough for a person to enter.

The photographing unit 11 is composed of a photographing section 21 and a background section 22 . The imaging unit 21 and the background unit 22 are installed separately. A space provided between the photographing unit 21 and the background unit 22 serves as a photographing space in which the user performs photographing work.

The photographing unit 21 is a device for photographing a user as a subject. A camera or the like is provided in front of the photographing unit 21 facing the photographing space. A front panel 41 is provided on the surface of the photographing section 21 that contacts the editing unit 12 . Assuming that the right side and the left side as seen from the user in the shooting space are the right side and the left side, the right side of the imaging unit 21 is composed of the side panel 42A and the left side is composed of the side panel 42B (FIG. 2). Configured.

The background portion 22 is composed of a rear panel 51, a side panel 52A, and a side panel 52B (FIG. 2), which are plate-like members. The back panel 51 is located on the back side of the user facing the front. The side panel 52A is attached to the right end of the rear panel 51, and the side panel 52B is attached to the left end of the rear panel 51. As shown in FIG.

The side panel 42A and the side panel 52A are provided substantially on the same plane with a predetermined gap therebetween. The upper portions of the side panel 42A and the side panel 52A are connected by a connecting portion 31A, which is a plate-like member. In addition, the lower portions of the side panel 42A and the side panel 52A are connected by a connecting portion 34 which is provided on the floor surface and which is, for example, a metal member.

The side panel 42B and the side panel 52B are similarly provided substantially in the same plane. The upper portions of the side panel 42B and the side panel 52B are connected by a connecting portion 31B. The lower portions of the side panel 42A and the side panel 52A are connected by a metal member (not shown) provided on the floor.

An opening formed by being surrounded by the side panel 42A, the connecting portion 31A, and the side panel 52A serves as an entrance to the imaging space. An opening formed by being surrounded by the side panel 42B, the connecting portion 31B, and the side panel 52B also serves as an entrance to the imaging space.

Above the photographing space, an opening surrounded by the front panel 41 of the photographing unit 21, the connecting portions 31A and 31B, and the rear panel 51 of the background portion 22 is formed. A ceiling strobe unit 32 is provided in the opening so as to partially cover the opening. One end of the ceiling strobe unit 32 is fixed to the connecting portion 31A, and the other end is fixed to the connecting portion 31B.

The ceiling strobe unit 32 incorporates a stroboscope arc tube that irradiates light toward the shooting space. Inside the ceiling strobe unit 32, a fluorescent lamp is provided in addition to the strobe arc tube. As a result, the ceiling strobe unit 32 also functions as lighting for the shooting space.

The editing unit 12 is a device for editing a captured image. The editing unit 12 is connected to the photographing unit 11 so that one side thereof contacts the front panel 41 of the photographing section 21 .

If the configuration of the editing unit 12 shown in FIG. 1 is taken as the configuration on the front side, the configuration used in the editing work is provided on each of the front side and the back side of the editing unit 12 . This configuration allows two sets of users to edit simultaneously.

The front side of the editing unit 12 is composed of a surface 12A and an inclined surface 12B formed above the surface 12A. The surface 12A is perpendicular to the floor surface and substantially parallel to the side panel 42A of the imaging unit 21 . A built-in tablet monitor and a touch pen are provided on the slope 12B as components used for editing work.

A columnar support portion 71A (FIG. 5) that supports one end of the lighting device 73 is provided on the upper right side of the slope 12B. A columnar support portion 71B that supports the other end of the lighting device 73 is provided on the left side of the slope 12B. A plate-like panel 72 is provided on the right side of the support portion 71A. A support portion 74 for supporting the curtain rail 75 is provided on the upper surface of the panel 72 .

A curtain rail 75 is attached above the editing unit 12 . The curtain rail 75 is configured by combining three rails 75A to 75C. The three rails 75A to 75C are combined to form a U-shape when viewed from above. One ends of the rails 75A and 75B provided in parallel are fixed to the connecting portions 31A and 31B, respectively, and the other ends of the rails 75A and 75B are joined to both ends of the rail 75C.

A curtain is attached to the curtain rail 75 so that the space in front of the front and the space in front of the back of the editing unit 12 are not visible from the outside. The space in front of the editing unit 12 surrounded by the curtain and the space behind the editing unit 12 become an editing space in which the user performs editing work.

As will be described later, the right side of the editing unit 12 is provided with a discharge port through which the printed sticker paper is discharged. The space in front of the right side of the editing unit 12 becomes a print waiting space where the user waits for the end of printing.

<Regarding the movement of users>
Here, the flow of the photo sticker creation game and the movement of the user associated therewith will be described.

FIG. 2 is a top plan view of the photo sticker creating apparatus 1. As shown in FIG.

First, the user moves from the doorway G1 as indicated by the white arrow #1 or from the doorway G2 as indicated by the white arrow #2. Enter A1. The doorway G1 is an opening between the side panels 42A and 52A, and the doorway G2 is an opening between the side panels 42B and 52B. A user performs a photographing operation in the photographing space A1 using a camera, a touch panel monitor, or the like provided in the photographing unit 21 .

The user who has completed the photographing work exits the photographing space A1 from the doorway G1 as indicated by the white arrow #3 and moves to the editing space A2-1, or enters the doorway G2 as indicated by the white arrow #4. , exits the photographing space A1 and moves to the editing space A2-2.

The editing space A2-1 is an editing space on the front side of the editing unit 12. FIG. On the other hand, the editing space A2-2 is the editing space behind the editing unit 12. FIG. To which of the editing space A2-1 and the editing space A2-2 the user should move is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the empty one of the two editing spaces is guided as the destination.

The user who has moved to the editing space A2-1 or the editing space A2-2 starts editing work. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing work at the same time.

After the editing work is completed, printing of the edited image is started. When printing starts, the user who has finished the editing work in the editing space A2-1 moves from the editing space A2-1 to the print waiting space A3 as indicated by the white arrow #5. Also, the user who has finished the editing work in the editing space A2-2 moves from the editing space A2-2 to the print waiting space A3 as indicated by the white arrow #6. After moving to the print waiting space A3, while waiting for the end of printing, for example, the user can select an image to be sent to the user's portable terminal or enter the e-mail address of the user's portable terminal. Do it as work.

When the printing is finished, the user receives the sticker paper ejected from the ejection port provided on the right side of the editing unit 12, and finishes the series of photo sticker creating games.

Next, the configuration of each part will be described.

<Structure of shooting unit>
FIG. 3 is a diagram showing a configuration example of the front of the photographing unit 21. As shown in FIG. The photographing unit 21 is configured to be surrounded by a front panel 41, a side panel 42A, and a side panel 42B.

A camera unit 81 is provided approximately in the center of the front panel 41 . The camera unit 81 is composed of a camera 91 , a front strobe unit 92 and a touch panel monitor 93 .

The camera 91 is, for example, a single-lens reflex camera, and is attached inside the camera unit 81 so that the lens is exposed. The camera 91 has an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and photographs a user in the imaging space A1. A moving image captured by the camera 91 (hereinafter also referred to as a live view image) is displayed on the touch panel monitor 93 in real time. A still image captured by the camera 91 at a predetermined timing, such as when an instruction to shoot is given, is saved as a shot image.

A front strobe unit 92 is provided above the camera 91 . The front strobe unit 92 emits light in synchronization with photographing by the camera 91 like other strobe units. The front strobe unit 92 irradiates the vicinity of the user's face as a subject with light from the front.

A touch panel monitor 93 is provided below the camera 91 . The touch panel monitor 93 is composed of a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated thereon. The touch panel monitor 93 has a function as a live view monitor that displays moving images captured by the camera 91, and a function that receives user selection operations by displaying various GUI parts. A moving image (live view image) and a still image (captured image) captured by the camera 91 are displayed on the touch panel monitor 93 .

An upper strobe unit 82 is installed above the camera unit 81 on the front panel 41 . A left strobe unit 83 is installed to the left of the camera unit 81 , and a right strobe unit 84 is installed to the right of the camera unit 81 . Furthermore, a box-shaped foot strobe unit 85 is installed below the camera unit 81 .

The upper strobe unit 82 irradiates the user with light from the upper front side. The left strobe unit 83 irradiates the user with light from the front left side. The right strobe unit 84 irradiates the user with light from the front right side. The foot strobe unit 85 irradiates the user's feet with light.

Inside the upper strobe unit 82, the left strobe unit 83, the right strobe unit 84, and the foot strobe unit 85, fluorescent lamps are provided. These fluorescent lamps are used together with the fluorescent lamps inside the ceiling strobe unit 32 to illuminate the photographing space A1. The brightness in the imaging space A1 is appropriately adjusted by adjusting the amount of light emitted by each fluorescent lamp or by adjusting the number of fluorescent lamps emitting light.

Box-shaped portions 86A and 86B lower than the foot strobe unit 85 are provided on the right and left sides of the foot strobe unit 85, respectively. The upper surface of each of the box-shaped portions 86A and 86B serves as a baggage storage area for the user to put baggage.

Further, the box-shaped portion 86A is provided with a coin slot 87 into which a user inserts coins.

Although not shown, a speaker is provided near the ceiling of the front panel 41, for example. The speaker outputs guide voices, BGM, sound effects, etc. related to the shooting work.

<Composition of the background part>
FIG. 4 is a diagram showing a configuration example of the background portion 22 on the photographing space A1 side.

A rear upper strobe unit 121 is provided at the upper center of the rear panel 51 . A rear right strobe unit 122 is provided on the upper right side of the rear panel 51 (left side in the drawing), and a rear left strobe unit 123 is provided on the upper left side of the rear panel 51 (the right side in the drawing).

The rear upper strobe unit 121 irradiates the user with light from the rear upper side. The rear right strobe unit 122 irradiates the user with light from the rear right side. The rear left strobe unit 123 irradiates the user with light from the rear left side.

A rear curtain 124 is attached to the surface of the rear panel 51 facing the photographing space A1 (front side in the figure). The color of the rear curtain 124 is green, for example. Although not shown, side curtains similar to the back curtain 124 are attached to the side panels 52A and 52B on the imaging space A1 side. The color of the side curtains should be the same as the color of the rear curtain 124 .

These curtains are used as curtains for chromakey. Thus, the chromakey process can be applied to the captured image, and the background image desired by the user can be combined with the background portion of the captured image. The colors of these curtains may be any color that allows chromakey processing, and may be other colors such as blue.

<Structure of editing unit>
FIG. 5 is a diagram showing a configuration example of the front side (editing space A2-1 side) of the editing unit 12. As shown in FIG.

A tablet built-in monitor 131 is provided approximately in the center of the slope 12B. A touch pen 132A is provided on the left side of the tablet built-in monitor 131 . A touch pen 132B is provided on the right side of the tablet built-in monitor 131 .

The tablet built-in monitor 131 is configured by laminating a tablet and a display. The tablet enables operation input using touch pen 132A or touch pen 132B. The tablet built-in monitor 131 displays, for example, an editing screen used for editing work. When two users simultaneously perform editing work, the touch pen 132A is used by the user on the left side of the tablet built-in monitor 131, and the touch pen 132B is used by the user on the right side of the tablet built-in monitor 131. .

FIG. 6 is a diagram showing a configuration example of the right side of the editing unit 12. As shown in FIG.

A touch panel monitor 141 is provided on a panel 72 forming part of the right side surface of the editing unit 12 . The touch panel monitor 141 displays a screen used for post-selection work.

A seal paper outlet 142 is provided at the bottom of the right side of the editing unit 12 . A printer is provided inside the editing unit 12 . The printer prints an image of the user of the editing space A2-1 or an image of the user of the editing space A2-2 in a predetermined layout (hereinafter referred to as a sticker layout) on sticker paper, and ejects the sticker paper. It is discharged from outlet 142 .

A speaker 143 is provided below the touch panel monitor 141 . The speaker 143 outputs guidance voices, BGM, sound effects, etc. regarding the post-selection work.

<Example of sticker paper>
FIG. 7 is a diagram showing an example of a sticker sheet produced by the photo sticker producing apparatus 1 having the external configuration as described above.

Edited images 181-1 to 181-5, which are five edited images, are printed side by side on the horizontally long sticker paper shown in FIG.

Among the edited images 181-1 to 181-5, the edited images 181-1 to 181-3 are images generated by editing the close-up image, and the edited images 181-4 and 181- 5 is an image generated by editing the whole body image.

A close-up image is an image in which the subject's face and upper body are enlarged. On the other hand, whole-body photography is an image that captures the whole body of the subject.

The close-up image and the full-body image have different aspect ratios. For example, the ratio of the horizontal length to the vertical length of the close-up image is 1:1.2, and the ratio of the horizontal length to the vertical length of the whole body image is 3:4. In the example of FIG. 7, the close-up image and the full-body image are printed with the same length in the horizontal direction. In practice, a background image, which is an image of a predetermined color or pattern, is synthesized as the user's background, and a foreground image, such as handwritten characters or a stamp image, is synthesized as the foreground.

In addition to the model name (LOVERY) and the shooting date, the e-mail address, ID, etc. are printed on the margin of the edge of the sticker paper. The e-mail address and ID printed in the blank area are used when the image sent from the photo sticker creating apparatus 1 to the server is viewed on a mobile terminal such as a mobile phone.

In this example, three close-up images and two full-body images are printed on the sticker paper, but the combination of the close-up image and the full-body image printed on the sticker paper is arbitrary.

FIG. 8 is a diagram showing an example of the layer structure of an edited image.

The edited image P1 at the left end is an image generated by editing. The edited image P1 is composed of images of layers of a background image P11, a photographed image P12, and a foreground image P13.

In the example of FIG. 8, the background image P11 is an image of a pattern of a wall made of stacked bricks. The foreground image P13 is an image including an image of handwritten characters "Love my friend" and a heart-shaped image. The image of the handwritten characters "Love my friend" is a pen image input by the user using the pen tool at the lower center position of the photographed image P12. The heart-shaped image is a stamp image input by the user using the stamp tool at the upper left position of the photographed image P12.

In this way, the edited image P1 is generated by superimposing the human region of the photographed image P12 extracted by the chromakey process on the background image P11, and superimposing the foreground image P13 thereon. It is also possible to input a pen image or a stamp image onto the background image P11 and display it in the background of the subject.

<Internal configuration of photo sticker creation device>
FIG. 9 is a block diagram showing a configuration example of the photo sticker creating apparatus 1. As shown in FIG. In FIG. 9, the same reference numerals are given to the same configurations as those described above. Duplicate explanations will be omitted as appropriate.

As shown in FIG. 9 , in the photo sticker creating apparatus 1 , a photographing unit 303 , editing units 304 A and 304 B, and a post selection unit 305 are connected to a PC (Personal Computer) unit 301 via an external input/output interface 302 . It is composed by being The PC section 301 is accommodated inside the housing of the editing unit 12, for example.

A CPU (Central Processing Unit) 311 , a ROM (Read Only Memory) 312 , and a RAM (Random Access Memory) 313 constituting the PC section 301 are interconnected by a bus 314 .

A CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creating apparatus 1 . The ROM 312 stores programs and data executed by the CPU 311 . A RAM 312 temporarily stores data and programs processed by the CPU 311 .

An input/output interface 315 is further connected to the bus 314 . A storage unit 316 , a communication unit 317 and a drive 318 are connected to the input/output interface 315 .

The storage unit 316 is a nonvolatile storage medium such as a hard disk or flash memory. The storage unit 316 stores various setting information and the like supplied from the CPU 311 . Information stored in the storage unit 316 is appropriately read by the CPU 311 .

A communication unit 317 is an interface of a network such as the Internet. A communication unit 317 communicates with an external device under the control of the CPU 311 . The communication unit 317 transmits the image selected by the user to a server managed by the manufacturer of the photo sticker creating apparatus 1, for example. The image transmitted from the communication unit 317 is stored in a predetermined storage area allocated in the server, displayed on the mobile terminal accessing the server, or downloaded to the mobile terminal.

A removable medium 319 such as an optical disk or a semiconductor memory is mounted in the drive 318 as appropriate. Programs and data read from the removable medium 319 by the drive 318 are supplied to the CPU 311 and stored in the storage unit 316 or installed.

The external input/output interface 302 is connected to the input/output interface 315 . Each unit is controlled by the PC unit 301 via the external input/output interface 302 .

The photographing unit 303 implements photographing processing for users in the photographing space A1. The photographing unit 303 includes an illumination device 331 , a camera 91 , a touch panel monitor 93 , a speaker 332 and a coin processing unit 333 .

The lighting device 331 is each strobe unit in the shooting space A1 and emits light according to the lighting control signal supplied from the PC section 301 .

The camera 91 performs photographing according to shutter control by the PC section 301 and outputs a photographed image (image data) obtained by photographing to the PC section 301 .

The coin processing unit 333 detects insertion of coins into the coin insertion slot 87 . When the coin processing unit 333 detects that a predetermined amount of coins has been inserted, the coin processing unit 333 outputs an activation signal instructing the start of the game to the PC unit 301 .

The editing unit 304A implements editing processing for users in the editing space A2-1. The editing unit 304A is composed of a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 341. FIG. The editing section 304B implements editing processing for users in the editing space A2-2, and has the same configuration as the editing section 304A. Hereinafter, the editing units 304A and 304B will simply be referred to as the editing unit 304 unless otherwise distinguished.

The tablet built-in monitor 131 displays an edit screen under the control of the PC unit 301 and accepts a user's operation on the edit screen. An input signal representing the content of the user's operation is supplied to the PC unit 301, and the captured image is edited.

The post-selection unit 305 implements post-selection processing for users in the print waiting space A3. The post-selection process is a process for causing the user to perform post-selection work. Post-selection unit 305 includes touch panel monitor 141 , speaker 143 , and printer 351 . A sticker paper unit 352 is attached to the printer 351 .

The touch panel monitor 141 displays various selection screens and the like under the control of the CPU 311, and accepts user operations on the screens. An input signal representing the content of the user's operation is supplied to the CPU 311, and various settings are performed.

The printer 351 drives a built-in head 361 and prints an image on a roll-shaped sticker paper 363 stored in the sticker paper unit 352 based on print data supplied from the PC section 301 . Further, the printer 351 cuts the sticker paper 363 on which the image is printed at a predetermined cut position by the cutter 362 and discharges the cut paper to the sticker paper outlet 142 .

FIG. 10 is a block diagram showing a functional configuration example of the photo sticker creating apparatus 1. As shown in FIG. At least some of the functional units shown in FIG. 10 are implemented by the CPU 311 executing a predetermined program.

In the photo sticker creating apparatus 1, a photographing processing unit 401, an editing processing unit 402, a printing processing unit 403, and a post-selection processing unit 404 are implemented.

The imaging processing unit 401 performs imaging processing by controlling each unit of the imaging unit 303 . The shooting processing unit 401 outputs data of a shot image obtained by performing shooting processing to the editing processing unit 402 . The shooting processing unit 401 supplies the editing processing unit 402 with data of a plurality of captured images obtained by performing shooting a plurality of times.

The editing processing unit 402 performs editing processing by controlling each unit of the editing unit 304 . As will be described later, the editing processing includes processing for adjusting the size of the user's eyes and the brightness of the skin in the photographed image, processing for selecting a background image to be combined with the background of the user photographed in the photographed image, and processing for selecting the background image. This includes a process of editing the photographed image synthesized with the .

In the game provided by the photo sticker creation device 1, a background selection screen, which is a screen used for selecting a background image, is displayed on the tablet built-in monitor 131 before editing the photographed image. The user can select a background image. A photographed image synthesized with a background image selected using the background selection screen is to be edited thereafter.

The edit processing unit 402 outputs data such as an edited image obtained by performing edit processing to the print processing unit 403 .

The print processing unit 403 performs print processing by controlling the printer 351 of the post-selection unit 305 .

The post-selection processing unit 404 performs post-selection processing by controlling the touch panel monitor 141 of the post-selection unit 305 . The post-selection processing includes processing for selecting images to be transmitted to the server.

FIG. 11 is a block diagram showing a functional configuration example of the edit processing unit 402. As shown in FIG.

The edit processing unit 402 includes a background image storage unit 411 , a background processing unit 412 , a photographed image acquisition unit 413 , a composition unit 414 , a display control unit 415 and an edit control unit 416 .

The background image storage unit 411 stores background image data. In the background image storage unit 411, a plurality of types of background images, such as an image of a predetermined color, an image representing a pattern, and an image in which handwritten-like characters are synthesized, are classified and managed for each category. When selecting a background, the background image stored in the background image storage unit 411 is supplied to the background processing unit 412 , the synthesizing unit 414 , and the display control unit 415 .

The background processing unit 412 processes the background image supplied from the background image storage unit 411 . The processing by the background processing unit 412 is image processing for changing the appearance of the image, such as the color, brightness, blurring, gradation, contrast, and transparency, of the entire or part of the background image. This is different from the process of synthesizing images according to the user's operation. For example, the background processing unit 412 has in advance a plurality of types of filters for processing different contents.

When the content of processing is selected by the user, the background processing unit 412 processes the selected same content on each of the plurality of background images, and outputs the processed background images to the synthesizing unit 414 and the display control unit 415. do. As will be described later, the processing by the background processing unit 412 is applied to a simple background image such as a single-color image.

The captured image acquisition unit 413 acquires the captured image supplied from the image capturing processing unit 401 . The captured image acquisition unit 413 acquires a plurality of captured images, such as five close-up images and one full-body image. The close-up image acquired by the photographed image acquiring unit 413 is output to the synthesizing unit 414 , and the full-body image is output to the display control unit 415 and the editing control unit 416 .

The synthesizing unit 414 extracts a region in which the user as a subject is captured from the captured image supplied from the captured image acquiring unit 413 by, for example, chromakey processing, and synthesizes the background image with the user's background. In this example, the captured image to which the background image is combined is only the close-up image, and the background image is not combined with the whole-body image.

When the processed background image is selected, the synthesizing unit 414 uses the processed background image supplied from the background processing unit 412 for synthesizing with the captured image. Further, when an unprocessed background image is selected, the synthesizing unit 414 uses the background image supplied from the background image storage unit 411 for synthesizing with the captured image. The combining unit 414 outputs the captured image combined with the background image to the display control unit 415 and the editing control unit 416 .

The display control unit 415 causes the tablet built-in monitor 131 to display various screens such as a background selection screen, an editing screen, and the like used for proceeding with the editing process.

For example, when the background image is selected, the display control unit 415 selects a sample image of the unprocessed background image stored in the background image storage unit 411 or a sample image of the background image processed by the background processing unit 412 . A sample image of the background image of is displayed on the background selection screen, and the user selects the background image.

Further, when editing a captured image, the display control unit 415 displays on the edit screen buttons used for selecting various tools used for editing, together with the captured image synthesized with the background image, so that the captured image can be edited. let the user do it. The whole body image supplied from the captured image acquisition unit 413 is also displayed on the editing screen as a captured image to be edited.

The editing control unit 416 edits the close-up image synthesized with the background image by the synthesizing unit 414 and the full-body image supplied from the shot image acquiring unit 413 according to the user's operation on the edit screen when editing the shot image. do. Information representing the result of editing by the editing control unit 416 is supplied to the display control unit 415 and reflected in the display of the editing screen.

<Operation of photo sticker creation device>
Here, the operation of the photo sticker creating apparatus 1 that provides the photo sticker creating game will be described with reference to the flowchart of FIG. The process of FIG. 12 is started when a predetermined amount of coins is inserted into the coin slot 87. The process of FIG.

In step S1, the photographing processing unit 401 causes the touch panel monitor 93 to display a live view image captured by the camera 91, and photographs a user in the photographing space A1 as a subject. The photographing by the photographing processing unit 401 is performed by appropriately changing the focal length of the camera 91 so as to photograph a total of six images, for example, five close-up images and one full-body image.

In step S2, the editing processing unit 402 controls the editing unit 304 corresponding to the editing space to which the user who has completed the shooting process is moved, out of the editing space A2-1 and the editing space A2-2. Edit processing is performed by In the editing process, the editing processing unit 402 edits the captured image according to the user's operation on the editing screen displayed on the tablet built-in monitor 131 to generate an edited image.

In addition, the editing processing unit 402 appropriately generates an image for mobile transmission, which is an image dedicated to transmission to the mobile terminal, according to the user's operation. The editing screen is provided with buttons that are operated when generating images for mobile transmission. The image for portable transmission is an image generated by subjecting the photographed image selected by the user to various types of image processing, including trimming and processing for synthesizing other images such as frame images. The image for portable transmission is transmitted to the user's portable terminal via the server and is not printed on the seal paper 363 . Details of the editing process will be described later with reference to the flowchart of FIG.

In step S3, the print processing unit 403 starts printing the edited image obtained by the editing process. That is, the print processing unit 403 generates print data by arranging the edited image in the layout selected by the user during the editing process, and outputs the generated print data to the printer 351 to print it on the sticker paper 363 .

In step S4, the post-selection processing unit 404 performs post-selection processing by causing the touch panel monitor 141 to display a predetermined screen. For example, the post-selection processing unit 404 causes the user who is waiting for the printing to be completed to select an image to be transmitted to the portable terminal, enter the e-mail address of the portable terminal to which the image is to be sent, and the like. The post-selection processing unit 404 transmits various images including the image selected by the user, such as a photographed image and an image for mobile transmission, to the server.

When the printing is finished, in step S5, the printer 351 discharges the photo sticker on which the edited image is printed in a predetermined layout to the sticker paper outlet 142, and the process is finished.

Each group of users of the photo sticker creating apparatus 1 is provided with a photo creating game consisting of a series of processes as described above. When a user of another group starts using the photo sticker creating device 1 following a user of a certain group, the photo creating game of the user who started using the photo sticker creating device 1 first and the user who started using the photo sticker creating device 1 later. The user's photo creation game will be played in parallel as appropriate. The processing of each step in FIG. 12 is appropriately performed in parallel with other processing or before or after other processing.

<Editing process>
Next, the editing process performed in step S2 of FIG. 12 will be described with reference to the flowchart of FIG.

In step S11, the display control unit 415 of the editing processing unit 402 causes the tablet built-in monitor 131 to display a retouch guidance screen. The retouch guidance screen is a screen for guiding the user that selection of face lines and selection of eye size and skin brightness can be performed later.

After displaying the retouching guidance screen for a predetermined time, the display control unit 415 causes the tablet built-in monitor 131 to display the face line selection screen in step S12.

The face line selection screen is a screen used to select the shape of the user's face line, that is, the outline of the face, captured in the captured image. The face line selection screen displays, for example, buttons for selecting a predetermined shape from among three types of facial contour shapes. When any shape is selected on the face line selection screen, the captured image acquisition unit 413 adjusts the contour shape of the face captured in each captured image.

In step S13, the display control unit 415 causes the tablet built-in monitor 131 to display an eye size/brightness selection screen.

The eye size/brightness selection screen is a screen used to select the eye size and skin brightness of the user in the captured image. The eye size/brightness selection screen includes, for example, a button for selecting a predetermined eye size from five types, and a predetermined brightness from five types of skin brightness. A button is displayed to select the

The photographed image acquisition unit 413 adjusts the size of the user's eyes in each photographed image so as to have the size selected on the eye size/brightness selection screen. In addition, the photographed image acquisition unit 413 adjusts the brightness of the user's skin appearing in each photographed image so as to achieve the selected brightness.

In step S14, the display control unit 415 causes the tablet built-in monitor 131 to display a background selection screen.

The background selection screen is a screen used for selecting a background image to be combined with the background of the user appearing in the captured image obtained by photography. A plurality of sample images representing background images are displayed on the background selection screen. The user can view the sample images and select one background image to be combined with each captured image.

<Example 1: Example of background selection screen>
FIG. 14 is a diagram showing an example of the background selection screen.

A message "Please select a background" is displayed in the upper center of the background selection screen, and thumbnail images P31 to P35 of five photographed images of two users are displayed below the message. Each of the thumbnail images P31 to P35 is a close-up thumbnail image in which the user's face and upper body are enlarged.

Also, in the example of FIG. 14, a cursor C is displayed around the thumbnail image P31. Cursor C indicates that a background image to be combined with the first captured image is being selected. The cursor C moves so as to highlight the captured image to be combined each time the background image is selected.

A display area 501, which is a horizontally long rectangular area, is formed under the thumbnail images P31 to P35. A background sample image, which is a sample of the background image, is displayed in the display area 501 . The user selects a background image to be combined with the captured image using the display in the display area 501 . Details of the display area 501 will be described later.

A balloon 511 is displayed above the display area 501 so as to partially overlap the display area 501 . The balloon 511 is displayed, for example, for a predetermined period of time from the start of display of the background selection screen. A balloon 511 displays a message indicating that the background image can be processed by operating a button provided in the display area 501 .

A balloon 512 displayed on the upper left of the background selection screen displays a description of the background image of a certain category.

On the left side of the display area 501, five circular category selection buttons 513-1L to 513-5L are displayed. Category selection buttons 513-1L to 513-5L are buttons operated by the user on the left side when selecting a background image category.

As indicated by the category selection buttons 513-1L to 513-5L, the background images are classified into five categories: "pop-up SET", "pop-up PURI", "modern SET", "design", and "normal". . In the photo sticker creating apparatus 1, a plurality of background images are prepared for each category.

In the example of FIG. 14, the "normal" category is selected by operating the category selection button 513-5L. The background images in the “normal” category are images with simple designs such as single-color images and images expressing color densities. The background images in the four categories other than "normal" are images with elaborate designs, such as images showing patterns and images combined with characters.

Background sample images in the display area 501 are switched according to the operation of the category selection buttons 513-1L to 513-5L.

On the right side of the display area 501, the same buttons as the category selection buttons 513-1L to 513-5L are prepared as category selection buttons 513-1R to 513-5R. The user on the right can also select a background image category. Of the category selection buttons 513-1L to 513-5L and the category selection buttons 513-1R to 513-5R, the category corresponding to the last operated button is being selected.

FIG. 15 is a diagram showing the display area 501 in FIG. 14. As shown in FIG.

Above the center of the display area 501, processing selection buttons 521 and 522, which are circular buttons that are operated when selecting the content of processing to be applied to the background image, are displayed side by side.

The processing selection button 521 displays the character "juwatto" representing the content of processing, and the processing selection button 522 displays the character "purutto" representing the content of other processing. When the processing selection button 521 is operated, a background sample image representing a background image that has been processed to be represented by “juwatto” is displayed as an option in the display area 501, and when the processing selection button 522 is operated , background sample images representing processed background images represented by "purutto" are displayed in the display area 501 as options.

A processing off button 523 that is operated to turn off the processing of the background image is displayed at a position one step below between the processing selection button 521 and the processing selection button 522 . When the processing off button 523 is operated, background sample images representing unprocessed background images are displayed in the display area 501 as options. The processing off button 523 cannot be selected (depressed) unless the processing selection button 521 or the processing selection button 522 is pressed.

Hereinafter, processing represented by "juwatto" will be referred to as processing A, and processing represented by "pulling" will be referred to as processing B. In addition, appropriately processing the background image is called processing ON, and not processing the background image is called processing OFF.

An upside-down convex area surrounding the processing selection buttons 521 and 522 and the processing OFF button 523 is a processing content selection region 501B in which buttons used for selecting processing content are displayed. An area other than the processing content selection area 501B in the display area 501 becomes a background selection area 501A in which a background image is selected using a plurality of background sample images. A display area 501 of the background selection screen is composed of a background selection area 501A and a processing content selection area 501B.

In the example of FIG. 15, the processing off button 523 is selected, and a background sample image representing a simple background image belonging to the "normal" category is displayed in the background selection area 501A with processing turned off. For example, when the background selection screen starts to be displayed, a background sample image representing a background image with processing turned off is displayed in the background selection area 501A. In order to reflect the processing on the background image, the user needs to press the processing selection button 521 or the processing selection button 522 .

The user looks at the background sample images displayed in the background selection area 501A and selects the background image to be combined with the first photographed image from 21 types of unprocessed background images. can be done.

FIG. 16 is a diagram showing a display example of the display area 501 when the processing selection button 521 is operated.

When the process selection button 521 is operated, the background sample images displayed in the background selection area 501A as background image selection candidates are collectively switched so as to represent the background image subjected to process A ( display of all background sample images is toggled).

When switching background sample images, an animation is displayed for each background sample image that dynamically transitions from the state of processing OFF to the state of processing ON in order to clearly indicate that processing has been applied. You may do so.

In the background selection area 501A, a background sample image representing the background image after the processing A is displayed. Each background sample image shown in FIG. 16 is an image representing a state in which processing A is applied to each background image belonging to the "normal" category.

The user looks at the background sample images displayed in the background selection area 501A and selects a background image to be combined with the first photographed image from 21 types of background images subjected to processing A. can be done.

FIG. 17 is a diagram showing a display example of the display area 501 when the processing selection button 522 is operated.

When the processing selection button 522 is operated, the background sample images displayed in the background selection area 501A are collectively switched so as to represent the background image on which processing B has been applied. In the background selection area 501A, a background sample image representing the background image in the state of being processed B is displayed. Each background sample image shown in FIG. 17 is an image representing a state in which processing B is applied to each background image belonging to the "normal" category.

As can be seen by comparing the background sample image of FIG. 16 and the background sample image of FIG. However, it is said to be a process that spreads radially while gradually thinning the color. The color becomes lighter from the center to the edge. By using the background image that has undergone processing A, a sense of depth is created between the person and the background, and the image appears more three-dimensional. If the image looks two-dimensional, a feeling of synthesis will occur and the image will look unnatural, but this can be prevented.

On the other hand, in processing B, in contrast to processing A, the color of the background image is made gradually lighter from the edge of the image toward the center. FIG. 18 shows an enlarged image (FIG. 18A) subjected to processing A and an image (FIG. 18B) subjected to processing B with respect to the same background image.

The user looks at the background sample images displayed in the background selection area 501A and selects a background image to be combined with the first photographed image from 21 types of background images subjected to processing B. can be done.

When a background image to be combined with the first captured image is selected, the thumbnail image P31 displayed on the background selection screen is displayed with the (selected) background image combined. When a processed background image is selected, the background of the thumbnail image P31 reflects the processing. Also, the cursor C moves to the position of the thumbnail image P32 of the second photographed image.

When a background image to be combined with the first captured image is selected, the background image to be combined with the second captured image is selected. At this time, the background sample image displayed in the display area 501 is The previous display is maintained.

That is, when the background image subjected to the processing A is selected as the background image to be combined with the first photographed image, immediately after that, the background sample image of the background image subjected to the processing A is displayed as it is. be. When selecting the background image subjected to processing B as the background image to be combined with the first shot image, the user needs to press the processing selection button 522 to switch the display of the background sample image.

Background images to be combined with the photographed image are selected one by one as described above. A predetermined time limit is assigned to the selection of a background image using the background selection screen. When the time limit has passed, unselected captured images are finalized in a state in which a predetermined unprocessed background image is synthesized.

FIG. 19 is a diagram showing an example of a combined image of processed background images.

In the example of FIG. 19, the shot image to be edited is configured by superimposing a background layer, processing information layer, and person layer.

The background layer is an unprocessed default background image layer. Default means no processing. If the background image is an image with a predetermined color applied throughout, the layer of the background image is a layer of color information representing the RGB values of that color.

The processing information layer is a layer of information regarding filters used for processing. Color, brightness, blurring, gradation, contrast, and transparency are adjusted by filtering using the processing information layer to generate a processed background image.

The person layer is a layer of an area of a person extracted by performing chromakey processing on a captured image. A value of 100%, for example, is set as the transparency of the area other than the person's area. When the three layers are superimposed, the processed background image is displayed in areas other than the person's area.

FIG. 19 shows an example in which the photo sticker creating apparatus 1 separately manages an unprocessed background image and information about the details of the process. When a processed background image is required, the photo sticker creating apparatus 1 generates a processed background image based on the information under management, and uses it for composition or the like.

FIG. 20 is a diagram showing another example of a synthesized image of processed background images.

In the example of FIG. 20, the shot image to be edited is configured by superimposing a background layer, which is a layer of a processed background image, and a person layer. When the two layers are superimposed, the processed background image is displayed in areas other than the person's area.

FIG. 20 shows an example in which the photo sticker creating apparatus 1 manages a processed background image separately from an unprocessed background image. When a processed background image is required, the photo sticker creating apparatus 1 uses a processed background image prepared in advance for synthesis or the like.

The method of managing the processed background image in the photo sticker creating apparatus 1 may be the method shown in FIG. 19 or the method shown in FIG. When the processed background image is managed by the method shown in FIG. 20, the background processing unit 412 of FIG. 11 is unnecessary.

As described above, the user can process the background image as desired. In addition, the user can select processing suitable for the shot image while looking at the thumbnail image of the shot image, and use it for synthesis with the shot image.

As shown in FIG. 8, the edited image is an image consisting of a background image, a photographed image (person image), or a foreground image. It will not be applied to the image. Since the person is not processed, it is possible to bring out the image of the person.

It should be noted that the processing of the background image as described above can be performed only when the "normal" category is selected. When a category other than the “Normal” category is selected, the display area 501 does not display the buttons used for selecting the processing content, and displays background sample images representing background images belonging to each category. .

In the above example, two types of processing, processing A and processing B, are prepared as contents of processing, but more types of processing may be prepared. For example, as shown in FIGS. 21A to 21D, processing such as adding gradation and adding dots, processing such as adding glossiness, processing such as adding gradation and adding white spots, and processing such as edging are performed. It is possible to use

In this case, buttons to be operated when selecting processing other than processing A and processing B are prepared in the processing content selection area 501B of the background selection screen.

Returning to the description of FIG. 13, in step S15, the display control unit 415 operates the category selection button 513-5L or the category selection button 513-5R on the background selection screen, and when the category “normal” is selected, The display of the background sample image is switched according to the user's operation.

That is, when the processing off button 523 is operated, the display control unit 415 causes the display area 501 to display a background sample image representing a background image with processing off. Further, when the processing selection button 521 or the processing selection button 522 is operated, the display control unit 415 causes the display area 501 to display a background sample image representing the background image subjected to the respective processing.

The background sample image may be generated by the display control unit 415 based on the background image stored in the background image storage unit 411 or the background image processed by the background processing unit 412, or may be generated by the background image storage unit 411. It may be prepared in advance in the storage unit 411 .

In the former case, when displaying a background sample image representing a background image with processing turned off, the display control unit 415 reduces the background image read from the background image storage unit 411 to generate a background sample image, and uses it for display. When displaying a background sample image representing a background image with processing ON, the display control unit 415 reduces the background image processed by the background processing unit 412 to generate a background sample image, and uses it for display.

In step S16, the synthesizing unit 414 synthesizes the background image selected by the user using the background sample image with the background of the user appearing in the captured image to be the synthesis destination. The synthesis unit 414 synthesizes the default background image stored in the background image storage unit 411 or the background image processed by the background processing unit 412 with the captured image supplied from the captured image acquisition unit 413 . .

The captured image combined with the background image is supplied to the display control unit 415 and reflected in the display of the thumbnail images P31 to P35. Also, the captured image combined with the background image is supplied to the editing control unit 416 as a captured image to be edited. If a background image to be combined with each of the five captured images is selected using the background selection screen, the process proceeds to step S17.

In step S17, the display control unit 415 causes the tablet built-in monitor 131 to display a name input screen.

The name input screen is a screen used by the user to input a name. The name input screen displays a keyboard and the like used for inputting a name. The entered name is used, for example, to generate a stamp image.

In step S18, the display control unit 415 causes the tablet built-in monitor 131 to display the edit screen.

The edit screen is a screen used for editing a captured image to be edited. The editing screen displays a photographed image to be edited and various editing tools (compositing images) such as stamp images and pen images used for editing.

FIG. 22 is a diagram showing an example of an edit screen displayed on the tablet built-in monitor 131. As shown in FIG.

The edit screen is basically configured by symmetrically providing main components. The left half area is used by the user on the left side of the tablet built-in monitor 131 . The right half area is used by the user on the right side of the tablet built-in monitor 131 . With such an editing screen configuration, mainly two users can perform editing work at the same time. It should be noted that the dashed lines surrounding each area on the editing screen shown in FIG. 22 are not actually displayed on the screen.

A thumbnail display area 611L is provided above the center of the left half area of the editing screen. The thumbnail display area 611L is a display area for thumbnail images representing captured images. A thumbnail image is generated, for example, by reducing each of the shot images combined with the background image. The user (the user on the left side of the tablet built-in monitor 131) selects a captured image to be edited by selecting a thumbnail image displayed in the thumbnail display area 611L.

In the example of FIG. 22, five close-up thumbnail images P31 to P35 and one full-body thumbnail image P36 are displayed side by side in the thumbnail display area 611L.

An editing area 612L is provided substantially in the center of the left half area. The editing area 612L is a display area for a photographed image to be edited selected using a thumbnail image. The user can select an editing tool using the touch pen 132A and edit the captured image displayed in the editing area 612L.

An editing palette 613L, which is a horizontally long rectangular area, is displayed below the editing area 612L. The editing palette 613L includes buttons for selecting various editing tools (compositing images) such as a pen tool (pen image) and a stamp tool (stamp image) that are combined with the captured image displayed in the editing area 612L. This is the displayed area.

Above the editing palette 613L, five types of tabs used for selecting categories of editing tools are displayed. Six types of tabs used for selecting the type of editing tool are displayed on the right side of the editing palette 613L. The user can switch the types and categories of editing tools displayed on the editing palette 613L using these tabs.

A makeup tool area 614L is displayed to the left of the editing area 612L. The makeup tool area 614L displays buttons that are operated when adjusting the color of the user's lips appearing in the shot image to be edited.

A correction tool selection area 615L is formed to the right of the edit area 612L. The correction tool selection area 615L is an area in which a button used to select an eraser tool, a "back" button, a "forward" button, a "from the beginning" button, etc. are displayed vertically.

The eraser tool is a tool used when erasing a synthesized editing tool. The "back" button and the "forward" button are buttons that are operated to return or advance the selection operation of the editing tool by one, and the "from the beginning" button cancels all the selection operations of the editing tool. This button is operated when returning to a state in which none of the editing has been performed. A "return 1 set" button is also displayed in the correction tool selection area 615L. By pressing the "Return 1set" button, it is possible to collectively erase the editing tools synthesized during a predetermined period of time.

On the right side of the correction tool selection area 615L, a create button 616L that is operated when creating an image for mobile transmission is displayed. The characters "mobile phone bonus" displayed on the edit screen of FIG. 22 represent images for mobile transmission. When the create button 616L is pressed, a screen for creating an image for mobile transmission is displayed superimposed on the edit screen.

An end button 617L is displayed above the correction tool selection area 615L to be operated when the editing process is to be ended.

In the right half area used by the user on the right side of the tablet built-in monitor 131, the same configuration as the left half area described above is arranged symmetrically.

Editing of a captured image is performed using such an editing screen.

In step S19 of FIG. 13, the editing control unit 416 edits the captured image to be edited according to the user's operation.

When the editing is completed by operating the end button or the like, the display control unit 415 causes the tablet built-in monitor 131 to display a division number selection screen in step S20.

The division number selection screen is a screen used to select a seal layout. A sticker layout is a layout (arrangement pattern) that determines the number, positions, and sizes of edited images to be arranged on one photo sticker. Edited images arranged according to the sticker layout selected by the user are printed on the sticker paper 363 .

In step S21, the display control unit 415 displays a guide screen on the tablet built-in monitor 131 to guide the user who has finished the editing work to move to the print waiting space A3. Guidance to move to the print waiting space A3 is also provided by outputting a voice from the speaker 143. FIG.

After that, the process returns to step S2 in FIG. 12, and the subsequent processes are performed.

As described above, the user can select a desired background image for the close-up image of the close-up image and the full-body image obtained by photographing, and combine them. Also, the background image can be processed as desired and used for synthesis with the captured image.

When a certain processing is selected, the background sample images displayed in the display area 501 are all switched to the processed image, so that the user can view the processed background image with a sense of unity. can be easily selected. That is, the user can select an image that has undergone the same processing as a background image to be combined with each captured image by continuously pressing the displayed background sample image after selecting a predetermined processing. can.

In the above, if background selection takes too much time, the time that can be allocated to editing will be shortened, and the turnover rate of the game will deteriorate. The user is prohibited from synthesizing a background image with the full-body image. Of course, for the whole body image, a desired background image may be selected on the background selection screen and synthesized.

Also, when editing a photographed image, it is possible to create an image for mobile transmission using a predetermined photographed image. An image may be used. The entire image for portable transmission is processed differently from the processing applied to the background image.

Since the entire mobile-transmission image including the area of the person is processed, an image having a different visual impression from the image printed on the sticker paper 363 can be provided as the mobile-transmission image. When the image for mobile transmission is created, the image for mobile transmission may not be processed.

Since the background image is processed, the stamp image/pen image forming the foreground image is not processed as described above. If the stamp image/pen image is placed in the background area by editing, the processed background image and the unprocessed stamp/pen image will be adjacent to each other, which may cause a sense of incongruity. . In order to prevent a sense of incompatibility, the stamp image/pen image may be processed in the same manner as the background image.

In this way, it is possible to apply the same processing to the foreground image as the processing applied to the background image. The user may be allowed to select the processing to be applied to the foreground image.

In the above description, buttons are displayed in the processing content selection area 501B as information used for selecting the processing content. good. When a sample image displayed in the processing content selection area 501B is selected, the processing represented by the selected sample image is applied to a plurality of background images, and the display of the background selection area 501A is switched collectively.

<Embodiment 2: Modified example of background selection screen>
FIG. 23 is a diagram showing another display example of the background selection screen.

In the example of FIG. 23, a processing ON button 631 and a processing OFF button 632 that are operated when processing the background image are displayed side by side in the upper center of the display area 501 . A region surrounding the processing ON button 631 and the processing OFF button 632 is a processing content selection region 501B used for selecting processing content.

When the processing ON button 631 is pressed, the display of the background sample images is collectively switched to an image representing a background image that has undergone processing of predetermined contents. Further, when the processing off button 632 is pressed while a background sample image representing a background image processed with predetermined contents is displayed, the display of the background sample image is changed to an image representing the processing off background image. can be switched together.

If there are multiple types of processing, the content of processing may be switched each time the processing ON button 631 is pressed. For example, if there are processing A and processing B, processing A is selected when the processing ON button 631 is pressed once, and processing is performed when the processing ON button 631 is pressed once. B is selected.

・Example 2-1
Only the processing off button 632 may be displayed in the processing content selection area 501B of the background selection screen. In this case, the default state of the background image is a state in which predetermined processing has been performed, and a background sample image representing the processed background image is displayed in the background selection area 501A. When the processing off button 632 is pressed, the background sample image representing the processed background image is switched to the background sample image representing the processing off background image.

By continuing to press the background sample image with the touch pen 132 for a predetermined period of time, the details of the processing applied to the background image may be switched. For example, when the background sample image representing the background image subjected to processing A is kept pressed, the background sample image is switched to the image representing the background image subjected to processing B. FIG. In this case, the switching of the display of the background sample images is not performed collectively, but is performed for each background sample image.

By pressing a thumbnail image of a captured image, the details of the processing to be applied to the background image to be combined with the captured image may be changed.

・Example 2-2
FIG. 24 is a diagram showing another display example of the background selection screen.

In the example of FIG. 24, on the left side of the display area 501, process selection buttons 641L and 642L are displayed side by side with the category selection button 513-5L. The text “processing A” is displayed on the processing selection button 641L, and the text “processing B” is displayed on the processing selection button 642L.

The category selection button 513-5L is a button operated when selecting a background image with processing off belonging to the “normal” category. When the category selection button 513-5L is pressed, the display area 501 displays a background sample image representing a processing-off background image belonging to the “normal” category.

The processing selection button 641L is a button that is operated when selecting a background image that has undergone processing A and belongs to the “normal” category. When the processing selection button 641L is pressed, a background sample image representing the background image processed by processing A is displayed in the display area 501 .

The processing selection button 642L is a button operated when selecting a background image subjected to processing B belonging to the “normal” category. When the processing selection button 642L is pressed, a background sample image representing the background image processed by processing B is displayed in the display area 501 .

By pressing a button (tab) on the left side of the display area 501, the user switches the display of the display area 501 to display a background image with no processing, a background image with processing A, and a background with processing B. You can select your favorite background image from the images. Buttons similar to the category selection button 513-5L, the processing selection button 641L, and the processing selection button 642L are also displayed on the right side of the display area 501 as the category selection button 513-5R, the processing selection button 641R, and the processing selection button 642R.

The area surrounding the category selection button 513-5L, the processing selection button 641L, and the processing selection button 642L, and the area surrounding the category selection button 513-5R, the processing selection button 641R, and the processing selection button 642R are each used to select the content of processing. It becomes the machining content selection area 501B used for .

・Example 2-3
FIG. 25 is a diagram showing another display example of the background selection screen.

In the example of FIG. 25, buttons that are operated when switching the content of the processing applied to the background image are displayed above the thumbnail images P31 to P35.

A processing selection button 651-1 displayed above the thumbnail image P31 is a button operated when selecting a background image subjected to processing A as a background image to be combined with the first shot image. When the processing selection button 651-1 is pressed, a background sample image representing the background image processed by processing A is displayed in the display area 501. FIG.

A processing selection button 651-2 displayed above the thumbnail image P31 is a button that is operated when selecting a background image subjected to processing B as a background image to be combined with the first photographed image. When the processing selection button 651-2 is pressed, a background sample image representing the background image processed by processing B is displayed in the display area 501. FIG.

A processing selection button 652-1 and a processing selection button 652-2 are displayed above the thumbnail image P32, and are used when selecting a background image to be combined with the second photographed image. A processing selection button 653-1 and a processing selection button 653-2 are displayed above the thumbnail image P33, and are used when selecting a background image to be combined with the third photographed image.

A processing selection button 654-1 and a processing selection button 654-2 are displayed above the thumbnail image P34, and are used when selecting a background image to be combined with the fourth photographed image. A processing selection button 655-1 and a processing selection button 655-2 are displayed above the thumbnail image P35, and are used when selecting a background image to be combined with the fifth photographed image.

The processing selection buttons 652-1 through 655-1 have the same function as the processing selection button 651-1, and the processing selection buttons 652-2 through 655-2 have the same function as the processing selection button 651-2.

A region surrounding the processing selection buttons 651-1 to 655-1 and the processing selection buttons 651-2 to 655-2 is a processing content selection region 501B used for selecting processing content.

The positions at which the processing selection buttons 651-1 to 655-1 and the processing selection buttons 651-2 to 655-2 are displayed are not limited to above the respective thumbnail images, and may be any position as long as the correspondence with the thumbnail images is known. It can be a position.

・Example 2-4
Although the background images to be combined with the five captured images are selected one by one, the background images to be combined with the five captured images may be selected collectively. In this case, a plurality of sample images representing a set of five background images are displayed in the display area 501 of the background selection screen. When one set is selected, the five background images forming the set are combined with the five captured images.

In this way, even when sample images representing a set of five background images are displayed on the background selection screen, it is possible to select the content of processing to be applied to the background images that make up each set. good. When the content of processing is selected, the display of the sample image is switched to an image representing a set of background images subjected to the selected processing.

By switching the contents of processing on a set-by-set basis and selecting a background image on a set-by-set basis, it is possible to reduce the time required to select a background image. In addition, since a set of background images processed in the same manner is used for compositing with the photographed image, it is possible to synthesize background images with a sense of unity.

After selecting the background images in units of sets, it may be possible to individually select the content of processing to be applied to each background image.

・Example 2-5
FIG. 26 is a diagram showing another display example of the background selection screen.

On the background selection screen of FIG. 26, it is possible to select the size of the user's eyes in the photographed image in addition to the selection of the background image.

A selection area 661 is formed to the right of the row of thumbnail images P31 to P35, and three types of buttons used to select the eye size are displayed. Other displays on the background selection screen in FIG. 26 are the same as those described with reference to FIG. 14 and the like.

When a button displayed in the selection area 661 is pressed, the size of the user's eyes in the captured image is adjusted by image processing and reflected in the display of the thumbnail images P31 to P35.

By using such a background selection screen, the user can select a background image that matches the captured image after adjusting the size of the eyes. The completeness of the image printed on the seal paper 363 is also improved.

The background selection screen may be used to adjust the appearance of the face, the brightness of the skin, the color of the hair, and the like instead of the size of the eyes.

・Example 2-6
FIG. 27 is a diagram showing another display example of the background selection screen.

The display of the background selection screen in FIG. 27 is different from the display in FIG. 26 in that the size of the eyes in the captured image can be selected for each user.

A selection area 661L displaying three types of buttons used for selecting the size of the eyes is formed to the left of the row of thumbnail images P31 to P35. Above the selection area 661L, for example, the face image P51 of the user appearing on the left side of the first photographed image is displayed.

The face image P51 is generated, for example, by performing face recognition on the first photographed image by the display control unit 415 and cutting out the range of the face shown on the left side by trimming. The display of selection area 661L is used by the user pictured on the left.

Similarly, a selection area 661R displaying three types of buttons used for selecting the size of the eyes is formed to the right of the thumbnail images P31 to P35. Above the selection area 661R, for example, the face image P52 of the user appearing on the right side of the first photographed image is displayed.

The face image P52 is generated, for example, by performing face recognition on the first photographed image by the display control unit 415 and cutting out the range of the face shown on the right side by trimming. The display of selection area 661R is used by the user pictured on the right.

By using such a background selection screen, each user can adjust the size of the eyes to suit his or her face, and can select a background image that matches the photographed image after adjustment. can.

・Example 2-7
FIG. 28 is a diagram showing another display example of the background selection screen.

On the background selection screen of FIG. 28, it is possible to select the size of the region of the person appearing in the photographed image in addition to the selection of the background image. A photographed image is generated by trimming a rectangular range in which a person is captured from an image with a wide angle of view. The narrower the trimming range, the larger the person appears in the captured image, and the wider the trimming range, the smaller the person appears in the captured image. Adjustment of the cutout range by trimming is performed using the background selection screen of FIG.

A selection area 671 is formed to the right of the row of thumbnail images P31 to P35, and three types of buttons used for selecting a range to be cut out by trimming are displayed. Other displays on the background selection screen in FIG. 28 are the same as those described with reference to FIG.

When a button displayed in the selection area 671 is pressed, the size of the user appearing in the captured image is adjusted by image processing and reflected in the display of the thumbnail images P31 to P35.

By using such a background selection screen, the user can select a background image that matches the size of the user in the captured image.

The trimming range may be adjusted by moving or scaling the captured image. For example, in this case, a display frame representing the trimming range is displayed while being superimposed and fixed on the captured image to be trimmed. The user moves, enlarges or reduces the photographed image so as to fit the desired range within the display frame.

<Example 3>
- Layer to be processed In the above description, the layer to be processed is only the layer of the background image, and the human region in the captured image is not processed.

(1) Processing may be performed to add an aura image according to the pose of the person. An aura image is a decorative image added around a person in a captured image. In this case, a person mask is generated by chromakey processing for the photographed image, and processing such as enlargement and movement is performed on this person mask to add an aura image to the boundary area between the person and the background.

(2) The person area may be processed in the same manner as the background image.

(3) Only the person area may be processed.

(4) When there is a foreground image, the foreground image may be processed in the same manner as the background image.

(5) The parameters used for adjusting the face may be changed according to the content of processing applied to the background image.

For example, if the processing applied to the background image is to perform a strong blurring process, the person will stand out when the person area is combined with such a processed background image. The parameters used for sizing are adjusted. On the other hand, if the background image is processed with a weak blurring process, the person will not stand out when the person area is combined with such a processed background image. A parameter used to adjust the depth is adjusted.

Since the way a person stands out differs depending on the content of processing applied to the background image, by adjusting the parameters relating to the appearance of the face in this manner, it is possible to obtain an optimally photographed image.

(6) The degree of gradation applied to the background image may be changed by pressing a predetermined button in order to give a sense of depth to the background of the person.

・Stamp image (1) When a stamp image is synthesized at the time of editing, if the position of the stamp image is the foreground position of the person area, the stamp image is not processed and is the background position of the person area Alternatively, the stamp image may be processed. A predetermined stamp image such as a heart-shaped stamp image is prepared on the editing screen, and it is possible to select whether the stamp image is to be combined with the foreground or the background of the person area.

As a result, the stamp image is synthesized in a natural state, so that it is possible to improve the completeness of the edited image.

(2) When a stamp image is synthesized during editing, the stamp image may be processed differently from the processing applied to the background image. It is possible to change the appearance of the image by performing processing different from the processing of the background image.

<Example 4>
- Example at the time of photographing (1) When a background image is selected before photographing, a processed background image may be combined with the live view image. Since the photographing is performed while knowing the details of the processing, the user is likely to have an image of the seal paper that will be finally obtained and how it will look on the portable terminal.

(2) If the photo sticker creation device 1 has a function of selecting a predetermined photographed image and retaking a photograph when a predetermined number of photographs such as six images have been photographed, It may be arranged such that not only the photographed image to be retaken is selected, but also the content of processing can be selected again.

(3) When a background image is selected before photographing, the type of photographed image obtained by photographing may be changed according to ON/OFF of processing.

When it is selected to process the background image (when the process is ON), for example, pin photography is performed for the purpose of obtaining an image to be used in SNS. Pin photography is photography for obtaining an image of the user alone. On the other hand, when processing off is selected, for example, shooting is performed for the purpose of obtaining a collage image. A collage image is one captured image created by combining a plurality of captured images.

・Modified example of sequence (1) The content of processing and the selection of the background image are performed using the same screen, but the content of processing and the selection of the pose at the time of shooting are performed using the same screen. good too.

(2) The contents of processing and the selection of the angle of view at the time of photographing may be performed using the same screen. Processing and angle of view may be selected.

(3) The selection of the details of processing and the number of users may be performed using the same screen.

(4) A background image may be selected at the time of editing.

FIG. 29 is a diagram showing another display example of the editing screen.

In the edit screen of FIG. 29, a display area 501 is displayed instead of the edit palette 613L, and category selection buttons 513-1L to 513-5L are displayed on the left side thereof. The display area 501 and category selection buttons 513-1L to 513-5L have functions similar to those described with reference to FIG. A background selection area 501A and a processing content selection area 501B are displayed on the edit screen.

By enabling selection of the background image at the time of editing in this way, the user can edit and select the background image while checking the balance between the editing and the background image. .

As described above, the embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.

1 photo sticker creation device, 91 camera, 92 touch panel monitor, 402 photography processing unit, 411 background image storage unit, 412 background processing unit, 413 photographed image acquisition unit, 414 synthesizing unit, 415 display control unit, 416 editing control unit

Claims (7)

a plurality of thumbnail images representing photographed images obtained by photographing the user as a subject;eachA selection screen displaying a plurality of sample images representing a background image to be combined with the photographed image is displayed with information used for selecting the content of processing, and the content of processing is selected using the information. a display control unit for switching the plurality of sample images to an image representing the background image processed with the same content according to the,
The selection of the background image is performed by selecting the background image to be combined with each of the captured images one by one,
When the background image to be combined with the predetermined captured image is selected, the display control unit displays the processed sample image as it is when selecting the background image to be combined with the next captured image. let
Display controller. The display control device according to claim 1, wherein the display control unit switches between displaying and not displaying the information used for selecting the content of processing according to the selection of the category of the background image. 3. The display control device according to claim 1, wherein the display control unit displays the information used for selecting the content of processing when the background image category of a single color is selected. 4. The display control device according to any one of claims 1 to 3, wherein the display control unit causes a plurality of selection buttons used for selecting processing content to be displayed as the information. 5. The display control device according to claim 4, wherein the display control unit displays the selection button including characters representing details of processing. The display controller
a plurality of thumbnail images representing photographed images obtained by photographing the user as a subject;eachdisplaying information used for selecting processing content on a selection screen displaying a plurality of sample images representing a background image to be combined with the captured image;
Switching the plurality of sample images to an image representing the background image processed with the same content in accordance with the content of processing being selected using the information.,
The selection of the background image is performed by selecting the background image to be combined with each of the captured images one by one,
When the background image to be synthesized with the predetermined photographed image is selected, the processed sample image is displayed as it is even when the background image to be synthesized with the next photographed image is selected.
Display control method. to the computer,
a plurality of thumbnail images representing photographed images obtained by photographing the user as a subject;eachdisplaying information used for selecting processing content on a selection screen displaying a plurality of sample images representing a background image to be combined with the captured image;
Switching the plurality of sample images to an image representing the background image processed with the same content in accordance with the content of processing being selected using the information.,
The selection of the background image is performed by selecting the background image to be combined with each of the captured images one by one,
When the background image to be synthesized with the predetermined photographed image is selected, the processed sample image is displayed as it is even when the background image to be synthesized with the next photographed image is selected.
A program for executing a process.

Images