JP2013092735A - Portable electronic device, display control method, and display control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable electronic device capable of reducing unpleasantness given to a user when one image is displayed across two screens.SOLUTION: A portable electronic device includes: face recognition means for detecting a face area included in an image; determination means for determining whether or not the detected face area is displayed across two displays when the image is displayed in a standard arrangement mode which defines conditions of a display position and a display size; and display control means for displaying the image in the standard arrangement mode when it is determined that the face area is displayed without being split across the two displays, and displaying the image in a mode in which the display position and/or the display size is changed so that the whole face area is displayed on one of the displays when the face area is determined to be displayed across the two displays.

Description

  The present invention relates to a portable electronic device equipped with two screens, and more particularly to content display control.

In recent years, smartphones have started to spread, and mobile phones have become more sophisticated, and mobile phone screens tend to expand. The screen of such a smartphone is about 3.5 inches as an example.
Furthermore, mobile phones equipped with two 3.5 inch screens have been developed. Such a mobile phone equipped with two screens can display different images on each screen, but if two screens are used as one screen equivalent to 4.7 inches, one image is enlarged. Can be displayed.

JP 2009-71588 A

When one image is displayed on two screens, the image is broken and displayed by the frame of the housing in which the two screens are respectively arranged. In particular, when a person's face is displayed across two screens during playback of a movie, a TV drama, or the like, there is a problem that the user is greatly uncomfortable.
Therefore, the present invention has been made in view of the above-described problems, and in a portable electronic device equipped with two screens, when using a method of displaying one image across two screens, It is an object of the present invention to provide a portable electronic device, a display control method, and a display control program that can reduce discomfort.

  In order to achieve the above object, a portable electronic device according to the present invention is a portable electronic device in which two casings each having a display are connected and one image is displayed across the two displays. When the image is displayed in a standard arrangement mode in which a face recognition unit that detects a face area included in the image and a condition of a display position and a display size are defined, the detected face area includes two face areas. A determination means for determining whether or not the image is displayed across the display; and when it is determined that the face area is displayed without extending over the two displays, the image is displayed in the standard arrangement mode. When the face area is determined to be displayed across two displays, the display position and / or the display size are changed so that the entire face area is displayed on one of the displays. The image Characterized in that it comprises a display control means for displaying.

  With the above configuration, when the portable electronic device displays one image across two displays, the entire face area is displayed on one of the displays, thereby reducing discomfort given to the user. be able to.

1 is an external view of a portable electronic device 1. FIG. It is a figure which shows the example of the image displayed on each display at the time of an open state. 2 is a functional block diagram functionally showing the configuration of the portable electronic device 1. FIG. It is a figure for demonstrating standard arrangement | positioning. It is a figure for demonstrating the arrangement | positioning change which concerns on Embodiment 1 when a face area | region is detected. 3 is a flowchart illustrating an operation of content reproduction processing according to the first embodiment. FIG. 6 is a diagram for explaining an effect of the first embodiment. It is a figure for demonstrating the arrangement | positioning change which concerns on Embodiment 2 when a face area | region is detected. 10 is a flowchart illustrating an operation of content reproduction processing according to the second embodiment. It is a figure for demonstrating the effect of Embodiment 2. FIG.

<1. Embodiment 1>
Below, the portable electronic device 1 which is one embodiment of the portable electronic device which concerns on this invention is demonstrated, referring drawings.
<1-1. Overview>
FIG. 1 is a diagram illustrating an appearance of the portable electronic device 1. The portable electronic device 1 includes an upper housing 11 and a lower housing 12. A first display 101 is disposed on the upper housing 11, and a second display 102 is disposed on the lower housing 12. Here, in each case, the surface on which the display is arranged is referred to as “main surface”. The upper housing 11 and the lower housing 12 are connected by a coupling portion 13. The base end side of the coupling portion 13 is pivotally supported by the lower housing 12, and the distal end side supports the upper housing 11 so as to be slidable and rotatable.

In the closed state shown in FIG. 1A, the upper casing 11 is positioned so as to overlap the main surface of the lower casing 12. Since the second display 102 is hidden by the upper casing 11, only the first display 101 is visible.
The portable electronic device 1 can be deformed from such a closed state to an open state shown in FIG. 1C by sliding the upper housing 11 as shown in FIG. In the open state, the main surface of the upper housing 11 and the main surface of the lower housing 12 are positioned on substantially the same plane, and both the first display 101 and the second display 102 can be visually recognized.

When the portable electronic device 1 is in the open state, as shown in FIG. 2 (a), a separate image can be displayed on each display, or as shown in FIG. 2 (b), one image can be displayed. Can be displayed across the first display 101 and the second display 102.
In the present embodiment, processing when the portable electronic device 1 reproduces moving image data (hereinafter referred to as “content”) such as a movie or a TV drama will be described.

When playing back the content, the portable electronic device 1 displays the content across the first display 101 and the second display 102 as shown in FIG. At this time, the portable electronic device 1 determines whether or not a frame image (hereinafter simply referred to as “image”) constituting the content includes a face of a specific person. If the face of a specific person is included, the portable electronic device 1 can display the face of the person without straddling the first display 101 and the second display 102 as necessary. The shift process for changing the display position of the image is performed.
<1-2. Internal Configuration of Portable Electronic Device 1>
FIG. 3 is a block diagram functionally showing the internal configuration of the portable electronic device 1.

As shown in the figure, the portable electronic device 1 includes a first display 101, a second display 102, a system control unit 103, a communication control unit 104, an antenna 105, a storage unit 106, a content buffer memory 107, a speaker 108, And a content display control unit 109.
Specifically, the portable electronic device 1 is a computer system including a processor, a ROM, a RAM, and the like. The storage unit 106, which is a ROM, stores computer programs such as a system control program, a content display control program, and a communication control program. Each of the system control unit 103, the communication control unit 104, and the content display control unit 109 realizes its functions when the processor executes a computer program stored in the storage unit 106.

The first display 101 includes a touch pad 111 as an input device and an LCD (Liquid Crystal Display) 112 as a display device. Although not shown, the first display includes an LED (Light Emitting Diode) backlight that is a light source.
Similarly, the second display 102 includes a touch pad 121, an LCD 122, and an LED backlight. As an example, the LCD 112 and the LCD 122 are 3.5 inches and can display an image of 800 × 480 pixels at the maximum.

  The touch pads 111 and 121 include capacitive touch sensors, and are provided so as to overlap the LCDs 112 and 122, respectively. The touch pads 111 and 121 are made of a transparent member so that images displayed on the LCDs 112 and 122 can be seen. In addition, the touch pads 111 and 121 detect the contact of the user's finger or the like, and during the detection, the coordinate values (x, y) of the contact position are set for each unit time (for example, 25 ms). To 103.

The system control unit 103 is connected to each functional block of the portable electronic device 1 and controls the entire portable electronic device 1.
The communication control unit 104 receives content from an external content server (not shown) via the antenna 105.
The content buffer memory 107 is a memory area (RAM) for temporarily storing the content received by the communication control unit 104 via the system control unit 103. The system control unit 103 sequentially reads out images from the content buffer memory 107 in accordance with the processing speed of the content display control unit 109, and outputs the read images to the content display control unit 109. It should be noted that the images constituting the content may all have the same predetermined size (for example, 1024 × 768 pixels, 1280 × 960 pixels, etc.), or the size may be variable for each image. .
<1-3. Details of Content Display Control Unit 109>
Here, the functional configuration of the content display control unit 109 will be described in detail.

The content display control unit 109 determines an arrangement for displaying each image constituting the content, and outputs each image to the first display and the second display with the determined arrangement.
As shown in FIG. 3, the content display control unit 109 includes a frame memory development unit 131, a face recognition unit 132, a determination unit 133, an arrangement change unit 134, and an output unit 135.
The frame memory development unit 131 holds in advance a standard arrangement 141 that is information defining a display size and a display position. The frame memory development unit 131 includes a frame memory 144. When images are sequentially received from the system control unit 103, the frame memory development unit 131 develops the received images in the frame memory 144 in a manner indicated by the standard layout 141.

Specifically, as shown in FIG. 4A, the standard arrangement 141 includes a display size 142 (960 × 800) and a display position 143 (0, 0).
The display size 142 represents the display size of one frame by the number of pixels. When the amount of received content data (number of pixels) is large, the frame memory development unit 131 thins out the pixels so that the number of pixels per frame is 960 × 800 pixels. Conversely, when the amount of data (number of pixels) of the received content is small, the pixels are complemented so that the number of pixels in one frame is 960 × 800 pixels.

The display position 143 is information for designating a writing position when an image is written in the frame memory 144, and represents a coordinate value of a pixel to be written in a reference point of the frame memory 144.
Here, as shown in FIG. 4B, the frame memory 144 uses the upper left end A as a reference point (0, 0), and sets the position (address) in the frame memory 144 in the horizontal direction from the reference point. This is expressed in an xy coordinate system with the axis being the y axis in the vertical direction.

Further, the “pixel coordinate value” is an xy with the pixel 201 at the upper left corner constituting the image as a reference (0, 0), the horizontal direction from the reference pixel 201 as the x axis, and the vertical direction as the y axis. It is a coordinate value (x, y) of each pixel in the coordinate system.
Since the display position is 143 (0, 0) in the standard arrangement 141, the frame memory development unit 131 converts the pixel 201 (0, 0) at the upper left end of the image into the upper left end A (0, 0) of the frame memory 144. Write to match.

  Further, the frame memory development unit 131 aligns the pixel 202 (959, 0) at the upper right end of the image with the upper right end B of the frame memory 144 and sets the pixel 203 (956, 797) at the lower right end of the image to the frame. The pixel 204 (0, 797) at the lower left end of the image is aligned with the lower left end D of the frame memory 144 in accordance with the lower right end C of the memory 144, and all the pixels constituting the image are stored in the frame memory. Write to 144.

  When the image developed in the frame memory 144 is output to the first display 101 and the second display 102, the output unit 135 described below displays the right image arranged in the right half area 145 of the frame memory 144. 4 (c) is output to the first display 101, and the left image arranged in the left half area 146 of the frame memory 144 is output to the second display 102 of FIG. 4 (c).

The face recognition unit 132 uses a well-known face recognition technique from each image developed in the frame memory 144 in the form shown by the standard layout 141 to obtain a “face region” that is a region including the face of a specific person. It has a function to detect.
Specifically, the face recognition unit 132 holds face data relating to feature points (for example, eyes, nose, lips, eyebrow end points, head apex, chin lower end point, etc.) included in a person's face in advance. . Then, the face recognition unit 132 extracts feature points from the image developed in the frame memory 144, and detects a human face using the extracted feature points and face data. Thereafter, the face recognition unit 132 determines the similarity between the detected face of the person and the face of the specific person given in advance, and whether or not the detected face of the person is the face of the specific person. Determine whether.

  When the face recognition unit 132 determines that the detected face of the person is the face of the specific person, the face recognition unit 132 specifies the coordinate values on the four-vertex frame memory 144 that form a rectangle including the face of the specific person. . In the present embodiment, specifying the coordinate values of the four vertices that form a rectangle including the face of a specific person is described as “detecting a face area”. When a plurality of human faces including the face of a specific person are included in one frame, the face recognition unit 132 of the present embodiment detects only the face area of the specific person.

When the face recognition unit 132 detects a face area and the image is output in the form indicated by the standard arrangement 141, the determination unit 133 displays the detected face area as the first display 101 and the second display. It is determined whether or not it is displayed across 102.
For example, consider a case where the image 150 shown in FIG. 5A is developed in the frame memory 144. The image 150 includes a face area 151.

The determination unit 133 acquires the x coordinate values of the four vertices a, b, c, and d constituting the face area 151 specified by the face recognition unit 132, and stores the acquired x coordinate values and the frame memory 144. It is determined whether or not the face area 151 is displayed across the first display 101 and the second display 102 using the x coordinate value (x _EF = 480) of the bisecting center line EF.
Specifically, when all the x coordinate values are smaller than 480, the determination unit 133 determines that the entire face area 151 is displayed on the second display 102. When all the x coordinate values are 480 or more, the determination unit 133 determines that the entire face area 151 is displayed on the first display 101. In addition, except for the case where all the x coordinate values are 480 or less or all the x coordinate values are 480 or more, the determination unit 133 displays the face area 151 across the first display 101 and the second display 102. to decide.

If the face area 151 is displayed without straddling two displays, the image 150 including the face area 151 may be output in the form indicated by the standard layout 141. In the example of FIG. 5A, the face area 151 is displayed across two displays, and thus shift processing is necessary.
The arrangement changing unit 134 changes the display position of the image developed in the frame memory 144 when the determining unit 133 determines that the face area is displayed across the first display 101 and the second display 102. Shift processing is performed.

Here, a specific example of shift processing when the image 150 shown in FIG. 5A is arranged in the frame memory 144 and when the image 160 shown in FIG. 5C is arranged in the frame memory 144. Will be described.
(1) Case of Image 150 FIG. 5A shows a state in which the image 150 is expanded in the frame memory 144 in the form indicated by the standard arrangement 141. The arrangement changing unit 134 calculates the area of the area aefd on the left side of the center line EF of the frame memory 144 and the area of the area ebcf on the right side of the center line EF in the face area 151, and compares the calculated areas. . Here, since the area of the left region aefd is large, the arrangement changing unit 134 identifies the second display 102 that is a display on which the region aefd is displayed as the “shift destination display”.

The arrangement changing unit 134 calculates the “extrusion amount l” that is the length of the portions eb and fc that protrude from the shift destination display among the sides ab and dc constituting the face area 151. Here, l = 120 pixels.
The arrangement changing unit 134 changes the display position of the image 150 developed in the frame memory 144 in the manner shown by the standard arrangement 141, and sets the pixel whose coordinate value is (120, 0) to the upper left end of the frame memory 144. According to A, the image 150 is rewritten in the frame memory 144 again.

  As a result, as shown in FIG. 5B, the image 150 is shifted to the left by the protrusion amount l = 120 pixels, and the entire face area 151 is displayed on the second display 102 as the shift destination display. become. When the size of the received image is larger than 960 × 800 pixels, or when the size of the temporally moving image is larger than 960 × 800 pixels, the arrangement changing unit 134 uses these data to generate a diagram. The pixels in the shaded area of 5 (b) may be complemented.

(2) Case of Image 160 FIG. 5C shows a state in which the image 160 is expanded in the frame memory 144 in a manner indicated by the standard arrangement 141. The arrangement changing unit 134 calculates the area of the region aefd on the left side of the center line EF of the frame memory 144 and the area of the region ebcf on the right side of the center line EF, and compares the calculated areas. . Here, since the area of the right region ebcf is large, the arrangement changing unit 134 identifies the first display 101 that is a display on which the region ebcf is displayed as the “shift destination display”.

The arrangement changing unit 134 calculates the “extension amount l” that is the length of the portions ae and df that protrude from the shift destination display among the sides ab and dc that form the face region 161. Here, l = 60 pixels.
The arrangement changing unit 134 changes the display position of the image 160 developed in the frame memory 144 in the manner shown by the standard arrangement 141, and changes the pixel having the coordinate value (0, 0) to A ₂ of the frame memory 144. At the same time, the image 160 is rewritten in the frame memory 144 again.

As a result, as shown in FIG. 5D, the image 160 is shifted to the right by the protrusion amount l = 60 pixels, and the entire face area 161 is displayed on the first display 101 as the shift destination display. become. As in the case of the image 150 described above, the arrangement changing unit 134 may complement the pixels in the shaded area in FIG.
The output unit 135 outputs the image developed in the frame memory 144 to the first display 101 and the second display 102. At this time, as described above, the output unit 135 outputs the left image to the second display 102 and outputs the right image to the first display.
<1-4. Operation of portable electronic device 1>
Here, the operation of content display control by the portable electronic device 1 will be described using the flowchart shown in FIG.

The operation shown in FIG. 6 is started by receiving an instruction for content reproduction by a user operation.
The content display control unit 109 repeats the processing from step S1 to step S16 for each image received from the system control unit 103.
First, the frame memory developing unit 131 develops the received image in the frame memory 144 in the form (display size 960 × 800 and display position (0, 0)) indicated by the standard layout 141 (step S2).

Next, the face recognition unit 132 performs face recognition processing of the image developed in the frame memory 144 (step S3). If no face area including the face of the specific person is detected as a result of the face recognition process (NO in step S4), the process proceeds to step S15.
If a face area including the face of the specific person is detected as a result of the face recognition process (YES in step S4), the determination unit 133 acquires the coordinate values of the four vertices constituting the face area from the face recognition unit 132 ( In step S5), it is determined whether the face area is divided by the center line of the frame memory 144. If the face area is not divided (NO in step S6), that is, if the entire face area is displayed on either the first display 101 or the second display 102, the process proceeds to step S15.

When the face area is divided (YES in step S6), the arrangement changing unit 134 calculates the area of the area displayed on the first display 101 and the area displayed on the second display 102 (step S7). .
When the area of the region displayed on the first display 101 is large or the areas are equal (YES in step S8), the arrangement changing unit 134 identifies the first display 101 as a shift destination display (step S9). Then, the “extension amount l” that is the length of the face area that protrudes from the first display 101 is calculated (step S10). Then, the arrangement changing unit 134 does not change the display size, shifts the image to the right by the protrusion amount l, and redeploys the image in the frame memory 144 (step S11).

  When the area of the region displayed on the second display 102 is large (NO in step S8), the arrangement changing unit 134 identifies the second display 102 as a shift destination display (step S12). Then, the “extension amount l” that is the length of the face area that protrudes from the second display 102 is calculated (step S13). Then, the arrangement changing unit 134 does not change the display size, shifts the image to the left by the protrusion amount l, and redeploys the image in the frame memory 144 (step S14).

Subsequently, the output unit 135 reads an image from the frame memory 144 and outputs the image to the first display 101 and the second display 102 (step S15).
When all the images that make up the content are processed, the content reproduction ends.
<1-5. Effect of Embodiment 1>
As shown in FIG. 7A, the face area included in the image has been conventionally displayed across the first display 101 and the second display 102, whereas the portable electronic device 1 of the present embodiment is If used, as shown in FIG. 7B, the image can be shifted to the left, and the arrangement can be changed so that the entire face area can be accommodated in the second display 102.

Thereby, the discomfort given to the user during the reproduction of the content can be reduced.
<2. Second Embodiment>
Hereinafter, another embodiment of the portable electronic device according to the present invention will be described with reference to the drawings.
<2-1. Overview>
In the first embodiment, when the face area spans two displays, the image is shifted to the right or left so that the face area is displayed without straddling the two displays. .

On the other hand, in the second embodiment, the face area is displayed without straddling the two displays by changing the display size of the image or by changing the display size and the display position of the image. To control.
Since the configuration of the portable electronic device according to the second embodiment is the same as that of the portable electronic device 1 shown in FIGS. Below, it demonstrates centering on a different part from Embodiment 1. FIG. For convenience, the components of the portable electronic device according to the second embodiment will be described using the reference numerals shown in FIG.
<2-2. Processing of Arrangement Changing Unit 134>
Here, when the image 170 shown in FIG. 8A is arranged in the frame memory 144 and when the image 180 shown in FIG. 8C is arranged in the frame memory 144, the arrangement changing unit 134. A specific example of the process performed by will be described.

(1) Case of Image 170 FIG. 8A shows a state in which the image 170 is expanded in the frame memory 144 in the form shown by the standard arrangement 141. The arrangement changing unit 134 calculates the area of the area aefd on the left side of the center line EF of the frame memory 144 and the area of the area ebcf on the right side of the center line EF in the face area 171 and compares the calculated areas. . Here, since the area of the left region aefd is large, the arrangement changing unit 134 identifies the second display 102 that is a display on which the region aefd is displayed as the “shift destination display”.

The arrangement changing unit 134 calculates the “extension amount l” that is the length of the portions eb and fc that protrude from the shift destination display 102 out of the sides ab and dc constituting the face region 171. Further, the arrangement changing unit 134 calculates a “protrusion ratio r” that is a ratio of l to the length L of the sides ab and dc. Here, r = 1 / L = 0.2.
The arrangement changing unit 134 reduces the display size of the image 170 developed in the frame memory 144 in the manner shown by the standard arrangement 141 by 20%, and changes the image to an image of 768 × 640 pixels. Then, the pixel whose coordinate value is (0, 0) of the image 170 of 768 × 640 pixels is aligned with the upper left end A of the frame memory 144, and the image 170 is rewritten in the frame memory 144 again.

As a result, as shown in FIG. 8B, the image 170 is reduced by 20%, so that the entire face area 171 is displayed on the second display 102 as the shift destination display. As in the case of the image 150 described above, the arrangement changing unit 134 may complement the pixels in the shaded area in FIG.
(2) Case of Image 180 FIG. 5C shows a state in which the image 180 is expanded in the frame memory 144 in the form indicated by the standard arrangement 141. The arrangement changing unit 134 calculates the area of the area aefd on the left side of the center line EF of the frame memory 144 and the area of the area ebcf on the right side of the center line EF in the face area 181 and compares the calculated areas. . Here, since the area of the right region ebcf is large, the arrangement changing unit 134 identifies the first display 101 that is a display on which the region ebcf is displayed as the “shift destination display”.

The arrangement changing unit 134 calculates the “extension amount l” that is the length of the portions ae and df that protrude from the shift destination display among the sides ab and dc constituting the face region 181. Further, the arrangement changing unit 134 calculates a “protrusion ratio r” that is a ratio of l to the length L of the sides ab and dc. Here, r = 1 / L = 0.2.
The arrangement changing unit 134 reduces the display size of the image 180 developed in the frame memory 144 in the manner shown by the standard arrangement 141 by 20%, and changes the image to an image of 768 × 640 pixels. Then, the pixel at the upper right end where the coordinate value of the image 170 of 768 × 640 pixels is (767, 0) is aligned with the upper right end B of the frame memory 144, and the image 180 is developed again in the frame memory 144 again. .

As a result, as shown in FIG. 8D, the image 180 is reduced by 20%, and the display position is shifted, so that the entire face area 181 is displayed on the first display 101 which is the shift destination display. Will be. As in the case of the image 150 described above, the arrangement changing unit 134 may complement the pixels in the shaded area in FIG.
<2-3. Operation of Portable Electronic Device According to Second Embodiment>
Here, the operation of content display control by the portable electronic device according to the second embodiment will be described using the flowchart shown in FIG. The operation shown in FIG. 9 is started by accepting an instruction for content reproduction by a user operation.

The content display control unit 109 repeats the processing from step S21 to step S36 for each image received from the system control unit 103.
First, the frame memory developing unit 131 develops the received image in the frame memory 144 in a mode (display size 960 × 800 and display position (0, 0)) indicated by the standard layout 141 (step S22).

Next, the face recognition unit 132 performs face recognition processing of the image developed in the frame memory 144 (step S23). As a result of the face recognition process, when a face area including the face of the specific person is not detected (NO in step S24), the process proceeds to step S35.
If a face area including the face of the specific person is detected as a result of the face recognition process (YES in step S24), the determination unit 133 acquires coordinate values constituting the face area from the face recognition unit 132 (step S25). Then, it is determined whether or not the face area is divided. If the face area is not divided (NO in step S26), that is, if the entire face area is displayed on either the first display 101 or the second display 102, the process proceeds to step S35.

When the face area is divided (YES in step S26), the arrangement changing unit 134 calculates the area of the area displayed on the first display 101 and the area displayed on the second display 102 (step S27). .
When the area of the region displayed on the first display 101 is large or the areas are equal (YES in step S28), the arrangement changing unit 134 identifies the first display 101 as a shift destination display (step S29). Then, the “protrusion ratio r” that is the ratio of the face area protruding from the first display 101 is calculated (step S30). The arrangement changing unit 134 reduces the display size of the image to 960 (1-r) × 800 (1-r), shifts the display position to the upper right end, and re-deploys the frame in the frame memory 144 (step S31). .

  When the area of the region displayed on the second display 102 is large (NO in step S28), the arrangement changing unit 134 identifies the second display 102 as a shift destination display (step S32). Then, the “protrusion ratio r” that is the ratio of the face area protruding from the second display 102 is calculated (step S33). The arrangement changing unit 134 reduces the display size of the image to 960 (1-r) × 800 (1-r), and re-expands it in the frame memory 144 without changing the display position (step S34).

Subsequently, the output unit 135 reads an image from the frame memory 144 and outputs the image to the first display 101 and the second display 102 (step S35).
When all the images that make up the content are processed, the content reproduction ends.
<2-4. Effects of Embodiment 2>
As shown in FIG. 10A, the face area included in the image is conventionally displayed across the first display 101 and the second display 102, whereas the portable electronic device of this embodiment is used. For example, as shown in FIG. 10B, by reducing the image, the arrangement can be changed so that the entire face area can be accommodated in the second display 102.

Thereby, the discomfort given to the user during the reproduction of the content can be reduced.
<3. Modification>
The embodiment of the portable electronic device according to the present invention has been described above. However, the illustrated portable electronic device can be modified as follows, and the present invention is portable as shown in the above embodiment. Of course, it is not limited to a type electronic device.
(1) In the above embodiment, the content has been described by taking moving image data such as a movie or a TV drama as an example. However, the present invention is not limited to this. The content may be still image data.
(2) The portable electronic device according to the present invention is not limited to the slide type as shown in FIG. The portable electronic device may have a configuration in which two housings in which displays are arranged are connected in a foldable manner. In the closed state, the main surfaces on which the displays are arranged face each other so that the displays cannot be visually recognized, and in the open state, the two displays can be simultaneously viewed.
(3) The present invention may be a mobile phone including the portable electronic device 1. The cellular phone includes an antenna for wireless communication, a wireless communication unit, a signal processing unit, a receiver, a microphone, and the like in addition to the configuration of FIG. Further, the present invention is not limited to the mobile phone provided with the portable electronic device 1, and various information terminals such as a portable game machine and a portable music player provided with the portable electronic device 1 are also included in the present invention.
(4) In the above embodiment, each touch pad has been described as being realized by a capacitive touch sensor. However, as this capacitive touch sensor, a large number of electrode patterns are made of plastic, glass, or the like. A projection type that is formed on a substrate and discriminates by measuring the ratio of the amount of current by a plurality of electrode patterns in the vicinity of the contact point, and has a conductive film and a substrate, and electrodes are formed at the corners of the substrate. An appropriate one can be used, such as a surface type that forms a uniform electric field by a conductive film and measures the ratio of the current amount of the terminal at the corner by contact with a finger or the like to determine the contact position.

In addition, the detection method of each touch pad is not limited to the capacitance method, but an electromagnetic induction method using a dedicated pen such as an electronic pen, a matrix switch method including a transparent electrode having a two-layer structure, and two resistive films A voltage is applied to one of the two resistance films, and the resistance film system detects the voltage according to the position operated on the other resistance film, and the rebound of the vibration wave is detected by the voltage change of the piezoelectric element, and the contact of the finger or the like is detected. Any suitable method may be used, such as a surface acoustic wave method, an infrared method for detecting a position where a finger or the like is in contact with a shielded infrared ray, or an optical sensor method for detecting a contact position by incorporating an optical sensor in an image.
(5) In the above embodiment, the arrangement is changed so that the face area is displayed on the first display 101 when the detected face area is substantially bisected by the two displays. However, it goes without saying that the arrangement may be changed so that the face area is displayed on the second display 102.

Furthermore, when the detected face area is substantially bisected by two displays, it is limited to changing the arrangement so that the face area is displayed on one of the preset displays as described above. Not.
For example, when the currently processed image includes a face area and the face area is substantially bisected by two displays, the position of the shift destination is determined using the position of the face area of the image that is temporally adjacent to the image. A display may be configured to be determined.

That is, when the specific person is moving from the left to the right of the screen, the arrangement changing unit 134 makes the first display 101 the shift destination display so that the face area included in the image is displayed on the right display. Identify. On the contrary, when the specific person is moving from the right to the left of the screen, the arrangement changing unit 134 shifts the second display 102 so that the face area included in the image is displayed on the left display. Specific to the display.
(6) In the above embodiment, the face recognition unit 132 is configured to detect only the face area of a specific person. However, the present invention is not limited to this. The face areas of a plurality of persons are detected from one image, and the arrangement is made so that all detected face areas are displayed without straddling two displays. Modifications are also included in the present invention.
(7) In the first embodiment, the arrangement changing unit 134 shifts the image by changing the display position of the image on the frame memory 144. However, the present invention is not limited to this. When the output unit 135 reads out an image developed in the frame memory 144 in the form indicated by the standard arrangement 141, the present invention also includes a case where the output unit 135 performs a shift process by shifting the read start position. In this case, it is necessary to notify the information specifying the reading start position from the arrangement changing unit 134 to the output unit 135.
(8) You may combine said embodiment and said modification suitably suitably.
<4. Supplement>
Hereinafter, the configuration as one embodiment of the present invention and its modifications and effects will be described.
(A) A portable electronic device according to an embodiment of the present invention is a portable electronic device in which two casings each having a display are connected and one image is displayed across the two displays. The face recognition means for detecting the face area included in the image and when the image is displayed in a standard arrangement in which the display position and display size conditions are defined, the detected face area spans two displays. A determination means for determining whether or not the image is displayed, and when it is determined that the face area is displayed without straddling two displays, the image is displayed in the standard arrangement mode, and the face area is displayed. Is displayed across two displays, the image is displayed in a manner in which the display position and / or display size is changed so that the entire face area is displayed on one of the displays. Display Characterized in that it comprises a control means.

According to this configuration, when the portable electronic device displays one image across two displays, the entire face area is displayed on one of the displays, thereby reducing discomfort given to the user. be able to.
(B) In the portable electronic device, when it is determined that the face area is displayed across two displays, the display control unit shifts one display having a large area of the face area to be displayed. It is characterized by comprising a specifying unit specified as a destination display, and a changing unit that changes a display position and / or a display size so that the entire face area is displayed on the shift destination display.

According to this configuration, since the amount of change in the display position and / or display size can be suppressed, it is possible to reduce a sense of discomfort felt by the user by changing the display position and / or display size of the image.
(C) In the portable electronic device, the face area detected by the face recognizing unit is a rectangle, and the display control unit forms the face area and has one side extending over the two displays. Among them, a calculation unit that calculates the length of a portion that protrudes from the shift destination display is provided, and the change unit changes the display position so that the image is shifted in the direction of the shift destination display by the calculated length. Then, the image is displayed with the changed display position and the display size defined in the standard arrangement mode.

According to this configuration, since the display position is shifted within a minimum range in which the entire face area can be accommodated in the shift destination display, it is possible to reduce discomfort felt by the user by changing the display position of the image.
(D) In the portable electronic device, the face area detected by the face recognizing unit is a rectangle, and the display control unit forms the face area on one side straddling the two displays. On the other hand, the image processing apparatus includes a calculation unit that calculates a ratio of a portion that protrudes from the shift destination display, and the change unit reduces the display size of the image by the calculated ratio, and the display position and reduction defined in the standard arrangement mode The image is displayed in the display size.

According to this configuration, since the display size is reduced within a minimum range in which the entire face area can be accommodated in the shift destination display, it is possible to reduce discomfort felt by the user by changing the display size of the image.
(E) In the portable electronic device, the face area detected by the face recognition means is a rectangle, and the display control means forms the face area on one side that straddles the two displays. On the other hand, the image processing apparatus includes a calculation unit that calculates a ratio of a portion that protrudes from the shift destination display, and the change unit reduces the display size of the image by the calculated ratio, and the image is reduced by the reduced length. The display position is changed so as to shift in the direction of the shift destination display, and the image is displayed with the changed display position and the reduced display size.

According to this configuration, the display size is reduced and the display position is shifted within a minimum range in which the entire face area can be accommodated in the shift destination display, so that the user feels by changing the display size and display position of the image. Discomfort can be reduced.
(F) In the portable electronic device, the image is each of a plurality of images constituting moving image data, and the face recognition unit specifies in advance from the start of reproduction of the moving image data to the end of reproduction. The face area including the face of the specified person is detected from each image.

For example, if the main character of a movie or TV drama is set as the specific person, the main character's face is always displayed on one of the displays. Therefore, the face of the hero is not displayed across the two displays, and the discomfort given to the user can be suppressed.
(G) In the portable electronic device, when the face area of the specific person detected in the image constituting the moving image data is displayed in a standard arrangement mode, the display is divided into two substantially two displays. In this case, the specifying unit specifies the shift destination display using the position of the face area included in the immediately preceding image or the immediately following image.

  For example, using the position of the face area included in the previous image or the next image of the image, whether the specific person is moving from the left to the right of the screen or moving from the right to the left It can be judged whether it is. Therefore, when the specific person is moving from the left to the right of the screen, the specifying unit specifies the shift destination display so that the face area included in the image is displayed on the right display that is the destination, and reversely In addition, when the specific person is moving from the right to the left of the screen, the specifying unit specifies the shift destination display so that the face area included in the image is displayed on the left display as the movement destination. Can do.

  Accordingly, it is possible to suppress a sense of incongruity felt by the user by changing the display position and / or display size of the image.

  The present invention includes two displays, and in an industry that manufactures and sells electronic devices that display and reproduce content using the two displays, a human face image included in the content straddles the two displays. By being displayed without being displayed, it can be used as a technique for providing a more comfortable content viewing environment for the user.

DESCRIPTION OF SYMBOLS 1 Portable electronic device 11 Upper housing | casing 12 Lower housing | casing 13 Connection part 101 1st display 102 2nd display 103 System control part 104 Communication control part 105 Antenna 106 Storage part 107 Content buffer memory 108 Speaker 109 Content display control part 131 Frame memory development unit 132 Face recognition unit 133 Judgment unit 134 Arrangement change unit 135 Output unit 144 Frame memory

Claims (9)

Two portable electronic devices that connect two casings each having a display and display one image across the two displays,
Face recognition means for detecting a face area included in the image;
A determination means for determining whether or not the detected face area is displayed across two displays when the image is displayed in a standard arrangement form in which a display position and a display size condition are defined;
When it is determined that the face area is displayed without straddling two displays, the image is displayed in the standard arrangement mode, and it is determined that the face area is displayed across two displays. And a display control means for displaying the image in a manner in which a display position and / or a display size is changed so that the entire face area is displayed on any one of the displays. Type electronic equipment. The display control means includes
When it is determined that the face area is displayed across two displays, a specifying unit that specifies one display having a large area of the displayed face area as a shift destination display;
The portable electronic device according to claim 1, further comprising: a changing unit that changes a display position and / or a display size so that the entire face area is displayed on the shift destination display. The face area detected by the face recognition means is rectangular;
The display control means includes
A calculation unit that calculates the length of a portion that forms the face region and extends out of the shift destination display among one side that straddles the two displays;
The changing unit changes the display position so that the image is shifted in the direction of the shift destination display by the calculated length, and the image is displayed with the changed display position and the display size defined by the standard arrangement. The portable electronic device according to claim 2, wherein the portable electronic device is displayed. The face area detected by the face recognition means is rectangular;
The display control means includes
A calculation unit that calculates the ratio of a portion that forms the face region and protrudes from the shift destination display with respect to one side straddling the two displays,
The said change part reduces the display size of the said image by the calculated ratio, and displays the said image by the display position defined by the said standard arrangement | positioning, and the reduced display size. Portable electronic device. The face area detected by the face recognition means is rectangular;
The display control means includes
A calculation unit that calculates the ratio of a portion that forms the face region and protrudes from the shift destination display with respect to one side straddling the two displays,
The changing unit reduces the display size of the image by the calculated ratio, and changes and changes the display position so that the image is shifted in the direction of the shift destination display by the reduced length. The portable electronic device according to claim 2, wherein the image is displayed at a display position and a reduced display size. The image is each of a plurality of images constituting moving image data,
The face recognition unit detects the face area including a face of a specific person specified in advance from each image from the start of playback to the end of playback of the moving image data. The portable electronic device described. When the face area of the specific person detected in the image constituting the moving image data is displayed in a two-part display when displayed in a standard arrangement mode, the specifying unit includes: The portable electronic device according to claim 6, wherein the shift destination display is specified using a position of the face area included in an image immediately before or one behind the image. A display control method used in a portable electronic device in which two housings each having a display are connected and one image is displayed across the two displays,
A face recognition step of detecting a face area included in the image;
A determination step of determining whether or not the detected face area is displayed across two displays when the image is displayed in a standard arrangement mode in which a display position and a display size condition are defined;
When it is determined that the face area is displayed without straddling two displays, the image is displayed in the standard arrangement mode, and it is determined that the face area is displayed across two displays. A display control step of displaying the image in a manner in which a display position and / or a display size is changed so that the entire face area is displayed on one of the displays. Control method. A display control program used in a portable electronic device in which two casings each having a display are connected and one image is displayed across the two displays,
A face recognition step of detecting a face area included in the image;
A determination step of determining whether or not the detected face area is displayed across two displays when the image is displayed in a standard arrangement mode in which a display position and a display size condition are defined;
When it is determined that the face area is displayed without straddling two displays, the image is displayed in the standard arrangement mode, and it is determined that the face area is displayed across two displays. A display control step of displaying the image in a manner in which a display position and / or a display size is changed so that the entire face area is displayed on one of the displays. A display control method characterized in that the display control method is executed.

Images