JP2013055675A - Image processing apparatus and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing apparatus and an image processing method capable of properly displaying a stereoscopic image in accordance with the positions of viewers.SOLUTION: According to the embodiment, the image processing apparatus comprises a viewer detector, a viewable region information calculator, and a viewable region controller. The viewer detector detects the number of viewers and the positions of the viewers using an image photographed with a camera. The viewable region information calculator calculates, in accordance with the number of the viewers and the positions of the viewers, control parameters so as to set viewable regions in which plural parallax images displayed on a display are viewable stereoscopically. The viewable region controller sets the viewable regions in accordance with the control parameters.

Description

  Embodiments described herein relate generally to a video processing apparatus and a video processing method.

In recent years, stereoscopic image display devices (so-called naked-eye 3D televisions) that allow viewers to view stereoscopic images with the naked eye without using special glasses have become widespread. This stereoscopic video display device displays a plurality of images with different viewpoints. The light rays of these images are guided to the viewer's eyes by controlling the output direction by, for example, a parallax barrier or a lenticular lens.
If the viewer's position is appropriate, the viewer sees different parallax images for the left eye and the right eye, and thus can recognize the image in three dimensions.

  However, with a naked-eye 3D television, there is a problem that an image cannot be seen stereoscopically depending on the position of the viewer.

JP-A-11-164329

  Provided are a video processing device and a video processing method capable of appropriately displaying a stereoscopic video in accordance with the position of a viewer.

  According to the embodiment, a video processing apparatus including a viewer detection unit and an image control unit is provided. The viewer detection unit detects the number and positions of viewers included in the video using the captured video. The image control unit performs image control according to the position of the viewer when the number of detected viewers is one, and according to the position of the viewer when the number of detected viewers is plural. Does not perform image control.

1 is an external view of a video display device 100 according to a first embodiment. 1 is a block diagram showing a schematic configuration of a video display device 100 according to a first embodiment. The figure which looked at a part of liquid crystal panel 1 and the lenticular lens 2 from upper direction. The figure which shows an example of the method of calculating viewing zone information. 6 is a flowchart showing an example of processing operation of the controller 10 of the video display apparatus 100 according to the first embodiment. The block diagram which shows schematic structure of the video display apparatus 100a which concerns on 2nd Embodiment. The flowchart which shows an example of the processing operation of the controller 10a of the video display apparatus 100a which concerns on 2nd Embodiment. The figure which shows the specific example of a visual field setting. The figure explaining the example which sets a priority based on viewing-and-listening time. The figure which shows an example of a priority table. The figure which shows the example which sets a priority based on a priority table. The figure which shows the example which shows the relationship between a viewer and the priority of the viewer. The block diagram which shows schematic structure of the video display apparatus 100 'which is a modification of FIG.

  Embodiments according to the present invention will be specifically described below with reference to the drawings.

(First embodiment)
FIG. 1 is an external view of a video display device 100 according to the first embodiment, and FIG. 2 is a block diagram showing a schematic configuration thereof. The video display device 100 includes a liquid crystal panel 1, a lenticular lens 2, a camera 3, a light receiving unit 4, and a controller (video processing device) 10.

  The liquid crystal panel (display unit) 1 is, for example, a 55-inch panel, and 11520 (= 1280 * 9) pixels in the horizontal direction and 720 pixels in the vertical direction are arranged. In each pixel, three subpixels, that is, an R subpixel, a G subpixel, and a B subpixel are formed in the vertical direction. The liquid crystal panel 1 is irradiated with light from a backlight device (not shown) provided on the back surface. Each pixel transmits light having a luminance corresponding to a parallax image signal (described later) supplied from the controller 10.

  The lenticular lens (aperture control unit) 2 has a plurality of convex portions arranged along the horizontal direction of the liquid crystal panel 1, and the number thereof is 1/9 of the number of pixels in the horizontal direction of the liquid crystal panel 1. The lenticular lens 2 is affixed to the surface of the liquid crystal panel 1 so that one convex portion corresponds to nine pixels arranged in the horizontal direction. The light transmitted through each pixel is output in a specific direction with directivity from the vicinity of the top of the convex portion.

  The liquid crystal panel 1 of the present embodiment can display a stereoscopic image by a multi-parallax method (integral imaging method) of 3 or more parallax or a 2-parallax method, and can also display a normal two-dimensional image. .

  In the following description, an example in which nine pixels are provided corresponding to each convex portion of the lenticular lens 2 and a 9-parallax multi-parallax method can be adopted will be described. In the multi-parallax method, the first to ninth parallax images are displayed on nine pixels corresponding to the respective convex portions. The first to ninth parallax images are images obtained by viewing the subject from nine viewpoints arranged along the horizontal direction of the liquid crystal panel 1. The viewer can stereoscopically view the video through the lenticular lens 2 by viewing one parallax image of the first to ninth parallax images with the left eye and the other parallax image with the right eye. According to the multi-parallax method, the viewing zone can be expanded as the number of parallaxes is increased. The viewing area refers to an area in which an image can be viewed stereoscopically when the liquid crystal panel 1 is viewed from the front of the liquid crystal panel 1.

  On the other hand, in the 2-parallax method, the right-eye parallax image is displayed on four of the nine pixels corresponding to each convex portion, and the left-eye parallax image is displayed on the other five. The left-eye and right-eye parallax images are images in which the subject is viewed from the left viewpoint and the right viewpoint among the two viewpoints arranged in the horizontal direction. The viewer can stereoscopically view the video through the lenticular lens 2 by viewing the left-eye parallax image with the left eye and the right-eye parallax image with the right eye. According to the two-parallax method, the stereoscopic effect of the displayed image is more easily obtained than in the multi-parallax method, but the viewing area is narrower than that in the multi-parallax method.

  The liquid crystal panel 1 can also display a two-dimensional image by displaying the same image on nine pixels corresponding to each convex portion.

  In the present embodiment, the relative positional relationship between the convex portion of the lenticular lens 2 and the displayed parallax image, that is, how to display the parallax image on the nine pixels corresponding to each convex portion, The viewing zone can be variably controlled according to the situation. Hereinafter, control of the viewing zone will be described by taking a multi-parallax method as an example.

FIG. 3 is a view of a part of the liquid crystal panel 1 and the lenticular lens 2 as viewed from above. The shaded area in the figure shows the viewing area, and the image can be viewed stereoscopically when the liquid crystal panel 1 is viewed from the viewing area. The other areas are areas where reverse viewing and crosstalk occur, and it is difficult to stereoscopically view the video.
3 shows the relative positional relationship between the liquid crystal panel 1 and the lenticular lens 2, more specifically, the distance between the liquid crystal panel 1 and the lenticular lens 2, or the horizontal shift between the liquid crystal panel 1 and the lenticular lens 2. FIG. It shows how the viewing zone changes depending on the amount.

  Actually, since the lenticular lens 2 is attached to the liquid crystal panel 1 with high accuracy, it is difficult to physically change the relative position between the liquid crystal panel 1 and the lenticular lens 2. .

  Therefore, in the present embodiment, the relative positional relationship between the liquid crystal panel 1 and the lenticular lens 2 is apparently displayed by shifting the display positions of the first to ninth parallax images displayed on each pixel of the liquid crystal panel 1. Change and thus adjust the viewing zone.

  For example, when the first to ninth parallax images are respectively displayed on nine pixels corresponding to the respective convex portions (FIG. 3A), the parallax images are displayed while being shifted to the right as a whole (FIG. 3). (B)), the viewing zone moves to the left. Conversely, when the parallax image is displayed shifted to the left as a whole, the viewing zone moves to the right.

  Further, when the parallax image is not shifted in the vicinity of the center in the horizontal direction, and the parallax image is displayed with a larger shift toward the outside toward the outer side of the liquid crystal panel 1 (FIG. 3C), the viewing zone is closer to the liquid crystal panel 1. Moving. In addition, what is necessary is just to interpolate suitably the pixel between the parallax image which shifts and the parallax image which does not shift, and the pixel between the parallax images from which the shift amount differs according to a surrounding pixel. Contrary to FIG. 3C, when the parallax image is not shifted near the center in the horizontal direction, and the parallax image is displayed with a large shift toward the center toward the outside of the liquid crystal panel 1, the viewing area is the liquid crystal panel 1. Move away from the camera.

  As described above, the viewing area can be moved in the left-right direction or the front-rear direction with respect to the liquid crystal panel 1 by shifting the whole or part of the parallax image. Although only one viewing zone is shown in FIG. 3 for the sake of simplification, actually, a plurality of viewing zones 21 exist in the viewing zone P, and these move together. The viewing zone is controlled by the controller 10 shown in FIG. Note that the viewing area other than the viewing area 21 is the reverse viewing area 22 in which it is difficult to view a good stereoscopic image due to occurrence of reverse viewing or crosstalk.

  Returning to FIG. 1, the camera 3 is attached at a predetermined elevation near the lower center of the liquid crystal panel 1, and photographs a predetermined range in front of the liquid crystal panel 1. The captured video is supplied to the controller 10 and used to detect information about the viewer such as the viewer's position and the viewer's face. The camera 3 may shoot either a moving image or a still image.

  The light receiving unit 4 is provided, for example, on the left side of the lower part of the liquid crystal panel 1. And the light-receiving part 4 receives the infrared signal transmitted from the remote control which a viewer uses. Whether the infrared signal is to display a stereoscopic image or a two-dimensional image, whether to use a multi-parallax method or a two-parallax method when displaying a stereoscopic image, whether to control the viewing area, Including signals indicating the like.

  Next, details of the components of the controller 10 will be described. As shown in FIG. 2, the controller (video processing device) 10 includes a tuner decoder 11, a parallax image conversion unit 12, a viewer detection unit 13, a viewing area information calculation unit 14, and an image adjustment unit 15. . The controller 10 is mounted as one IC (Integrated Circuit), for example, and is disposed on the back side of the liquid crystal panel 1. Of course, a part of the controller 10 may be implemented by software.

  A tuner decoder (reception unit) 11 receives and selects an input broadcast wave and decodes an encoded video signal. When a data broadcast signal such as an electronic program guide (EPG) is superimposed on the broadcast wave, the tuner decoder 11 extracts it. Alternatively, the tuner decoder 11 receives an encoded video signal from a video output device such as an optical disk playback device or a personal computer instead of a broadcast wave, and decodes it. The decoded signal is also called a baseband video signal, and is supplied to the parallax image conversion unit 12. When the video display apparatus 100 does not receive broadcast waves and displays a video signal received exclusively from the video output device, a decoder having a decoding function may be provided as a receiving unit instead of the tuner decoder 11.

  The video signal received by the tuner decoder 11 may be a two-dimensional video signal, and left-eye and right-eye images are obtained by frame packing (FP), side-by-side (SBS), top-and-bottom (TAB), or the like. It may be a three-dimensional video signal. In addition, the video signal may be a three-dimensional video signal including an image having three or more parallaxes.

  The parallax image conversion unit 12 converts the baseband video signal into a plurality of parallax image signals and supplies them to the image adjustment unit 15 in order to stereoscopically display the video. The parallax image conversion unit 12 has different processing contents depending on which of the multi-parallax method and the two-parallax method is adopted. The processing content of the parallax image conversion unit 12 differs depending on whether the baseband video signal is a two-dimensional video signal or a three-dimensional video signal.

  When the two-parallax method is adopted, the parallax image conversion unit 12 generates left-eye and right-eye parallax image signals corresponding to the left-eye and right-eye parallax images, respectively. More specifically, as follows.

  When a two-parallax method is adopted and a 3D video signal including a left-eye image and a right-eye image is input, the parallax image conversion unit 12 can display the left-eye and right-eye parallax images in a format that can be displayed on the liquid crystal panel 1. Generate a signal. When a 3D video signal including three or more images is input, for example, using any two of them, the parallax image conversion unit 12 generates a left-eye parallax image signal and a right-eye parallax image signal.

  In contrast, when a two-dimensional parallax method is used and a two-dimensional video signal that does not include parallax information is input, the parallax image conversion unit 12 uses the left eye for the left eye based on the depth value of each pixel in the video signal. And a right-eye parallax image signal is generated. The depth value is a value indicating how much each pixel is displayed so as to be seen in front of or behind the liquid crystal panel 1. The depth value may be added to the video signal in advance, or the depth value may be generated by performing motion detection, composition identification, human face detection, and the like based on the characteristics of the video signal. In the parallax image for the left eye, the pixel seen in the foreground needs to be displayed shifted to the right side from the pixel seen in the back. Therefore, the parallax image conversion unit 12 generates a left-eye parallax image signal by performing a process of shifting the pixel that appears in the foreground in the video signal to the right. The larger the depth value, the larger the shift amount.

  On the other hand, when the multi-parallax method is adopted, the parallax image conversion unit 12 generates first to ninth parallax image signals corresponding to the first to ninth parallax images, respectively. More specifically, as follows.

  When the multi-parallax method is adopted and a two-dimensional video signal or a three-dimensional video signal including an image of 8 parallax or less is input, the parallax image conversion unit 12 uses the left-eye and right-eye from the two-dimensional video signal. The first to ninth parallax image signals are generated based on the depth information in the same manner as the generation of the parallax image signal.

  When a multi-parallax method is adopted and a three-dimensional video signal including an image of 9 parallax is input, the parallax image conversion unit 12 generates the first to ninth parallax image signals using the video signal.

  The viewer detection unit 13 detects a viewer using the video imaged by the camera 3, and information related to the detected viewer (for example, the number of viewers, position, face information, etc .; hereinafter, "viewer recognition"). It is collectively referred to as “information”. Further, the viewer detection unit 13 can track even if the viewer moves. Therefore, the viewing time for each viewer can be grasped.

The viewer's position information is represented as, for example, positions on the X axis (horizontal direction), Y axis (vertical direction), and Z axis (direction orthogonal to the liquid crystal panel 1) with the center of the liquid crystal panel 1 as the origin. The More specifically, the viewer detection unit 13 first recognizes the viewer by detecting a face from the video captured by the camera 3. Next, the viewer detection unit 13 calculates the position on the X axis and the Y axis from the position of the viewer in the video, and calculates the position on the Z axis from the size of the face.
The number of viewers can be obtained from the number of detected viewer faces, for example. When there are a plurality of viewers, the viewer detector 13 may detect a predetermined number, for example, 10 viewers. In this case, when the number of detected faces is larger than 10, for example, the positions of 10 viewers are detected in order from the position closer to the liquid crystal panel 1, that is, the position on the Z-axis is smaller. Further, only a person facing the liquid crystal panel 1 may be detected as a viewer.

  In addition, there is no restriction | limiting in particular in the method in which the position detection module 13 detects a viewer's position, The camera 3 may be an infrared camera and may detect a viewer's position using a sound wave.

  The viewing area information calculation unit 14 calculates control parameters for setting the viewing area according to the number of viewers and the positions of the viewers. This control parameter is, for example, an amount by which the parallax image described in FIG. 3 is shifted, and is a single parameter or a combination of a plurality of parameters. Then, the viewing zone information calculation unit 14 supplies the calculated control parameter to the image adjustment unit 15.

  FIG. 4 is a diagram illustrating an example of a technique for calculating viewing zone information. The viewing zone information calculation unit 14 determines in advance several possible viewing zone patterns. Then, for each viewing zone, the viewing zone information calculation unit 14 calculates an area where the viewing zone and the detected viewer overlap, and determines the viewing zone having the maximum area as an appropriate viewing zone. In the example of FIG. 4, among the predetermined patterns of the five viewing zones (shaded regions) in FIGS. 4A to 4E, the viewing zone is set on the left side toward the liquid crystal panel 1. In 4 (b), the area where the viewer 20 overlaps with the viewing area is maximized. Therefore, the viewing zone information calculation unit 14 determines that the viewing zone pattern in FIG. 4B is an appropriate viewing zone. In this case, control parameters for displaying a parallax image in the pattern of FIG. 4B are supplied to the image adjustment unit 15 of FIG.

  More specifically, in order to set a desired viewing zone, the viewing zone information calculation unit 14 may use a viewing zone database in which a control parameter is associated with a viewing zone set by the control parameter. The viewing zone information calculation unit 14 can find a viewing zone in which the selected viewer can be accommodated by searching the viewing zone database.

  The image adjusting unit (viewing zone control unit) 15 supplies the liquid crystal panel 1 after adjusting the parallax image signal according to the calculated control parameter in order to control the viewing zone. . The liquid crystal panel 1 displays an image corresponding to the adjusted parallax image signal.

  FIG. 5 is a flowchart illustrating an example of a processing operation of the controller 10 of the video display apparatus 100 according to the first embodiment.

  First, the viewer detection unit 13 detects the number and positions of viewers using the video taken by the camera 3 (step S11). Then, the viewing zone is set as follows according to the number and positions of the detected viewers.

  When the number of viewers is one (YES in step S12), the viewing zone information calculation unit 14 calculates control parameters so that the viewing zone is set at the viewer's position (step S13). Then, the image adjustment unit 15 adjusts the parallax image signal according to the control parameter (step S14), and the parallax image corresponding to the adjusted parallax image signal is displayed on the liquid crystal panel 1. Thereby, an appropriate viewing area is set for the viewer.

  On the other hand, when there are a plurality of viewers (NO in step S12), the viewing zone information calculation unit 14 does not change the viewing zone and does not update the control parameter so as to maintain the current viewing zone. As a result, the processing of the image adjustment unit 15 is not updated, and the viewing zone is kept at a fixed position.

  For example, if one of them moves while watching the video with multiple people, and the viewing zone follows the moved person, the viewing status of other viewers who are still watching the video May get worse. On the other hand, in this embodiment, since the viewing area is kept constant, an appropriate viewing area is set for a viewer who is viewing a video at a standstill.

  Thus, in the first embodiment, the number of viewers is detected, and if there is only one viewer, a viewing zone suitable for the viewer is set. Therefore, a viewing zone suitable for the viewer is set. The On the other hand, since the viewing zone is not updated if there are a plurality of viewers, it is possible to suppress the viewing zone from being changed unnecessarily when there are a plurality of viewers.

(Second Embodiment)
In the first embodiment described above, the viewing zone is not updated when there are a plurality of viewers. On the other hand, in the second embodiment, when there are a plurality of viewers, the viewing zone is updated based on a predetermined prioritization rule.

  FIG. 6 is a block diagram illustrating a schematic configuration of a video display device 100a according to the second embodiment. In FIG. 6, the same reference numerals are given to components common to FIG. 2, and the differences will be mainly described below.

  The controller 10a of the video display device 100a of FIG. 6 further includes a priority setting unit 16 and a storage unit 17. When there are a plurality of viewers, the priority setting unit 16 sets a priority for each viewer based on a predetermined prioritization rule. An example of the priority rule will be described later. The storage unit 17 is used for setting the priority.

  FIG. 7 is a flowchart illustrating an example of a processing operation of the controller 10a of the video display device 100a according to the second embodiment.

  First, the viewer detection unit 13 detects the number and positions of viewers using video captured by the camera 3 (step S21). And the priority setting part 16 sets a priority to each viewer (step S22). When there is one viewer, the priority setting unit 16 may set the highest priority of the viewer. On the other hand, when there are a plurality of viewers, priority is set for each viewer based on the prioritization rule. The priority and position of each viewer are supplied to the viewing area information calculation unit 14.

  Subsequently, the viewing area information calculation unit 14 calculates a control parameter according to the priority (step S23). For example, the viewing area information calculation unit 14 calculates the control parameter so that the viewing area is set at the position of the viewer with the highest priority. Alternatively, the viewing area information calculation unit 14 may calculate the control parameter so that as many viewers as possible fall within the viewing area in the order of priority as follows. That is, first, the viewer with the lowest priority is excluded, and calculation of control parameters for allowing all remaining viewers to fall within the viewing zone is attempted. If the control parameter still cannot be calculated, the control parameter calculation is attempted by excluding the viewer with the lowest priority among the remaining viewers. By repeating this, it is possible to calculate a control parameter for preferentially placing a viewer with a relatively high priority within the viewing zone.

  The image adjustment unit 15 adjusts the parallax image signal according to the control parameter calculated in this way (step S24), and a parallax image corresponding to the adjusted parallax image signal is displayed on the liquid crystal panel 1.

  FIG. 8 is a diagram illustrating a specific example of viewing zone setting according to the present embodiment.

  FIG. 8A shows an example in which there is one viewer. When there is one viewer, the viewing area Sa is set at the position of the viewer.

  FIGS. 8B and 8C show examples when there are a plurality of viewers. Both figures show the video display device 100, the viewers A to D, and the set viewing zones Sb and Sc, and the number and positions of viewers are the same. Also, the priority of each viewer is assumed to be higher in the order of viewers A, B, C, and D.

  FIG. 8B is an example in which the viewing area information calculation unit 14 calculates the control parameter so that the viewing area is set at the position of the viewer with the highest priority in step S23. In this case, the viewing zone is set so that the viewer A is positioned at the center of the viewing zone so that the viewer A having the highest priority can view the video with the highest quality. No consideration is given to viewers with the second or higher priority.

  FIG. 8C illustrates an example in which the viewing area information calculation unit 14 calculates the control parameters so that as many viewers as possible fall within the viewing area in descending order of priority in step S23. In this case, although the viewer A having the highest priority deviates from the center of the viewing zone, for example, two viewers A and B having a relatively high priority can be accommodated in the viewing zone.

  Hereinafter, examples of prioritization rules will be described.

  As a first example, priorities can be set in order from the viewer with the longest viewing time. This is because a viewer who has a long viewing time has a high possibility of having a high willingness to view the program. The viewing time may be based on the start time of the content, for example. When watching a broadcast wave, for example, the start time of the content can be grasped from the information of the electronic program guide acquired by the tuner decoder 11. The viewing time can be stored in the storage unit 17.

  FIG. 9 is a diagram illustrating an example in which priority is set based on viewing time. In the figure, viewers with high priority are drawn above.

  Initially, when only the viewer A is viewing at time t0 and is detected by the viewer detection unit 13, the priority of the viewer A is set to the highest (FIG. 9A). When the viewer B is newly detected by the viewer detection unit 13 at time t1, the viewer A has a longer viewing time, so the priority of the viewer B is set lower than that of the viewer A. (FIG. 9B). When the viewer A moves at time t2 and is no longer detected by the viewer detector 13, the priority of the viewer B is set high (FIG. 9 (c)). At this time, the viewing time of the viewer A stored in the storage unit 17 is reset to zero. Even if the viewer A returns at time t3 and is detected again by the viewer detector 13, the viewer B has a longer viewing time, so the priority of the viewer A is set lower than that of the viewer B. (FIG. 9D).

  Note that if the viewer is not detected by the viewer detector 13, the viewing time may not be reset to zero.

  As a second example, a priority table indicating the relationship between viewer information and priority may be stored in the storage unit 17 in advance. The viewer information is, for example, the viewer's face. Then, the viewer detection unit 13 detects the viewer's face using the video imaged by the camera 3, and the priority setting unit 16 uses the priority table stored in the storage unit 17. Priority can be set for.

  FIG. 10 is a diagram illustrating an example of the priority table. In the figure, the priorities are set higher in the order of viewers A, B, and C in advance. The viewers A to C are, for example, families, the viewer A is a mother, the viewer B is a child, and the viewer C is a father. As viewer information, the faces of viewers A to C are actually registered.

  FIG. 11 is a diagram illustrating an example of setting priorities based on the priority table. First, when only the viewer A is viewing at time t0 and is detected by the viewer detection unit 13, the priority of the viewer A is set to the highest (FIG. 11 (a)). When viewer B is newly detected by viewer detection unit 13 at time t1, viewer A has higher priority (FIG. 10), so viewer B's priority is higher than viewer A's priority. It is set low (FIG. 11 (b)). When the viewer A moves at time t2 and is no longer detected by the viewer detection unit 13, the priority of the viewer B is set high (FIG. 11 (c)). When the viewer A returns at time t3 and is detected again by the viewer detection unit 13, the viewer A has a higher priority (FIG. 10), and therefore the priority of the viewer B regardless of the viewing time. Is set lower than the priority of the viewer A (FIG. 11 (d)).

  As another example, the priority setting unit 16 may set the priority according to the position of the viewer. For example, the priority may be set higher for a viewer near 3H (H is the height of the liquid crystal panel 1), which is the optimum viewing distance, or the priority may be set higher for a viewer closer to the liquid crystal panel 1. May be. Alternatively, a higher priority may be set for a viewer in front of the liquid crystal panel 1. Further, the highest priority may be set for a viewer who has a remote control.

By the way, the priority setting unit 16 may present a relationship between the viewer and the priority of the viewer. For example, as shown in FIG. 12A, when the priority of the viewer is changed, text data indicating that may be superimposed on the video and displayed on the liquid crystal panel 1. Further, as shown in FIG. 12B, the whole or a part of the video imaged by the camera 3 may be displayed on the liquid crystal panel 1 by changing the display mode of the viewer according to the priority. More specifically, a viewer with a higher priority may be displayed with a darker color or a different color depending on the priority.
Alternatively, markers (flags) may be added and displayed to a predetermined number of viewers in descending order of priority.

  In this way, in the second embodiment, since the viewing area is set by giving priority to the viewer, there are a plurality of viewers, even if a part of the viewer does not fit within the viewing area. However, it is possible to keep viewers with high priority within the viewing zone.

In the video display device of each embodiment described above, the example in which the viewing area is controlled by using the lenticular lens 2 and shifting the parallax image has been described, but the viewing area may be controlled by other methods.
For example, instead of the lenticular lens 2, a parallax barrier may be provided as the opening control unit. FIG. 13 is a block diagram showing a schematic configuration of a video display apparatus 100 ′ which is a modification of FIG. As shown in the drawing, the aperture control unit 2 ′ may be controlled by providing a viewing zone control unit 15 ′ in the controller 10 ′ without performing the process of shifting the parallax image. In this case, the output direction of the parallax image displayed on the liquid crystal panel 1 is controlled using, as control parameters, the distance between the liquid crystal panel 1 and the opening control unit 2 ′ and the horizontal displacement between the liquid crystal panel 1 and the opening control unit. By doing so, the viewing zone is controlled. The video display device 100 ′ of FIG. 12 may be applied to each embodiment.

  At least a part of the video processing apparatus described in the above-described embodiments may be configured by hardware or software. When configured by software, a program for realizing at least a part of the functions of the video processing apparatus may be stored in a recording medium such as a flexible disk or a CD-ROM, and read and executed by a computer. The recording medium is not limited to a removable medium such as a magnetic disk or an optical disk, but may be a fixed recording medium such as a hard disk device or a memory.

  In addition, a program that realizes at least a part of the functions of the video processing apparatus may be distributed via a communication line (including wireless communication) such as the Internet. Further, the program may be distributed in a state where the program is encrypted, modulated or compressed, and stored in a recording medium via a wired line such as the Internet or a wireless line.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 Liquid crystal panel 2 Lenticular lens 2 'Aperture control part 3 Camera 4 Light-receiving part 10, 10', 10a Controller 11 Tuner decoder 12 Parallax image conversion part 13 Viewer detection part 14 Viewing area information calculation part 15 Image adjustment part 15 'Viewing area Control unit 16 Priority setting unit 17 Storage unit 100, 100 ', 100a Video processing display device

Claims (10)

A viewer detection unit that detects the number and position of viewers included in the video using the captured video;
When the number of detected viewers is one, image control according to the position of the viewer is performed, and when the number of detected viewers is plural, image control according to the position of the viewer is not performed. An image control unit. A viewer detection unit that detects the number and position of viewers included in the video using the captured video;
A priority setting unit configured to set a priority for each of the plurality of viewers based on a predetermined prioritization rule when the number of detected viewers is plural;
When the number of detected viewers is one, image control according to the position of the viewer is performed, and when the number of detected viewers is plural, the priority is taken into consideration for the position of the viewer. And an image control unit that performs corresponding image control.   The video processing apparatus according to claim 1, wherein when the number of viewers detected is one, the image control unit performs image control following the movement when the viewer moves.   The video processing apparatus according to claim 1, wherein the image control is control for a plurality of parallax images forming a stereoscopic video.   The video processing apparatus according to claim 1, further comprising a display unit that displays the image-controlled image. A receiving unit for decoding the input video signal;
The video processing apparatus according to claim 5, wherein the image control unit performs image control on the decoded input video signal.   The video processing apparatus according to claim 6, wherein the reception unit receives and selects a broadcast wave and decodes the broadcast wave. With a camera
The video processing apparatus according to claim 1, wherein the viewer detection unit detects the number and positions of viewers included in the video using a video taken by the camera. Detecting the number and position of viewers included in the video using the captured video;
When the number of detected viewers is one, the step of performing image control according to the position of the viewers,
A video processing method in which image control according to the position of a viewer is not performed when the number of detected viewers is plural. Detecting the number and position of viewers included in the video using the captured video;
Setting a priority for each of the plurality of viewers based on a predetermined prioritization rule when the number of detected viewers is plural;
When the number of detected viewers is one, image control according to the position of the viewer is performed, and when the number of detected viewers is plural, the priority is taken into consideration for the position of the viewer. Performing a corresponding image control, and a video processing method.

Images