JP2017032741A - Display device, display control method and program for the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device that makes displays of contents easily viewable to operators, and can provide much more information thereto.SOLUTION: A display device comprises: a display unit that is plurally provided at a different angle on a surface of an outer side, and displays respective contents; an imaging unit that photographs surroundings at 360 degrees; an operator detection unit that implements image processing of images photographed by the imaging unit, and determines a plurality of adjacent display units displaying the contents on the basis of a result of detecting a position of a face of an operator and orientation thereof; and a content control unit that corrects the contents to be displayed on respective display units on the basis of the position of the face of the operator and orientation thereof, and an angle of the display unit having the display of the content determined by the operator detection unit, and causes the display unit to display the corrected contents, respectively.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a display device that displays content, a display control method, and a program therefor.

  As a display device for displaying content, a device that controls display of content according to a person who is viewing the displayed content is known. This display device includes a camera in the display device, and controls content when it is recognized that a human face is present in an image captured by the camera.

  An example of a display device is described in Patent Document 1. The liquid crystal display device described in Patent Document 1 processes an image taken by a camera, detects the position and orientation of the face of a person watching the content, and which content on the liquid crystal display panel is attracting attention Is determined. When the liquid crystal display device determines that the content is attracting attention, the liquid crystal display device lowers the luminance of the content other than the content on the liquid crystal display panel.

JP 2009-237210 A

  However, in the technique described in Patent Document 1 described above, when the user does not look at the display device from the front, since the displayed content appears oblique to the user, the user feels difficult to see. Therefore, the technique described in Patent Document 1 has a problem that the content itself cannot be easily controlled based on the relative angle between the user and the display device. Patent Document 1 described above is a technique related to display control of a single liquid crystal display device (television receiver), and there is no disclosure of a technique for controlling display of content across a plurality of liquid crystal display devices. For example, a wristwatch-type display device has a problem in that the amount of information that can be displayed is small in a single display region because the area of the display region is small.

  An object of the present invention is to provide a display device, a display control method, and a program for displaying content that can solve the above-described problems. Specifically, an example of an object of the present invention is to provide a display device that allows an operator to easily view content display and provide a larger amount of information.

  A first display device according to an embodiment of the present invention is provided with a plurality of different angles on the outer surface, a display unit that displays content, a shooting unit that captures 360 degrees around the image, and an image captured by the shooting unit. Image processing and an operator detection unit that determines a plurality of adjacent display units for displaying content based on the result of detecting the position and orientation of the operator's face, the position and orientation of the operator's face, and the operator A content control unit that corrects the content to be displayed on each display unit based on the angle of the display unit that has determined the display of the content by the detection unit and displays the content on the display unit.

  In a first display control method according to an aspect of the present invention, a plurality of display units for displaying content are provided on the outer surface at different angles, and an image obtained by the imaging unit shooting 360 degrees is image-processed. Detecting the position and orientation of the face, determining a plurality of adjacent display units for displaying the content, and determining the position and orientation of the detected operator's face and the angle of the display unit for determining the display of the content. The content displayed on the display unit is corrected and displayed on the display unit.

  According to an embodiment of the present invention, a first program includes, on a computer, a plurality of display units that display content on the outer surface at different angles, and an image captured by the imaging unit 360 degrees is processed by an image processor. Detecting the position and orientation of the user's face, determining a plurality of adjacent display units for displaying the content, and based on the detected position and orientation of the operator's face and the angle of the display unit determining the display of the content, respectively. The content displayed on the display unit is corrected, and a process of displaying the content on the display unit is executed.

  According to the present invention, it is possible to obtain an effect that it is easy for an operator to visually recognize the display of content and a larger amount of information can be provided.

FIG. 1 is a perspective view showing an example of an external configuration of a display device 100 according to the first embodiment of the present invention. FIG. 2 is a diagram showing an example of the configuration of the display device 100 according to the first embodiment of the present invention viewed from another angle (x-axis direction). FIG. 3 is a block diagram showing an example of the configuration of the display device 100 according to the first embodiment of the present invention. FIG. 4 is a diagram illustrating an example of an imaging region of each imaging unit of the display device 100 according to the first embodiment of the present invention. FIG. 5 is a diagram illustrating an example of a visual recognition area for visually recognizing each display unit of the display device 100 according to the first embodiment of the present invention. FIG. 6 is a schematic diagram illustrating an example of an image obtained by shooting 360 degrees outside the outer periphery of the display device 100 according to the first embodiment of the present invention. FIG. 7 is a schematic diagram illustrating an example of a method for calculating the orientation of the operator's face in an image taken 360 degrees outside the outer periphery of the display device 100 according to the first embodiment of the present invention. FIG. 8 is a schematic diagram illustrating another example of an image obtained by photographing the outside of the outer periphery of the display device 100 according to the first embodiment of the present invention over 360 degrees. FIG. 9 is a schematic diagram illustrating an example of a method for displaying content on the first to third display units 101 to 103 of the display device 100 according to the first embodiment of the present invention. FIG. 10 is a schematic diagram illustrating an example of how the operator sees content when the contents are displayed on the first to third display units 101 to 103 of the display device 100 according to the first embodiment of the present invention. FIG. 11 is a diagram illustrating a hardware configuration example when the operator detection unit 501 and the content control unit 502 of the display device 100 according to the first embodiment of the present invention are realized by a computer device. FIG. 12 is a flowchart illustrating an outline of content display operation on the display device 100 according to the first embodiment. FIG. 13 is a perspective view showing an example of the configuration of the display device 110 according to the second embodiment of the present invention. FIG. 14 is a flowchart illustrating an outline of the operation of starting the supply of power to the first to fourth imaging units 201 to 204 in the display device 110 according to the second embodiment. FIG. 15 is a perspective view showing an example of the configuration of the display device 120 according to the third embodiment of the present invention.

  Next, embodiments of the present invention will be described in detail with reference to the drawings.

[First Embodiment]
FIG. 1 is a perspective view showing an example of an external configuration of a display device 100 according to the first embodiment of the present invention. Moreover, FIG. 2 is a figure which shows an example of the external appearance structure of the display apparatus 100 in the 1st Embodiment of this invention seen from another angle. FIG. 3 is a block diagram showing an example of the configuration of the display device 100 according to the first embodiment of the present invention. 1 to 3, the display device 100 is a wristwatch type display device, and includes first to eighth display units 101 to 108 and first to fourth imaging units 201 to 204. In addition, the display device 100 includes an operator detection unit 501 and a content control unit 502 inside the display device 100 (not shown in FIGS. 1 and 2).

  The circumferential surface of the display device 100 which is a wristwatch-type display device is defined as the yz plane, and the direction perpendicular to the circumferential surface of the display device 100, that is, the direction in which the arm is inserted into the wristwatch-type display device is defined as the x-axis direction. To do. Further, the second display unit 102 and the sixth display unit 106 are located in the xz plane, and the fourth display unit 104 and the eighth display unit 108 are located in the xy plane. Define FIG. 2 is a diagram illustrating an example of the configuration of the display device 100 viewed from the x-axis direction.

  Next, the configuration of the display device 100 according to the first embodiment will be described.

  The first to eighth display units 101 to 108 are displays provided on the outer periphery of the display device 100. The display system may be any system such as a liquid crystal display or an organic EL (Electro-Luminescence) display. Referring to FIG. 2, the display device 100 includes eight display units having the same size so as to surround the outer periphery of the display device 100 without a gap. For this reason, the 1st-8th display parts 101-108 are each installed in the state inclined 45 degree | times from the adjacent display part.

  The first to fourth imaging units 201 to 204 are provided on the side portions of the second display unit 102, the fourth display unit 104, the sixth display unit 106, and the eighth display unit 108, respectively, and display devices. The outside of the outer periphery of 100 is photographed over 360 degrees. Note that the number of shooting units and the locations provided are not limited to this example, and any form may be used as long as the outside of the outer periphery of the display device 100 can be shot 360 degrees.

  The operator detection unit 501 performs image processing on images captured by the first to fourth imaging units 201 to 204, and analyzes what is captured. When a human face is detected as a result of the image processing, it is regarded as an operator's face, the position and orientation of the operator's face are determined, and content is displayed from the first to eighth display units 101 to 108. A plurality of adjacent display portions are determined.

  FIG. 4 is a diagram illustrating an example of an imaging region of each imaging unit of the display device 100 according to the first embodiment of the present invention. The outermost rectangle is provided for convenience in defining each area. Actually, each imaging area is extended outside the area divided by the outermost rectangle.

  Referring to FIG. 4, the first imaging unit 201 captures a range of a first imaging area 301, a second imaging area 302, and a third imaging area 303. Similarly, the second imaging unit 202 captures the range of the third imaging area 303, the fourth imaging area 304, and the fifth imaging area 305. The third imaging unit 203 captures a range of the fifth imaging area 305, the sixth imaging area 306, and the seventh imaging area 307. The fourth imaging unit 204 captures the range of the seventh imaging area 307, the eighth imaging area 308, and the first imaging area 301.

  The operator detection unit 501 processes and synthesizes the images captured by the first to fourth imaging units 201 to 204 as necessary, and generates an image obtained by imaging the outer periphery of the display device 100 from 360 degrees. Here, the first imaging area 301, the third imaging area 303, the fifth imaging area 305, and the seventh imaging area 307 are imaging areas in which a plurality of imaging units perform imaging. The operator detection unit 501 processes the images in these shooting regions so as not to overlap, and synthesizes the images so as to form a single seamless image, thereby generating an image.

  FIG. 5 is a diagram illustrating an example of a visual recognition area for visually recognizing each display unit of the display device 100 according to the first embodiment of the present invention. As in FIG. 4, the outermost rectangle is provided for convenience in defining each region. Actually, each visual recognition area is extended outside the area divided by the outermost rectangle.

  Referring to FIG. 5, the first visual recognition area 401 is defined outside the first display unit 101. The same applies to the second to eighth viewing regions 402 to 408 and the second to eighth display units 102 to 108. The boundary of each visual recognition area is an extension line that connects the connecting portions between the display units with a line from the center point of the circumferential surface of the display device 100 on the yz plane.

  The operator detection unit 501 determines areas corresponding to the first to eighth viewing areas 401 to 408 on the image when an image obtained by shooting 360 degrees outside the outer periphery of the display device 100 is generated. The operator detection unit 501 may perform a process of writing the boundary line of the viewing area in the image. Further, when the operator detection unit 501 determines that a human face appears in the image taken 360 degrees outside the outer periphery of the display device 100 as a result of the image processing, Determine if it is in the viewing area. That is, the operator detection unit 501 determines which region of the first to eighth viewing regions 401 to 408 the operator is in. At this time, when the operator's face is shown across a plurality of areas of the first to eighth visual recognition areas 401 to 408 on the image, the area of the part where the operator's face in each area is shown is compared. Then, the area that is the largest is determined as the area where the operator is present.

  FIG. 6 is a schematic diagram illustrating an example of an image obtained by shooting 360 degrees outside the outer periphery of the display device 100 according to the first embodiment of the present invention. In the example of FIG. 6, the operator's face is detected across the second visual recognition area 402 and the third visual recognition area 403. Here, the operator detection unit 501 compares the area of the second visual recognition area 402 in which the operator's face is shown with the area of the third visual recognition area 403 in which the operator's face is shown. To do. In the example of FIG. 5, the area of the second visual recognition area 402 in which the operator's face is shown is larger than the area of the third visual recognition area 403 in which the operator's face is shown. The operator detection unit 501 determines that the operator is in the second visual recognition area 402. In addition, when two or more human faces are detected at the same time, for example, when a person in the vicinity is captured, the operator detection unit 501 has the largest area of the detected area, that is, the largest image. The face is determined as the operator's face.

  In addition, the operator detection unit 501 analyzes the image of the operator's face in the image and detects the positions of the eyes or glasses and nose. The operator detection unit 501 determines the orientation of the operator's face based on the detected positions of eyes or glasses and nose. An example of the determination method will be described.

  The operator detection unit 501 connects the positions of both eyes or glasses in the detection result with a line, and generates a straight line that is orthogonal to the line and passes through the position of the nose. Based on the calculation result of the inclination of the straight line, the operator detection unit 501 determines the orientation of the operator's face.

  FIG. 7 is a schematic diagram illustrating an example of a method for calculating the orientation of the operator's face in an image taken 360 degrees outside the outer periphery of the display device 100 according to the first embodiment of the present invention. In the example of FIG. 7, the operator detection unit 501 connects the positions of both eyes or glasses with a line, and obtains the inclination θ of a straight line perpendicular to the line and passing through the position of the nose as tan θ = b / a. . At this time, a is the horizontal movement amount of the image, and b is the vertical movement amount of the image.

  In addition, the operator detection unit 501 specifies adjacent display units that can be visually recognized by the operator based on the detection result of the eye or the position of the glasses and the nose. In the example of FIG. 6, the operator detection unit 501 includes the second display unit 102 when the operator looks at the display device 100, and the first display unit 101 on the left side of the second display unit 102. It is determined that the third display unit 103 can be visually recognized on the right side.

  FIG. 8 is a schematic diagram illustrating another example of an image obtained by photographing the outside of the outer periphery of the display device 100 according to the first embodiment of the present invention over 360 degrees. In the case of the example in FIG. 8, the position of the face shown in the image taken 360 degrees outside the outer periphery of the display device 100 is the same as in FIG. 6, but as a result of detecting the positions of the eyes or glasses and nose, The detection unit 501 determines that the face orientation is opposite to that in FIG. That is, the operator detection unit 501 determines that the operator wears the display device 100 on the arm from the reverse direction. In this case, when the operator looks at the display device 100, the operator detection unit 501 has the second display unit 102, the third display unit 103 on the left side of the second display unit 102, and the right side of the second display unit 102. It is determined that the first display unit 101 is visible. The operator detection unit 501 determines these visible display units from among the first to eighth display units 101 to 108 as a plurality of adjacent display units that display content.

  The content control unit 502 corrects the content to be displayed on each display unit based on the position and orientation of the operator's face and the angle of the display unit from which the operator detection unit 501 has determined the display of the content. Control to display on the screen. The content displayed on each display unit may be any type of content. For example, information on time and date issued from a time management unit (not shown) may be displayed, or an image in an image storage unit (not shown) may be displayed. Screen information received from an external terminal by wireless communication may be displayed.

  First, a content correction method based on the position and orientation of the operator's face will be described. The content control unit 502 acquires the orientation of the operator's face determined by the operator detection unit 501, that is, the angle θ from the horizontal direction of the image captured 360 degrees outside the outer periphery of the display device 100. The horizontal direction of the image taken outside 360 degrees from the outer periphery of the display device 100 coincides with the circumferential direction of the display unit corresponding to the visual recognition area where the operator is present. Therefore, the content control unit 502 outputs an image obtained by rotating the content by the same angle θ as the face direction of the operator, and displays the image on the display unit that the operator detection unit 501 has determined to display, so that the operator You can view the content without worrying about.

  FIG. 9 is a schematic diagram illustrating an example of a method for displaying content on the first to third display units 101 to 103 of the display device 100 according to the first embodiment of the present invention. Referring to FIG. 9, when the orientation of the operator's face is an angle θ, the content control unit 502 outputs content to be output to the second display unit 102 by 90 ° −θ from the circumferential direction of the second display unit 102. The rotated correction is performed, and an image of the correction result is output. Similarly, the content control unit 502 performs correction by rotating the content output to the first display unit 101 and the content output to the third display unit 103 by 90 ° -θ from the circumferential direction of the second display unit 102. The correction result image is output.

  Next, a content correction method based on the angle of the display unit that determines the content display will be described.

  FIG. 10 is a schematic diagram illustrating an example of how the operator sees content when the contents are displayed on the first to third display units 101 to 103 of the display device 100 according to the first embodiment of the present invention. Actually, the main correction is performed after the above-described content correction based on the position and orientation of the operator's face. However, in FIG. 10, when the above-described correction is not performed (second display) Description will be made assuming that the portion 102 is viewed from the front, θ = 90 °. Referring to FIG. 10, the first display unit 101 and the second display unit 102, and the second display unit 102 and the third display unit 103 are installed in a state of being inclined by 45 degrees. Therefore, from the operator in the second viewing area 402 corresponding to the second display unit 102, the content of the third display unit 103 is 1 / √ compared to the content of the second display unit 102. It looks compressed twice. That is, assuming that the actual circumferential length of the third display unit 103 is c, the operator can visually recognize the circumferential length of the third display unit 103 as c / √2. The same applies to the first display unit 101. In order to correct this, the content control unit 502 generates an image obtained by enlarging the content to be displayed on the first display unit 101 and the third display unit 103 in advance in the circumferential direction by √2. Then, the content control unit 502 controls the generated image to be transmitted and displayed on the first display unit 101 and the third display unit 103, respectively. By performing this correction, the operator can view the content without worrying about the angle of the display unit.

  FIG. 11 is a diagram illustrating a hardware configuration example when the operator detection unit 501 and the content control unit 502 of the display device 100 according to the first embodiment of the present invention are realized by a computer device. As shown in FIG. 11, the operator detection unit 501 and the content control unit 502 include a communication interface 10, a CPU (Central Processing Unit) 11, a main storage device 14, and a secondary storage device 15, respectively.

  The communication interface 10 constitutes an input / output interface for communication with the processing device and peripheral terminals. The communication interface 10 also includes an interface for connection control between an operator detection unit 501 and a network (not shown) connected to the content control unit 502.

  The CPU 11 operates the operating system to control the entire operator detection unit 501 and content control unit 502 according to the first embodiment of the present invention. Further, the CPU 11 reads a program or data from the secondary storage device 15 to the main storage device 14, for example. Specifically, the CPU 11 operates as the operator detection unit 501 and the content control unit 502 in the first embodiment, and executes various processes based on program control. Further, the CPU 11 of the operator detection unit 501 and the content control unit 502 is not limited to one and may include two or more CPUs. Further, the operator detection unit 501 and the content control unit 502 may use a common CPU 11.

  The main storage device 14 is a working memory based on the control of the CPU 11.

  The secondary storage device 15 is, for example, an optical disk, a flexible disk, a magnetic optical disk, an external hard disk, a semiconductor memory, or the like, and records a computer program so that it can be read by a computer. The secondary storage device 15 temporarily or non-temporarily stores a computer program to be executed by the operator detection unit 501 and the content control unit 502. Therefore, the CPU 11 may read a computer program recorded in the secondary storage device 15 and operate as the operator detection unit 501 and the content control unit 502 according to the program.

  The computer program may be downloaded from an external computer (not shown) connected to the communication network.

  Note that the operator detection unit 501 and the content control unit 502 are not limited to the computer device illustrated in FIG. 11, and each unit may be realized by a hardware circuit. However, the means for realizing each unit included in the operator detection unit 501 and the content control unit 502 is not particularly limited. In other words, the operator detection unit 501 and the content control unit 502 may be realized by one physically coupled device, or two or more physically separated devices are connected by wire or wirelessly. It may be realized by the apparatus.

  The operation of the display device 100 configured as described above will be described with reference to the flowchart of FIG.

  FIG. 12 is a flowchart illustrating an outline of content display operation on the display device 100 according to the first embodiment. Note that the processing according to this flowchart may be executed based on the above-described program control by the CPU.

  As shown in FIG. 12, first, the operator detection unit 501 always performs image processing and monitors images captured by the first to fourth imaging units 201 to 204 (step S <b> 101).

  Next, the operator detection unit 501 checks whether or not a human face can be recognized in the image processed image (step S102). If a human face cannot be recognized (NO in step S102), the operator detection unit 501 returns to step S101 and monitors the image. When a human face can be recognized (YES in step S102), the operator detection unit 501 regards the recognized face as the operator's face, and determines the position and orientation of the operator's face (step S103).

  Next, the operator detection unit 501 determines a plurality of adjacent display units that display content from the first to eighth display units 101 to 108 based on the determination result in step S103 (step S104). .

  Next, the operator detection unit 501 performs image analysis on the reflected operator's face and detects the positions of eyes or glasses and nose (step S105).

  Next, the operator detection unit 501 determines the orientation of the operator's face based on the detection result in step S105 (step S106).

  Next, the content control unit 502 acquires content data to be displayed on the display unit determined in step S104 (step S107).

  Next, the content control unit 502 generates an image obtained by correcting the content data acquired in step S107 based on the face orientation of the operator determined in step S106 (step S108).

  Next, the content control unit 502 further corrects the image generated in step S108 based on the angle of the display unit that displays the content (step S109).

  Next, the content control unit 502 controls to transmit and display the image corrected in step S109 to the display unit that displays the content (step S110).

  Next, the display unit that displays the content displays the received image based on the control of the content control unit 502 in step S110 (step S111).

  Thus, the display device 100 ends the content display operation.

  Next, effects of the first exemplary embodiment of the present invention will be described.

  The above-described display device 100 according to the present embodiment makes it easy for the operator to visually recognize the display of content, and can provide a larger amount of information.

  This is because the following configuration is included. That is, first, the operator detection unit 501 performs image processing on images captured by the first to fourth imaging units 201 to 204, and confirms whether or not a human face can be recognized. Secondly, when the operator detection unit 501 detects a human face, the operator detection unit 501 determines the position and orientation of the operator's face, and displays a plurality of contents from the first to eighth display units 101 to 108. The adjacent display part is determined. Third, the content control unit 502 corrects the content displayed on each display unit based on the position and orientation of the operator's face and the angle of the display unit that the operator detection unit 501 has determined to display the content. , Control to display on the display unit. Thereby, the display apparatus 100 can display content on a plurality of adjacent display units. In addition, the operator can view the content without worrying about the relative angle between the user and the display device 100 and the angle of the display unit. For this reason, the display device 100 can obtain an effect that the operator can easily view the display of the content and can provide a larger amount of information.

  As a modification, the display device 100 stores a pattern of the structure of a specific person's face in a storage unit (not shown), and when the operator detection unit 501 detects a human face, the stored specific person It may be determined whether or not the pattern matches the face structure pattern. The display device 100 performs a process of continuing the content display operation only when it matches the stored pattern of the face structure of a specific person. Here, the pattern of the face structure is, for example, a pattern of positions of eyes or glasses and nose. In the case of this modification, the display device 100 does not display content on the display unit even if a face of a person other than a specific person that stores the pattern of the face structure is detected. For this reason, it is possible to prevent others from acquiring information and to improve security.

  Further, as a modification, when the operator detection unit 501 detects a plurality of human faces, the display device 100 may display the content on all the display units corresponding to the detected human visual area. In the case of this modification, it can be expected to be used as a receiver that allows a plurality of people to view the content at the same time and does not display the content on a display portion where no people are present, thereby reducing power consumption.

[Second Embodiment]
Next, a second embodiment of the present invention will be described in detail with reference to the drawings. Hereinafter, the description overlapping with the above description is omitted as long as the description of the present embodiment is not obscured.

  FIG. 13 is a block diagram showing an example of the configuration of the display device 110 according to the second embodiment of the present invention.

  Referring to FIG. 13, the display device 110 according to the present embodiment is added with a vibration detection unit 503 as compared with that of the first embodiment.

  When the vibration detection unit 503 is connected to a power supply unit (not shown) of the display device 110 and detects vibration of a predetermined intensity or more, the first to eighth display units 101 to 108 and the first to fourth imaging units 201 are detected. Supply power to ~ 204. Further, when a predetermined time has elapsed after detecting vibration, the supply of power to the first to eighth display units 101 to 108 and the first to fourth imaging units 201 to 204 is stopped. The vibration detection unit 503 is realized by, for example, an acceleration sensor. Further, the vibration of a predetermined intensity or higher is specifically a vibration that causes an operator who wears the display device 110 on his / her arm to raise his / her arm in order to confirm the display on the display device 110. In other words, the display device 110 according to the present embodiment uses the first to eighth display units 101 to 108 and the first to eighth triggers triggered by the operator raising his arm to confirm the display on the display device 110. The fourth imaging units 201 to 204 are energized. As a result, the first to fourth photographing units 201 to 204 start photographing the first to fourth photographing regions 301 to 304, respectively.

  After these processes are completed, the content display operation is started in the same manner as the display device 100 in the first embodiment.

  Next, the operation of the display device 110 will be described with reference to the flowchart shown in FIG.

  FIG. 14 is a flowchart illustrating an outline of the operation of starting the supply of power to the first to fourth imaging units 201 to 204 in the display device 110 according to the second embodiment. Note that the processing according to this flowchart may also be executed based on the above-described program control by the CPU.

  As shown in FIG. 14, first, when the vibration detection unit 503 does not detect vibration of a predetermined intensity or more (NO in step S201), and when a predetermined time has not elapsed (NO in step S202), this processing is performed. Ends as is. When the predetermined time has elapsed (YES in step S202) and the first to eighth display units 101 to 108 and the first to fourth imaging units 201 to 204 are energized (YES in step S203), The vibration detection unit 503 stops power supply to the display unit and the imaging unit (step S204). If the first to eighth display units 101 to 108 and the first to fourth imaging units 201 to 204 are not energized (NO in step S203), the process ends.

  When the vibration detection unit 503 detects a vibration having a predetermined intensity or more (YES in step S201), the vibration detection unit 503 receives the first to eighth display units 101 to 108 and the first to fourth from the power supply unit (not shown). The power supply to the photographing units 201 to 204 is started (step S205).

  Thus, the display device 110 ends the operation of starting the supply of power to the first to fourth imaging units 201 to 204. This operation is always performed periodically.

  Next, effects of the second exemplary embodiment of the present invention will be described.

  The display device 110 in the present embodiment described above can reduce power consumption.

  This is because the following configuration is included. That is, first, the vibration detection unit 503 detects first to eighth power from a power supply unit (not shown) when the operator detects a vibration of a predetermined strength or higher that raises an arm to confirm the display on the display device 110. Supply of power to the display units 101 to 108 and the first to fourth imaging units 201 to 204 is started. Second, the vibration detection unit 503 has a power supply when a predetermined time has elapsed and the first to eighth display units 101 to 108 and the first to fourth imaging units 201 to 204 are energized. Stop supplying. Therefore, when a predetermined time has elapsed after the first to fourth imaging units 201 to 204 have started to be triggered by the operator performing a gesture of raising his arm to check the display on the display device 110 The imaging of the first to fourth imaging units 201 to 204 is stopped. For this reason, for example, when the operator does not visually recognize the display device 110, the first to eighth display units 101 to 108 and the first to fourth imaging units 201 to 204 are not energized, and the first -The 4th imaging | photography parts 201-204 are not imaged. For this reason, the display device 110 has an effect of reducing power consumption.

[Third Embodiment]
Next, a third embodiment of the present invention will be described in detail with reference to the drawings. Hereinafter, the description overlapping with the above description is omitted as long as the description of the present embodiment is not obscured.

  FIG. 15 is a block diagram showing an example of the configuration of the display device 120 according to the third embodiment of the present invention.

  Referring to FIG. 15, the display device 120 according to the present embodiment includes an operator light source detection unit 521 instead of the operator detection unit 501 as compared with that of the first embodiment. Further, a content control unit 522 is provided instead of the content control unit 502.

  The operator light source detection unit 521 is different from the operator detection unit 501 in the first embodiment in processing in the following points. In step S <b> 102, the operator light source detection unit 521 checks not only whether a human face can be recognized in the image processed image, but also whether there is a light source with a predetermined illuminance or higher. A light source having a predetermined illuminance or higher is a light source regarded as the sun outdoors. In step S103, the operator light source detection unit 521 not only determines the position and orientation of the operator's face, but also if the light source has a predetermined illuminance or higher, the position of the light source is the first to eighth positions. It is also determined which of the viewing areas 401 to 408 is located. In step S110, when the position of the light source equal to or higher than the predetermined illuminance is in a region adjacent to the viewing region where the operator is present, control is performed to turn off the display unit corresponding to the viewing region including the light source. For example, in the example of FIG. 5, a light source having a predetermined illuminance or higher is detected in the first visual recognition area 401 or the third visual recognition area 403 adjacent to the second visual recognition area 402 where the operator is present. This is because it is difficult for an operator to visually recognize the display unit when a bright light source such as the sun is in the region.

  Next, effects of the third exemplary embodiment of the present invention will be described.

  The display device 120 in the present embodiment described above can further reduce power consumption.

  This is because the following configuration is included. That is, first, the operator light source detection unit 521 checks whether or not there is a light source having a predetermined illuminance or higher in the image that has been subjected to image processing. Second, the content control unit 522 performs control to turn off the display unit corresponding to the visual recognition area including the light source when the position of the light source having a predetermined illuminance or higher is in an area adjacent to the visual recognition area where the operator is present. . Thereby, since the display part that is difficult for the operator to visually recognize is turned off, the display device 120 can further reduce power consumption.

  Each component in each embodiment of the present invention described above can be realized by a computer apparatus and firmware based on program control as well as by realizing the function in hardware. The program is provided by being recorded on a computer-readable recording medium such as a magnetic disk or a semiconductor memory, and is read by the computer when the computer is started up. The read program causes the computer to function as a component in each of the embodiments described above by controlling the operation of the computer.

  Although the present invention has been described with reference to each embodiment, the present invention is not limited to the above embodiment. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

  For example, each component described in each of the above embodiments does not necessarily have to be individually independent. For example, for each component, a plurality of components may be realized as one module, or one component may be realized as a plurality of modules. Each component is configured such that a component is a part of another component, or a part of a component overlaps a part of another component. Also good.

  Further, in each of the embodiments described above, a plurality of operations are described in order in the form of a flowchart, but the described order does not limit the order in which the plurality of operations are executed. For this reason, when each embodiment is implemented, the order of the plurality of operations can be changed within a range that does not hinder the contents.

  Furthermore, in each embodiment described above, a plurality of operations are not limited to being executed at different timings. For example, another operation may occur during the execution of a certain operation, or the execution timing of a certain operation and another operation may partially or entirely overlap.

  Furthermore, in each of the embodiments described above, a certain operation is described as a trigger for another operation, but the description does not limit all relationships between the certain operation and the other operations. For this reason, when each embodiment is implemented, the relationship between the plurality of operations can be changed within a range that does not hinder the contents. The specific description of each operation of each component does not limit each operation of each component. For this reason, each specific operation | movement of each component may be changed in the range which does not cause trouble with respect to a functional, performance, and other characteristic in implementing each embodiment.

  A part or all of the above-described embodiment can be described as in the following supplementary notes, but is not limited thereto.

  (Supplementary Note 1) A plurality of different angles are provided on the outer surface, each of which displays a content, a photographing unit that captures 360 degrees of the surroundings, an image photographed by the photographing unit, and processes the image of the operator's face Based on the result of detecting the position and orientation of the operator, the operator detection unit that determines a plurality of adjacent display units for displaying the content, the position and orientation of the operator's face, and the operator detection unit determines the display of the content A display device comprising: a content control unit that corrects content to be displayed on each display unit based on an angle of the display unit and displays the content on the display unit.

  (Additional remark 2) The operator detection part detects the position and direction of a face based on the result of having extracted the position of the eyes or glasses and nose of a person's face from the image which the image | photographing part image-processed image | photographed. The display device described in 1.

  (Additional remark 3) The display apparatus of Additional remark 1 or 2 which further includes the vibration detection part which detects a vibration, and a power supply is supplied to an imaging | photography part and a display part when a vibration detection part detects the vibration more than predetermined intensity | strength. .

  (Additional remark 4) When there exists a light source more than predetermined | prescribed illumination intensity, an operator detection part detects the position of a light source, and a content control part is based on the position and direction of an operator's face, and the position of a light source, respectively. 4. The display device according to any one of appendices 1 to 3, which determines whether or not content can be displayed on the display unit.

  (Supplementary Note 5) If the pattern of the face structure of the operator detected by the operator detection unit matches the pattern stored in advance, the content control unit displays the content on the display unit according to any one of supplementary notes 1 to 4 The display device described.

  (Additional remark 6) When the operator detection part detects the position of several faces simultaneously, any one of Additional remark 1 thru | or 4 which determines the display part which displays a content based on the position of all the faces at least. Display device.

  (Supplementary note 7) A plurality of display units for displaying content are provided on the outer surface at different angles, and an image obtained by photographing the surroundings by 360 degrees is image-processed to detect the position and orientation of the operator's face, and the content A plurality of adjacent display units for displaying the content, and correcting the content displayed on each display unit based on the detected position and orientation of the operator's face and the angle of the display unit that determined the display of the content, A display control method for displaying each on the display unit.

  (Supplementary note 8) The display control method according to supplementary note 7, wherein the position and orientation of the face are detected based on the result of extracting the positions of the eyes or glasses and nose of the person's face from the image photographed by the image processing photographing unit. .

  (Supplementary note 9) The display control according to supplementary note 7 or 8, further including a vibration detection unit that detects vibration, wherein power is supplied to the photographing unit and the display unit when the vibration detection unit detects vibration of a predetermined intensity or more. Method.

  (Supplementary Note 10) Further, when there is a light source with a predetermined illuminance or higher, the position of the light source is detected, and whether or not content can be displayed on each display unit is determined based on the position and orientation of the operator's face and the position of the light source The display control method according to any one of appendices 7 to 9.

  (Supplementary note 11) The display control method according to any one of supplementary notes 7 to 10, wherein the content is displayed on the display unit when the detected pattern of the face structure of the operator matches the pattern stored in advance.

  (Supplementary note 12) The display control method according to any one of supplementary notes 7 to 11, wherein when a plurality of face positions are detected at the same time, a display unit for displaying content is determined based on at least all face positions.

  (Supplementary note 13) A plurality of display units for displaying content are provided on the outer surface at different angles, and the image capturing unit performs image processing on an image of 360 degrees around the periphery, detects the position and orientation of the operator's face, A plurality of adjacent display units for displaying the content, and correcting the content displayed on each display unit based on the detected position and orientation of the operator's face and the angle of the display unit that determined the display of the content, A program that causes a computer to execute processing to be displayed on the display unit.

  (Additional remark 14) Additional processing 13 which makes a computer perform the process which detects the position and direction of a face based on the result of having extracted the position of the face of the person's face from the image which the image | photographing part image-processed, or eyeglasses and the nose. The program described in.

  (Supplementary note 15) Further, when there is a light source having a predetermined illuminance or higher, the position of the light source is detected, and whether or not content can be displayed on each display unit is determined based on the position and orientation of the operator's face and the light source position. 15. The program according to appendix 13 or 14, which causes a computer to execute processing to be performed.

  (Supplementary note 16) The program according to any one of supplementary notes 13 to 15, which causes the computer to execute a process of displaying content on the display unit when the detected pattern of the face structure of the operator matches a pattern stored in advance. .

  (Supplementary Note 17) The supplementary note 13 to 16, wherein when a plurality of face positions are detected at the same time, the computer executes a process of determining a display unit for displaying content based on at least all the face positions. Program.

10 Communication interface 11 CPU
14 Main storage device 15 Secondary storage device 100, 110, 120 Display device 101, 102, 103, 104, 105, 106, 107, 108 Display unit 201, 202, 203, 204 Shooting unit 301, 302, 303, 304, 305, 306, 307, 308 Imaging area 401, 402, 403, 404, 405, 406, 407, 408 Viewing area 501 Operator detection unit 502, 522 Content control unit 503 Vibration detection unit 521 Operator light source detection unit

Claims (10)

A plurality of display units provided at different angles on the outer surface, each displaying content,
An imaging unit that captures 360 ° surroundings;
An operator detection unit that performs image processing on an image captured by the imaging unit and determines a plurality of adjacent display units that display content based on a result of detecting the position and orientation of the operator's face;
Based on the position and orientation of the operator's face and the angle of the display unit at which the operator detection unit has determined the display of the content, the content to be displayed on each display unit is corrected, and the display unit A display device comprising: a content control unit to be displayed.   The operator detection unit detects the position and orientation of a face based on the result of extracting the positions of the eyes or glasses and nose of a person's face from the image captured by the image capturing unit subjected to image processing. The display device described. It further includes a vibration detection unit that detects vibration,
The display device according to claim 1, wherein when the vibration detection unit detects a vibration having a predetermined intensity or more, power is supplied to the imaging unit and the display unit.   The operator detection unit further detects the position of the light source when there is a light source with a predetermined illuminance or higher, and the content control unit determines the position and orientation of the operator's face based on the position of the light source. The display device according to claim 1, wherein whether or not content can be displayed on the display unit is determined.   The content control unit displays content on the display unit when the pattern of the operator's face structure detected by the operator detection unit matches a pattern stored in advance. The display device described.   The display according to any one of claims 1 to 4, wherein when the operator detection unit detects the positions of a plurality of faces at the same time, the display unit for displaying content is determined based on at least the positions of all the faces. apparatus. A plurality of display parts for displaying content are provided on the outer surface at different angles,
The image capturing unit performs image processing on an image of 360 degrees around the periphery, detects the position and orientation of the operator's face, determines a plurality of adjacent display units for displaying content,
Based on the detected position and orientation of the operator's face and the angle of the display unit that has determined the display of the content, the content displayed on each display unit is corrected and displayed on the display unit. Method.   The display control method according to claim 7, wherein the position and orientation of the face are detected based on the result of extracting the positions of the eyes or glasses and nose of a person's face from the image captured by the image capturing unit that has performed image processing. A plurality of display parts for displaying content are provided on the outer surface at different angles,
The image capturing unit performs image processing on an image of 360 degrees around the periphery, detects the position and orientation of the operator's face, determines a plurality of adjacent display units for displaying content,
Based on the detected position and orientation of the operator's face and the angle of the display unit that has determined the display of the content, the content to be displayed on each display unit is corrected and displayed on the display unit. A program to be executed by a computer. 10. The computer according to claim 9, wherein the computer executes processing for detecting the position and orientation of the face based on the result of extracting the positions of the eyes or glasses and nose of the person's face from the images captured by the image capturing unit that has performed the image processing. Program.

Images