JP6170457B2 - Presentation management device and presentation management program - Google Patents

Description

  The present invention relates to a presentation management apparatus and a presentation management program for operating a presentation image displayed on a screen or a screen by a gesture.

  In recent years, in meetings and lectures, presentation materials are projected on a screen or a large display, and the projected screen is operated by a user's gesture.

  Also, in the presentation, after the presentation is over, there may be a question and answer session with the audience. At that time, if the speaker in the audience can make a desired page from the slide used for the presentation, indicate a specific part from the content of the page, or modify the content of the page, Smooth communication between presenters and audience.

  For example, in the technique disclosed in Patent Document 1, in order to achieve the above object, a plurality of participants who participate in a presentation can share and control the presentation.

  With this technology, a presenter primary user can give temporary control to a speaker (secondary user) in the audience to manipulate the presentation screen at the end of the presentation. When control by the secondary user is complete, the primary user can remove control from the secondary user or the secondary user can relinquish control.

  Of course, with this technology, the presenter or speaker can operate the screen with gestures, so there is no need to prepare a pointing device or the like for operating the screen or showing the necessary part in the presentation.

  In addition, in the technique disclosed in Patent Document 2, when a gesture of a presenter who makes a presentation is detected, the start of an explicit presentation is performed so as not to erroneously detect the movement of the presenter as a gesture before starting the presentation. It is configured to start detecting a gesture after receiving an instruction.

  In the technique disclosed in Patent Document 3, the gestures of the presenter are classified into recommended or non-recommended operations, and if they are non-recommended operations, the screen operation is invalidated to conform to the content of the presentation. Accept only gestures.

  Patent Documents 4 and 5 disclose a technique for detecting a person from a captured image.

JP 2013-514585 A (paragraphs [0066]-[0070]) JP2013-020434A JP 2010-205235 A JP 2013-228930 A JP 2005-149145 A

  However, in the technique of Patent Document 1, it is not clear how the presenter gives a specific speaker in the audience composed of plural persons the authority to operate the screen by gesture. There was a problem to apply.

  In view of the circumstances as described above, an object of the present invention is to provide a presentation management device that allows a presenter to easily give a screen operation authority by a gesture to a specific speaker in a plurality of audiences. To provide a presentation management program.

  (1) In order to achieve the above object, a presentation management apparatus according to an aspect of the present invention operates a photographing unit capable of photographing a presentation presenter and an audience, and a screen on which the presentation image is displayed. When a gesture detection unit capable of detecting an authority deprivation gesture for instructing deprivation of authority from a captured image and a first authority deprivation gesture for the audience by the presenter are detected by the gesture detection unit, A specifying unit that specifies a target person of the first authority deprivation gesture from a captured image; and an authority control unit that gives an authority to operate the screen with the specified target person as a speaker.

  (2) In order to achieve the above object, in the presentation management apparatus according to an aspect of the present invention, the gesture detection unit indicates one target person by the presenter as the first privilege deprivation gesture. It may be configured to detect a gesture.

  (3) In order to achieve the above object, in the presentation management apparatus according to an aspect of the present invention, the specifying unit specifies the target person based on a gesture pointing to the one target person by the presenter. But you can.

  (4) In order to achieve the above object, in the presentation management device according to an aspect of the present invention, the specifying unit is configured such that a second authority deprivation gesture indicating a specific range of the audience by the presenter is the gesture detection. Each of the one or more target persons included in the specific range based on a gesture pointing to the specific range of the audience by the presenter, and the authority control unit The configuration may be such that the authority to operate the screen is given with each target person as a speaker.

  (5) In order to achieve the above object, in the presentation management apparatus according to an aspect of the present invention, the authority control unit reaches in the direction of one speaker who is given the authority by the presenter. When the third authority giving gesture for pulling the extended hand is detected by the gesture detecting unit, the authority given to the speaker in the direction in which the hand is extended may be deprived.

  (6) In order to achieve the above object, in the presentation management apparatus according to an aspect of the present invention, the authority control unit raises one hand by facing the gesture detection unit by the presenter and raises the other hand. The configuration may be such that when the fourth authority giving gesture moved from top to bottom is detected by the gesture detecting unit, the authority given from all the speakers is deprived.

  (7) In order to achieve the above object, a presentation management program according to an aspect of the present invention operates a screen on which a presentation image is displayed from a video of a presenter and an audience of a presentation photographed by a photographing unit. A gesture detection unit capable of detecting an authority deprivation gesture for instructing deprivation of authority to perform, and when the first authority deprivation gesture for the audience by the presenter is detected by the gesture detection unit, the first authority The computer is caused to function as a specifying unit that specifies a target person of the deprivation gesture from the captured video, and an authority control unit that gives authority to operate the screen with the specified target person as a speaker.

  As described above, according to the present invention, the presenter can easily give the authority of the screen operation by the gesture to the specific speaker in the plural audience.

1 is a configuration diagram of a pointing control device 1. FIG. It is the figure which looked at the specific example of the positional relationship on which the pointing control apparatus 1 presupposes from the top. 4 is a diagram illustrating a state in which a presenter or a speaker operates an image displayed on a screen of a display unit 31. FIG. It is a figure which shows a mode that the target person pointed out becomes a speaker by the gesture which points the audience which a presenter raises one hand and gives screen operation authority with the other hand. The presenter raises one hand, points to the audience who is authorized to operate the screen with the other hand, and then pulls out (takes away) the gesture to remove the screen operation authority from the indicated speaker. FIG. A speaker who raises one hand and turns the hand around the audience in a specific area to which the other hand wants to grant screen operation authority is used to call multiple speakers in the indicated area. It is a figure which shows a mode that becomes. All the screen operation authority given to the speaker by the presenter is reset by pointing the motion of the motion capture sensor of the presentation management device, raising one hand, and moving the other hand from top to bottom (all It is a figure which shows a mode that it strips off. It is a block diagram of the presentation management apparatus 2 concerning embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[About assumptions]
The presentation management apparatus according to this embodiment is based on a specific presentation form. Therefore, in the following description, a pointing control device used for this specific presentation form will be described.

[Configuration of the assumed pointing control device]
First, the configuration of the pointing control device premised on the presentation management device according to the present embodiment will be described. FIG. 1 is a configuration diagram of the pointing control device 1.

  The assumed pointing control device 1 is roughly composed of a motion capture sensor 10 and a control unit 20.

  The motion capture sensor 10 includes a camera 11, a user detection unit 12, and an operation detection unit 13.

  The camera 11 captures surrounding images including the presenter and audience of the presentation.

  The user detection unit 12 identifies the presenter and speaker (described later) of the presentation from the image captured by the camera 11.

  The motion detection unit 13 detects (extracts) a specific motion of the presenter or speaker identified by the user detection unit 12. For example, when the presenter or the speaker points the image displayed on the screen of the display device with a finger and moves the hand while pointing, the motion detection unit 13 extracts the movement of the finger.

  For example, if the presenter or speaker moves the hand pointing to the screen to the right, the cursor on the screen also moves to the right. In this way, the presenter or speaker can hold the nothing and can instruct the cursor to move with his bare hands. The motion detector 13 does not recognize the absolute position of the presenter's or speaker's hand pointing at the screen, but extracts the finger movement by recognizing the relative position where the hand is moved.

  The control unit 20 moves the cursor displayed on the screen of the display unit 31 of the display device 30 or sends a slide page of the presentation according to the finger movement extracted by the motion detection unit 13.

  In addition, you may change the gesture to accept with a presenter and a speaker. For example, while the presenter can make many gestures to perform complex screen operations, the speaker may not be used to performing gestures, so for example, point a specific point on the screen with your finger Only simple gestures such as gestures and gestures for sending pages may be performed.

  Note that the motion detection unit 13 can recognize various specific movements (gestures) without being limited to the motion of the presenter or the speaker pointing the image displayed on the screen of the display device with a finger.

  Note that the display device 30 having the display unit 31 shown in FIG. 1 may be configured as a part of the pointing control device 1, or a general display device may be separately prepared and used.

  When a projector and a screen are used as a general display device, a screen surface on which a presentation image is projected by the projector is an image display surface.

  In the above description, the motion capture sensor 10 includes the camera 11 and the like. However, the present invention is not limited to this configuration, and the camera 11, the user detection unit 12, the operation detection unit 13, and the distance detection unit 14. May be independent of each other. By making each independent, a commercially available general and inexpensive motion capture sensor can be used.

  Heretofore, the configuration of the pointing control device premised on the presentation management device according to the present embodiment has been described.

[Assumed deployment]
Next, the positional relationship among the motion capture sensor 10, the display device 30, the presenter, the audience A, the audience B, and the audience C, which is assumed by the pointing control apparatus 1 used together with the presentation management apparatus according to the present embodiment, is specifically described. An example will be described. The audience includes speakers. FIG. 2 is a diagram illustrating a specific example of the positional relationship assumed by the pointing control device 1. FIG. 2 is a view of the positional relationship as seen from above.

  A large liquid crystal display as the display device 30 is arranged in front of the audience A, the audience B, and the audience C, and the screen as the display unit 31 of the large liquid crystal display is directed toward the audience A, the audience B, and the audience C. Yes.

  The motion capture sensor 10 is installed immediately before the display device 10. In this example, the motion capture sensor 10 is installed immediately before the display device 10, but the installation position is not limited to this position. The position where the motion capture sensor 10 is disposed may be anywhere as long as the gestures of the presenter and the speaker can be appropriately detected.

  The position of the presenter who gives a presentation and performs a gesture (screen operation gesture) for pointing the screen in order to move the cursor on the screen of the display unit 31 may be an intermediate position between the display unit 31 and the audience C. It is done.

  The user detection unit 12 recognizes the positional relationship among the display device 30, the presenter, the audience A, the audience B, and the audience C from the image captured by the camera 11, and the presenter and the audience (or an authority deprivation gesture described later). Identify the speaker).

  The arrangement described here is an example, and as another example, a screen is installed in front of the audience A, the audience B, and the audience C as the display device 30, and from behind the audience A, the audience B, and the audience C. A configuration in which an image is projected by a projector may be used. In this case, the motion capture sensor 10 may be disposed near the screen or may be disposed near the projector.

  The specific examples of the positional relationship among the motion capture sensor 10, the display device 30, the presenter, the audience A, the audience B, and the audience C, which are assumed by the pointing control device 1, have been described above.

[About the gestures required for screen operations]
Next, how a presenter or a speaker operates an image displayed on the screen of the display unit 31 will be described. FIG. 3 is a diagram illustrating a state where a presenter or a speaker operates an image displayed on the screen of the display unit 31.

  When the presenter or the speaker performs a gesture (screen operation gesture) that points the screen of the display unit 31 with a finger, the pointing control device 1 detects the gesture, and the pointing control device 1 moves the cursor on the screen. Or send a page of a presentation slide.

  Specifically, the user detection unit 12 identifies the presenter from the image captured by the camera 11, and the motion detection unit 13 detects the screen operation gesture of the presenter identified by the user detection unit 12. The control unit 20 operates the screen of the display unit 31 according to the screen operation gesture detected by the motion detection unit 13.

  In addition, when the presenter and the speaker give instructions by the screen operation gesture at the same time, the instructions of the presenter have priority.

  As described above, the manner in which the presenter or the speaker operates the image displayed on the screen of the display unit 31 has been described.

[Overview of this embodiment]
Next, an overview of the presentation management apparatus according to the present embodiment will be described.

  In the presentation management apparatus according to the present embodiment, the authority for performing the screen operation by a gesture (screen operation gesture) is appropriately given to the questioner or the speaker in the audience by a simple gesture (privilege gesture). Giving or stripping it out helps to facilitate communication in the presentation.

  For this reason, the presenter who uses the presentation management apparatus according to the present embodiment has exclusive authority to give and take authority to perform screen operations to speakers in the audience in addition to authority to perform screen operations. .

  When the audience is given the authority to operate the screen by the presenter's authority deprivation gesture, the audience can operate the screen as a speaker using the screen operation gesture. Further, if the authority to operate the screen given by the presenter's authority deprivation gesture is deprived, the screen cannot be operated by the screen operation gesture.

  The audience cannot operate the screen with the screen operation gesture unless the presenter gives the authority to operate the screen.

  The presenter can give or remove screen operation authority to a plurality of speakers individually. When screen operation authority is given to a plurality of speakers, the plurality of speakers can jointly operate the screen.

  In addition, the presenter can give or deprive the screen operation authority as a speaker by performing an authority deprivation gesture to a part of a plurality of audiences.

  For example, the screen operation authority can be given to the audience sitting at the right side as a speaker by a gesture indicating a wide range including the audience sitting at the right side of the venue among the audience at the presentation venue. In this case, the audience sitting on the left side of the venue cannot have the authority to operate the screen. A plurality of audiences given screen operation authority can operate the screen jointly.

  The overview of the presentation management apparatus according to the present embodiment has been described above.

[Specific examples of privilege deprivation gestures]
Next, when using the presentation management apparatus according to the present embodiment, a specific example of the authority deprivation gesture used when the presenter gives or deprives the speaker the authority to operate the screen will be described.

(Give screen authority to one specific person)
In FIG. 4, the presenter (audience B) who is pointed at by the presenter raises one hand and points to the audience who wants to give screen operation authority with the other hand (first gesture) becomes the speaker. It is a figure which shows a mode.

(Takes screen operation authority from the speaker who has been given screen operation authority)
FIG. 5 shows the remarks indicated by the presenter pointing up the audience who raises one hand and pointing to the audience who is authorized to operate the screen with the other hand (the third gesture). It is a figure which shows a mode that screen operation authority is stripped from a person.

(Give screen operation authority to a specific range of people)
FIG. 6 is indicated by a gesture (second gesture) in which the presenter raises one hand and turns his hand to surround the audience in a specific range where the other hand wants to grant screen operation authority. It is a figure which shows a mode that the several subject (audience A and audience B) of the range which becomes the speaker becomes a speaker.

(Reset all screen operation authority you gave)
FIG. 7 shows a gesture (fourth gesture) in which the presenter turns the direction of the motion capture sensor (described later) of the presentation management device, raises one hand, and moves the other hand from top to bottom. It is a figure which shows a mode that all the screen operation authority given to the speaker is reset (all stripped).

  The specific example of the authority deprivation gesture used when the presenter gives or deprives the speaker the authority to operate the screen when using the presentation management apparatus according to the present embodiment has been described above.

[Configuration of presentation management device]
Next, the configuration of the presentation management apparatus according to the present embodiment will be described. As described above, the presentation management apparatus according to the present embodiment is based on the pointing control apparatus 1 described above. Therefore, the configuration of the presentation management device is a new function added based on the configuration of the pointing control device 1. FIG. 8 is a configuration diagram of the presentation management apparatus 2 according to the present embodiment.

  In the following, only functions newly added to make the pointing control device 1 the presentation management device 2 will be described.

  A distance detector 14 is added to the motion capture sensor 10. The distance detector 14 detects the distance from the display device 30 to the presenter or speaker.

  The motion detection unit 13 (gesture detection unit) detects the presenter and speaker's screen manipulation gestures, as well as the presenter's authority deprivation gesture.

  The user detection unit 12 (identification unit) identifies the positions of the presenter and the speaker based on the video captured by the camera 11 (imaging unit) and the distance detected by the distance detection unit 14.

  The control unit 20 includes an operation / condition determination unit 21 (authority control unit) and a storage unit 22. Based on the presenter's authority deprivation gesture, the calculation / condition determination unit 21 gives the screen manipulation authority to the target person who is the target of the gesture in the audience as a speaker, The screen operation authority is taken away from the speaker who has been given the screen operation authority.

  The storage unit 22 stores the positions of the presenter and the speaker as position information. Note that the storage unit 22 may store information related to the presenter and the speaker other than the position information.

  The configuration of the presentation management apparatus 2 according to the present embodiment has been described above.

[Processing flow]
Next, the flow of each process performed in the presentation management apparatus 2 will be described.

(1) Recognition of Presenter First, the presentation management device 2 identifies a presenter of a presentation. This is because only the presenter is in a preferential position where the speaker can be given the screen operation authority by the authority giving / rejecting gesture.

  Based on the position of the person detected by the distance detection unit 14, the user detection unit 12 sets the person closest to the display device 30 as the presenter.

  From the viewpoint of preventing malfunction, when a person who is located at a specific distance or more is detected, even if the person is the person closest to the display device 30, the person may not be recognized as a presenter.

  However, the present invention is not limited to this configuration, and the configuration may be such that the administrator of the presentation management device 2 explicitly designates the presenter from a plurality of persons photographed by the camera 11.

(2) Granting of screen operation authority When the presenter raises one hand, the camera 11 captures the gesture, and the feature point of the arm mentioned by the motion detection unit 13 is extracted based on the captured video. The calculation / condition determination unit 21 prepares to grant screen operation authority based on the extracted arm feature points.

  Next, when the presenter points to one of the audience or a specific range of the audience with the other hand, the camera 11 captures the gesture, and the motion detection unit 13 is based on the captured video. The indicated person is specified as a speaker, and the user detection unit 12 detects the position of the specified speaker. The detected speaker position information is stored in the storage unit 22.

  Finally, the calculation / condition determination unit 21 grants screen operation authority to the specified speaker.

(3) At the time of screen operation The screen operation gesture by the speaker who is given the screen operation authority is continuously detected by the motion detection unit 13. When a certain screen operation gesture is detected, the calculation / condition determination unit 21 collates the detected position coordinates with the position coordinates of the speaker stored in the storage unit 22 and has a screen operation authority. It is determined whether or not it is a screen operation gesture. If it is a speaker's screen operation gesture, the gesture is accepted and the screen operation is performed.

(4) Deprivation of authority to operate the screen When the presenter raises one hand, the camera 11 captures the gesture, and the feature point of the arm mentioned by the motion detection unit 13 is extracted based on the captured image. The calculation / condition determination unit 21 prepares to deprive the screen operation authority based on the extracted arm feature points.

  Next, when the presenter points to one of the audience or a specific range of the audience with the other hand and performs a gesture of pulling the hand, the camera 11 captures the gesture, and the captured image is displayed. Based on this, the speaker who is pointed to by the motion detector 13 is specified, and the position of the speaker who is specified is detected by the user detector 12. The detected speaker location information is deleted from the storage unit 22.

  Finally, the calculation / condition determination unit 21 removes the screen operation authority from the specified speaker.

(5) Resetting screen operation authority When the presenter performs a gesture of turning the direction of the motion capture sensor 10 of the presentation management device 2, raising one hand, and moving the other hand from top to bottom, the camera 11 The gesture is photographed, and the calculation / condition determination unit 21 resets (removes all) the screen operation authority given to the speaker. All the speaker location information stored in the storage unit 22 is also deleted.

  The flow of each process performed in the presentation management apparatus 2 has been described above.

[Additional notes]
In addition, the present technology is not limited to the above-described embodiment, and various changes can be made without departing from the scope of the present technology.

DESCRIPTION OF SYMBOLS 1 ... Pointing control apparatus 2 ... Presentation management apparatus 10 ... Motion capture sensor 11 ... Camera 12 ... User detection part 13 ... Motion detection part 14 ... Distance detection part 20 ... Control part 21 ... Calculation and condition determination part 22 ... Memory | storage part 30 ... Display device 31 ... Display unit

Claims (7)

A filming unit capable of shooting the video of the presenter and audience of the presentation;
A gesture detection unit capable of detecting an authority deprivation gesture for instructing deprivation of authority to operate the screen on which the image of the presentation is displayed;
A specifying unit for specifying a target person of the first privilege deprivation gesture from a captured image when a first privilege deprivation gesture for the audience by the presenter is detected by the gesture detection unit;
An authority control unit that gives authority to operate the screen with the identified target person as a speaker ,
The specific part is:
When the second privilege deprivation gesture indicating the specific range of the audience by the presenter is detected by the gesture detecting unit, the specific range based on the gesture indicating the specific range of the audience by the presenter Identify one or more target audiences
The authority control unit
A presentation management device that gives authority to operate the screen with each of the identified target persons as a speaker . A filming unit capable of shooting the video of the presenter and audience of the presentation;
A gesture detection unit capable of detecting an authority deprivation gesture for instructing deprivation of authority to operate the screen on which the image of the presentation is displayed;
A specifying unit for specifying a target person of the first privilege deprivation gesture from a captured image when a first privilege deprivation gesture for the audience by the presenter is detected by the gesture detection unit;
An authority control unit that gives authority to operate the screen with the identified target person as a speaker;
With
The authority control unit
When the gesture detection unit detects a fourth authority deprivation gesture that moves the other hand from the top to the bottom by facing the direction of the gesture detection unit by the presenter, all the speakers A presentation management device that relinquishes the authority given by The presentation management device according to claim 1 or 2 ,
The gesture detection unit
A presentation management device that detects a gesture by the presenter pointing to the one target person as the first authority deprivation gesture. The presentation management device according to claim 3 ,
The specific part is:
A presentation management device that identifies the target person based on a gesture by the presenter pointing to the one target person. The presentation management device according to any one of claims 1 to 4 , wherein
The authority control unit
When the gesture detection unit detects a third authority deprivation gesture by the presenter to reach the direction of one of the authorized speakers and then pull the extended hand, A presentation management device that relinquishes the authority given to a speaker who is in the direction of extending the voice . A gesture detection unit capable of detecting an authority deprivation gesture for instructing deprivation of authority to operate a screen on which the image of the presentation is displayed, from images of a presenter and an audience of the presentation photographed by the photographing unit;
A specifying unit for specifying a target person of the first privilege deprivation gesture from a captured image when a first privilege deprivation gesture for the audience by the presenter is detected by the gesture detection unit; and
An authority control unit that gives authority to operate the screen with the identified target person as a speaker
As a presentation management program for making a computer function as
The specific part is:
When the second privilege deprivation gesture indicating the specific range of the audience by the presenter is detected by the gesture detecting unit, the specific range based on the gesture indicating the specific range of the audience by the presenter Identify one or more target audiences
The authority control unit
Give authority to operate the screen with each identified target person as a speaker
Presentation management program. A gesture detection unit capable of detecting an authority deprivation gesture for instructing deprivation of authority to operate a screen on which the image of the presentation is displayed, from images of a presenter and an audience of the presentation photographed by the photographing unit;
A specifying unit for specifying a target person of the first privilege deprivation gesture from a captured image when a first privilege deprivation gesture for the audience by the presenter is detected by the gesture detection unit; and
An authority control unit that gives authority to operate the screen with the identified target person as a speaker
As a presentation management program for making a computer function as
The authority control unit
When the gesture detection unit detects a fourth authority deprivation gesture that moves the other hand from the top to the bottom by facing the direction of the gesture detection unit by the presenter, all the speakers Deprive the authority that was given from
Presentation management program.

Images