WO2017002250A1

WO2017002250A1 - Display system, electronic pen device, electronic pen device light emission control method

Info

Publication number: WO2017002250A1
Application number: PCT/JP2015/069074
Authority: WO
Inventors: 俊彦松澤; 松見　邦典; 啓行新治
Original assignee: 日立マクセル株式会社
Priority date: 2015-07-01
Filing date: 2015-07-01
Publication date: 2017-01-05

Abstract

Provided is a technology of reducing or eliminating unnecessary power consumption of an electronic pen device in a display system including the electronic pen device. This display system is provided with: an electronic pen device that emits light when the electronic pen device is brought into contact with an object; and a display device that displays an image at a position of a point indicated in a display region of a display medium by a user using the electronic pen device, said image corresponding to the point. The electronic pen device is provided with: a contact detection unit that detects states including a contact state and a non-contact state between a leading end section and the object; a light emitting unit wherein switching between a light emitting state, wherein light is emitted from the leading end section, and a non light emitting state, wherein light is not emitted from the leading end section, can be performed; a power supply unit that supplies, to at least the light emitting unit, power for emitting light; and a control unit that performs a control relating to the light emission. The control unit controls, in the contact state, the light emitting unit to be in the light emitting state, and controls, in the non-contact state, the light emitting unit to be in the non light emitting state, and switches the state of the light emitting unit from the light emitting state to the non light emitting state when the contact state continued for a predetermined time.

Description

Display system, electronic pen device, and electronic pen device light emission control method

The present invention relates to a technology of a display system including an electronic pen device.

There are the following systems as a display system including an electronic pen device. The user performs an operation of drawing an arbitrary character or the like on the display area with the electronic pen device. The electronic pen device emits light according to a state in which the tip of the electronic pen device contacts the display area. The display device detects light emission from the electronic pen device and displays an image corresponding to a handwriting by the electronic pen device in a display area.

JP, 2013-45206, A (patent documents 1) is mentioned as a prior art example concerning an electronic pen device. Patent Document 1 describes the following technology as an electronic pen. This electronic pen includes a push switch unit that switches the contact state by pressing the tip, a light emitting unit that emits infrared rays, a control unit that emits light in response to the contact state, a battery that supplies power to the light emitting unit, and the like. A power switch for switching the power on and off is provided.

JP 2013-45206 A

In a display system including a conventional electronic pen device, unnecessary power consumption may occur due to light emission from the electronic pen device. For example, when the user does not use the electronic pen device for a normal function, the electronic pen device may be left on a pen stand or the like. The tip of the electronic pen device contacts an object such as a pen stand and emits light in response to the contact. Electric power from a battery or the like is consumed for light emission. As the electronic pen device continues to contact and emit light, unnecessary power consumption occurs for the subsequent time.

An object of the present invention is to provide a technique that can reduce or prevent unnecessary power consumption of an electronic pen device in a display system including the electronic pen device.

A representative embodiment of the present invention is a display system including an electronic pen device, and has the following configuration.

The display system according to an embodiment corresponds to an electronic pen device that emits light by touching an object, and a point indicated by the user using the electronic pen device in a display area of a display medium. In a display system comprising a display device for displaying an image to be played, the electronic pen device detects a state including a contact state and a non-contact state between the tip of the electronic pen device and the object; and A light emitting unit that can switch between a light emitting state that emits light from the tip and a non-light emitting state that does not emit light, a power supply unit that supplies power for the light emission to at least the light emitting unit, and a control that controls the light emission A light emission detection unit for detecting the light emission from the electronic pen device in the display area, and based on the detection of the light emission, the display device in the display area A calculation unit that calculates a position of a point indicated by the child pen device; and a display unit that displays an image corresponding to the point at the position of the point in the display area based on the calculated position of the point. The control unit sets the light emitting unit in the light emitting state when in the contact state, sets the light emitting unit in the non light emitting state when in the non-contact state, and turns the light emitting unit on when the contact state continues for a predetermined time. Switching from the light emitting state to the non-light emitting state.

According to a typical embodiment of the present invention, unnecessary power consumption of the electronic pen device can be reduced or prevented with respect to a display system including the electronic pen device.

It is a figure which shows the structure of the display system of Embodiment 1 of this invention. FIG. 3 is a diagram illustrating an arrangement example in the display system according to the first embodiment. FIG. 3 is a diagram illustrating a configuration of an electronic pen and a display device in the display system according to the first embodiment. 3 is a diagram illustrating a configuration of an electronic pen and light emission control in the display system of Embodiment 1. FIG. 6 is a diagram illustrating a flow of light emission control of a control unit of the electronic pen in the display system of Embodiment 1. FIG. It is a figure which shows the example of the contact and light emission of an electronic pen in the display system of Embodiment 1. FIG. 3 is a diagram showing a detailed configuration of a display device in the display system of Embodiment 1. FIG. It is a figure which shows the structure and light emission control of an electronic pen in the display system of Embodiment 2 of this invention. FIG. 10 is a diagram illustrating a configuration of an electronic pen in a display system according to a modification of the second embodiment. It is a figure which shows the structure of the electronic pen in the display system of the other modification of Embodiment 2. FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that components having the same function are denoted by the same reference symbols throughout the drawings for describing the embodiment, and the repetitive description thereof will be omitted. In the drawing, some elements are connected by lines, but the elements are connected to each other, including lines not shown, and operate in cooperation.

The display system according to the present embodiment includes the electronic pen device according to the present embodiment and a display device. The electronic pen device light emission control method of the present embodiment is a method including a light emission control procedure of the electronic pen device of the present embodiment.

(Embodiment 1)
The display system, the electronic pen device, and the electronic pen device light emission control method according to the first embodiment of the present invention will be described with reference to FIGS.

[Display system]
FIG. 1 shows the overall configuration of the display system according to the first embodiment. The display system of Embodiment 1 includes an electronic pen 1, a display device 2, an information processing device 3, a video output device 4, and a display medium 5. An information processing device 3 and a video output device 4 are connected to the display device 2 as external devices. In FIG. 1, the user holds the electronic pen 1 as an operation article in the hand 8 and draws an arbitrary character or the like on the display area 6 of the display medium 5. Note that (X, Y, Z) is shown as a direction for explanation. The X direction and the Y direction correspond to the horizontal direction and the vertical direction in the plane of the display area 6 and are the directions constituting the position coordinates. The Z direction corresponds to the normal direction to the surface of the display area 6.

The display system of Embodiment 1 realizes an electronic whiteboard, an interactive projector, and the like. This display system has an interactive function. The interactive function is a function that allows a user to perform arbitrary drawing using the electronic pen 1 on a background using the projector function or an arbitrary projected display image. The interactive function detects a handwriting including a point indicated by the user with the electronic pen 1 in the display area 6 of the display medium 5 and immediately superimposes an image corresponding to the handwriting on a projected display image in the display area 6. It is a function to display. The user can draw an arbitrary character, perform a function operation instruction, or the like by an operation of pointing a point with the electronic pen 1 or an operation of arbitrarily drawing in the display area 6. Interactive functions can support presentations by users.

The display device 2 is a projection-type image display device, and has a function of projecting and displaying an image on the display area 6 of the display medium 5 as a projector function. The display device 2 includes a processing unit for realizing an interactive function. The display device 2 is linked to the information processing device 3 and the video output device 4, and can project and display video corresponding to arbitrary data input from the information processing device 3 and video data input from the video output device 4. .

The electronic pen 1 is a dedicated electronic pen device that is an element constituting the display system. In other words, the electronic pen 1 is a contact-type light emitting device or an instruction device. The electronic pen 1 is a contact type light emitting device having a function of emitting light from the tip when the tip contacts an object such as the display medium 5. The electronic pen 1 is an instruction device for pointing a point on the display area 6 and drawing a line.

The electronic pen 1 has a pen shape corresponding to a pen that is a general writing instrument. The user holds the electronic pen device 1 in the hand 8 and performs an operation of pointing an arbitrary point in the display area 6 or an operation of drawing an arbitrary character or figure. Since the electronic pen 1 itself does not have a function as a general writing instrument, for example, a drawing function using ink, the drawing operation is only an operation, and the drawing function is realized by projection display.

The electronic pen 1 emits light when in a contact state where the tip is in contact with the surface of the display medium 5 or the like, and does not emit light when in a non-contact state where it is not in contact. The electronic pen 1 emits IR light 51, which is infrared light, as an electromagnetic wave when in contact.

The display medium 5 is a medium or device constituting a screen. The display medium 5 may be a dedicated device constituting the display system, such as a white board, or a general indoor wall or device. A display area 6 is provided on the front surface of the display medium 5.

The display area 6 has a two-dimensional plane in the X direction and the Y direction, and corresponds to the screen. The display area 6 is a target area for the projector function and the interactive function, and is a light emission detection target area and a video projection display area. The light emission detection target area is an area in which the IR light 51 can be detected by photographing from the display device 2. The video projection display area is a projection plane of video by visible light 52 from the display device 2. In the display area 6, when using the interactive function, the user performs an operation of pointing an arbitrary point with the electronic pen 1 or an operation of drawing with an arbitrary handwriting. In response to this operation, IR light 51 is emitted from the electronic pen 1.

In addition, as the display area 6, the light emission detection target area and the video projection display area may not completely overlap. That is, the first area that is the light emission detection target area and the video projection display area, the second area that is the light emission detection target area, and the third area that is the video projection display area may be mixed.

The display area 6 is a horizontally long rectangle in FIG. 1 and includes an area 6a and an area 6b. In the display area 6, a plurality of types of areas can be set in advance based on the setting in the display device 2. As a plurality of types of areas in the display area 6, in FIG. 1, a video area that is the area 6a and an operation icon area that is the area 6b are set.

In the area 6a, an image of arbitrary data such as a white background or a material designated by the user is displayed, and can be freely drawn by the electronic pen 1 thereon. In the display area 6, the basic background color in the projection display is white, but it may be black, and the color can be set by the user.

Handwriting

9a and 9b are shown as examples of drawing in the area 6a. The handwriting 9 a shows an example in which the user is drawing with the electronic pen 1. The handwriting 9b shows an example of drawn characters and figures. The black line in the handwriting 9 a is composed of a plurality of continuous points, and is displayed by the projection of the visible light 52 from the display device 2. Point 7 of the handwriting 9a indicates a point where the tip of the electronic pen 1 is in contact. A state where the IR light 51 is emitted from the tip of the electronic pen 1 at the position of the point 7 is indicated by a broken star. IR light 51 is indicated by a dashed arrow. Visible light 52 is indicated by a two-dot chain line arrow. A point 7a indicates the position coordinates of the point in the display area 6 as (x, y).

In the area 6b, operation icons and the like are displayed. The operation icon is an icon for an instruction related to use of a function such as an interactive function. The user selects and operates the operation icon in the area 6 b using the electronic pen 1. Thereby, an instruction corresponding to the operation icon is given to the interactive function. Similar to the detection mechanism in the area 6a, the display device 2 recognizes the operation icon selected in the area 6b and executes processing corresponding to the instruction of the operation icon.

Although not shown, the operation icons include, for example, “pen operation (drawing)”, “mouse operation (drawing)”, “eraser”, “video switching”, “operation menu”, and the like. “Pen operation (drawing)” corresponds to a function of switching to drawing using the electronic pen 1. “Mouse operation (drawing)” corresponds to the function of switching to drawing using the mouse of the information processing apparatus 3. “Eraser” corresponds to an eraser function for erasing the handwriting in the region 6a. “Video switching” corresponds to a function of switching a video to be displayed from a plurality of videos. The “operation menu” corresponds to a function for calling the operation menu. In the operation menu, a function for selecting a device to be used such as the display device 2 or the information processing device 3, a function for selecting a function to be used among the devices, a function for performing setting for each function, or the like is selected and used. Is possible.

The information processing apparatus 3 is a PC or the like, has presentation software and the like, and stores arbitrary data such as a presentation material file. The information processing device 3 communicates with the display device 2 and can input and output various types of data including instructions regarding interactive functions to the display device 2. The information processing device 3 can output arbitrary data to the display device 2 in order to display an image of arbitrary data in the area 6 a of the display area 6.

The video output device 4 can communicate with the display device 2 and output video data for displaying video in the area 6a to the display device 2. The video output device 4 can be various devices such as a DVD player. As the information processing device 3 and the video output device 4, a portable terminal such as a smartphone or a tablet is also possible. The connection method between the devices may be wired connection or wireless connection.

The outline of the display system in FIG. 1 is as follows. When using the interactive function of the display system, the user arbitrarily performs an operation such as drawing on the display area 6 of the display medium 5 using the electronic pen 1. With this operation, when the tip of the electronic pen 1 is in contact with the surface of the display area 6, a light emission state in which the IR light 51 is emitted from the tip of the electronic pen 1 is brought about. The display device 2 detects IR light 51, which is light emission from the tip of the electronic pen 1 in the contact state and the light emission state, by photographing the display area 6. The display device 2 calculates position coordinates corresponding to the position of the point 7 pointed to by the electronic pen 1 in the display area 6 based on the detection of light emission. Based on the calculation of the position coordinates of the point 7, the display device 2 projects and displays an image corresponding to the point 7 with visible light 52 at the position of the point 7 in the display area 6. Thereby, the point 7 is displayed in black on the white background of the display area 6, for example. Similarly, the display device 2 detects a handwriting including a plurality of points that are continuous in time series in correspondence with the locus of light emission that occurs when the tip of the electronic pen 1 moves in contact with the display area 6. Then, the display device 2 projects and displays the video corresponding to the handwriting on the display area 6 while superimposing the video on the arbitrary video.

[Example]
FIG. 2 shows an arrangement example in the display system of the first embodiment. This display system is used indoors, for example, in a conference room or classroom. Corresponding to the usage scene, the display medium 5 and the display device 2 are installed in a predetermined positional relationship. In FIG. 2, the display area 6 of the display medium 5 is shown in the YZ plane as viewed from the side. The display medium 5 is installed on, for example, an indoor wall. The display device 2 is installed at a predetermined position in the Z direction with respect to the center of the front surface of the display medium 5. For example, the display device 2 is installed on a table. The position of the display device 2 in the Y direction is a position that is obliquely lower than the center of the display area 6, but may be a position that is obliquely upper.

The electronic pen 1 shows a state in which a long axis is arranged in the Z direction as a state before the tip comes into contact with the XY plane which is the surface of the display area 6. When the tip of the electronic pen 1 is in contact with the surface of the display area 6, IR light 51 is emitted from the tip of the electronic pen 1, and the IR light 52 is reflected or scattered by the surface of the display area 6. A part is detected by the display device 2.

The projection display unit 24 and the light emission detection unit 21 are exposed at the end of the display device 2. The projection display unit 24 emits visible light 52 and the IR light 51 is incident on the light emission detection unit 21. The display device 2 projects and displays an image with visible light 52 on the display area 6 by the projection display unit 24, images the display area 6 by the light emission detection unit 21 configured by an imaging sensor or the like, and emits IR light from the electronic pen 1. 51 is detected.

The band is different between the IR light 51 which is light emission for position detection and the visible light 52 for projecting and displaying an image. As a design, two types of light, IR light 51 and visible light 52, are used so that the light emission for position detection does not interfere with the video when the user views the projected display video.

Also, calibration is performed in advance according to the arrangement of the display system. Calibration is adjustment of the display system, and is adjustment for enabling appropriate light emission detection and projection display in the display area 6. The calibration includes adjustment to make the photographing range of the light emission detection unit 21 in the display area 6 coincide with the display range of the projection display unit 24.

[Electronic pen (1)]
FIG. 3 shows configurations of the electronic pen 1 and the display device 2 in the display system of the first embodiment. In FIG. 3, the Z direction corresponds to the longitudinal direction and the axial direction of the pen-shaped housing of the electronic pen 1. First, a schematic configuration of the electronic pen 1 will be described with reference to FIG.

The electronic pen 1 has a tip portion 101, a connection portion 102, and a main body portion 103 in a pen-shaped housing. The electronic pen 1 includes a light emitting unit 11, a contact detection unit 12, a control unit 13, and a power supply unit 14 in a housing. The light emitting unit 11 is provided in the housing of the distal end portion 101. A contact detection unit 12, a control unit 13, and a power supply unit 14 are included in the housing of the main body unit 103. The light emitting unit 11, the contact detection unit 12, the control unit 13, and the power supply unit 14 are connected to each other.

The tip portion 101 is a portion that is brought into contact with the surface of the display area 6. The exterior of the tip 101 transmits the IR light 51 from the internal light emitting unit 11 to the outside. The tip portion 101 is connected to the main body portion 103 through the connection portion 102. The tip shape of the tip portion 101 has an ellipse or other curved shape in the ZY section with respect to the axis in the Z direction as shown in FIG.

The main body 103 is a portion that is gripped by the user's hand 8 and has, for example, a cylindrical shape and a constant diameter around an axis in the Z direction. In the housing of the main body 103, the contact detection unit 12 is disposed near the distal end portion 101 and the connection portion 102, and the power supply unit 14 is disposed near the distal end on the opposite side.

The connection part 102 is a part that connects the tip part 101 and the main body part 103. The connection unit 102 has a mechanism corresponding to the contact detection method of the contact detection unit 12. As an example of the configuration, the connection unit 102 is configured by a component that slightly expands and contracts in a direction including the Z direction. When the tip portion 101 receives a force such as a pressing force or a frictional force in a direction including the Z direction due to contact with an object, the connecting portion 102 slightly expands and contracts with the displacement of the tip portion 101. According to the expansion and contraction of the connecting portion 102, the contact detection unit 12 detects a state related to contact.

The connection part 102 may be provided so as to extend inside the casing of the tip part 101 as an example of the configuration. When the distal end portion 101 receives a pressing force or the like due to contact with an object, the casing of the distal end portion 102 is slightly displaced in the Z direction along the casing of the connection portion 102. According to the displacement of the tip 101, the contact detection unit 12 detects a state related to contact.

As another configuration example, the connection unit 102 may be configured by a fixed component that does not expand and contract according to a contact detection method. In this case, the contact detection unit 12 may detect a state related to the contact of the tip portion 101 from an electrical state or vibration that acts on the tip portion 101.

The light emitting unit 11 is configured by a circuit including an LED (light emitting diode) that emits IR light 51 and the like. The LED of the light emitting unit 11 emits the IR light 51 by being driven based on the light emission control signal from the control unit 13 and the power supplied from the power supply unit 14. Based on the light emission control from the control unit 13, the light emitting unit 11 enters a light emitting state in which the IR light 51 is emitted when the tip 101 is in contact with the surface of an object such as the display medium 5. Based on the light emission control from the control unit 13, the light emitting unit 11 enters a non-light emitting state in which the IR light 51 is not emitted when the tip 101 is in a non-contact state with the surface of the object.

The contact detection unit 12 detects a contact state and a non-contact state as a state relating to contact between the tip 101 and the surface of the object such as the display medium 5 by a predetermined contact detection method. Specifically, the contact detection unit 12 detects a state in which the tip 101 and the point in the display area 6 are in contact as a contact state, and detects a state in which the tip 101 and the point in the display area 6 are not in contact. Detect as contact state. The contact detection unit 12 informs the control unit 13 of the state related to the detected contact.

The contact detection unit 12 is provided at a position near the connection portion 102 of the main body 103 as a position in the vicinity of the tip 101 so that contact detection regarding the tip 101 can be performed. The contact detection unit 12 is configured by a circuit including a predetermined switch or sensor corresponding to the contact detection method. This switch may be a mechanical switch or an electrical switch.

The switch of the contact detector 12 is open when the tip 101 is not in contact with the object, and is closed when the tip 101 is in contact with the object. When the switch of the contact detection unit 12 is in the open state, a signal indicating the non-contact state is provided from the contact detection unit 12 to the control unit 13, and in the closed state, a signal indicating the contact state is provided from the contact detection unit 12 to the control unit 13. It is done.

The switch of the contact detection unit 12 receives, for example, a displacement of the connection unit 102 due to a force that works when the tip 101 contacts an object, and when this displacement is equal to or greater than a certain displacement, predetermined terminals are in contact with each other, The state is switched from the open state to the closed state.

When the contact detection unit 12 includes a sensor such as a press sensor, the following configuration may be used. The sensor of the contact detection unit 12 inputs a force that works when the tip 101 contacts an object through the connection unit 102. When the input force is a certain force or more, this sensor detects the contact state and switches the switch of the contact detection unit 12 from the open state to the closed state.

The control unit 13 performs light emission control on the light emitting unit 11, the contact detection unit 12, and the power supply unit 14 based on the contact detection in the contact detection unit 12. In particular, the control unit 13 receives a signal representing a state from the contact detection unit 12 and gives a light emission control signal to the light emitting unit 11. When the control unit 13 receives a signal indicating the contact state, the control unit 13 provides the light emission unit 11 with a signal for setting the light emission state. When receiving the signal indicating the non-contact state, the control unit 13 sets the light emission unit 11 to the non-light emission state. Give a signal to do. The control part 13 is comprised by IC chip containing CPU etc., for example.

The light emitting unit 11 is switched between a light emitting state and a non-light emitting state in response to a light emission control signal from the control unit 13. That is, the light emitting unit 11 emits light from the LED using the power supplied from the power supply unit 14 when receiving a signal for making the light emitting state in the contact state, and makes the light emitting state in the non-contact state. When the signal is received, the LED does not emit light.

The power supply unit 14 supplies necessary power to each unit including the light emitting unit 11. The power supply unit 14 supplies power necessary for light emission of the LEDs to the light emitting unit 11. The power supply unit 14 is configured by, for example, a circuit including a battery and a stable circuit. In the power supply unit 14, for example, one or more batteries are accommodated in the housing of the main body unit 103. A cover (not shown) is provided on a part of the housing of the main body 103. The user can attach and detach the battery by opening and closing the cover of the housing.

[Electronic pen (2)]
FIG. 4 shows the configuration and light emission control of the electronic pen 1 according to the first embodiment. The control unit 13 uses the signal from the contact detection unit 12 to monitor the contact state and the non-contact state as states relating to the contact of the electronic pen 1.

As the first light emission control, the control unit 13 controls the light emitting unit 11 to be in a light emitting state when in a contact state, and controls the light emitting unit 11 to be in a non-light emitting state when in a non-contact state. When the control unit 13 changes from the non-contact state to the contact state, the light-emitting unit 11 is switched from the non-light-emitting state to the light-emitting state. When the control unit 13 changes from the contact state to the non-contact state, the light-emitting unit 11 is changed from the light-emitting state to the non-light-emitting state. Switch to. The control unit 13 gives a signal corresponding to the state to the light emitting unit 11 in the first light emission control.

FIG. 4 shows an example of a signal given from the control unit 13 to the light emitting unit 11 during the light emission control as the light emission control signal 401. (A) is a signal for making it the light emission state at the time of a contact state, and shows the ON state which is a state in which a predetermined pulse signal is supplied. This pulse signal is a signal in which ON / OFF of a predetermined voltage is repeated at a predetermined cycle. (B) is a signal for making a non-light emitting state in a non-contact state, and shows an OFF state in which a predetermined pulse signal is not supplied.

The light emitting unit 11 emits IR light 51 in accordance with the pulse signal supplied from the control unit 13. Specifically, when the pulse signal is supplied, the light emitting unit 11 causes the LED to blink at a predetermined frequency in accordance with the pulse signal. That is, when the pulse signal voltage is on, the LED is turned on using the power supplied from the power supply unit 14, and when the pulse signal voltage is off, the LED is turned off. .

The control unit 13 further performs second light emission control. As the second light emission control, when the contact state continues for a predetermined time or more based on the monitoring of the state related to the contact of the electronic pen 1, the control unit 13 emits the light emission state of the light emitting unit 11 at the time when the predetermined time is reached. To the non-emission state. At this time, similarly to the first light emission control, the control unit 13 gives a signal for making the light emitting unit 11 non-light emitting. That is, the control unit 13 sets the OFF state in which the pulse signal is not supplied to the light emitting unit 11 at the timing. Thereby, in the light emission part 11, it will be in the non-light-emission state which does not light-emit LED, and the electric power from the power supply part 14 is not consumed in this non-light-emission state.

Since the contact state and the light emission state have a correspondence relationship, the second light emission control of the control unit 13 is, in other words, switching to the non-light emission state when the light emission state continues for a certain time or more. Further, the non-light emitting state can be associated with not using the power supplied from the power supply unit 14 to the light emitting unit 11 or turning off the power supply from the power supply unit 14 to the light emitting unit 11. Therefore, the second light emission control of the control unit 13 may be a control for turning off the power supply from the power supply unit 14 to the light emitting unit 11 when the contact state continues for a certain time or more.

The controller 13 is preset with a value of [fixed time] for the second light emission control. Let [constant time] and its value be T1. The set value of [fixed time] is, for example, several minutes.

In the second light emission control, the control unit 13 determines whether the contact state is continued for a certain period of time, for example, as follows. FIG. 4 shows the contact state constant time continuation determination 402, which is a part of the second light emission control. The horizontal axis represents time, and the vertical axis represents the binary state of contact state or non-contact state. The control unit 13 continuously inputs a signal representing a state from the contact detection unit 12.

The control unit 13 measures the time for which the contact state continues. Let this duration be T2. The controller 13 measures the duration T2 using a timer, for example. The control unit 13 starts counting the timer from the time point when the non-contact state is switched to the contact state, and measures the duration T2. When the duration T2 reaches a certain time T1, the control unit 13 stops supplying the pulse signal so that the light emitting unit 11 is switched from the light emitting state to the non-light emitting state at that timing.

In the example in FIG. 4, it is in a non-contact state until time t1, and changes to a contact state at time t1. The contact state continues from time t1, and at time t2, the duration T2 reaches a certain time T1. Therefore, the light emission state is switched to the non-light emission state at time t2.

When the control unit 13 switches to the non-light emission state by the second light emission control and then enters the contact state again after passing through the non-contact state, the light emission unit 11 is set to the light emission state similarly to the first light emission control. To do. In the example in FIG. 4, the electronic pen 1 is once in a non-contact state at a time t3 after the time t2, and is in a contact state again at a time t4. As a result, the light emission state is switched again at time t3.

[Flash control]
FIG. 5 shows a flow of light emission control of the control unit 13 of the electronic pen 1 in the display system of the first embodiment. Hereinafter, steps S1 to S11 in FIG. 5 will be described.

(S1) The control unit 13 inputs a signal indicating a state related to contact from the contact detection unit 14.

(S2) The control unit 13 determines whether it is a contact state or a non-contact state based on the signal of S1. If it is in the contact state (S2-Y), the process proceeds to S3, and if it is in the non-contact state (S2-N), the process proceeds to S5.

(S3) The control unit 13 confirms whether it is in a contact state and corresponds to a specific state described later. If the flag value indicating the specific state is 1 (S3-Y), the process proceeds to S10, and if not (S3-N), the process proceeds to S4.

(S4) The control unit 13 controls the light emitting unit 11 to emit light when in a contact state. That is, the control unit 13 is turned on to supply a predetermined pulse signal to the light emitting unit 11 in order to enter the light emitting state, and proceeds to S6 after S4.

(S5) The control unit 13 controls the light emitting unit 11 to be in a non-light emitting state when in a non-contact state. That is, the control unit 13 sets the OFF state in which the supply of the predetermined pulse signal to the light emitting unit 11 is stopped in order to set the non-light emitting state. After S5, the process of FIG. 5 ends, and the process returns to the beginning and repeats in the same manner.

(S6, S7) In S6, the control unit 13 checks whether or not the non-contact state has changed to the contact state. If the non-contact state has changed to the contact state (S6-Y), the process proceeds to S7. Otherwise (S6-Y), the process proceeds to S8. In S7, the control unit 13 starts measuring the duration T2 of the contact state.

(S8, S9) In S8, the control unit 13 determines whether the contact state has continued for a certain time in the contact state and the light emission state. If the duration T2 has reached the certain time T1 (S8-Y), the control unit 13 proceeds to S9. If not (S8-N), the control unit 13 ends the processing in FIG. Go back and repeat in the same way.

In S9, the control unit 13 performs control to switch the light emitting unit 11 from the light emitting state to the non-light emitting state. That is, the control unit 13 stops the supply of a predetermined pulse signal to the light emitting unit 11 in order to enter the non-light emitting state.

When it becomes a non-light-emitting state by S9, the electronic pen 1 will be in a contact state and a non-light-emitting state. The control unit 13 distinguishes this specific state from other states in terms of control. Therefore, the control unit 13 changes the value of a predetermined flag from 0 to 1, for example, in this specific state.

(S10, S11) In S10, the control unit 13 confirms whether or not the contact state corresponds to the state in which the contact state is once again changed to the non-contact state after continuing for a certain period of time. In other words, the control unit 13 confirms whether or not the specific state has changed from the non-contact state to the contact state. If this state is applicable (S10-Y), the control unit 13 proceeds to S11. If not, the control unit 13 ends the processing of FIG. 5, returns to the beginning, and repeats the same.

In S11, the control unit 13 switches the light emitting unit 11 from the non-light emitting state to the light emitting state as in S4. The control unit 13 returns the value of the flag from 1 to 0 so as to return from the specific state to the normal state in terms of control, ends the processing of FIG. 5, returns to the beginning, and repeats the processing in the same manner.

[Examples of electronic pen contact and light emission]
FIG. 6 shows an example of contact and light emission of the electronic pen 1 in the display system of the first embodiment. In this example, when the user does not use the electronic pen 1 for the interactive function, which is a normal function, the electronic pen 1 continues to contact an object and the light emission state continues.

FIG. 6 shows a case where the electronic pen 1 is placed in an arbitrary object, for example, a container that is a pen stand 601 with the tip 101 positioned downward. The tip 101 is in contact with the bottom surface of the container. Due to the weight of the electronic pen 1 in the vertical direction, a force of a certain level or more is applied to the tip portion 101. The weight is more accurately expressed as follows. Gravity based on the mass of the electronic pen 1 excluding the tip 101 and the gravitational acceleration acts as the pen's own weight. Thereby, when the threshold value that is a boundary between the force that the contact detection unit 12 does not detect contact and the force that detects contact is equal to or lower than the gravity, in other words, when the gravity is equal to or higher than the threshold, the contact detection unit 12 Is detected as a contact state. As a threshold value set for contact detection, the contact detection unit 12 has a threshold value that is a boundary between a force that does not detect contact and a force that detects contact smaller than the weight of the electronic pen device. Corresponding to this contact state, the light emitting unit 11 enters the light emitting state according to the light emission control of the control unit 13. In the contact state and the light emission state, the battery of the power supply unit 14 is discharged and a direct current is supplied to the light emission unit 11 to emit light, so that power is consumed.

Here, with regard to the design of the electronic pen 1, the higher the sensitivity related to contact detection of the contact detection unit 12, the higher the performance of drawing related to the interactive function. That is, when a user draws a character or the like on the display area 6 with the electronic pen 1, the user can easily draw if the handwriting is displayed with high sensitivity to the contact of the electronic pen 1. The higher the contact detection sensitivity, the higher the performance of interactive functions. Here, the lower the threshold of the force when the contact detection unit 12 detects contact, the higher the contact detection sensitivity. In particular, depending on the display system, there may be a case where the display area 6 is set to be horizontal, for example, when the contact detection unit 12 of the electronic pen 1 is brought into contact with an object in the vertical direction, contact detection is performed by the weight of the electronic pen 1. An interactive function that is easier for the user to draw can be realized by setting the contact detection sensitivity of the contact detection unit 12 so that the unit 12 detects the contact state.

As described above, when the threshold value of the force with which the contact detection unit 12 detects contact is smaller than the weight of the electronic pen 1, the electronic pen 1 stands in the vertical direction with respect to the bottom surface of the object as shown in FIG. The contact state is detected by the weight of the electronic pen 1. When the tip of the electronic pen 1 is kept in contact with some object, such as when the electronic pen 1 is left on the pen stand 601 after using the normal function, the light emission state of the electronic pen 1 continues unintentionally. End up.

In the conventional electronic pen, when the normal function is not used, when the tip of the electronic pen is kept in contact with the object as in the case of FIG. 6, the light emission state continues, and thus the light emission state continues. Unnecessary power consumption is consumed for hours, and battery consumption increases.

Therefore, the electronic pen 1 according to the first embodiment has a function of automatically switching to the non-light emitting state according to the elapsed time of the contact state and the light emitting state as in the second light emission control. Thereby, since the electric power of the battery of the power supply part 14 is not consumed for the light emission in the light emission part 11, unnecessary power consumption can be reduced and prevented. The user can use the electronic pen 1 without worrying about the power consumption. Even if the user leaves the electronic pen 1 on the pen stand 601 or the like during or after using the interactive function, unnecessary power consumption is reduced. That is, the display system of Embodiment 1 can realize high convenience.

[Display device (1)]
The schematic configuration of the display device 2 will be described with reference to FIG. The display device 2 includes a control unit 20, a light emission detection unit 21, a position calculation unit 22, a position drawing unit 23, a projection display unit 24, a handwriting storage unit 25, an input / output unit 26, a data storage unit 27, and a data display unit 28. .

The control unit 20 controls the entire display device 2 including each unit such as the light emission detection unit 21. In addition, the control unit 20 has a function for performing user settings.

The light emission detection unit 21 includes an imaging function, and detects IR light 51 emitted from the light emission unit 11 of the tip 101 of the electronic pen 1 that is in contact with the surface of the display region 6 by photographing the display region 6. To do. The light emission detection unit 21 is configured by an infrared sensor or the like that can detect electromagnetic waves including the IR light 51. The light emission detection unit 21 has a function of photographing a band including the IR light 51 in accordance with the light emission characteristics of the electronic pen 1. The light emission detector 21 detects the IR light 51 from the point 7 pointed to by the electronic pen 1 in the display area 6 based on an image obtained by photographing the display area 6.

It is preferable that the light emission detection unit 21 has a function of photographing in a band including not only IR light but also a visible light component for calibration described later. The light emission detection unit 21 may include an image sensor that can image a visible light component.

The position calculation unit 22 analyzes the captured image by the light emission detection unit 11 based on the detection of the light emission by the light emission detection unit 21, and is indicated by the contact and light emission of the tip 101 of the electronic pen 1 in the display area 6. The position coordinates of the obtained point 7 are calculated by a predetermined calculation. The position coordinates in the display area 6 are expressed as the position coordinates (x, y) of the point 7a in the XY plane of FIG. Similarly, the position calculation unit 22 calculates the position coordinates of a plurality of points that are continuous in time series corresponding to the movement locus of the tip of the electronic pen 1, and calculates them as handwriting. The position calculation unit 22 and the position drawing unit 23 are realized, for example, by hardware program such as FPGA and ASIC, or software program processing by a general-purpose CPU.

The position drawing unit 23 projects and displays an image corresponding to the point, for example, a black point, at the position of the point indicated by the electronic pen 1 in the display area 6 based on the calculation of the position coordinate in the position calculation unit 22. Video data is generated. And the position drawing part 23 displays the said image | video on the display area 6 by drive-controlling the projection display part 24 based on the said video data. Similarly, the position drawing unit 23 generates video data corresponding to handwriting composed of a plurality of points that are continuous in time series, and displays the video corresponding to the handwriting on the display area 6.

The handwriting storage unit 25 stores handwriting data including point position coordinates. The position calculation unit 22 and the position drawing unit 23 read and write handwriting data in the handwriting storage unit 25 as necessary.

The projection display unit 24 projects and displays an image by the visible light 52 corresponding to the handwriting including the dots on the display area 6 according to the drive control and the image data from the position drawing unit 23. The visible light 52 includes visible light 52a for displaying the point 7 pointed by the electronic pen 1 and visible light 52b for displaying arbitrary data.

The input / output unit 26 has an input / output interface and a communication interface. The input / output unit 26 has, for example, a USB interface as an input / output interface, and can be connected to an input device or an output device. The information processing device 3 and the video output device 4 are connected to the input / output unit 26. The input / output unit 26 performs data input from the outside, data output to the outside, and communication with the outside. In addition, the input / output unit 26 provides information for operation input including settings to the user as a user interface, and accepts operation input from the user.

The input / output unit 26 outputs the handwriting data in the handwriting storage unit 25 to an external device based on a user operation. The input / output unit 26 inputs arbitrary data such as materials from the information processing apparatus 3 and stores the data in the data storage unit 27. The input / output unit 26 receives video data from the video output device 4 and stores it in the data storage unit 27.

The data storage unit 27 stores arbitrary data and video data for projection display on the display area 6.

The data display unit 28 generates video data for projection display on the display area 6 based on arbitrary data and video data stored in the data storage unit 27, and the projection display unit 24 based on the video data. By controlling the drive, video is projected and displayed on the display area 6.

The projection display unit 24 generates video data obtained by combining handwriting data on arbitrary video data as required, and projects and displays a video in which handwriting is superimposed on an arbitrary video based on the video data. .

[Display device (2)]
FIG. 7 shows a detailed configuration of the display device 2 in the display system of the first embodiment. The display device 2 includes a control unit 210, an interactive function unit 220, a display unit 230, a sensor unit 240, a memory 211, a nonvolatile memory 212, an operation signal input unit 213, a communication unit 214, and a video input unit 215. The interactive function unit 220 includes a position coordinate calculation unit 221, an application unit 222, and a calibration unit 223. The display unit 230 includes a projection optical system 231, a display element 232, a display element driving unit 233, an illumination optical system 234, a light source 235, and a power source 236.

The correspondence between the configurations of FIGS. 3 and 7 is as follows. The control unit 210 corresponds to the control unit 20. The light emission detection unit 21 corresponds to the sensor unit 240 or the like. The position calculation unit 22 corresponds to the position coordinate calculation unit 221 and the like. The position drawing unit 23 and the data display unit 28 correspond to the application unit 222 and the like. The projection display unit 24 corresponds to the display unit 230 and the like. The handwriting storage unit 25 and the data storage unit 27 correspond to the memory 211 and the like. The input / output unit 26 corresponds to the operation signal input unit 213, the communication unit 214, the video input unit 215, and the like.

The control unit 210 controls the entire operation including the operation of each unit of the display device 2. The control unit 210 includes a processor, a ROM, a RAM, and the like (not shown). The control unit 210 realizes a control function by executing a software process by executing a program loaded into the RAM by the processor. In particular, the control unit 210 realizes an interactive function having high-speed responsiveness by controlling the sensor unit 240, the interactive function unit 220, the display unit 230, and the like in cooperation.

The memory 211 is a primary storage device or a secondary storage device, and various data such as control data and application of the display device 2, temporary processing data, arbitrary data for projection display, video data, video data for projection display, etc. Remember.

The nonvolatile memory 212 stores various data including control data of the display device 2 and data related to the interactive function. Data related to the interactive function includes display data such as operation icons, calibration data, and the like.

The operation signal input unit 213 corresponds to an operation button of the main body of the display device 2, a light receiving unit of the remote controller, etc., and inputs an operation signal based on a user operation and transfers it to the control unit 210 or the like. The display device 2 may include a display panel on which operation input information is displayed.

The communication unit 214 is connected to an external device such as the information processing device 3, communicates with the external device, transmits data in the memory 211 to the external device, and transmits data from the external device to the memory 211. Store.

The video input unit 215 is connected to the video output device 4, receives video data from the video output device 4, and stores it in the memory 211.

The sensor unit 240 is a part including a sensor that captures an image of the display area 6 that is the front surface of the display medium 5 and detects light emission from the electronic pen 1. The sensor unit 240 includes, for example, an infrared sensor that detects the IR light 51, an optical filter, and the like. The sensor unit 240 detects an infrared light component corresponding to the IR light 51 from the captured image in the display area 6. The sensor unit 240 outputs the captured image and the light emission detection information to the interactive function unit 220.

Note that the sensor unit 240 may have a function of detecting not only infrared light but also some visible light components other than infrared light, that is, visible light components related to the projected image in the display area 6. This can be realized, for example, by setting the cut wavelength of the optical filter included in the sensor unit 240 in the visible light wavelength band, for example, in the middle of the red visible light region. The display device 2 can use this function for calibration and the like.

The interactive function unit 220 performs processing for realizing the interactive function of the display system. The interactive function unit 220 is realized by hardware circuit processing, software program processing by a processor, or the like.

The position coordinate calculation unit 221 calculates the position coordinate of the point 7 pointed by the user with the electronic pen 1 in the display area 6 based on the captured image and the light emission detection information obtained from the sensor unit 240 by a predetermined calculation. Then, handwriting data including the position coordinates is obtained.

The application unit 222 is realized based on an application program stored in the memory 211. The application unit 222 inputs handwriting data including the position coordinates obtained by the position coordinate calculation unit 221 and performs predetermined processing. In the first embodiment, the application unit 222 is a drawing unit, and the application is a drawing application that realizes an electronic whiteboard or an interactive projector. As a predetermined process, the application unit 222 performs a process of projecting and displaying a corresponding video so as to draw the handwriting of the electronic pen 1 by the user on the white background or arbitrary data video in the display area 6. The application unit 222 sends the video data generated for the drawing to the display element driving unit 233. Accordingly, the display element 232, the projection optical system 231 and the like are driven and controlled by the display unit 230, and an image is displayed on the display area 6.

The processing of the application unit 222 includes processing for setting and displaying the region 6a and the region 6b in the display region 6, processing for displaying a video obtained by combining a plurality of video data in the region 6a, and operation of operation icons in the region 6b. Including processing for recognizing. The process of the application unit 222 includes a process of converting position coordinates in the video data using the calibration data in the nonvolatile memory 212 before performing projection display based on the video data.

The application of the application unit 222 is not limited to a drawing application, and may include other applications. As another application, an application linked with an application such as the information processing apparatus 3 or the video output apparatus 4 may be used. For example, the user designates a point in a predetermined area corresponding to the display area 6 by an input operation using a mouse or the like on the display screen by the application of the information processing apparatus 3. The information processing device 3 transmits information including the position coordinates of the designated point to the display device 2. The application unit 222 of the display device 2 inputs the information and causes the display area 6 to display an image corresponding to the designated point.

The calibration unit 223 performs processing related to calibration. The calibration unit 223 creates calibration data including coordinate conversion information based on the calibration work in advance and stores it in the nonvolatile memory 212. The coordinate conversion information is information indicating the correspondence between the position coordinates of the points in the captured image of the display area 6 and the position coordinates of the points projected and displayed in the display area 6.

In the display unit 230, the projection optical system 231 includes optical elements such as lenses and mirrors, and projects visible light 52 corresponding to an image onto the display area 6 based on a signal from the display element 232. The display element 232 is an element that generates a projected image. For example, a transmissive liquid crystal panel, a reflective liquid crystal panel, a DMD (Digital Micro-mirror Device (registered trademark) panel), or the like is applicable. The display element driving unit 233 sends a drive signal generated according to the video signal of the video data to the display element 232. The light source 235 is a light source that generates illumination light for projection display. For example, a high-pressure mercury lamp, a xenon lamp, an LED light source, a laser light source, or the like is applicable. The power source 236 supplies power to the light source 235 and the like. The illumination optical system 234 collects the illumination light from the light source 235 and irradiates the display element 232 with the illumination light as more uniform illumination light. The display element 232 generates a projection image based on the drive signal from the display element driving unit 233 and the illumination light from the illumination optical system 234 and projects the projection image through the projection optical system 231.

[Effects]
As described above, according to the display system including the electronic pen 1 of the first embodiment, unnecessary power consumption of the electronic pen 1 can be reduced or prevented. Even when the tip of the electronic pen 1 comes into contact with an arbitrary object and emits light, it automatically enters a non-light-emitting state after a predetermined time has elapsed, so that unnecessary power consumption can be reduced and prevented, and the power supply unit 14 Can extend the battery life. The user does not need to pay attention to the state of the electronic pen 1 and can realize high convenience as a display system.

Further, the electronic pen 1 according to Embodiment 1 does not have a power switch that can be turned on / off by the user, and power control is automatically realized together with light emission control. In the case of the conventional electronic pen, when the contact state and the light emission state remain, the user may not be aware, and unnecessary power consumption may increase. On the other hand, according to the first embodiment, even if the user does not notice that the electronic pen 1 is left in the light-emitting state, it automatically enters the non-light-emitting state after a certain period of time, and unnecessary power consumption increases. Is prevented.

[Modification]
As a modification of the display system of Embodiment 1, the following is mentioned.

The shape of the electronic pen 1 is not limited to a pen shape or a bar shape. Each unit such as the control unit 13 of the electronic pen 1 may be mounted on a substrate. The substrate is accommodated and fixed in the housing of the electronic pen 1.

The light emitted from the light emitting unit 11 of the electronic pen 1 is not limited to IR light, but can be ultrasonic waves or the like. In that case, the light emission detection unit 21 of the display device 2 includes a sensor capable of detecting ultrasonic waves and the like.

The contact detection unit 102 of the electronic pen 1 may be mounted in the tip 101 together with the light emitting unit 11. Further, the contact detection unit 12 or the like may be mounted in the connection unit 102. In the case where the light emitting unit 11 and the contact detection unit 12 are provided in the distal end portion 101, the distal end portion 101 has both functions of contact detection and light emission.

The contact detection method of the contact detection unit 12 may be any method that can detect the contact state and the non-contact state between the tip 101 and the object, and is not limited to the method described above, and various methods are applicable.

For example, a method of detecting a state related to the contact of the tip 101 by an electrical state may be used. In this case, an element such as a capacitor is provided at the tip portion 101 and the like, and a contact state and a non-contact state are detected according to the value of the capacitance and the like.

The light emission control signal given from the control unit 13 to the light emitting unit 11 is not limited to the pulse signal as shown in FIG. 4 but may be a constant voltage signal or the like.

The electronic pen 1 may be provided with a mechanism that allows the user to variably set the set value for the predetermined time T1 related to the second light emission control.

The control unit 13 is not limited to a method of giving a light emission control signal to the light emitting unit 11 according to the state related to the contact as a method of light emission control, and various methods are possible. For example, the control unit 13 sends a predetermined signal to the switch in the power supply unit 14, the switch in the light emitting unit 11, or the power supply unit 14 and the light emitting unit when the control unit 13 is in a non-contact state or when the contact state continues for a certain time. 11 to the switch between. As a result, the switch is opened, and power supply from the power supply unit 14 to the light emitting unit 11 is stopped. Since there is no power supply from the power supply part 14, the light emission part 11 does not light-emit LED, but will be in a non-light-emission state.

The contact state continuation time determination method is not limited to the method realized by the control unit 13 using a timer, and various methods are applicable. For example, a method for making a determination based on an electrical state is possible. For example, the contact detection unit 12 is provided with an element such as a capacitor corresponding to time measuring means in addition to a switch that opens and closes according to a state related to contact. In the closed state of the switch corresponding to the contact state, electric charges are accumulated in the element such as the capacitor. When the value of the capacity is equal to or greater than the threshold value, it is determined that the contact state has continued for a certain period of time.

Also, a mode in which the light emission state is continuously determined for a certain period of time is also possible. The light emitting unit 11 is provided with a predetermined element corresponding to time measuring means. When the light emission state in the light emitting unit 11 continues for a certain time, it is detected as a value in the element. And based on the detection, the light emission state of the light emission part 11 is switched to a non-light-emission state.

The power supply unit 14 may be configured by a circuit including a rechargeable battery. The display system may include a device including a mechanism for charging the rechargeable battery of the power supply unit 14 of the electronic pen 1, such as a cradle device.

The method of controlling light emission in the electronic pen 1 is not limited to a mode in which the control unit 13 is independently mounted by the CPU or the like and controls the light emitting unit 11 from the control unit 13, and various types are possible. The control unit 13 and the light emission control function may be integrated into the light emitting unit 11, the contact detection unit 12, or the power supply unit 14. For example, the following forms are mentioned.

The light emission control may be performed from the control unit 13 to the contact detection unit 12. For example, during normal times, the contact detection unit 12 provides a signal corresponding to detection of a state related to contact to the light emitting unit 11 and the control unit 13. The light emitting unit 11 switches between a light emitting state and a non-light emitting state according to a signal from the contact detection unit 12. The control unit 13 determines whether the contact state has continued for a certain period of time, and gives a signal for switching to the non-light-emitting state to the contact detection unit 12 when the contact state has continued for a certain period of time. The contact detection unit 12 gives a signal for switching to the non-light emitting state to the light emitting unit 11 according to the signal from the control unit 13. The light emitting unit 11 switches from the light emitting state to the non-light emitting state according to the signal.

The light detection control of the control unit 13 may be integrated in the contact detection unit 12 and the light emission unit 11. For example, regarding the first light emission control, the contact detection unit 12 gives a signal for setting the light emitting unit 11 to the light emitting state in the contact state, and makes the light emitting unit 11 non-light emitting state in the contact state. Give a signal. The light emitting unit 11 switches its state between a light emitting state and a non-light emitting state in accordance with a signal from the contact detection unit 12. In addition, regarding the second light emission control, the contact detection unit 12 determines whether the contact state has continued for a certain period of time, and if it continues, gives a signal for switching to the non-light emission state to the light emission unit 11. The light emitting unit 11 switches to the non-light emitting state according to the signal.

The form in which the light emission control of the control unit 13 is integrated in the contact detection unit 12 and the power supply unit 14 may be employed. For example, the contact detection unit 12 gives a signal to the power supply unit 14 to supply power from the power supply unit 14 to the light emitting unit 11 when in the contact state. When the power supply unit 14 continues for a certain period of time, the power supply unit 14 is given a signal for stopping the power supply from the power supply unit 14 to the light emitting unit 11. The power supply unit 14 controls power supply to the light emitting unit 11 in accordance with a signal from the contact detection unit 12. Thus, the light emitting unit 11 is switched between the light emitting state and the non-light emitting state in accordance with the power supply from the power source unit 14 and the state of its stop.

The display device 2 and the display medium 5 are not limited to the projection display method, and a liquid crystal display method and other display methods are also applicable. For example, in the case of a liquid crystal display method, the display medium 5 is a liquid crystal display panel and is connected to the display device 2 which is a main body. Drawing with the electronic pen 1 is performed in the display area of the liquid crystal display panel, and the display device 2 detects the handwriting of the drawing. The display device 2 generates liquid crystal display data and sends it to the liquid crystal display panel when displaying an image including the handwriting of the electronic pen 1, thereby displaying an image on the display area of the liquid crystal display panel.

In FIG. 1, the information processing device 3 and the video output device 4 may be omitted. Further, the display device 2 may be integrated with functions of an external device such as the information processing device 3 or the video output device 4. Further, the display device 2 may be configured by interconnecting a plurality of devices. For example, the display device 2 may be configured by an interconnection of an infrared camera device, a projector device, and a PC.

Further, the display device 2 may realize an interactive function in cooperation with an external device such as the information processing device 3 or the video output device 4. That is, the external device includes components that realize part of the interactive function. For example, the information processing device 3 includes a processing unit corresponding to the interactive function unit 220 of the display device 2 of FIG. The information processing device 3 communicates with the display device 2, links with the function, and performs processing related to a part of the interactive function. For example, the display device 2 transmits the light emission detection information in the display area 6 to the information processing device 3. The information processing device 3 calculates position coordinates, generates video data including the position coordinates, and transmits the video data to the display device 2. The display device 2 projects and displays an image on the display area 6 based on the image data.

Also, the interactive function may be realized by both the display device 2 and the external device, and one interactive function may be selected and used based on the user's instruction or setting.

(Embodiment 2)
The display system and the like according to the second embodiment will be described with reference to FIGS. The basic configuration of the second embodiment is the same as that of the first embodiment, and hereinafter, a description will be given of portions of the configuration of the second embodiment that are different from the configuration of the first embodiment.

[Electronic pen]
FIG. 8 shows the configuration of the electronic pen 1 in the display system of the second embodiment. FIG. 8A shows the components. FIG. 8B particularly shows power on / off and light emission control.

8A, the electronic pen 1 according to the second embodiment has a power switch 15 as a component different from the first embodiment. The power switch 15 is connected to the power supply unit 14 and can be turned on / off by the user. When the power switch 15 is turned on, the power supply unit 14 is turned on, and when the power switch 15 is turned off, the power supply unit 14 is turned off. When the power supply unit 14 is in a power-on state, power is supplied from the power supply unit 14 to each unit such as the light emitting unit 11, the contact detection unit 12, and the control unit 13, and when the power supply is in a power-off state, power supply to each unit is stopped. The light emission control of the first embodiment is possible in the power-on state, and is impossible in the power-off state. That is, the power switch 15 in FIG. 8A is a power switch that can switch off the power supply of the power supply unit 14 by the user regardless of the contact state detected by the contact detection unit 12.

The power switch 15 is provided at the end of the main body 103 of the electronic pen device 1 on the side opposite to the tip 101. The power switch 15 is configured by, for example, a mechanical mechanism that can be switched on and off in response to a slide operation or a button operation. The power switch 15 has a mechanism that allows the user to identify the power-on state and the power-off state. As an example of the mechanism, in a power-on state by a slide operation of the power switch 15, a symbol such as “ON” can be seen in red.

FIG. 8B shows a configuration related to the power switch 15. A switch 801 is provided in the middle of the power supply line between the power supply unit 14 and each unit such as the light emitting unit 11. The switch 801 may be provided inside the power supply unit 14. The power switch 15 and its switch 801 are connected by a control line. When the power switch 15 is turned on, the power is turned on and the switch 802 is controlled to be closed. When the power switch 15 is turned off, the power is turned off and the switch 802 is controlled to be opened. In the power-on state, power is supplied from the power supply unit 14 to each unit such as the light emitting unit 11. In the power-on state, as in the first embodiment, the state of the light emitting unit 11 is controlled by supplying a light emission control signal from the control unit 13 to the light emitting unit 11 in accordance with the state related to contact.

Comparing the first embodiment and the second embodiment, in the first embodiment, the power switch 15 that can switch off the power supply of the power supply unit 14 by the user regardless of the contact state detected by the contact detection unit 12 is provided. Since there is no power on / off operation by the user, the power supply of the power supply unit 14 cannot be forcibly turned off. Therefore, it is very effective to reduce or prevent unnecessary power consumption by the light emission control described in FIG. 4, FIG. 5, and FIG. In the second embodiment, since the power switch 15 is provided, the power state can be controlled by the user. The user normally turns on the power switch 15 and then uses the interactive function, and turns off the power switch 15 after use. However, when the user leaves the power switch 15 in the ON state after using the interactive function, the situation is the same as in the first embodiment. After that, when the tip of the electronic pen 1 is kept in contact with the object as shown in FIG. 6, the second light emission control is activated in the same manner as in the first embodiment, and the non-light emission state is automatically activated after a predetermined time has elapsed. To be. Therefore, even when the power switch 15 is provided, unnecessary power consumption is reduced and prevented by the light emission control described with reference to FIGS. 4, 5, and 6.

[Modification]
FIG. 9 shows a configuration of an electronic pen 1 which is a modification of the second embodiment. In the electronic pen 1 of this modification, a fixed switch 16 is provided in the connection unit 102 instead of the power switch 15 of the electronic pen 1 in FIG. The fixed switch 16 is a switch by a mechanical mechanism, and switches between movement and fixation of the distal end portion 101 according to an on / off operation by the user. When the fixed switch 16 is in the OFF state due to the OFF operation, the distal end portion 101 is fixed, and the distal end portion 101 is not movable with respect to the main body portion 103. In this fixed state, the contact detection unit 12 does not detect displacement or force as in the first embodiment, and therefore detects it as a non-contact state. That is, in this fixed state, only the non-contact state is controlled, and even if the tip 101 is in contact with the object, it is treated as a non-contact state. In this fixed state, since it is a non-contact state, the control part 13 makes the light emission part 11 non-light-emission state. In this non-light emitting state, the light emitting unit 11 does not consume the power of the power supply unit 14.

When the fixed switch 16 is in an ON state due to an ON operation, the distal end portion 101 is in a movable state, and the distal end portion 101 is movable with respect to the main body portion 103. In the movable state, the contact detection unit 12 detects the displacement and force as in the first embodiment, so that the contact state and the non-contact state can be detected. In this movable state, the control unit 13 performs light emission control as in the first embodiment.

Thus, even when the fixed switch 16 is used to switch between the fixed state and the movable state of the distal end portion 101, an effect close to the configuration in which the power switch 15 is used to switch the power on / off state can be obtained. In this modification, the fixed switch 16 is in an off state, which corresponds to a power-off state, and unnecessary power consumption can be prevented.

The following are examples of mechanical mechanisms in the fixed switch 16. By disposing the component parts of the fixed switch 16 in the gap between the tip portion 101 and the main body portion 103 in the connection portion 102, the tip portion 101 cannot move at least in the Z direction.

As a mechanism for realizing the on / off operation of the fixed switch 16, for example, a button or the like is provided in the connection unit 102. In the off state, the button functions as a protrusion, and the tip 101 cannot be moved in the Z direction. When the user presses the button, in the on state, the protrusion is eliminated so as to be flat, and the tip portion 101 can be moved in the Z direction.

As another mechanism, a groove is provided on the outside of the connecting portion 102 around the Z-direction axis and on the inside of the corresponding tip portion 102 so as to be able to rotate around the Z-direction axis. As the off operation, the user rotates the tip 101 along the groove around the axis of the connecting portion 102 so that the end of the tip 101 contacts the end of the main body 103. Thereby, in the OFF state, the tip 101 does not move any more.

FIG. 10 shows a modification of the fixed switch 16 in FIG. 9 as the configuration of the electronic pen 1 which is a modification of the second embodiment. With respect to the fixed switch 16 of FIG. 9, in the modification of FIG. 10, a cap 17 is provided as a component independent of the tip portion 101. When the user does not use the electronic pen 1, the user puts the cap 17 on the tip portion 101. The operation of putting the cap 17 on the tip 101 corresponds to the off operation of setting the fixed switch 16 in the off state, that is, the fixed state.

Corresponding grooves or the like are provided on the inner side of the cap 17 and the outer side of the connecting portion 102, and the grooves and the like are engaged with each other by the operation of putting the cap 17 on the distal end portion 101. The cap 17 is fixed to the connection portion 102 and the main body portion 103.

As the cap 17 is put on, the cap 17 mechanically acts on the fixed switch 16, so that the fixed switch 16 is turned off, that is, fixed, as in the mechanism of FIG. As a result, the tip portion 101 enters a non-contact state and a non-light emitting state, and the light emitting unit 11 does not use the power of the power source unit 14.

In this modification, the tip portion 101 is protected by the operation of covering the cap 17 and the power is turned off, and unnecessary power consumption can be prevented.

As another modification, the cap 17 and the fixed switch 16 shown in FIG. 10 may be integrated as one component. As another modification, a dedicated cradle device, a pen stand device, or the like may be provided instead of the cap 17. When the user does not use the electronic pen 1, for example, the user inserts the tip 101 of the electronic pen 1 into the cradle device. This cradle device has the same mechanism as the cap 17 and fixed switch 16 in FIG. As a result, the same action as in FIG. 10 works, and the tip of the electronic pen 1 enters a non-contact state and a non-light emitting state, and the light emitting unit 11 does not use the power of the power source unit 14.

The present invention has been specifically described above based on the embodiments. However, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen, 2 ... Display apparatus, 3 ... Information processing apparatus, 4 ... Image output apparatus, 5 ... Display medium, 6 ... Display area, 6a, 6b ... Area, 7, 7a ... Point, 8 ... Hand, 9a, 9b ... handwriting, 11 ... light emitting unit, 12 ... contact detection unit, 13 ... control unit, 14 ... power supply unit, 20 ... control unit, 21 ... light emission detection unit, 22 ... position calculation unit, 23 ... position drawing unit, 24 ... Projection display unit, 25 ... handwriting storage unit, 26 ... input / output unit, 27 ... data storage unit, 28 ... data display unit, 51 ... IR light, 52 ... visible light, 101 ... tip portion, 102 ... connection unit, 103 ... Body part.

Claims

An electronic pen device that emits light upon contact with an object;
A display device for displaying an image corresponding to the point at the position of the point indicated by the user using the electronic pen device in the display area of the display medium;
In a display system comprising:
The electronic pen device is
A contact detection unit that detects a state including a contact state and a non-contact state between the tip of the electronic pen device and the object;
A light emitting unit capable of switching between a light emitting state emitting light from the tip portion and a non-light emitting state not emitting light;
A power supply unit that supplies power for the light emission to at least the light emitting unit;
A control unit for controlling the light emission;
With
The display device
A light emission detector for detecting the light emission from the electronic pen device in the display area;
A calculation unit that calculates a position of a point indicated by the electronic pen device in the display area based on the detection of the light emission;
A display unit for displaying an image corresponding to the point at the position of the point in the display area based on the calculated position of the point;
With
The controller is
When the contact state, the light emitting unit is in the light emission state,
When the non-contact state, the light emitting unit is in the non-light emitting state,
When the contact state continues for a certain time, the light emitting unit is switched from the light emitting state to the non-light emitting state,
Display system.
The display system according to claim 1,
The control unit switches the light-emitting unit from the non-light-emitting state to the light-emitting state when the contact state is changed from the non-contact state to the contact state again after switching to the non-light-emitting state when the contact state continues for a predetermined time. Switch,
Display system.
The display system according to claim 1,
The contact detection unit and the light emitting unit are provided in or near the tip of the electronic pen device.
Display system.
The display system according to claim 1,
A threshold value that is a boundary between the force that the contact detection unit does not detect contact and the force that detects contact is smaller than the weight of the electronic pen device,
Display system.
The display system according to claim 1,
The electronic pen device does not include a power switch that can switch off the power supply of the power supply unit by the user regardless of the contact state detected by the contact detection unit,
The light emitting unit consumes power supplied from the power supply unit when in the light emitting state.
Display system.
The display system according to claim 1,
The electronic pen device includes a power switch that can switch off the power supply of the power supply unit by the user regardless of the contact state detected by the contact detection unit,
The light emitting unit consumes power supplied from the power source unit when the power switch is not turned off and in the light emitting state.
Display system.
The display system according to claim 1,
In the vicinity of the tip portion of the electronic pen device, a fixing switch is provided for switching by the user between a first state in which the tip portion is fixed so as not to move and a second state in which the tip portion is movable.
The contact detection unit detects the non-contact state in the first state, and can detect the contact state and the non-contact state in the second state.
Display system.
The display system according to claim 1,
The control unit stops power supply from the power source unit to the light emitting unit so as to switch the light emitting unit from the light emitting state to the non-light emitting state when the contact state continues for a certain period of time.
Display system.
The display system according to claim 1,
The display unit of the display device includes:
Projecting and displaying an image corresponding to the point at the position of the point in the display area,
In the display area, a background video, a video based on arbitrary data, or a video based on external input video data is projected and displayed.
Display system.
An electronic pen device that emits light upon contact with an object;
A display device for displaying an image corresponding to the point at the position of the point indicated by the user using the electronic pen device in the display area of the display medium;
In the electronic pen device in a display system comprising:
A contact detection unit that detects a state including a contact state and a non-contact state between the tip of the electronic pen device and the object;
A light emitting unit capable of switching between a light emitting state emitting light from the tip portion and a non-light emitting state not emitting light;
A power supply unit that supplies power for the light emission to at least the light emitting unit;
A control unit for controlling the light emission;
With
The controller is
When the contact state, the light emitting unit is in the light emission state,
When the non-contact state, the light emitting unit is in the non-light emitting state,
When the contact state continues for a certain time, the light emitting unit is switched from the light emitting state to the non-light emitting state,
Electronic pen device.
An electronic pen device that emits light upon contact with an object;
A display device for displaying an image corresponding to the point at the position of the point indicated by the user using the electronic pen device in the display area of the display medium;
In an electronic pen device light emission control method in a display system comprising:
The electronic pen device is
A contact detection unit that detects a state including a contact state and a non-contact state between the tip of the electronic pen device and the object;
A light emitting unit capable of switching between a light emitting state emitting light from the tip portion and a non-light emitting state not emitting light;
A power supply unit that supplies power for the light emission to at least the light emitting unit;
A control unit for controlling the light emission;
With
As a step executed by the control unit of the electronic pen device,
Bringing the light emitting part into the light emitting state when in the contact state;
Bringing the light emitting unit into the non-light emitting state when in the non-contact state;
Switching the light emitting unit from the light emitting state to the non-light emitting state when the contact state continues for a predetermined time;
An electronic pen device light emission control method.