JP5413315B2 - Information processing system and display processing program - Google Patents

Description

  The present invention relates to an information processing system capable of inputting information using a coded pattern indicating position coordinates, and in particular, alignment (calibration) between the position coordinates of a coded pattern and the position coordinates of a display screen of a computer device. ) Regarding processing.

  In recent years, electronic pens that digitize written information have been developed, and “Anoto Pen” developed by Anoto, Sweden, is known as a representative one. Anotopen is used together with special paper on which a dot pattern indicating a position coordinate patterned by a predetermined algorithm is printed. Anotopen has a small camera for shooting the dot pattern printed on the dedicated paper at the pen tip, a processor for calculating the position coordinates on the dedicated paper from the shot dot pattern, and the calculated position coordinates etc. It is equipped with a data communication unit that transmits to. When a user writes characters on the special paper with an anotopen or puts a check mark on the image designed on the special paper, the small camera shoots the dot pattern printed on the special paper as the pen moves. The entry information such as characters and images written by the user is recognized from the continuous position coordinates calculated by the processor. Then, this entry information is transmitted from the Anotopen to a nearby personal computer or a terminal device such as a mobile phone by the data communication unit (for example, Patent Document 1).

  Further, when such an electronic pen, a computer, a projector, and a screen are used and the screen is filled with the electronic pen and scanned, the computer performs a predetermined process accordingly, and the computer display screen is displayed on the screen by the projector. A projection system has been proposed (for example, Patent Documents 2 to 5). The electronic pen reads the dot pattern formed on the screen, and the computer analyzes the position coordinates based on the information transmitted from the electronic pen and performs processing according to the position coordinates. Even if an electronic pen without ink is used, if an electronic pen is traced on the screen, an image in which a line is drawn is projected from the projector according to the handwriting (stroke). It can be operated.

  Furthermore, recently, by pasting a transparent sheet printed with a dot pattern on a computer display and handwriting on the transparent sheet with an electronic pen, the dot pattern can be read with the electronic pen and handwritten on the computer. Has also been proposed (for example, Patent Document 6).

  On the other hand, in the system as described above, in order to match the image projected on the screen by the projector and the image displayed on the computer, the coordinate system of the screen and the coordinate system of the computer monitor are matched. Need to be calibrated.

  For example, as a system for executing calibration, a personal computer (hereinafter, referred to as a personal computer (hereinafter referred to as a personal computer)) is used in which a computer screen is projected onto a whiteboard (screen) by a projector, and the coordinates entered with a marker on the whiteboard are read with a coordinate reader. , Called a “personal computer”), a system that can be clicked on a personal computer screen has been proposed (for example, Patent Document 7). Specifically, this system has a configuration in which a calibration point is first projected by a projector, and the point is indicated by a marker, thereby calibrating the coordinates of the whiteboard and the coordinates of the personal computer screen. doing. In addition, in order to calibrate the position coordinates on the computer display and the position coordinates on the dot pattern of the transparent sheet affixed to the display, it is also proposed to read the dot pattern near the four corners of the display with an electronic pen. (For example, Patent Document 8).

  On the other hand, recently, in a conference system (so-called video conference system) for smoothly performing a conference at a place separated via a network, in order to accurately display an image at each base, There is also known one that performs calibration for each system on the image data receiving side (for example, Patent Document 9). This conference system is an implementation of a display device that displays the size information of the imaging range and the number of pixels in the imaging system provided on the organizer side that captures a shared image shared between the bases, and the supplied image on the organizer side. A configuration in which the size on the display screen of the shared image at each site is made common to the reference size based on the display area and the size information of the number of pixels, and the image display at each site is controlled based on the shared reference size have.

Japanese translation of PCT publication No. 2003-511761 JP 2008-152755 A JP 2002-149331 A JP 2008-155421 A Special table 2003-508831 gazette JP 2003-256122 A JP 2007-233999 A JP 2008-165384 A JP 2009-105818 A

  However, in the systems of Patent Documents 7 and 8, although it is possible to execute calibration for a case where predetermined information such as handwriting is input on a single screen or display, a plurality of screens or It is not assumed that calibration is executed on the assumption that a stroke by a marker or an electronic pen is input on the display. Therefore, the systems described in Patent Documents 7 and 8 accurately calibrate when strokes are input to another screen or display while calibration is being performed on one screen or display. Can not run.

  Further, in the system described in Patent Document 9, the image itself displayed on each display device at each site is made common to the reference size so as to optimize the display on the system at each site. Calibration is not performed to match the entry area where characters, figures, or other diagrams are written on the screen and the coordinate system of the display area that displays the image of each display device. There is no description.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a coordinate system and an electronic pen on each screen in a system that displays strokes written with an electronic pen as images on a plurality of screens or displays. Information processing system and display capable of accurately aligning the coordinate system of the image display area for drawing the stroke of each with the electronic pen and displaying the stroke by the electronic pen as an image on each screen or display An object is to provide a processing program.

  (1) In order to solve the above-described problem, an information processing system according to the present invention applies a stroke by an electronic pen on a plurality of screens on which coded patterns indicating position information readable by the electronic pen are formed. An information processing system used for projecting and displaying via respective projection means corresponding to the electronic pen when the stroke is entered on one screen by the electronic pen. Receiving means for receiving the coordinate information on the one screen calculated while reading the coding pattern; and, on the basis of the received coordinate information, the display means displays a stroke on the one screen by the electronic pen. Drawing processing means for drawing in the image display area having the stroke of the drawn electronic pen Using the projection unit, a transmission unit that transmits an image signal to be displayed on the screen to each projection unit, and a mark image that guides a position to be brought into contact with each screen by the electronic pen are displayed. Calibration processing means for executing a calibration process for associating the coordinate system of each screen with the coordinate system of the image display area, respectively, wherein the calibration processing means is received during the display of the mark image. When the coordinate information is coordinate information belonging to the screen to be calibrated, the position coordinates of the mark image on the target screen are recognized based on the coordinate information, and the recognized position coordinates The coordinate system of the screen being calibrated based on The calibration process for associating with the coordinate system of the image display area is executed, and when the coordinate information received during the display of the mark image is coordinate information belonging to a screen that is not subject to calibration, It has a configuration for executing predetermined error processing.

  With this configuration, the information processing system according to the present invention has an image display area included in a display unit that draws one screen (hereinafter referred to as “target screen”) to be calibrated and a stroke of the electronic pen. When coordinate information belonging to another screen that is not subject to calibration (hereinafter referred to as “non-target screen”) is received during calibration processing with the coordinate system, error processing is performed. Run. That is, the present invention does not affect the calibration process on the target screen by the coordinate information even if the coordinate information on the non-target screen is received during the calibration process on the target screen. Calibration processing can be performed accurately. Therefore, according to the present invention, the coordinate system of each screen and the coordinate system of the image display area can be aligned with high accuracy, and the stroke on the screen by the electronic pen can be accurately displayed as an image on each screen. be able to.

  (2) In order to solve the above-described problem, the information processing system of the present invention provides a plurality of display means provided with a transparent sheet on the front surface on which a coded pattern indicating position information readable by an electronic pen is formed. An information processing system used for drawing and displaying a stroke by an electronic pen, wherein when the stroke is written on a transparent sheet by the electronic pen, the electronic pen is encoded with the stroke. Receiving means for receiving the coordinate information on the one transparent sheet calculated while reading the pattern, and each display means shows the stroke on the one transparent sheet by the electronic pen based on the received coordinate information. A drawing processing means for drawing in a predetermined image display area, and a position to be brought into contact with each display means by the electronic pen Calibration processing means for executing a calibration process for associating the coordinate system of each transparent sheet with the coordinate system for the image display area used when drawing the stroke on each display means while displaying the mark image to be idled And when the coordinate information received during display of the mark image is coordinate information belonging to a transparent sheet to be calibrated, based on the coordinate information, Recognize the position coordinates of the mark image on the target transparent sheet, and associate the coordinate system of the transparent sheet to be calibrated with the coordinate system of the image display area based on the recognized position coordinates The coordinate information received during the display of the mark image after executing the calibration process. There when coordinate information belonging to a transparent sheet in the non-target calibration, an error process is executed a predetermined, has a structure.

  With this configuration, the information processing system according to the present invention includes a single transparent sheet (hereinafter referred to as “target transparent sheet”) to be calibrated and a predetermined image display area for drawing a stroke of the electronic pen. If coordinate information belonging to another transparent sheet that is not subject to calibration (hereinafter referred to as “non-target transparent sheet”) is received during calibration processing with the coordinate system, an error will occur. Execute the process. That is, according to the present invention, even if coordinate information on the non-target transparent sheet is received during the execution of the calibration process for the target transparent sheet, the coordinate information does not affect the calibration process on the target transparent sheet. Therefore, the calibration process can be performed accurately. Therefore, according to the present invention, the coordinate system in each transparent sheet and the coordinate system in the image display area can be aligned with high accuracy, and the stroke on the transparent sheet by the electronic pen can be accurately displayed on each display means. Can be displayed.

  (3) In order to solve the above-described problem, the information processing system of the present invention is a transparent screen on which a coding pattern indicating position information readable by an electronic pen is formed or on which a coding pattern is formed. An information processing system used for displaying a stroke of the electronic pen on a display unit provided on a front surface and projecting or directly displaying a stroke of the electronic pen on the projection unit. The information processing system uses the electronic pen on the screen or the transparent sheet. A receiving means for receiving coordinate information on the screen or on the transparent sheet, which is calculated while the electronic pen reads the coded pattern according to the stroke when the stroke is written on the screen; and the received Based on the coordinate information, the electronic pen can be placed on the screen or transparent sheet. A drawing processing means for drawing a stroke in an image display area formed in a predetermined device, and an image signal for displaying the drawn stroke of the electronic pen on the screen is transmitted to the projection means, and the stroke The coordinates of each screen while displaying a mark image for guiding the position of the electronic pen abutting on each screen by using the projection means, and transmitting the image signal for displaying the image to the display means Each of the coordinate system of each transparent sheet and the coordinate system of the image display area while displaying the mark image on the display means. Calibration processing means for executing respective calibration processes to be associated, If the coordinate information received during the display of the mark image is coordinate information belonging to the screen or transparent sheet that is the object of calibration, the calibration processing means becomes the target based on the coordinate information. The position coordinate of the mark image on the screen or the transparent sheet is recognized, and based on the recognized position coordinate, the coordinate system of the screen or the coordinate system of the transparent sheet and the image display area to be calibrated If the coordinate information received during the display of the mark image is coordinate information belonging to a screen or transparent sheet that is not subject to calibration, a predetermined process is performed. Configured to execute the specified error processing.

  With this configuration, the information processing system of the present invention executes a calibration process between a target screen or target transparent sheet to be calibrated and a coordinate system of a predetermined image display area for drawing a stroke of the electronic pen. When coordinate information belonging to a non-target screen or a non-target transparent sheet that is not targeted for calibration is received, error processing is executed. That is, even if the coordinate information in the non-target screen or the non-target transparent sheet is received during the execution of the calibration process for the target screen or the target transparent sheet, the present invention uses the coordinate information in the target screen or the target transparent sheet. Since the calibration process is not affected, the calibration process can be performed accurately. Therefore, according to the present invention, the coordinate system in the screen or the transparent sheet and the coordinate system in the image display area can be aligned with high accuracy, and the stroke on the transparent sheet by the electronic pen can be accurately applied to each corresponding screen. Can be displayed as an image.

  (4) In the information processing system according to the present invention, the calibration processing unit may perform the error processing at a predetermined position on the screen or a predetermined display position of the display unit. In addition, a display control process for displaying a predetermined error display is executed.

  With this configuration, the information processing system of the present invention allows the electronic pen to enter a stroke when coordinate information on the non-target screen or the non-target transparent sheet is received during the calibration process for the target screen or the target transparent sheet. Can be surely recognized by the user as an error.

  (5) In the information processing system of the present invention, when calibration processing is already performed on a non-target screen or transparent sheet specified based on the received coordinate information, the calibration is performed. The processing means is based on the coordinate information received by the receiving means and the position touched by the electronic pen on the non-target screen or by the electronic pen on the non-target transparent sheet. A display control process for displaying a predetermined error is executed based on the position of the display means corresponding to the set position.

  With this configuration, the information processing system of the present invention is brought into contact with the electronic pen when coordinate information on the non-target screen or the non-target transparent sheet is received during the execution of the calibration process for the target screen or the target transparent sheet. A predetermined error can be displayed at the specified position. That is, according to the present invention, regarding the display at the position where the electronic pen is in contact, it is assumed that the position can be surely seen by the user, and an error is displayed at the position, so that the stroke entry by the electronic pen is an error. This can be surely recognized by the user.

  (6) In the information processing system of the present invention, the calibration processing means is coordinate information indicating coordinates outside the area formed on the screen or the transparent sheet, and is a predetermined calibration. When the coordinate information indicating the instruction is received, the calibration is started, and the coordinate information received by the first contact of the electronic pen with the mark image displayed on each screen after the calibration is started. Based on the coordinate information received by specifying the screen for performing the calibration process or by the first contact of the electronic pen to the position of the transparent sheet corresponding to the mark image displayed on the display means The transparent sheet for performing the calibration process is specified. It may be.

  With this configuration, the information processing system of the present invention can identify the target screen to be calibrated by contact with the mark image serving as a reference when executing calibration, or the mark image Since the target transparent sheet to be calibrated can be specified by contacting the transparent sheet corresponding to the position where is displayed, it is possible to easily execute calibration without performing complicated operations. it can.

  (7) In the information processing system of the present invention, the calibration processing unit receives coordinate information that is unique coordinate information different for each screen or transparent sheet and indicates a predetermined calibration instruction. At this time, the calibration may be started, and a calibration process may be performed on the screen or the transparent sheet specified by the received coordinate information.

  With this configuration, the information processing system of the present invention makes an electronic pen contact with an area having coordinate information for starting calibration, so that a screen or a transparent sheet previously associated with the coordinate information is applied. Since the calibration can be executed, the calibration can be surely executed on the screen or the transparent sheet desired by the user.

  (8) In the information processing system of the present invention, the unique coordinate information indicating the calibration instruction on the screen or the transparent sheet is coordinates outside the region formed on each screen or each transparent sheet. You may have the structure which shows.

  With this configuration, the information processing system of the present invention can execute calibration by providing coordinates for instructing calibration separately from each screen or each transparent sheet. Therefore, according to the present invention, it is not necessary to previously incorporate the coordinates for instructing the calibration into the screen or the transparent sheet, so that it is possible to easily construct a system for executing the calibration.

  (9) In the information processing system of the present invention, the unique coordinate information indicating the calibration instruction on the screen or the transparent sheet is within a predetermined area in the coordinate system of the screen or the transparent sheet. You may have the structure which shows this position coordinate.

  With this configuration, the information processing system according to the present invention has an area for starting calibration in the screen or the transparent sheet, so that the calibration can be easily performed even while the stroke is being written on the screen or the transparent sheet with the electronic pen. Can be started. Therefore, the present invention can always display the stroke of the electronic pen entered by the user on the screen or the transparent sheet accurately.

  (10) In the information processing system of the present invention, the information processing system further includes an input unit for inputting an instruction to execute the calibration by a user, and the calibration processing unit includes an instruction to execute the calibration. Is input to the input means, and the calibration process is started based on the coordinate information received by the first contact of the electronic pen with the mark image displayed on each screen. The calibration process is performed based on the coordinate information received by the first contact of the electronic pen with the position of each transparent sheet corresponding to the mark image displayed on the display means. The transparent sheet is specified.

  With this configuration, the information processing system of the present invention can identify the target screen or target transparent sheet to be calibrated by contacting the mark image that is the reference when performing calibration. Calibration can be easily executed without performing complicated operations.

  (11) Further, in order to solve the above-described problem, the display processing program of the present invention is obtained by using the electronic pen on a plurality of screens on which coded patterns indicating position information readable by the electronic pen are formed by a computer. A display processing program for projecting and displaying a stroke through each projection means corresponding to each screen, wherein the computer is used when the stroke is entered on one screen by the electronic pen. Receiving means for receiving coordinate information on the one screen calculated while the electronic pen reads the coded pattern according to a stroke; on the one screen by the electronic pen based on the received coordinate information; Drawing process to draw strokes in the image display area of the display means A transmission means for transmitting an image signal for displaying the drawn stroke of the electronic pen on each screen to each projection means, and a mark for guiding a position to be brought into contact with each screen by the electronic pen While displaying an image using the projection unit, the computer functions as a calibration processing unit that executes a calibration process for associating the coordinate system of each screen and the coordinate system of the image display area, respectively, and the computer, If the coordinate information received during the display of the mark image is coordinate information belonging to the calibration target screen, the position coordinates of the mark image on the target screen based on the coordinate information And calibrate based on the recognized position coordinates. The calibration process for associating the coordinate system of the screen that is the target of calibration with the coordinate system of the image display area is executed, and the coordinate information received during the display of the mark image is not subject to calibration. In the case of coordinate information belonging to a certain screen, it is configured to function as the calibration processing means for executing a predetermined error process.

  With this configuration, the information processing system according to the present invention can be configured by installing the display processing program in a computer.

  (12) In order to solve the above-described problem, the display processing program of the present invention includes a plurality of transparent sheets provided with a transparent sheet on which a coded pattern indicating position information readable by an electronic pen is formed by a computer. A display processing program for drawing and displaying a stroke by the electronic pen on a display means, wherein the electronic pen is used when the stroke is entered on one transparent sheet by the electronic pen. Receiving means for receiving coordinate information on the one transparent sheet, calculated while reading the coded pattern according to the stroke, and a stroke on the one transparent sheet by the electronic pen based on the received coordinate information Drawing processing means for drawing in a predetermined image display area of each display means, each table While displaying a mark image for guiding the position of contact with the electronic pen on the means, the coordinate system of each transparent sheet is associated with the coordinate system for the image display area used when drawing the stroke on each display means When the coordinate information received during the display of the mark image is coordinate information belonging to the transparent sheet to be calibrated, and function as calibration processing means for executing each calibration process Includes recognizing the position coordinates of the mark image on the target transparent sheet based on the coordinate information, and the coordinate system of the transparent sheet to be calibrated based on the recognized position coordinates; The calibration process for associating the coordinate system of the image display area The calibration processing means that executes predetermined error processing when the coordinate information received during the display of the mark image is coordinate information belonging to a transparent sheet that is not subject to calibration. It has the structure which functions as.

  With this configuration, the information processing system according to the present invention can be configured by installing the display processing program in a computer.

  (13) In order to solve the above-described problem, the display processing program of the present invention is provided on a screen on which a coding pattern indicating position information readable by an electronic pen is formed by a computer, or the coding pattern. The information processing system used for projecting the stroke of the electronic pen on the projection unit or directly displaying the stroke on the display unit provided with a transparent sheet on which the electronic sheet is formed on the front surface. When the stroke is written on the screen or the transparent sheet by a pen, coordinate information on the screen or the transparent sheet calculated by the electronic pen reading the coding pattern according to the stroke is obtained. Receiving means for receiving, and on the basis of the received coordinate information, the electronic pen; A drawing processing means for drawing a stroke on the screen or transparent sheet by an image display area formed in a predetermined device, and projecting an image signal for displaying the drawn stroke of the electronic pen on the screen A transmission means for transmitting an image signal for displaying the stroke to the display means, and a mark image for guiding a position to be brought into contact with each screen by the electronic pen using the projection means. Calibration processing for associating the coordinate system of each screen and the coordinate system of the image display area with each other, and displaying the mark image on the display means, and the coordinate system of each transparent sheet and the image display Execute calibration processing to correlate each area coordinate system. Calibration processing means, and when the coordinate information received during display of the mark image is coordinate information belonging to the screen or transparent sheet to be calibrated, Recognizing the position coordinates of the mark image on the target screen or transparent sheet based on the information, and based on the recognized position coordinates, the coordinate system of the screen targeted for calibration or the transparent sheet The coordinate processing associated with the coordinate system of the image display area and the coordinate system of the image display area is executed, and the coordinate information received during the display of the mark image belongs to a screen or transparent sheet that is not subject to calibration In the case of information, predetermined error handling To perform the function as the calibration processing means.

  With this configuration, the information processing system according to the present invention can be configured by installing the display processing program in a computer.

  The information processing system or display processing program of the present invention can accurately align the coordinate system on each screen and the coordinate system of a predetermined image display area for drawing the stroke of the electronic pen, The stroke on the screen can be accurately displayed as an image on each screen.

  In addition, the information processing system or display processing program of the present invention can align the coordinate system of each transparent sheet and the coordinate system of the display area of the display means with high accuracy, respectively, and the stroke on the screen by the electronic pen. Can be accurately displayed as an image on each screen.

  The information processing system or the display processing program of the present invention includes a coordinate system on a screen and a coordinate system of a predetermined image display area for drawing a stroke of an electronic pen, and a coordinate system on a transparent sheet and a coordinate system of the image display area, respectively. In addition to being able to align with high accuracy, the stroke on the screen or display means by the electronic pen can be accurately displayed as an image on each screen or display means.

It is a system configuration figure of the information processing system in a 1st embodiment. It is explanatory drawing which shows the relationship between the arrangement | positioning of the dot in a dot pattern, and the value converted. It is an example which shows the information by which the arrangement | sequence of the dot pattern and the arrangement of the dot pattern were converted, (a) shows a dot pattern typically, (b) is a figure which shows the example of the information corresponding to it. . It is the schematic which shows the structure of an electronic pen. It is a functional block diagram of a computer apparatus. It is an example of the coordinate definition information memorize | stored in the memory | storage means in 1st Embodiment. It is an example of the screen management table memorize | stored in a memory | storage means. It is a figure for demonstrating the display of the stroke of the electronic pen in a screen. It is a figure which shows the 1st mark image for calibration and the 2nd mark image which were projected on the screen in 1st Embodiment. It is a figure for demonstrating the relationship between the 1st mark image displayed in the calibration process, and pen-up. It is a figure for demonstrating the position coordinate of the 1st display reference point on the display screen of a computer apparatus, and a 2nd display reference point. It is a figure for demonstrating the position coordinate of the 1st recognition reference point on the paper of a screen, and a 2nd recognition reference point. It is an example at the time of displaying an error display from the position where the electronic pen was pen-down. 6 is a flowchart (part 1) illustrating an operation of stroke drawing processing including calibration processing in the first embodiment. 6 is a flowchart (part 2) illustrating an operation of stroke drawing processing including calibration processing in the first embodiment. It is a flowchart which shows the operation | movement of the error process in 1st Embodiment. It is an example of the coordinate definition information memorize | stored in the memory | storage means 25 in 2nd Embodiment. It is a flowchart (the 1) which shows operation | movement of the drawing process of a stroke including the calibration process in 2nd Embodiment. 12 is a flowchart (part 2) illustrating an operation of stroke drawing processing including calibration processing in the second embodiment. It is a system configuration figure of an information processing system in a 3rd embodiment. It is a figure which shows the 1st mark image and 2nd mark image for a calibration displayed on the display apparatus in 3rd Embodiment. It is a modification of the system block diagram of the information processing system in 3rd Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the embodiment described below, the electronic pen is provided on a plurality of screens on which coded patterns indicating position information readable by the electronic pen are formed, or on a transparent sheet formed on each of a plurality of displays. In the embodiment in which the information processing system and the display processing program of the present invention are applied to an information processing system that displays a stroke as an image on each screen or each display when the stroke is entered by is there.

<First Embodiment>

  First, a first embodiment of an information processing system 10 according to the present invention will be described with reference to FIGS.

[Configuration and overview of information processing system]
First, the configuration and outline of the information processing system 10 in the first embodiment will be described with reference to FIG. FIG. 1 is a system configuration diagram showing the configuration of the information processing system 10 in the first embodiment.

  As shown in FIG. 1, the information processing system 10 is filled with electronic pens 1 </ b> A and 1 </ b> B (1) on screens 4 </ b> A and 4 </ b> B (4) on which coded patterns indicating unique coordinate ranges are respectively formed. This is a system for collecting strokes and displaying them on each screen 4A, 4B (4). A plurality of electronic pens 1A, 1B (1), a computer device 2, and a plurality of projectors 3A, 3B as projection means. (3) and the image signal distributor 5. In the following description, a unified reference numeral such as the electronic pen “1” is used unless otherwise specified.

  Each electronic pen 1 is used when writing a stroke on the screen 4, and calculates a position coordinate of the stroke on the screen 4 while reading a coding pattern formed on the screen 4 as the stroke is written. . Then, the electronic pen 1 transmits to the computer device 2 entry information relating to the entered stroke including the calculated position coordinate information (coordinate information). The computer device 2 receives the entry information transmitted from the electronic pen 1, and draws the stroke of the electronic pen 1 on the display screen (image display area) 201 of the display means 26 based on the entry information, while each screen 4 In order to display the same image as that displayed on the display screen 201, a predetermined image signal is output to the image signal distributor 5. The image signal distributor 5 outputs the received image signal to each projector 3. Each projector 3 projects the same image as the image displayed on the display screen 201 on each screen 4 based on the input image signal. Each screen 4 displays an image projected by each projector 3.

  In the information processing system 10 having such a configuration, the computer apparatus 2 displays, for each screen 4, the coordinate system (for each screen 4) in order to accurately display the written stroke on the display screen 201 and each screen 4. That is, a calibration process is performed in which the position coordinates on each screen 4 are associated with the coordinate system of the image display area of the display screen 201 (that is, the position coordinates on the display screen 201).

  In particular, the computer apparatus 2 starts executing the calibration process based on the entry of the stroke of the electronic pen 1 on the instruction sheet 6 and applies the electronic pen 1 to a predetermined position on each screen 4 (4A and 4B). Two mark images (hereinafter referred to as “first mark image” and “second mark image”) 601A, 601B (601), and 602A, 602B (602) to be brought into contact with each other are displayed. Further, the computer device 2 determines a target screen to be calibrated based on the entry information when the electronic pen 1 is brought into contact with the first mark image 601 (601A or 601B), and the target screen The position coordinates of the first mark image 601 are recognized. The computer apparatus 2 further recognizes the position coordinates of the second mark image 602 with respect to the determined target screen, and based on the recognized position coordinates of the first mark image 601 and the second mark image 602, Calibration processing for associating the coordinate system of the screen 4 (4A or 4B), which is a screen, with the coordinate system of the display screen 201 is executed.

  On the other hand, when the computer device 2 receives the entry information belonging to the non-target screen that is the other screen 4 (4B or 4A) during the execution of the calibration processing on the target screen, the computer device 2 performs error processing. As this error processing, the computer device 2 is arranged such that the center on each screen 4 or a position on the screen 4 where the electronic pen 1 is in contact with the non-target screen (a pen-down position described later), etc. Then, a display control process for displaying a predetermined error display by the projector 3 at a predetermined position on the screen 4 is executed.

[screen]
Next, the screens 4A and 4B (4) will be described with reference to FIG.

  Each screen 4A, 4B (4) has a dot pattern (coded pattern) to be described later on the front surface of a magnet plate (whiteboard) 401A, 401B (401) that is hard enough to apply sufficient writing pressure to the electronic pen 1, respectively. Is a sheet 402A, 402B (402) formed on the entire surface by printing, pressed from above with a magnet, or pasted with glue, adhesive or adhesive. A wall surface of a room may be used instead of the magnet plate 401. Further, instead of the paper 402, a plastic sheet on which a dot pattern is printed may be used, and the dot pattern may be directly formed on a magnet plate (white board) 401.

  Each of the sheets 402A and 402B has coordinate input areas (hereinafter also referred to as “projection areas”) 403A and 403B (403), which are areas on which images are projected. The coordinate input areas 403A and 403B are areas determined by adjusting the distances between the projectors 3A and 3B and the screens 4A and 4B, the elevation angles of the projectors 3A and 3B, and the like. Note that when the coordinate input areas 403A and 403B protrude from the sheets 402A and 402B, respectively, there is no dot pattern in the protruded area, and entry information cannot be generated by the electronic pen 1, and therefore the sheets 402A and 402B respectively. Is formed inside.

  Since the screen 4 has the above-described configuration, when the user writes characters, figures, or other diagrams on the screen 4 with the electronic pen 1, the electronic pen 1 follows the movement locus of the pen tip portion 103. Then, the dot pattern printed on the paper 402 is read locally and continuously, the coordinates (position coordinates) of the local position on the screen 4 are calculated, and the electronic data is transmitted to the computer apparatus 2 as entry information. When the computer device 2 draws the stroke of the electronic pen 1 on the display screen 201 of the display means 26, each projector 3 receives the image signal transmitted from the computer device 2 via the image signal distributor 5, The same image as that displayed on the display screen 201 is projected onto the sheet 402 of the screen 4.

  On the other hand, on the screen 4, an instruction sheet 6 on which a dot pattern indicating a unique coordinate range is printed is pasted as an alignment instruction area for performing calibration processing on the outside of the sheet 402. The alignment instruction area includes position coordinates defined by a dot pattern (coded pattern) on the paper 402 of the screen 4 and position coordinates on the display screen (display) 201 in the display unit 26 of the computer apparatus 2. This is an area in which a dot pattern for causing the computer apparatus 2 to execute a calibration process for making these correspond is printed. In addition, the instruction sheet 6 is formed in a form that can be attached to another member such as a sticker, and the user can fill in the display screen 201 of the computer device 2 with the electronic pen 1 (coordinate input). ) Are pasted outside the area of the coordinate input area 403 so as not to be misunderstood.

  When the user taps the instruction sheet 6 with the electronic pen 1 (specifically, taps the screen 4), the computer apparatus 2 starts the calibration process. When the computer apparatus 2 performs the calibration process, the coordinate input area 403 on the screen 4 is determined, and the coordinate system of the display screen 201 of the computer apparatus 2 is set on the coordinate input area 403 on the screen 4. A coordinate conversion function for corresponding to the coordinate system is calculated and associated with the screen 4 and stored in the storage means 25 of the computer apparatus 2.

  Further, the instruction sheet 6 is not indispensable when the screen 4 is manufactured in advance. The instruction sheet 6 is formed in advance in a form such as a seal separately from the screen 4 so that the user can arbitrarily attach it to the screen 4 later. You may leave it. Furthermore, instead of pasting each instruction sheet 6 on the screen 4, a single instruction sheet 6 may be pasted on a notebook or computer device 2 or the like that can be carried by the user.

[Dot pattern]
Next, an Anoto dot pattern (coded pattern) printed on the sheet 402 of the screen 4 and the instruction sheet 6 will be described with reference to FIGS. FIG. 2 is a diagram for explaining the relationship between the dots of the dot pattern printed on the paper 402 and the values to which the dots are converted. FIG. 3 shows the conversion of the dot pattern arrangement and the dot pattern arrangement. It is an example which shows performed information.

  As shown in FIG. 2, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the dot position is shifted from the reference position (intersection of the vertical line and horizontal line) in the vertical and horizontal directions. The value of each dot is converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The dot pattern is configured such that the position coordinates on the screen 4 are determined by the combination of the information thus associated. The dot pattern is printed with an ink containing carbon that absorbs infrared rays.

  FIG. 3A shows an arrangement of dot patterns at certain positions on the screen 4. As shown in FIG. 3A, 6 × 6 dots are arranged within a range of about 2 mm in length and width so that a unique pattern can be obtained regardless of where 6 × 6 dots are taken on the screen 4. Yes. The dot pattern formed by these 36 dots holds the relative position coordinates of the paper 402 and the dot pattern address (coded pattern address). FIG. 3B is a diagram in which each dot shown in FIG. 3A is converted into a value associated with the regularity shown in FIG. 2 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

[Electronic pen]
Next, the electronic pens 1A and 1B (1) will be described with reference to FIG. FIG. 4 is a schematic diagram showing the structure of the electronic pen 1.

  As shown in FIG. 4, the electronic pen 1 includes a pen unit 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM or a RAM, and the like. A communication unit 111 including a real-time clock 110, an antenna, and the like, a battery 112, and an infrared transmission filter 113 provided in front of the COMS camera 106.

  The tip of the pen unit 104 is a pen point unit 103, and the user touches the pen point unit 103 of the electronic pen 1 against the sheet 402 or the instruction sheet 6 of the screen 4 and enters a stroke such as characters. Or tap. Here, the first contact of the pen tip portion 103 of the electronic pen 1 with the paper 402 or the like is referred to as pen down, and the fact that the pen tip portion 103 leaves the contacted (contacted) state is pen-up. Call it.

  A trajectory written between the pen-down and pen-up of the electronic pen 1 becomes one stroke, and a character, a figure, or another diagram is formed from one or a plurality of strokes. Further, since the electronic pen 1 is used for tapping or entering characters on the screen 4 projected by the projector 3, the pen unit 104 is not filled with ink.

  The battery 112 is for supplying electric power to each component in the electronic pen 1. For example, the power of the electronic pen 1 itself is turned on / off by detaching a cap (not shown) of the electronic pen 1. It may be configured. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied through the pen unit 104 from the pen tip unit 103 when the user writes or taps a character, figure, or other diagram on the screen 4 with the electronic pen 1, that is, the writing pressure. The value is transmitted to the processor 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. Therefore, when the user enters characters or the like on the screen 4 with the electronic pen 1, the pen tip 103 is applied with a writing pressure, and when the pressure sensor 107 detects a writing pressure higher than a predetermined value, the processor 108 It is determined that entry has started, and the operation of the LED 105 and the CMOS camera 106 is started. Further, when the user finishes entering one stroke and releases the electronic pen 1 from the screen 4, the writing pressure exceeding a predetermined value is not detected, and the pressure sensor 107 detects pen-up.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 irradiates infrared rays toward the vicinity of the pen tip portion 103 on the screen 4. The irradiated area is slightly deviated from the position where the pen tip 103 contacts the screen 4. The CMOS camera 106 images a dot pattern in a region irradiated by the LED 105 via the infrared transmission filter 113 and supplies image data of the dot pattern to the processor 108.

  Infrared rays irradiated by the LED 105 are absorbed by the carbon contained in the dots. That is, since carbon absorbs infrared rays, the portion of dots printed with carbon-containing ink has a small amount of infrared reflection, and the portion other than dots has a large amount of infrared reflection. The infrared transmission filter 113 blocks sunlight or ultraviolet rays while allowing only infrared rays to pass therethrough. Therefore, by photographing with the CMOS camera 106, by setting a threshold value based on the difference in the amount of reflected infrared light, it is possible to distinguish the dot region containing carbon from the other regions. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 3A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called.

  While the stroke is entered by the user, the processor 108 determines the X and Y coordinates (that is, the stroke (handwriting) on the screen 4 of the stroke to be entered by the user from the dot pattern of the image data supplied by the CMOS camera 106 (that is, "Position coordinates", hereinafter also referred to as "coordinate data") is continuously calculated. That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 3 (a) supplied by the CMOS camera 106 into the data array shown in FIG. 3 (b). Convert to Y coordinate bit value, calculate X and Y coordinate data from the data array by a predetermined calculation method, and also calculate the dot pattern address corresponding to the calculated X and Y coordinate data (the same value in a certain coordinate range) Ask). Then, the processor 108 associates the current time (time stamp: entered time information) transmitted from the real-time clock 110, the writing pressure data, the dot pattern address, and the X and Y coordinate data. Since the 6 × 6 dot pattern on the screen 4 does not overlap in the screen 4, when the user enters characters or the like with the electronic pen 1, it indicates which position on the screen 4 the entered position corresponds to. It can be specified by coordinate calculation by the processor 108.

  The memory 109 stores property information such as a pen ID (electronic pen identification information) such as “pen01” or “pen02” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. The communication unit 111 associates time information (time stamp), writing pressure data, dot pattern address, X and Y coordinate data (hereinafter referred to as “stroke information”), and pen ID as entry information. It transmits to the computer apparatus 2. Transmission to the computer apparatus 2 by the communication unit 111 is performed immediately and sequentially by wireless transmission such as Bluetooth (registered trademark).

[Computer device]
Next, the computer apparatus 2 will be described with reference to FIGS. 5 is a functional block diagram of the computer apparatus 2, and FIG. 6 is an example of coordinate definition information stored in the storage unit 25 in the present embodiment. FIG. 7 is an example of a screen management table stored in the storage unit 25.

  The computer device 2 includes, as hardware, an antenna device capable of data communication with the electronic pen 1, a processor such as a CPU, a memory such as a ROM and a RAM, a display, a mouse and a keyboard input interface, and the like. Functionally, the computer apparatus 2 includes an input unit 21 such as a mouse and a keyboard, a reception unit 22, a processing unit 24, a storage unit 25, a display unit 26, and a transmission unit 27 as shown in FIG. Then, the computer device 2 performs predetermined processing such as drawing processing and calibration processing based on the entry information received from the electronic pen 1.

  The receiving unit 22 includes an antenna and a receiving circuit, and receives entry information transmitted from the electronic pen 1 and transmits it to the processing unit 24.

  The storage means 25 is configured by a memory such as a hard disk, a ROM, and a RAM. The storage unit 25 stores a display screen 201 of the display unit 26 based on a program for performing a calibration process (hereinafter referred to as a “calibration program”) and entry information received by the receiving unit 22. A program for performing a drawing process for displaying a stroke on the screen 4 by the electronic pen 1 (hereinafter referred to as “drawing program”) is stored. The storage unit 25 also displays a first mark image 601 and a second mark image 602 displayed on the display screen 201 of the display unit 26 during the calibration process, and a first display reference point for displaying those mark images. In addition, various data used when the calibration process is executed, such as the position coordinates of the second display reference point and the coordinate definition information, are stored in advance. In particular, as the coordinate definition information, as shown in FIG. 6, for each screen 4, information for defining a dot pattern address and a coordinate area (hereinafter also simply referred to as “coordinate area”), the type of the screen 4. As well as various information of the screen number used to identify the screen 4. In addition, the coordinate definition information includes information on the instruction sheet 6, and specifically includes dot pattern addresses, information defining the coordinate area, and information indicating the type. Note that the type information stored as the coordinate definition information in the storage means 25 is information indicating whether the screen 4 is a positioning instruction area or not. For example, information indicating paper) may be included.

  The storage means 25 stores entry information generated and transmitted by the electronic pen 1 when a user enters a stroke of a character, figure or other diagram on the screen 4 during execution of the drawing program. To do. The storage means 25 stores the screen number of the target screen as an alignment number as shown in FIG. 7 when the calibration program is executed by the calibration processing means 242 described later. Corresponding to the screen number of the screen (in other words, the alignment number), the position coordinates of the first recognition reference point and the second recognition reference point, information defining the coordinate input area, and each information of the coordinate conversion function are Stored in the screen management table. FIG. 7A shows a state in which each information of the coordinate input area, the coordinate conversion function, and each recognition reference point in the screen management table is not stored, and FIG. Specifically, the screen 4A) having the screen number “SCR01” indicates a state in which information on the coordinate input area, the coordinate conversion function, and each recognition reference point is stored. Further, since the position coordinates of the first recognition reference point and the second recognition reference point are only used for the calculation of the coordinate conversion function, the storage in the screen management table may be omitted.

  The processing unit 24 is configured by a processor such as a CPU, and activates a calibration program stored in the storage unit 25 to perform a predetermined calibration process for each screen 4. Further, the processing means 24 is a drawing that displays the strokes written on the screen 4 by the electronic pen 1 on the display screen 201 of the display means 26 based on the entry information of the electronic pen 1 received by the receiving means 22. Process. Specifically, as illustrated in FIG. 5, the processing unit 24 includes a drawing processing unit 241 that performs a drawing process, and a calibration processing unit 242 that performs a calibration process. Details of the drawing processing unit 241 and the calibration processing unit 242 in the processing unit 24 will be described later.

  The display unit 26 is configured by a display or the like, and displays the contents instructed by the processing unit 24 on the display screen 201.

  The transmission unit 27 transmits an image signal used for displaying an image on the display unit 26 to each projector 3 via the image signal distributor 5 according to an instruction from the processing unit 24 in order to display a predetermined image on the screen 4. . In the transmission unit 27, the data transmission method to the projector 3 may be a wired method or a wireless method. Each projector 3 projects an image similar to the image displayed on the display screen 201 of the display unit 26 on each coordinate input area 403 of each screen 4 based on the image signal transmitted from the transmission unit 27. To do.

[Processing means]
Next, details of the processing means 24 will be described with reference to FIGS. FIG. 8 is a diagram for explaining the display of strokes written by the electronic pen 1A on the screen 4A. FIG. 9 shows the first mark image 601A for calibration and the second image projected on the screen 4A. It is a figure which shows the mark image 602A. 10 is a diagram for explaining the relationship between the first mark image 601A displayed on the screen 4A and the pen-up in the calibration process, and FIG. 11 is a diagram illustrating the first on the display screen 201 of the computer apparatus 2. It is a figure for demonstrating the position coordinate of a display reference point and a 2nd display reference point. Further, FIG. 12 is a diagram for explaining the position coordinates of the first recognition reference point and the second recognition reference point on the sheet 402A of the screen 4A, and FIG. 13 shows an error from the position where the electronic pen 1B is pen-down. It is an example when the display 603B is displayed.

  The drawing processing unit 241 stores in the storage unit 25 each piece of entry information (that is, the coordinate attribute information and pen ID of a partial stroke constituting one stroke) received by the receiving unit 22 of the electronic pen 1 (1A or 1B). However, the coordinate definition information stored in the storage means 25 is referred to, and it is determined whether the stroke is entered on the screen 4 (4A or 4B) or the stroke is entered on the alignment instruction area. Specifically, the drawing processing means 241 recognizes to which coordinate area in the coordinate definition information shown in FIG. 6 part or all of the position coordinates included in the received entry information belongs, and the coordinate area It is determined whether the type associated with is “screen number (paper)” or “positioning instruction area”.

  When the drawing processing unit 241 determines that the entry information is a stroke entry on the screen 4, the screen of the screen to which the entry information belongs (hereinafter referred to as “entry screen”, for example, the screen 4A). Recognize the number. Specifically, the drawing processing unit 241 recognizes the screen number stored in association with the coordinate area determined to include the entry information received in the above determination process, based on the coordinate definition information. . Further, the drawing processing unit 241 determines whether or not the calibration process is being performed, and whether or not the coordinate conversion function in the recognized entry screen is defined and already recorded in the storage unit 25. . When the drawing processing unit 241 determines that the calibration process is not being executed and the coordinate conversion function is defined and already stored in the storage unit 25, each drawing processing unit 241 includes each of the received entry information. X, Y coordinate data (position coordinates) are respectively converted into position coordinates on the display screen 201 of the display means 26 by a coordinate conversion function corresponding to the screen number, and the electronic pen 1A or A drawing process for drawing a 1B stroke is executed. The transmission unit 27 projects the stroke drawn on the display screen 201 onto the coordinate input area 403 (403A and 403B) of each screen 4 (4A and 4B) via each projector 3 (3A and 3B). In order to do this, a predetermined image signal is output to the image signal distributor 5.

  For example, as shown in FIG. 8, when the user enters the character “ABC” in the coordinate input area 403A of the screen 4A using the electronic pen 1A, the drawing processing means 241 displays a stroke line segment corresponding to the handwriting. 26 can be drawn on the display screen 201, and a stroke segment of the electronic pen 1A can be projected on the screen 4A by the projector 3A without being shifted from the handwriting on the screen 4A. The stroke segment of the electronic pen 1A is also projected on the screen 4B by the projector 3B.

  When the drawing processing unit 241 determines that the entry information is a stroke entry (for example, a tap) in the alignment instruction area of the instruction sheet 6, the calibration processing unit 242, that is, the stroke by the electronic pen 1. Is determined to be included in the coordinate area defined as the alignment instruction area in the coordinate definition information, the calibration process is executed. When the calibration processing unit 242 starts the calibration process, the calibration processing unit 242 performs initialization to clear the alignment number, the position coordinates of the first recognition reference point, and the position coordinates of the second recognition reference point stored in the storage unit 25. In addition, the first mark image and the second mark image are displayed on the display screen 201 of the display unit 26 at different timings based on the position coordinates of the first display reference point and the second display reference point stored in the storage unit 25. To display each. At this time, the calibration processing means 242 displays a predetermined instruction message on the display screen 201 of the display means 26 such as “Please raise the pen tip when it touches the center of the target”.

  When the calibration processing unit 242 displays such a display on the display unit 26, the first mark image 601A and the second mark image 602A are displayed on the screen 4A by the projector 3A as shown in FIG. And an instruction message 701A that is the same as the instruction message displayed on the display screen 201, “Please raise the pen tip when it touches the center of the target.” Is projected. The first mark image 601B and the second mark image 602B are projected on the screen 4B by the projector 3B at the respective timings, and the same instruction message 701B as the instruction message displayed on the display screen 201 is projected. The

  The calibration processing unit 242 executes the calibration process for the screen 4A or 4B to which the entry information received first belongs after starting the calibration process and displaying the first mark image. That is, the calibration processing unit 242 recognizes the drawing processing unit 241 based on the stroke information received by the first contact of the electronic pen 1 with the first mark image 601 displayed on each screen 4 (4A and 4B). Based on the screen number of the entry screen, the screen 4A or 4B for performing the calibration process is specified.

  Further, the calibration processing unit 242 performs pen-up of the electronic pen 1 included in the entry information regarding the target screen received during the display of the first mark image 601 or the second mark image 602 on each screen 4. The position coordinates are recognized as the position coordinates of the first recognition reference point and the second recognition reference point, respectively. For example, when the first recognition reference point is recognized on the screen 4A, as shown in FIG. 10, the calibration is performed while the user holds the electronic pen 1A down on the screen 4A. The pen tip is moved to the position (center of the concentric circle) where the mark image 601A is projected, and then the pen is raised. Since the electronic pen 1A generates entry information related to the stroke from the pen down to the pen up and transmits the information to the computer apparatus 2 immediately and sequentially, the calibration processing unit 242 receives it during the display of the first mark image 601A. The position coordinates of the first recognition reference point can be recognized by recognizing the position coordinates of the pen-up with the electronic pen 1A from the entered information. Note that the calibration processing unit 242 can recognize the position coordinates of the second recognition reference point by a similar method. Further, the calibration processing means 242 performs the coordinate conversion function on the entry screen in which the entry information is recognized even if the entry of the stroke in the alignment instruction area is not executed and the calibration process is not started. Is not defined and is not recorded in the screen management table of the storage means 25, the drawing processing means 241 determines which screen 4 needs to be calibrated and performs the calibration process. Start.

  On the other hand, when the calibration processing unit 242 recognizes the coordinates of the first recognition reference point and the second recognition reference point, the calibration input unit 242 determines the coordinate input area based on the recognized position coordinates of the first recognition reference point and the second recognition reference point. The coordinate conversion function is defined, and the defined coordinate input area and coordinate conversion function are stored in the screen management table in association with the screen number of the target screen.

  Here, a coordinate input area and a coordinate conversion function defined by the calibration processing unit 242 will be described.

  As shown in FIG. 11, on the display screen 201 of the display means 26 of the computer apparatus 2, when the X axis is defined as the right direction and the Y axis is defined as the downward direction, the lower left end point, the lower right end point, the first display reference point, and the second display point. Each display reference point can be defined as follows.

Upper left point: Coordinate 202 (Xamin, Yaman)
Lower right corner point: coordinate 203 (Xamax, Yamax)
First display reference point: coordinates 204 (Xa1, Ya1)
Second display reference point: coordinates 205 (Xa2, Ya2)
However, Xamin ≦ Xa1 <Xa2 ≦ Xamax
Yamin ≦ Ya1 <Ya2 ≦ Yamax

  The coordinates 204 (Xa1, Ya1) and the coordinates 205 (Xa2, Ya2) indicate intermediate points between the upper left end point and the lower right end point.

  Further, the position coordinates of the first recognition reference point and the second recognition reference point recognized on the screen 4 are based on the first display reference point and the second display reference point on the display screen 201 of the computer device 2. Position coordinates obtained by analyzing the dot pattern (coded pattern) included in the entry information generated by the tap with the electronic pen 1 to the first mark image 601 and the second mark image 602 projected onto . Therefore, in the coordinate input area 403 projected on the screen 4 by the projector 3, if the X axis is defined as the right direction and the Y axis is defined as the downward direction, the upper left end point, the upper left end point of the coordinate input area 403, and the right side of the coordinate input area 403 Each of the lower end point, the first recognition reference point, and the second recognition reference point can be defined by predetermined position coordinates. For example, on the screen 4A, as shown in FIG.

Upper left corner point: coordinate 404A (XAb0, YAb0)
Upper left point of the coordinate input area 403A: coordinates 405A (XAbmin, YAbmin)
Lower right corner point of the coordinate input area 403A: coordinates 406A (Xbmax, Ybmax)
First recognition reference point: coordinates 407A (XAb1, YAb1)
Second recognition reference point: coordinates 408A (XAb2, YAb2).
However, XAb0 ≦ XAbmin <XAb1 <XAb2 ≦ XAbmax
YAb0 ≦ YAbmin <YAb1 <YAb2 ≦ YAbmax
It becomes. Note that coordinates 407A (XAb1, YAb1) and coordinates 408A (XAb2, XAb2) indicate intermediate points between the upper left end point and the lower right end point. Further, the screen 4B can be defined similarly to the screen 4A.

  And when it prescribes | regulates as mentioned above in the screen 4A, the coordinate 204 (Xa1, Ya1) of the 1st display reference point in the display screen 201 of the computer apparatus 2 and the coordinate 205 (Xa2, Ya2) of the 2nd display reference point Corresponds to the coordinates 407A (XAb1, YAb1) of the first recognition reference point and the coordinates 408A (XAb2, YAb2) of the second recognition reference point in the dot pattern on the paper 402A. Accordingly, the upper left corner point coordinates 405A (XAbmin, YAbmin) and the lower right corner point coordinates 406A (XAbmax, YAbmax) (each of the diagonal coordinates in the rectangular coordinate input area 403A) that define the coordinate input area 403A projected on the screen 4A. (Vertex) can be expressed by (Expression 1) to (Expression 4).

  Further, each point is also defined for the screen 4B as described above, and each diagonal of the rectangular coordinate input area 403B projected on the screen 4B is expressed by the same expression as (Expression 1) to (Expression 4). The upper left corner point coordinates (XBbmin, YBbmin) and the lower right corner point coordinates (XBbmax, YBbmax) which are vertices can be expressed.

It should be noted that coordinate input areas 403A and 403B of the screens 4A (screen number “SCR01”) and 4B (screen number “SCR02”) shown in FIG. 7 are defined from the rectangular area having the respective coordinate values as the vertical angle points. be able to.

  Then, the position coordinates (XAbn, YAbn) and (XBbn, YBbn) defined by the dot patterns on the sheets 402A and 402B of the screens 4A and 4B are displayed on the display screen 201 in the display unit 26 of the computer apparatus 2. The position coordinates (Xan, Yan) can be calculated. For example, in the screen 4A, it can be calculated by (Equation 5) and (Equation 6), respectively.

  Of course, also on the screen 4B, the position coordinates (Xan, Yan) on the display screen 201 can be calculated in the same manner as in (Expression 5) and (Expression 6).

  The function defined by (Equation 5) and (Equation 6) calculated in this way is referred to as a coordinate transformation function, and the calibration processing unit 242 performs the first recognition reference point and the second recognition reference as described above. A coordinate conversion function is defined and stored in the storage unit 25 each time the instruction sheet 6 is designated for each of the screens 4A and 4B based on the position coordinates of the points. Note that a predetermined coefficient for correcting distortion may be applied to the term of the arithmetic expression depending on the angle of each projector 3 with respect to each screen 4.

  On the other hand, the calibration processing unit 242 has an entry screen recognized by the drawing processing unit 241 based on the entry information received during the execution of calibration on a non-target screen that is different from the target screen that is the target of the calibration process. If it is determined that the information is entry information, a predetermined error display process is performed. Specifically, as the error display process, the calibration processing unit 242 receives the received entry information when the coordinate conversion function in the entry screen which is a non-target screen is already defined and stored in the storage unit 25. Based on the above, the position coordinate on the entry screen where the electronic pen 1 is pen-down is recognized, and the recognized position coordinate is converted into the position coordinate on the display screen 201 by the coordinate conversion function of the entry screen. From the converted position coordinates, an error message “Screen 01 (or 02) is being aligned. Please wait.” Is displayed. In particular, since the calibration processing unit 242 holds the screen number of the target screen as the alignment number during the calibration process, “screen” is selected as the screen during the calibration process based on the held alignment number. “01 (or 02)” can be variably displayed in the error display message.

  When the calibration processing unit 242 displays an error display on the display screen 201, the transmission unit 27 transmits the image signal of the error display drawn on the display screen 201 to each projector 3 ( 3A and 3B), each screen 4 (4A and 4B) displays the same image as the error display drawn on the display screen 201. For example, when the calibration process is executed for the screen 4A and the stroke is entered with the electronic pen 1B on the screen 4B, the screen 4B has a display screen as shown in FIG. An error display 603B identical to the error display drawn on 201 is displayed in the coordinate input area 403B at the position where the electronic pen 1B is pen-down.

  Further, the calibration processing unit 242 determines that the coordinate conversion function for the entry screen which is a non-target screen has not been defined yet and is not stored in the storage unit 25, from the center position coordinates on the display screen 201. "Please wait for the screen 01 (or 02) to be aligned. Please wait." Is displayed. Then, when the calibration processing unit 242 displays an error display on the display screen 201, the transmission unit 27 transmits the image signal of the image including the error display drawn on the display screen 201 through the image signal distributor 5. Output to the projector 3, each screen 4 displays the same image as the image drawn on the display screen 201, with the error display displayed at the center position.

  The calibration processing unit 242 determines whether or not the entry screen used when recognizing the position coordinates of the second recognition reference point matches the screen storing the position coordinates of the first recognition reference point. Then, it is determined whether the entry information received during the execution of the calibration is for the target screen that is the target of the calibration process or the entry information on a non-target screen that is different from the target screen.

[Stroke drawing process including calibration process]
Next, with reference to FIG. 14 and FIG. 15, stroke drawing processing including calibration processing in the information processing system 10 will be described. 14 and 15 are flowcharts showing the operation of stroke drawing processing including calibration processing.

  First, stroke drawing processing including calibration start processing will be described with reference to FIG.

  In this operation, it is assumed that coordinate definition information such as the position coordinates of the first display reference point and the second display reference point and the screen management table are stored in the storage unit 25 in advance.

  First, when a stroke is entered on the sheet 402 (402A or 402B) or the instruction sheet 6 of the screen 4 (4A or 4B) by the user using the electronic pen 1 (1A or 1B), the electronic pen 1 is The entry information is transmitted to the computer apparatus 2 (step S101). Specifically, when a stroke is entered on the screen 4A, 4B or the instruction sheet 6 by the user, the pressure sensor 107 detects the contact of the pen tip portion 103 by detecting a writing pressure of a predetermined value or more, The LED 105 emits infrared rays, and the camera 106 captures a dot pattern along a stroke or tap to be written. The processor 108 continuously calculates position coordinates along the stroke or tap from the image data of the captured dot pattern, and the position coordinates, the dot pattern address, the current time transmitted by the real-time clock 110, the pen pressure In association with the data (hereinafter, “stroke information”) and the pen ID, it is immediately and sequentially transmitted to the computer apparatus 2 as entry information (step S101).

  Next, in the computer apparatus 2, when the receiving unit 22 receives the entry information (stroke information and pen ID) transmitted from the electronic pen 1, the drawing processing unit 241 includes the stroke information and the pen ID included in the entry information. Is stored in the storage means 25 (step S201).

  Next, the drawing processing unit 241 determines whether or not the received stroke information is an entry on the screen 4 (step S202). Specifically, the drawing processing unit 241 refers to the coordinate definition information stored in the storage unit 25, recognizes the coordinate area to which the position coordinate included in the stroke information belongs, and associates it with the coordinate area. It is determined whether or not the type of information is “screen (paper)”. At this time, when the drawing processing unit 241 determines that the received stroke information is not an entry on the screen 4 (step S202: No), the drawing processing unit 241 proceeds to the process of step S207. In the determination processing in step S202, the drawing processing unit 241 may use only one position coordinate included in the stroke information such as the earliest position coordinate in time, or may use a plurality or all of the position coordinates. May be.

  If the drawing processing means 241 determines that the received stroke information is an entry on the screen 4 (step S202: Yes), the drawing processing means 241 inputs the screen number associated with the coordinate area to which the stroke information belongs. Recognized as a screen number (step S203). Specifically, the drawing processing unit 241 recognizes the screen number stored in the coordinate definition information in association with the corresponding coordinate area in the process of step S202. For example, when the drawing processing unit 241 recognizes that the position coordinates included in the stroke information are included in the coordinate area “(x1, y1), H1, W1” in the process of step S202, Recognizes the screen number as “SCR01” (screen 4A).

  By the processing in step S203, the calibration processing means 242 starts the calibration processing and displays the first mark image, and then selects the screen 4 (4A or 4B) to which the entry information received first belongs as the target screen. And the calibration process can be appropriately executed. That is, the calibration processing unit 242 can perform error processing when the entry information belonging to the screen 4 (4B or 4A) that is not the target screen is received during the execution of the calibration processing.

  Next, the drawing processing unit 241 determines whether or not the calibration process is being executed (step S204), and if it is determined that the calibration process is being executed (step S204: Yes), FIG. The process proceeds to step S301. If the drawing processing unit 241 determines that the calibration process is not being executed (step S204: No), the drawing processing unit 241 checks whether a coordinate conversion function on the entry screen is defined (step S205). That is, the drawing processing unit 241 checks whether or not a coordinate conversion function is stored in the screen management table of the storage unit 25 in association with the screen number recognized by the processing in step S203. At this time, when the drawing processing unit 241 determines that the coordinate conversion function on the entry screen is not defined (step S205: No), the process proceeds to step S208.

  When the drawing processing unit 241 determines that the coordinate conversion function in the entry screen is defined (step S205: Yes), the drawing processing unit 241 receives the received image based on the corresponding coordinate conversion function stored in the storage unit 25. Each position coordinate of the stroke information is converted into a position coordinate on the display screen 201 of the display means 26, and the stroke of the electronic pen 1 (1A or 1B) is displayed on the display screen 201 along the converted position coordinate. When the drawing processing unit 241 displays the stroke of the electronic pen 1 on the display screen 201 of the display unit 26, the transmission unit 27 displays the same image as the image displayed on the display screen 201 on each of the screens 4A and 4B. In order to display the image, a predetermined image signal is output to the projectors 3A and 3B via the image signal distributor 5.

  On the other hand, when the drawing processing means 241 determines in step S202 that the received stroke information is not an entry on the screen 4 (step S202: No), the received stroke information is entered in the alignment instruction area. It is determined whether or not there is (step S207). Specifically, the drawing processing unit 241 determines whether or not the type information stored in the coordinate definition information associated with the corresponding coordinate area in the process of step S202 is the “alignment instruction area”. . The process in step S207 is provided so that the calibration process can be executed again regardless of whether the calibration process is being executed.

  At this time, if the drawing processing unit 241 determines that the received stroke information is not an entry in the alignment instruction area (step S207: No), this operation ends.

  When the drawing processing unit 241 determines that the received stroke information is an entry in the alignment instruction area (step S207: Yes), or in step S205, the drawing processing unit 241 determines the coordinates on the entry screen. If it is determined that the conversion function is not defined (step S205: No), the calibration processing unit 242 starts the calibration process, and performs alignment in the screen management table stored in the storage unit 25. The number, the position coordinates of the first recognition reference point, and the position coordinates of the second recognition reference point are cleared (step S208).

  Next, the calibration processing unit 242 displays the first mark image on the display screen 201 of the display unit 26 based on the position coordinates of the first display reference point stored in the storage unit 25 (step S209). End the operation. In the process of step S209, when the calibration processing unit 242 displays the first mark image for calibration on the display screen 201 of the display unit 26, the screen is displayed on each projector 3 (3A and 3B). 4, while projecting the first mark image 601 for calibration, the user is prompted to perform pen-up at the reference point (center of the concentric circle) of the first mark image 601 for calibration by the electronic pen 1. For example, as shown in FIG. 9, the processing unit 24 causes the projector 3A to display an instruction message such as “Please raise the pen tip when it touches the center of the target” while projecting the mark image 601A onto the screen 4A. Or a similar voice instruction is output.

  Next, a calibration process following the calibration start process in steps S208 and S209 in FIG. 14 will be described with reference to FIG.

  This operation is executed when entry information is received after the display of the first mark image in the process of step S209 in FIG. 14 and the drawing processing means 241 determines that the calibration process is being executed in the process of step S204. The

  First, the calibration processing unit 242 refers to the screen management table stored in the storage unit 25 and determines whether or not an alignment number is stored in the screen management table (step S301). At this time, if the calibration processing unit 242 determines that the alignment number is stored in the screen management table (step S301: Yes), the calibration processing unit 242 proceeds to the process of step S305. If the calibration processing unit 242 determines that the alignment number is not stored in the screen management table (step S301: No), the calibration processing unit 242 stores the screen number of the entry screen in the storage unit 25 as the alignment number. (Step S302). Specifically, the calibration processing unit 242 stores the screen number recognized by the drawing processing unit 241 in the process of step S203 in the screen management table of the storage unit 25 as an alignment number.

  For this reason, in the present operation based on the previous entry information, when the calibration process is started, the calibration process is started and the screen of the screen 4 on which the stroke is first written after the first mark image is displayed is displayed. The number is stored in the storage means 25 as an alignment number. That is, among the entry information generated by the contact of each electronic pen 1 with each first mark image 601 displayed on each screen 4, the entry information received first by the computer device 2 after displaying the first mark image. Based on (coordinate information), the screen 4 (4A or 4B) recognized as the entry screen is specified as the target screen to be subjected to the calibration process.

  Next, the calibration processing means 242 extracts the pen-up position coordinates of the electronic pen 1 from the received entry information, and uses the extracted position coordinates as the position coordinates of the first recognition reference point. The number is stored in the screen management table in association with the number (step S303).

  Next, the calibration processing unit 242 displays the second mark image on the display screen 201 of the display unit 26 based on the position coordinates of the second display reference point stored in the storage unit 25 (step S304). End the operation. In step S304, when the calibration processing unit 242 displays the second mark image on the display screen 201 of the display unit 26, the transmission unit 27 performs calibration on each screen 4 with respect to each projector 3. An image signal for projecting the second mark image 602 for the operation is output. Then, the screen 4 displays the second mark image 602 for calibration with the electronic pen 1 and prompts the user to pen up at the reference point (the center of the concentric circle) of the second mark image 602.

  On the other hand, when the calibration processing unit 242 determines in step S301 that the alignment number is stored in the screen management table (step S301: Yes), the drawing processing unit 241 recognizes in the processing of step S203. It is determined whether or not the screen number of the entry screen is the same as the alignment number stored in the screen management table (step S305). At this time, if the calibration processing means 242 determines that the screen number of the entry screen and the alignment number are not the same (step S305: No), it executes an error display process (step S310) and performs this operation. Terminate. On the other hand, when the calibration processing means 242 determines that the screen number of the entry screen is the same as the alignment number (step S305: Yes), it extracts the pen-up position coordinates from the received entry information. Then, the extracted position coordinates are stored in the screen management table as the position coordinates of the second recognition reference point in association with the screen number of the target screen (step S306).

  Next, the calibration processing unit 242 uses each of the diagonal vertices of the coordinate input area 403 based on the position coordinates of the first recognition reference point and the second recognition reference point stored in the screen management table of the storage unit 25 in the target screen. (See formulas 1 to 4) to define the coordinate area of the coordinate input area 403 and store or update the coordinate area of the specified coordinate input area in the screen management table in association with the screen number of the target screen (Step S307).

  Next, the calibration processing unit 242 calculates a coordinate conversion function of the target screen (see Equations 5 and 6), and stores or updates the calculated coordinate conversion function in the screen management table in association with the screen number of the target screen. (Step S308).

  Finally, the calibration processing unit 242 ends the calibration on the target screen (step S309) and ends this operation. In the process of step S309, if an error display is executed in the previous stroke drawing process, the displayed error display is canceled.

[Error display processing]
Next, the operation of the error display process executed during the calibration process will be described with reference to FIG. FIG. 16 is a flowchart showing the error processing operation.

  First, when error processing is started in step S310 of FIG. 15 in stroke drawing processing including calibration processing, the calibration processing means 242 coordinates the screen number of the entry screen recognized in the processing of step 203. It is determined whether or not a conversion function is defined (step S401). Specifically, the calibration processing unit 242 determines whether or not a coordinate conversion function is stored in the screen management table in association with the screen number of the entry screen. At this time, if the calibration processing unit 242 determines that the coordinate conversion function is not defined for the entry screen (step S401: No), an error display is displayed at the center of the display screen 201 of the display unit 26. (Step S404), this operation is terminated.

  In step S404, when the calibration processing unit 242 displays an error display at the center of the display screen 201 of the display unit 26, the transmission unit 27 inputs the coordinates of each screen 4 to each projector 3. An image signal for projecting an error display at the center of the area 403 is output. For example, the transmission means 27 sends an image signal for projecting an error display “Screen 01 being aligned. Please wait for a while” to the center of the coordinate input area 403 of each screen 4 to each projector 3. Output. Each screen 4 displays the error display in the center.

  On the other hand, when the calibration processing unit 242 determines that a coordinate conversion function is defined for the entry screen (step S401: Yes), the position coordinates pen-down by the electronic pen 1 are included in the received entry information. Based on the coordinate conversion function of the entry screen, the extracted position coordinates are converted into position coordinates on the display screen 201 (step S402).

  Next, the calibration processing unit 242 displays an error display on the display screen 201 of the display unit 26 based on the coordinate coordinates obtained by the coordinate conversion (step S403), and ends this operation.

  In the process of step S403, when the calibration processing unit 242 displays an error display at a position corresponding to the position where the electronic pen 1 is pen-downed on the entry screen of the display screen 201 of the display unit 26, the transmission unit 27 is displayed. Outputs an image signal for causing each projector 3 to project an error display 603 at a position where the electronic pen 1 of each screen 4 is pen-down. For example, when the error display in step S402 is performed for the pen-down to the screen 4B that is not the target screen, the transmission unit 27 instructs each projector 3 to “align the screen 01. Please wait for a while. Is output as an image signal for projecting an image displayed on the screen 4B at the position where the electronic pen 1 is pen-down. Then, on the screen 4B, as shown in FIG. 13, the error display 603B is displayed at a position where the electronic pen 1B is pen-down. The screen 4A has an error at a position corresponding to the position where the electronic pen 1B in the coordinate input area 403A is pen-down regardless of whether the electronic pen 1A is not pen-down or the position where the electronic pen 1A is pen-down. A display 603A is displayed.

<Operational effects of the first embodiment>
As described above, the information processing system 10 according to the present embodiment performs the calibration process on the screen 4A or 4B that is the target of the calibration process, to the other screen 4B or 4A that is not the target of the calibration process. When the entry information by the stroke entry of the electronic pen 1A or 1B is received, error processing is executed. Therefore, during the execution of the calibration process for the screen 4A or 4B of the target screen, the non-target screen 4B or 4A. Even if the entry information in is received, the entry information does not affect the calibration process in the target screen, and the calibration process can be accurately performed on the screen 4A or 4B. Therefore, the information processing system 10 can accurately align the coordinate system on each of the calibrated screens 4A and 4B and the coordinate system of the predetermined image display area for drawing the stroke of the electronic pen, The strokes on the screen 4A or 4B by the electronic pen 1A or 1B can be collected and displayed as an image accurately on the respective screens 4A and 4B.

  Further, when the information processing system 10 receives the entry information on the non-target screen 4B or 4A during the execution of the calibration process for the screen 4A or 4B of the target screen, the information processing system 10 enters the stroke with the electronic pen 1A or 1B. The user can be surely recognized that this is an error. In particular, the information processing system 10 can display an error at a position penned down by the electronic pen 1B or 1A on the non-target screen 4B or 4A for calibration processing. That is, regarding the display at the position where the electronic pen is in contact, it is assumed that the position can be surely seen by the user, and an error is displayed at the position, so that the user is informed that the stroke entry with the electronic pen is an error. It can be recognized with certainty.

  Further, the information processing system 10 starts the calibration process, displays the first mark image on the display screen 201, and then touches the first mark image 601 displayed on each screen 4A and 4B with the electronic pen 1. Of the generated entry information, the screen 4A or 4B can be specified as the target screen to be calibrated based on the entry information received first by the computer apparatus 2, so that a complicated operation is not performed. Calibration can be executed easily.

<Modification>
Next, a modification of the first embodiment will be described.

  In the first embodiment, the calibration processing unit 242 performs the calibration process based on the stroke entry with the electronic pen 1A or 1B on the instruction sheet 6, but from the input unit 21 of the computer 2 The calibration process may be executed based on the instruction. In this case, in the drawing process including the calibration process illustrated in FIG. 7, the processes in steps S202 and S207 are omitted, and the calibration processing unit 242 instructs the input from the input unit 21 of the computer apparatus 2. The calibration processing is started based on the above, the alignment number, the position coordinates of the first recognition reference point, and the position coordinates of the second recognition reference point are cleared, and the first display reference point stored in the storage means 25 and The first mark image is displayed on the display screen 201 based on the position coordinates of the second display reference point. Also in this modified example, when the computer apparatus 2 receives the entry information regarding the screen 4 in which the coordinate conversion function is not defined when the calibration process is not being executed, which screen 4 needs to be calibrated. Can be displayed and the calibration process can be started (see Steps S205: No, S208, and S209).

  In the first embodiment, error display processing is performed as error processing. However, the calibration processing unit 242 simply ignores the received entry information and uses it as information used for the calibration processing. You just don't have to. In this case, in the stroke drawing process including the calibration process, the process of step S310 is omitted.

  In the first embodiment, the calibration processing unit 242 displays the first mark image 601 and recognizes the position coordinates of the first recognition reference point, and then displays the second mark image 602 and the second recognition reference point. Although the first mark image and the second mark image are displayed on the display screen 201 at the same time, the first mark image 601 and the second mark image 602 are displayed on each screen 4 at the same time. The position coordinates of the first recognition reference point and the second recognition reference point may be recognized. In this case, the calibration processing unit 242 displays the first mark image 601 and the second mark image 602 on each screen 4 at the same time, and then a plurality of stroke information (for example, 2) written on the entry screen. Each stroke information) is received. Then, the calibration processing means 242 compares the pen-up position coordinates included in each received stroke information, and uses the position coordinates that are the minimum values for both the X and Y coordinates on the coordinate system of the entry screen as the first recognition reference. The position coordinates may be recognized as the position coordinates of the point, and the position coordinates having the maximum values in both the X coordinate and the Y coordinate may be recognized as the position coordinates of the second recognition reference point.

  In the first embodiment, the calibration processing unit 242 recognizes the pen-up position coordinates included in the stroke information as the position coordinates of the first recognition reference point or the second recognition reference point. The pen-down position coordinate indicating the position where the pen 1 is in contact with the screen 4 may be recognized from the stroke information, and the recognized position coordinate may be used as the position coordinate of the first recognition reference point or the second recognition reference point.

  In the first embodiment, the calibration processing unit 242 may draw the stroke information that is the target of the error processing on the display screen 201 after executing the error display processing. In this case, the transmission unit 27 outputs an image signal for projecting the drawn stroke onto each screen 4 to each projector 3. Each screen 4 displays the drawn strokes. This process is executed after the process of step S403.

  In the first embodiment, the information processing system 100 uses only one electronic pen 1 instead of performing stroke drawing processing and calibration processing on the plurality of screens 4 using the plurality of electronic pens 1. The stroke drawing process and the calibration process for the plurality of screens 4 may be executed by the user using the.

  In the first embodiment, two images of the first mark image 601 and the second mark image 602 are displayed on each screen 4 in order to recognize the first recognition reference point and the second recognition reference point. However, three or more mark images may be displayed and the calibration process may be executed based on three or more recognition reference points.

  In the first embodiment, the present invention is applied to the two screens 4 (4A and 4B). However, the present invention is applied to an information processing system that displays the stroke of the electronic pen 1 on three or more screens. be able to.

Second Embodiment
Next, an information processing system 100 according to the second embodiment will be described with reference to FIGS.

  The second embodiment is different from the first embodiment in that an instruction sheet 6 having an alignment instruction area on which the same dot pattern is printed is pasted on each screen 4 (4A and 4B). It is characterized in that the instruction sheet 6 on which the dot pattern is printed is pasted on the screens 4A and 4B, respectively. Other configurations of the present embodiment are the same as those of the first embodiment, and the same members are denoted by the same reference numerals and description thereof is omitted.

[Coordinate definition information]
First, coordinate definition information stored in the storage unit 25 will be described with reference to FIG. FIG. 17 is an example of coordinate definition information stored in the storage unit 25 in the present embodiment.

  As coordinate definition information stored in the storage means 25, as shown in FIG. 17, information on a plurality of screens 4 and information on a plurality of alignment instruction areas provided for each screen 4 are stored. . In particular, the information relating to each alignment instruction area includes a screen of the screen 4 on which different dot pattern addresses, information defining different coordinate areas, information indicating the type, and instruction paper 6 having the alignment instruction area are pasted. The numbers are associated and stored in the storage unit 25 as coordinate definition information.

[Stroke drawing process including calibration process]
Next, stroke drawing processing including calibration processing in the information processing system 100 according to the second embodiment will be described with reference to FIGS. 18 and 19. 18 and 19 are flowcharts showing the operation of stroke drawing processing including calibration processing in the second embodiment.

  In this operation, processing similar to that in the flowcharts of FIGS. 14 and 15 of the first embodiment will be omitted as appropriate.

  First, the electronic pen 1 (1A or 1B), when the user performs a stroke entry on the sheet 402 of the screen 4 (4A or 4B) or any instruction sheet 6, the entry information is sent to the computer apparatus 2. Transmit (step S501).

  Next, in the computer apparatus 2, when the receiving unit 22 receives the entry information (stroke information and pen ID) from the electronic pen 1, the drawing processing unit 241 stores the stroke information and the pen ID included in the entry information. 25 (step S601).

  Next, the drawing processing unit 241 determines whether or not the received stroke information is an entry on the screen 4 (step S602). At this time, when the drawing processing unit 241 determines that the received stroke information is not an entry on the screen 4 (step S602: No), the drawing processing unit 241 proceeds to the process of step S607. In the determination process in step S602, the drawing processing unit 241 may use only one position coordinate included in the stroke information, such as the earliest position coordinate in time, or a plurality of or all position coordinates. May be.

  If the drawing processing unit 241 determines that the received stroke information is an entry on the screen 4 (step S602: Yes), the drawing processing unit 241 enters the screen number associated with the coordinate area to which the stroke information belongs. It is recognized as a screen number (step S603).

  Next, the drawing processing unit 241 determines whether or not the calibration process is being executed (step S604). If it is determined that the calibration process is being executed (step S604: Yes), FIG. The process proceeds to step S701. If the drawing processing unit 241 determines that the calibration process is not being executed (step S604: No), the drawing processing unit 241 checks whether the coordinate conversion function on the entry screen is defined (step S605). That is, the drawing processing unit 241 checks whether or not a coordinate conversion function is stored in the screen management table of the storage unit 25 in association with the screen number recognized by the processing in step S603. At this time, if the drawing processing unit 241 determines that the coordinate conversion function in the entry screen is not defined (step S605: No), the process proceeds to step S609.

  When the drawing processing unit 241 determines that the coordinate conversion function in the entry screen is defined (step S605: Yes), the drawing processing unit 241 receives the received image based on the corresponding coordinate conversion function stored in the storage unit 25. Each position coordinate of the stroke information is converted into a position coordinate on the display screen 201, and the stroke of the electronic pen 1 (1A or 1B) is displayed on the display screen 201 of the display means 26 along the converted position coordinate. When the drawing processing unit 241 displays the stroke of the electronic pen 1 on the display screen 201 of the display unit 26, the transmission unit 27 displays the same image as the image displayed on the display screen 201 on each screen 4. In order to do this, a predetermined image signal is output to each projector 3 via the image signal distributor 5.

  On the other hand, when the drawing processing unit 241 determines in step S602 that the received stroke information is not an entry on the screen 4 (step S602: No), the received stroke information is stored in the alignment instruction area (instruction sheet 6). ) Is determined (step S607). Specifically, the drawing processing unit 241 determines whether or not the type information associated with the corresponding coordinate area and stored in the coordinate definition information in the process of step S602 is the “positioning instruction area”. . At this time, when the drawing processing unit 241 determines that the received stroke information is not an entry in the alignment instruction area (step S608: No), this operation ends.

  When the drawing processing unit 241 determines that the received stroke information is an entry in the alignment instruction area (step S607: Yes), the drawing processing unit 241 corresponds to the corresponding coordinate area of the stroke information. The screen number to which the alignment instruction area is pasted, which is attached and stored in the coordinate definition information, is recognized (step S609).

  Next, the calibration processing unit 242 starts the calibration processing, and in the screen management table stored in the storage unit 25, the alignment number, the position coordinates of the first recognition reference point, and the position of the second recognition reference point The coordinates are cleared (step S609). Next, the calibration processing unit 242 stores the screen number recognized in step S608 or S603 in the storage unit 25 as an alignment number (step S610). That is, the calibration processing unit 242 fills in information by filling in the screen 4 in which the coordinate conversion function is not defined when the calibration for the specific screen 4 is instructed by filling in the specific instruction sheet 6. Is received and the undefined screen 4 is forcibly calibrated, the target screen is specified and the corresponding screen number is stored in the storage means 25 as the alignment number.

  Next, the calibration processing unit 242 displays the first mark image on the display screen 201 of the display unit 26 (step S611), and ends this operation. In step S611, when the calibration processing unit 242 displays the first mark image for calibration on the display screen 201 of the display unit 26, the calibration processing unit 242 performs calibration on the screen 4 for each projector 3. While projecting the first mark image 601 for calibration, the user is prompted to perform pen-up at the reference point (center of concentric circles) of the first mark image 601 for calibration with the electronic pen 1. For example, as shown in FIG. 9, the processing unit 24 causes the projector 3A to display an instruction message such as “Please raise the pen tip when it touches the center of the target” while projecting the mark image 601A onto the screen 4A. Or a similar voice instruction is output.

  Next, the calibration process following the calibration starting process in steps S609 to S611 in FIG. 18 will be described with reference to FIG.

  This operation is executed when entry information is received after the display of the first mark image in the process of step S611 in FIG. 18 and the drawing processing means 241 determines that the calibration process is being executed in the process of step S604. The

  First, the calibration processing unit 242 determines whether or not the screen number recognized in step S603 is the same as the alignment number stored in the screen management table of the storage unit 25 (step S701). At this time, if the calibration processing means 242 determines that the recognized screen number is different from the alignment number (step S701: No), it executes an error display process (step S710) and ends this operation.

  On the other hand, when the calibration processing unit 242 determines that the recognized screen number is the same as the alignment number (step S701: Yes), the calibration processing unit 242 associates the first screen with the screen number of the target screen in the screen management table. It is determined whether or not a recognition reference point is stored (step S702). At this time, if the calibration processing unit 242 determines that the first recognition reference point is stored in the screen management table (step S702: Yes), the calibration processing unit 242 proceeds to the process of step S706. In addition, when the calibration processing unit 242 determines that the first recognition reference point is not stored in the screen management table (step S702: No), the pen-up of the electronic pen 1 is included in the received entry information. The position coordinates are extracted, and the extracted position coordinates are stored in the screen management table in association with the screen number of the target screen as the position coordinates of the first recognition reference point (step S703).

  Next, the calibration processing unit 242 displays the second mark image on the display screen 201 of the display unit 26 based on the position coordinates of the second display reference point stored in the storage unit 25 (Step S704). End the operation. In step S704, when the calibration processing unit 242 displays the second mark image on the display screen 201 of the display unit 26, the transmission unit 27 performs calibration on each screen 4 with respect to each projector 3. An image signal for projecting the second mark image 602 for the operation is output. Then, the screen 4 displays the second mark image 602 for calibration with the electronic pen 1 and prompts the user to pen up at the reference point (the center of the concentric circle) of the second mark image 602.

  On the other hand, if the calibration processing unit 242 determines in step S702 that the first recognition reference point is stored in the screen management table (step S702: Yes), the calibration processing unit 242 determines that the pen-up information is included in the received entry information. The position coordinates are extracted, and the extracted position coordinates are stored in the screen management table as the position coordinates of the second recognition reference point in association with the screen number of the target screen (step S706).

  Next, the calibration processing unit 242 uses each of the diagonal vertices of the coordinate input area 403 based on the position coordinates of the first recognition reference point and the second recognition reference point stored in the screen management table of the storage unit 25 in the target screen. (See formulas 1 to 4) to define the coordinate area of the coordinate input area 403 and store or update the coordinate area of the specified coordinate input area in the screen management table in association with the screen number of the target screen (Step S707).

  Next, the calibration processing unit 242 calculates a coordinate conversion function of the target screen (see Equations 5 and 6), and stores or updates the calculated coordinate conversion function in the screen management table in association with the screen number of the target screen. (Step S708).

  Finally, the calibration processing unit 242 ends the calibration on the target screen (step S709) and ends the operation. In the process of step S709, when an error display is executed in the previous stroke drawing process, the displayed error display is canceled.

<Effects of Second Embodiment>
As described above, the information processing system 100 of the second embodiment performs writing (contact with) the electronic pen 1A or 1B in the alignment instruction area having the coordinate input area (coordinate information) for starting the calibration process. )), The screen 4A or 4B previously associated with the alignment area can be specified as the target screen and the calibration process can be executed. Therefore, the user can surely select the screen 4A or 4B desired by the user. Calibration processing can be executed.

  In addition, when the information processing system 100 receives entry information related to the screen 4A or 4B for which the coordinate conversion function is not defined, the information processing system 100 identifies the screen 4A or 4B as the target screen and executes the calibration process. Can do. For this reason, the calibration process can be surely executed on the screen 4A or 4B whose coordinate conversion function is not defined, regardless of the timing of entry with the electronic pen 1 on the other screen 4.

<Modification>
Next, a modification of the second embodiment will be described.

  In the second embodiment, alignment instruction areas for executing the calibration process are provided as instruction sheets 6 outside the coordinate input areas 403A and 403B of the screens 4A and 4B. It may be provided in the area 403. In this case, an alignment instruction area may be formed in the coordinate input area 403 of the screen 4 as an area that varies for each calibration process by a menu and an icon, or an area fixed to a part of the screen 4. An alignment instruction area may be formed. When the alignment region is formed by the menu or the icon, as described above, the position coordinate on the screen 4 and the position coordinate on the display screen 201 in the display unit 26 of the computer device 2 are coordinates by the coordinate conversion function. Since calibration is performed by conversion, each time the calibration process is executed, the position coordinates of the menu or icon are recognized, and the stroke by the electronic pen 1 is entered for the position coordinates on the screen 4 of the menu or icon. Then, the calibration processing unit 242 can recognize the calibration processing start instruction. In addition, when the alignment instruction area is fixed in the coordinate input area 403, it may be displayed that the position is the alignment instruction area.

  When areas for starting the calibration process are provided in the screens 4A and 4B in this way, the calibration process can be easily performed even when the screen is being written on the screen 4A or 4B by the electronic pen 1. Since it can be started, the stroke of the electronic pen 1 written by the user on the screen can always be displayed accurately.

<Third Embodiment>
Next, the information processing system 101 in the third embodiment will be described with reference to FIGS. FIG. 20 is a system configuration diagram of the information processing system 101 in the present embodiment, and FIG. 21 shows the first mark image and the second mark image for calibration displayed on the display device 40A in the present embodiment. FIG.

[Configuration and overview of information processing system]
The information processing system 101 according to the third embodiment displays images on a plurality of screens 4 using a plurality of projectors 3 in the first embodiment, and performs stroke entry with the electronic pen 1 using any one of the screens 4. Instead of the dots, the electronic pen 1 uses a plurality of display devices 40A and 40B (40) and transparent sheets 8A and 8B (8) on which dot patterns formed on the front surfaces of the display devices 40A and 40B are printed. It is characterized in that strokes are entered. In addition, in this embodiment, about the member same as 1st Embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

  As shown in FIG. 20, the information processing system 101 according to the third embodiment includes a plurality of display devices 40A and 40B having electronic pens 1A and 1B, display screens (image display areas) 401A and 401B, and each display device. Transparent sheets 8A and 8B formed on the front surfaces of 40A and 40B and printed with a dot pattern (coded pattern) that can be read by the electronic pen 1, and the same for each display device, such as filling strokes in the electronic pens 1A and 1B. A computer device 20 that performs various processes for displaying an image and an image signal distributor 5 that distributes an image signal output from the computer device 20 and outputs the image signal to the display devices 40A and 40B are provided. The computer device 20 has substantially the same configuration as the computer device 2 of the first embodiment, but differs from the computer device 2 only in that it does not have the display means 26 independently.

[Transparent sheet]
The transparent sheets 8A and 8B are attached to the front surfaces of the display areas 401A and 401B of the display devices 40A and 40B, and are displayed on the display areas 401A and 401B such as the stroke of the electronic pen 1 or the first mark images 801A and 801B. Each image is transmitted so that the image can be viewed from the front.

  For example, when the calibration process is executed, as shown in FIG. 21, the first mark image 801A and the second mark image 802A change the timing of the display device 40A so as to be visible from the front surface of the transparent sheet 8A. In addition, an instruction message 901A is displayed, “Please raise the pen tip when it touches the center of the target”.

  In addition, the dot pattern of this embodiment is printed on each transparent sheet 8 with the ink which has the characteristic to selectively reflect infrared rays. Therefore, in the electronic pen 1, the processor 108 is determined from the image data captured by the CMOS camera 106 with a threshold value so that a partial region with strong infrared reflection is recognized as a dot.

[Coordinate definition information]
The coordinate definition information stored in the storage means 25 of the computer device 20 includes a dot pattern address, a coordinate area, type information indicating “transparent sheet” or “alignment instruction area”, a screen number (transparent As the sheet number), identification information of each corresponding transparent sheet 8 such as “SHT01” and “SHT02” is included.

[Stroke drawing process including calibration process]
Stroke drawing processing including calibration processing in the information processing system 101 is the same as stroke drawing processing including calibration processing in the information processing systems 10 and 100 of the first and second embodiments. The point that was processed for the screen 4 in the second embodiment is that the transparent sheet 8 is processed. Specifically, for example, “screen”, “entry screen”, “target screen” and the like in the first and second embodiments are “transparent sheet”, “entry transparent sheet”, “ Processed as “target transparent sheet” or the like.

<Operational effects of the third embodiment>
As described above, in the information processing system 101 according to the third embodiment, when the calibration process is performed on the transparent sheet 8A or 8B that is the target of the calibration process, the other transparent sheet that is not the target of the calibration process. Since error processing is executed when the entry information by filling the stroke of the electronic pen 1 into 8B or 8A is received, the calibration process is being performed for the transparent sheet 8A or 8B of the target screen (target transparent sheet). Even if the coordinate information on the non-target transparent sheet 8B or 8A is received, the entry information does not affect the calibration process on the target transparent sheet 8, and the calibration process can be performed accurately. it can. Therefore, the information processing system 101 can accurately align the coordinate system of each transparent sheet 8A and 8B with the coordinate system of the predetermined image display area for drawing the stroke of the electronic pen, and the electronic pen 1A. Alternatively, the strokes on the transparent sheet 8A or 8B by 1B can be collected and displayed on the respective transparent sheets 8A and 8B as an image accurately.

<Modification>
Next, a modification of the third embodiment will be described.

  As shown in FIG. 22, the present modification is different from the third embodiment described above in that the stroke by the electronic pen 1 is displayed as an image on the plurality of display devices 40 having the transparent sheet 8. You may make it display the image of the stroke by the electronic pen 1 written on the screen 4A or the transparent sheet 8B with respect to the display apparatus which has the screen 4A demonstrated in the form, and the transparent sheet 8B. That is, in this modification, the strokes respectively written by the electronic pens 1A and 1B (1) on the screen 4A on which the coded pattern indicating the unique coordinate range is formed and on the display device 40B having the transparent sheet 8B are written. This is a system for collecting and displaying. Specifically, the information processing system 102 of the present modification includes a plurality of electronic pens 1A, 1B (1), a computer device 2, a projector 3A that projects an image on a screen 4A, and a display screen (image display area). Display device 40B having 401B, transparent sheet 8B formed on the front surface of display device 40B and printed with a dot pattern readable by electronic pen 1, screen 4A and display device such as strokes in electronic pens 1A and 1B The computer apparatus 2 which performs various processes for displaying the same image on 40B and the image signal distributor 5 are comprised.

  Note that the operation of the calibration process in the present modification is replaced with the screen 4 and the display instead of being processed for one of the plurality of screens 4 or the plurality of display devices 40 in the first embodiment or the third embodiment. The same processing is executed except that the devices 40 are mixed and processing. For example, “screen”, “entry screen”, “target screen”, etc. in the first and second embodiments are “screen” or “transparent sheet”, “target screen” or “entry transparent sheet”, “target screen”. Alternatively, the process is executed as a “target transparent sheet” or the like.

  In the third embodiment, as in the second embodiment, the alignment instruction area for executing the calibration process is provided outside the display areas 401A and 401B, and different dot patterns are printed. The instruction sheet 6 may be attached to the displays 40A and 40B, respectively, and an alignment instruction area may be provided in the display areas 401A and 401B instead of the instruction sheet 6.

  The information processing systems 10, 100, and 101 can be used in a system that uses a plurality of screens 4 or display devices 40 such as a school class, a company conference room, a lecture, and a presentation.

DESCRIPTION OF SYMBOLS 1, 1A, 1B ... Electronic pen 2, 20 ... Computer apparatus 21 ... Input means 22 ... Reception means 24 ... Processing means 241 ... Drawing processing means 242 ... Calibration processing means 25 ... Storage means 26 ... Display means 27 ... Transmission means 201 Display screen 202 ... Upper left point coordinate of display screen 203 ... Lower right point coordinate of display screen 204 ... First display reference point 205 ... Second display reference point 3, 3A, 3B ... Projector 4, 4A, 4B ... Screen 40, 40A, 40B ... Display device 401, 401A, 401B ... Magnet plate (white board)
402, 402A, 402B ... Paper 403, 403A, 403B ... Image projection area (projection area) / coordinate input area 404 ... Upper left point coordinates 405 ... Upper left point coordinates of coordinate input area 406 ... Lower right point coordinates of coordinate input area 407 ... First recognition reference point coordinates 408 ... second recognition reference point coordinates 5 ... Image signal distributor 6 ... Instruction sheet (positioning instruction area)
601, 601 A, 601 B, 801 A ... first mark image for calibration 602, 602 A, 602 B, 802 A ... second mark image for calibration 603, 603 A, 603 B ... error display 701 A, 701 B, 901 A ... instruction message 8, 8A, 8B ... Transparent sheet 10, 100, 101, 102 ... Information processing system

Claims (13)

Used for projecting and displaying the stroke of the electronic pen on each of the plurality of screens on which the coded pattern indicating the position information readable by the electronic pen is formed through the projection means corresponding to each screen. An information processing system,
Receiving means for receiving coordinate information on the one screen calculated by the electronic pen reading the coded pattern according to the stroke when the stroke is written on the one screen by the electronic pen; ,
Drawing processing means for drawing a stroke on one screen by the electronic pen in an image display area of the display means based on the received coordinate information;
Transmitting means for transmitting an image signal for displaying the drawn stroke of the electronic pen on each screen to each projection means;
A calibration process for associating the coordinate system of each screen with the coordinate system of the image display area while displaying a mark image that guides the position of the electronic pen in contact with each screen using the projection unit, respectively. Calibration processing means to be executed;
With
The calibration processing means includes
If the coordinate information received during the display of the mark image is coordinate information belonging to the calibration target screen, the position coordinates of the mark image on the target screen based on the coordinate information And executing the calibration process for associating the coordinate system of the screen to be calibrated with the coordinate system of the image display area based on the recognized position coordinates,
An information processing system, wherein, when the coordinate information received during display of the mark image is coordinate information belonging to a screen that is not subject to calibration, a predetermined error process is executed. An information processing system used for drawing and displaying strokes by the electronic pen on a plurality of display means provided on the front surface with a transparent sheet on which a coded pattern indicating position information readable by the electronic pen is formed. And
When the stroke is written on one transparent sheet by the electronic pen, the electronic pen receives the coordinate information on the one transparent sheet calculated while reading the coded pattern according to the stroke. Means,
Drawing processing means for drawing a stroke on one transparent sheet by the electronic pen in a predetermined image display area of each display means based on the received coordinate information;
While displaying a mark image for guiding a position to be brought into contact with the electronic pen on each display means, a coordinate system for each transparent sheet and a coordinate system for an image display area used when drawing the stroke on each display means, Calibration processing means for respectively executing calibration processing for associating
With
The calibration processing means includes
When the coordinate information received during the display of the mark image is coordinate information belonging to the transparent sheet that is the object of calibration, the mark information on the transparent sheet that is the target based on the coordinate information is displayed. Recognizing position coordinates, and executing the calibration process for associating the coordinate system of the transparent sheet that is the object of calibration with the coordinate system of the image display area based on the recognized position coordinates;
An information processing system that performs predetermined error processing when coordinate information received during display of the mark image belongs to a transparent sheet that is not subject to calibration. . On the screen on which a coding pattern indicating position information readable by the electronic pen is formed, or on the display means provided on the front surface with the transparent sheet on which the coding pattern is formed, the stroke by the electronic pen is An information processing system used for projecting on a projection means or displaying directly,
When the stroke is written on the screen or the transparent sheet by the electronic pen, the coordinates on the screen or the transparent sheet calculated by the electronic pen reading the coding pattern according to the stroke. Receiving means for receiving information;
Drawing processing means for drawing a stroke of the electronic pen on the screen or transparent sheet based on the received coordinate information in an image display area formed in a predetermined device;
A transmission unit that transmits an image signal for displaying the drawn stroke of the electronic pen on the screen to the projection unit, and that transmits an image signal for displaying the stroke to the display unit;
A calibration process is performed for associating the coordinate system of each screen with the coordinate system of the image display area while displaying, using the projection unit, a mark image that guides the position where the electronic pen contacts the screen. And calibration processing means for executing a calibration process for associating the coordinate system of each transparent sheet with the coordinate system of the image display area while displaying the mark image on the display means,
With
The calibration processing means includes
When the coordinate information received during the display of the mark image is coordinate information belonging to the screen or transparent sheet to be calibrated, the target screen or transparent sheet is based on the coordinate information. Recognizing the position coordinates of the mark image above, and associating the coordinate system of the screen to be calibrated or the coordinate system of the transparent sheet with the coordinate system of the image display area based on the recognized position coordinates Run the calibration process,
Information in which, when the coordinate information received during the display of the mark image is coordinate information belonging to a screen or transparent sheet that is not subject to calibration, predetermined error processing is executed. Processing system. The information processing system according to any one of claims 1 to 3,
The calibration processing means executes display control processing for displaying a predetermined error display at a predetermined position on the screen or at a predetermined display position of the display means as the error processing. Information processing system. The information processing system according to claim 4,
When the calibration process on the non-target screen or transparent sheet specified based on the coordinate information received by the receiving unit has already been performed,
The calibration processing means is based on the received coordinate information and the position touched by the electronic pen on the non-target screen, or touched by the electronic pen on the received coordinate information and the non-target transparent sheet. An information processing system for executing a display control process for displaying a predetermined error based on the position of the display means corresponding to the position. The information processing system according to any one of claims 1 to 5,
The calibration processing means includes
When coordinate information indicating coordinates outside the area formed on the screen or the transparent sheet and receiving coordinate information indicating a predetermined calibration instruction, the calibration is started,
After starting the calibration, the screen for performing the calibration process is specified based on the coordinate information received by the first contact of the electronic pen with the mark image displayed on the screen, or the display unit An information processing system that identifies a transparent sheet to be subjected to the calibration processing based on coordinate information received by the first contact of the electronic pen with the position of the transparent sheet corresponding to the mark image displayed on the screen. The information processing system according to any one of claims 1 to 5,
The calibration processing unit starts the calibration and receives the coordinate information that is unique to each screen or transparent sheet, and when the coordinate information indicating a predetermined calibration instruction is received. An information processing system that performs a calibration process on a screen or a transparent sheet specified by coordinate information. The information processing system according to claim 7,
The information processing system in which the unique coordinate information indicating a calibration instruction on the screen or the transparent sheet indicates coordinates outside a region formed on the screen or the transparent sheet. The information processing system according to claim 7,
The information processing system in which the unique coordinate information indicating a calibration instruction on the screen or the transparent sheet indicates a position coordinate in a predetermined region in the coordinate system of each screen or the transparent sheet. The information processing system according to any one of claims 1 to 5,
An input means for inputting an instruction to execute the calibration by a user;
The calibration processing means includes
When an instruction to execute the calibration is input to the input means, the calibration is started,
Based on the coordinate information received by the first contact of the electronic pen with the mark image displayed on the screen, the screen for performing the calibration process is specified, or corresponds to the mark image displayed on the display means An information processing system that identifies a transparent sheet to be subjected to the calibration processing based on coordinate information received by the first contact of the electronic pen to the position of each transparent sheet to be performed. The stroke by the electronic pen is projected and displayed through a projection unit corresponding to each screen on a plurality of screens on which coded patterns indicating position information readable by the electronic pen are formed by a computer. A display processing program for
The computer,
Receiving means for receiving coordinate information on the one screen calculated by the electronic pen reading the coded pattern according to the stroke when the stroke is written on the one screen by the electronic pen;
A drawing processing means for drawing a stroke on the one screen by the electronic pen in an image display area of the display means based on the received coordinate information;
Transmitting means for transmitting an image signal for displaying the drawn stroke of the electronic pen on each screen to each projection means;
A calibration process for associating the coordinate system of each screen with the coordinate system of the image display area while displaying a mark image that guides the position of the electronic pen in contact with each screen using the projection unit, respectively. Calibration processing means to be executed,
And function as
The computer,
If the coordinate information received during the display of the mark image is coordinate information belonging to the calibration target screen, the position coordinates of the mark image on the target screen based on the coordinate information And executing the calibration process for associating the coordinate system of the screen to be calibrated with the coordinate system of the image display area based on the recognized position coordinates,
When the coordinate information received during display of the mark image is coordinate information belonging to a screen that is not subject to calibration, the coordinate information is made to function as the calibration processing means for executing a predetermined error process. Characteristic display processing program. Display processing program for drawing and displaying strokes by the electronic pen on a plurality of display means provided on the front surface with a transparent sheet on which a coded pattern indicating position information readable by the electronic pen is formed by a computer Because
The computer,
When the stroke is written on one transparent sheet by the electronic pen, the electronic pen receives the coordinate information on the one transparent sheet calculated while reading the coded pattern according to the stroke. means,
Drawing processing means for drawing a stroke on one transparent sheet by the electronic pen in a predetermined image display area of each display means based on the received coordinate information;
While displaying a mark image for guiding a position to be brought into contact with the electronic pen on each display means, a coordinate system for each transparent sheet and a coordinate system for an image display area used when drawing the stroke on each display means, Calibration processing means for respectively executing calibration processing for associating
And function as
The computer,
When the coordinate information received during the display of the mark image is coordinate information belonging to the transparent sheet that is the object of calibration, the mark information on the transparent sheet that is the target based on the coordinate information is displayed. Recognizing position coordinates, and executing the calibration process for associating the coordinate system of the transparent sheet that is the object of calibration with the coordinate system of the image display area based on the recognized position coordinates;
When the coordinate information received during the display of the mark image is coordinate information belonging to a transparent sheet that is not subject to calibration, a predetermined error process is executed, and the function is performed as the calibration processing unit. A display processing program characterized by that. By means of the electronic pen on a screen on which a coding pattern indicating position information readable by the electronic pen is formed by a computer or on a display means provided with a transparent sheet on which the coding pattern is formed on the front surface An information processing system used for projecting a stroke onto a projection means or directly displaying a stroke,
The computer,
When the stroke is written on the screen or the transparent sheet by the electronic pen, the coordinates on the screen or the transparent sheet calculated by the electronic pen reading the coding pattern according to the stroke. Receiving means for receiving information,
A drawing processing means for drawing a stroke on the screen or the transparent sheet by the electronic pen in an image display area formed in a predetermined device based on the received coordinate information;
Transmitting means for transmitting an image signal for displaying the drawn stroke of the electronic pen on the screen to the projecting means, and transmitting an image signal for displaying the stroke to the display means;
A calibration process is performed for associating the coordinate system of each screen with the coordinate system of the image display area while displaying, using the projection unit, a mark image that guides the position where the electronic pen contacts the screen. And calibration processing means for executing a calibration process for associating the coordinate system of each transparent sheet with the coordinate system of the image display area while displaying the mark image on the display means,
And function as
The computer,
When the coordinate information received during the display of the mark image is coordinate information belonging to the screen or transparent sheet to be calibrated, the target screen or transparent sheet is based on the coordinate information. Recognizing the position coordinates of the mark image above, and associating the coordinate system of the screen to be calibrated or the coordinate system of the transparent sheet with the coordinate system of the image display area based on the recognized position coordinates Run the calibration process,
When the coordinate information received during the display of the mark image is coordinate information belonging to a screen or transparent sheet that is not subject to calibration, the calibration processing means executes a predetermined error process An information processing program characterized by functioning.

Images