JP4722784B2 - Electronic blackboard apparatus, image processing method in electronic blackboard apparatus, and program thereof - Google Patents

Description

  The present invention relates to an electronic blackboard device having a large display device such as a plasma display or a liquid crystal display, an image processing method in the electronic blackboard device, and a program thereof.

  Various image processing techniques have been disclosed so far for image processing of display devices. For example, there is a smoothing process for smoothing jaggedness (jaggy) of an outline that occurs when an image is enlarged and displayed (see, for example, Patent Document 1). According to the smoothing processing device and the software that performs the smoothing process, an image with a smooth outline is displayed even if the image is enlarged. Accordingly, the smoothing process as described above can be said to be a preferable image processing technique particularly in an electronic blackboard apparatus that includes a large-screen display device and frequently performs enlarged display of images.

  FIG. 1 is a diagram showing a schematic configuration of a conventional smoothing processing apparatus that can be mounted on an electronic blackboard apparatus. The smoothing processing apparatus mainly includes an information processing apparatus 100 such as a personal computer, an input unit 200, and a display apparatus 300. In the figure, an example in which a light pen is used as a device of an input unit is shown, and the information processing apparatus 100 is further configured by a device control unit 110, a pen drawing unit 120, and an image display processing unit 130.

  As a general application of the electronic blackboard apparatus, there is an operation of performing drawing using a light pen, a mouse, or the like on an image displayed on the screen, and the device control unit 110 of the information processing apparatus 100 includes an input unit 200. When the input from the light pen is detected, the pen drawing unit 120 performs drawing reflecting the movement of the pen. The image display processing unit 130 performs display processing such as the smoothing processing described above, and displays the processed image on the display device 300.

  By the way, when drawing on a background image such as a desktop screen, the image and drawing are usually composed of different layers. Therefore, even if a line is drawn on the background image, the drawing portion Can only be modified or deleted.

  FIG. 2 is a diagram schematically illustrating a relationship between a background image and drawing in a conventional image processing method. In the figure, a layer having a desktop screen as a background image is represented as a background image layer 50, and a transparent window for drawing is represented as a drawing layer 60. As shown in FIG. 2A, when the desktop image is full-sized, that is, displayed on the screen in the same size as the display screen of the electronic blackboard device, the light pen 200 is touched on the screen for drawing. When this is done, drawing is directly performed on the drawing layer 60 having the same size as the background image layer 50. Since the display screen 80, which is an area visible on the screen, is the same size as the background image layer 50 and the drawing layer 60, it is displayed as if lines were drawn on the desktop screen.

On the other hand, when displaying a part of the desktop image in an enlarged manner, as shown in FIG. 2B, first, the entire background image layer 50 is enlarged to a desired magnification, and a desired position is displayed on the screen (on the screen). Drawing is performed after the image is displayed on the display screen 80), which is an area visible in FIG. At that time, the entire background image layer 50 is enlarged, and at the same time, the drawing layer 60 for drawing is enlarged at the same rate. Therefore, when a screen on which a part of the enlarged desktop screen is displayed is drawn with a light pen, the drawing is directly performed on the drawing layer 60 with the line width enlarged at the same rate.
JP 2000-163602 A (2nd page-5th page, FIG. 1)

  However, when the conventional image processing method is used for the electronic blackboard device, the background image layer 50 and the drawing layer 60 are independent. For example, after the background image layer 50 is enlarged, image processing such as smoothing processing is performed. However, there is a problem in that the same image processing cannot be performed as appropriate for the subsequent drawing. This is because the conventional image display is not configured to perform the same image processing at any time for an arbitrarily performed drawing operation. Therefore, the enlarged drawing layer 60 is enlarged at the same rate. In particular, a thick line is drawn, and particularly when an oblique line is drawn, there is a problem that jaggy occurs and display quality is inferior.

  FIG. 3 is a diagram schematically showing a state of lines drawn on a background image in a conventional image processing method. When the background image is full size, the line drawn with an arbitrary line width is displayed as shown in FIG. 3A, but when the background image is enlarged at a predetermined magnification, it is drawn with the same line width. Lines are also displayed as shown in FIG. Even if the background image is smoothed (not shown), if jaggy occurs on the drawing line, the display quality is inferior, which is not preferable. However, if all the displays on the screen are to be smoothed, both the background image layer 50 and the drawing layer 60 must be separately smoothed, resulting in a problem that the processing becomes complicated.

  In addition, as shown in FIG. 2B, when the conventional image processing method is used for the electronic blackboard device, when the enlarged display is performed, only a part is displayed on the screen, but the background image layer and the drawing layer are displayed. Both were previously enlarged. For this reason, there is a problem in that an enlargement process for all images and an image memory for storing the enlarged image are required, and a large area of the memory is consumed.

  As problems to be solved by the present invention, in the electronic blackboard device and its image processing method, the problem that the smoothing process for smoothing the jaggy of the drawing line becomes complicated, the amount of use of the image memory increases, The problem of high costs because a large-capacity image memory is required is an example.

  In order to solve the above problem, the electronic blackboard device according to claim 1 is an electronic blackboard device capable of drawing an image by an input unit on a display screen capable of enlarging and displaying a part of a full-size background image layer. A blackboard device that detects an input operation by the input means to the display screen, and an image storage unit that stores the full-size background image layer and a drawing layer having a size corresponding to the full-size background image layer And the drawing corresponding to the coordinate position on the display screen where the input operation detected by the input detection unit is performed based on the display location of the background image layer displayed on the display screen and the enlargement ratio thereof. An input position calculation unit for calculating a coordinate position of the layer, a locus drawing unit for drawing a locus by the input operation with respect to the coordinate position of the drawing layer calculated by the input position calculation unit, and a background image layer Some And an image compositing unit that generates a composite image by combining the image data of the drawing layer corresponding to the location, an image processing unit that performs predetermined image processing on the composite image generated by the image combining unit, and the image processing And a display unit that is processed by the unit and enlarged and displayed to the same size as the display screen.

In the image processing method in an electronic blackboard apparatus according to claim 3, compared magnified display screen capable of displaying a partial portion of the full size of the background image layer, an electronic blackboard apparatus capable draws an image by the input means An image processing method according to claim 1, wherein an input operation by the input means for the display screen is detected, and the original size is calculated from the coordinate position where the input operation is detected, the enlargement ratio of the display screen, and the position information of the display location. An input position calculating step for calculating an input position in a drawing layer corresponding to a large background image layer, and a drawing step for drawing a locus of the input means on the drawing layer at the position calculated by the input position calculating step; A composite image generation step of generating a composite image by combining a part of the background image layer and the image data of the drawing layer corresponding to the part; and the composite image generation step An image processing step for performing predetermined image processing on the composite image generated by the screen, and a display step for displaying the composite image processed in the image processing step in an enlarged size to a display screen. It is characterized by including.

An image processing program in an electronic blackboard device according to claim 5 is an electronic blackboard device capable of drawing an image by an input means on a display screen capable of enlarging and displaying a part of a full-size background image layer. To the computer included in the display screen, the input operation by the input means to the display screen is detected, and from the coordinate position where the input operation is detected, the enlargement ratio of the display screen and the position information of the display location, An input position calculating step for calculating an input position in a drawing layer corresponding to the background image layer; a drawing step for drawing a locus of the input means on the drawing layer at the position calculated by the input position calculating step; A composite image generation step of generating a composite image by combining a part of the background image layer and the image data of the drawing layer corresponding to the part; and the composite image generation An image processing step for performing predetermined image processing on the composite image generated by the step, and a display step for displaying the composite image processed in the image processing step in the same size as a display screen are executed. It is characterized by making it.

An electronic blackboard apparatus according to an embodiment of the present invention is an electronic blackboard apparatus capable of drawing an image by an input unit on a display screen capable of enlarging and displaying a part of a background image layer. The best mode is characterized by having the means of 1) to (7).
(1) An image storage unit for storing the full-size background image layer and a drawing layer having a size corresponding to the full-size background image layer. (2) An input detection unit for detecting an input operation by an input unit to the display screen. (3) The coordinate position of the drawing layer corresponding to the coordinate position on the display screen where the input operation detected by the input detection unit is performed is calculated based on the display location of the background image layer displayed on the display screen and the enlargement ratio. (4) A locus drawing unit that draws a locus by the input operation with respect to the coordinate position of the drawing layer calculated by the input position calculating unit. (5) A part of the background image layer and its location (6) An image processing unit that performs predetermined image processing on the synthesized image generated by the image synthesizing unit. (7) By the image processing unit. Processed A display unit is enlarged and displayed in the same size as the display screen Te

  Hereinafter, examples which are examples of the electronic blackboard device according to the embodiment of the present invention will be given and described with reference to the drawings.

  FIG. 4 is a diagram showing a schematic configuration of the electronic blackboard device of the example in the embodiment of the present invention. The electronic blackboard device 10 mainly includes an input detection unit 1, an input position calculation unit 2, a locus drawing unit 3, an image storage unit 4, an image acquisition unit 5, an image composition unit 6, an image processing unit 7, and a display unit 8. Is done.

  The input detection unit 1 detects an input from an input unit 200 connected to the electronic blackboard device 10 such as a light pen or a mouse. The input position calculation unit 2 calculates position information such as which position of the displayed background image layer the position on the display instructed by the input means 200 matches. Based on the calculation result of the input position calculation unit 2, the locus drawing unit 3 applies the locus of the input unit 200 to the drawing layer 60 having a size corresponding to the full-size background image layer 50 stored in the image storage unit 4. draw. The image storage unit 4 is an image memory or the like included in the electronic blackboard device 10, and data of the drawing layer 60 is stored and held in a predetermined area in the image storage unit 4. The full-size background image layer 50 is stored and held in a region different from the drawing layer 60 in the image storage unit 4 as image data of a layer (layer) different from the drawing layer 60.

  The image acquisition unit 5 acquires image data stored in the image storage unit 4 and transfers the image data to the image synthesis unit 6, or transfers the composite image data transmitted from the image synthesis unit 6 to the image processing unit 7. To do. Further, the detection status of the input detection unit 1 is determined, and the input position calculation unit 2 is instructed to calculate the input position. The image composition unit 6 merges (synthesizes) the background image layer 50 and the drawing layer 60 corresponding to the background image layer 50 to generate image data of one layer. The synthesized image data includes a background image and a drawing. The image processing unit 7 mainly performs display-related image processing on the image data transferred from the image composition unit 6 via the image acquisition unit 5. For example, image enlargement processing or smoothing processing. The display unit 8 displays the image data processed by the image processing unit 7.

  Next, the operation of the electronic blackboard device 10 having the above configuration will be described. In the following, the screen display operation at the time of drawing, particularly at the time of drawing when the background image is enlarged and displayed, will be described, and description of other operations will be omitted. In the following embodiment, an example using a light pen as the input unit 200 will be described. However, the present invention is not limited to this, and it is needless to say that any input unit such as a mouse may be used.

  FIG. 5 is a flowchart showing the screen display processing procedure of the electronic blackboard device 10 in the embodiment of the present invention. First, when the light pen (input unit) 200 is brought into contact with and moved on the display screen of the electronic blackboard device 10 in which a part of the desktop screen as a background image is enlarged, the input detection unit 1 detects an input. (Step S101), the function unit after the input position calculation unit 2 is caused to execute the drawing display process (step S102). After the drawing display process, the input detection unit 1 determines whether or not the input continues, that is, whether or not the light pen is moving (step S103). If the light pen is moving, the drawing of step S102 is performed. Repeat the display process. On the other hand, when the movement of the light pen is finished, the screen display processing procedure is finished.

  Next, a detailed procedure of the drawing display process will be described. FIG. 6 is a flowchart showing a drawing display processing procedure of the electronic blackboard device 10 in the embodiment of the present invention. First, the input position calculation unit 2 calculates the position (coordinates) corresponding to the full-size background image layer from the display magnification ratio / position information of the enlarged portion with respect to the pen-down position on the enlarged desktop screen. (Step S201).

  Then, a pen locus is drawn on the drawing layer 60 stored in the image storage unit 4 based on the calculated position information (step S202). The drawing layer 60 is a drawing layer 60 corresponding to the full-size desktop screen, that is, the background image layer 50 that is not enlarged. Thereafter, the drawing layer 60 to which drawing has been added is stored in the image storage unit 4, and the drawing layer 60 is updated (step S203).

Next, the image acquisition unit 5 is necessary to enlarge and display the drawing layer 60 and the background image layer 50 stored in the image storage unit 4 at the same magnification as that initially displayed on the screen. Only the part is cut out and transferred to the image composition unit 6 (step S204).
The image composition unit 6 merges (combines) the extracted two layer data (step S205), and transfers the combined image data to the image processing unit 7 (step S206).

  The image processing unit 7 performs enlargement processing on the acquired composite image data, and further performs image processing such as smoothing processing (step S207). The image data subjected to the image processing is transferred to the display unit 8 (step S208), and the display unit 8 executes a known screen display process (step S209).

7A and 7B are diagrams for explaining the outline of the drawing display processing in the electronic blackboard device according to the embodiment of the present invention. FIG. 7A is a diagram showing a display screen 80 in which an image is not enlarged, and FIG. The figure which shows the display screen 80 which expands a part of background image layer 50, and is writing with the light pen 200, (c) demonstrates the process in the background image layer 50 and the drawing layer 60 on the image storage part 4. FIG. It is explanatory drawing.
In the electronic blackboard device in the present embodiment, as shown in FIG. 7C, the background image layer 50 and the drawing layer 60 are stored in the image storage unit 4 of the electronic blackboard device 10, and FIG. When the full-size display screen 80 shown is enlarged and the drawing is performed by touching the screen with the light pen 200, the drawing is recorded in the drawing layer 60 in the image storage unit 4 shown in FIG. . Then, only the portions necessary for screen display in the background image layer 50 and the drawing layer 60 are cut out, and the image data of these two layers are combined (merged), and enlargement processing and smoothing are performed on the merged image data. Image processing such as processing is performed, and a processed image 70 as shown in FIG. 7B is displayed.

  While the light pen 200 is moving on the screen, that is, while drawing is continued, the above-mentioned “drawing on the drawing layer 60 in the image storage unit 4 by calculating the position of the light pen 200” and “background The composition of the image layer 50 and the drawing layer 60, image processing, and screen display "are continuously repeated, and the screen display is sequentially updated at a predetermined cycle (for example, a cycle of 100 milliseconds).

  As described above, since the data of the background image layer 50 and the drawing layer 60 synthesized by the image synthesis unit 6 is cut out only in a necessary area in advance, the data amount of the synthesized image can be reduced, Further, since image processing such as enlargement and smoothing only needs to be performed on the composite image with a small amount of data, the processing load can be reduced, and the consumption of the buffer memory used at the time of processing is reduced. be able to. Therefore, the processing speed can be improved.

  Note that the image processing performed in the above embodiment may be other processing such as spatial filtering, image conversion, and degraded image restoration in addition to the smoothing processing. Therefore, description of the details of the smoothing process is omitted. Regardless of which image processing is performed, processing is performed on the image data obtained by synthesizing the background image layer 50 and the drawing layer 60. Therefore, as in the conventional case, the image is displayed on the desktop screen (background image) and the drawing lines. There is no problem that display quality (jaggy, etc.) is different.

  In the embodiment of the present invention, what is drawn by the input unit 200 may be other than so-called pen drawing in which the locus is drawn. For example, an image stamp (bitmap image such as a seal or an icon) is drawn. (Press an image stamp). That is, even if an image stamp is pressed during enlargement of the display screen, the image stamp itself is also smoothed and enlarged, and the same effect can be obtained.

  As described above, according to the electronic blackboard device according to the embodiment of the present invention, since the full-size data of the desktop screen is stored in the storage unit, the enlarged display is displayed on the screen. It is only necessary to perform enlargement processing only on the portion to be stored, and it is not necessary to newly store and hold image data or the like obtained by enlarging the entire desktop screen, so that significant consumption of the memory area becomes unnecessary.

  Furthermore, according to the electronic blackboard device according to the present embodiment, only the portions necessary for the enlarged display of the background image layer 50 and the drawing layer 60 are synthesized, so that the memory consumption related to the synthesis is reduced, and accordingly, the enlargement process is performed. And smoothing processing can be executed simultaneously. That is, the locus of the light pen drawn on the enlarged screen can also be sequentially smoothed.

As described above in detail in the above embodiment, the electronic blackboard device according to the embodiment of the present invention has a light pen, a mouse, etc. on a display screen capable of enlarging and displaying a part of the background image layer 50. An electronic blackboard device 10 capable of drawing an image by the input means 200, and an image storage unit 4 for storing a full-size background image layer 50 and a drawing layer 60 having a size corresponding to the full-size background image layer 50; The input detection unit 1 that detects an input operation by the input unit 200 to the display screen, and the input operation detected by the input detection unit 1 based on the display location of the background image layer 50 displayed on the display screen and its enlargement ratio. The input position calculation unit 2 that calculates the coordinate position of the drawing layer 60 corresponding to the coordinate position on the display screen that has been performed, and the coordinate position of the drawing layer 60 calculated by the input position calculation unit 2 by the input operation Gauge Generated by the image synthesizing unit 6, the image synthesizing unit 6 that generates a synthesized image obtained by synthesizing part of the background image layer 50 and the image data of the drawing layer 60 corresponding to the part. The image processing unit 7 that performs predetermined image processing on the combined image, and the display unit 8 that is processed by the image processing unit 7 and enlarged to the same size as the display screen is displayed.
Further, the image processing method in the electronic blackboard device according to the embodiment of the present invention is an electronic blackboard device capable of drawing an image by input means on a display screen capable of enlarging and displaying a part of the background image layer. An image processing method for detecting an input operation by the input unit with respect to the display screen, and from the coordinate position where the input operation is detected, an enlargement ratio of the display screen, and position information of a display location, the background image An input position calculating step for calculating an input position in a drawing layer corresponding to the layer, a drawing step for drawing a locus of input means on the drawing layer at the position calculated by the input position calculating step, and the background image A composite image generation step for generating a composite image by combining a part of the layer and image data of the drawing layer corresponding to the part, and the composite image generation step. An image processing step for performing predetermined image processing on the generated composite image, and a display step for displaying the composite image processed in the image processing step in an enlarged size substantially the same as a display screen. It is a waste.
As a result, only a partial area of the background image layer 50 and the drawing layer 60 may be combined (merged), and image processing such as enlargement and smoothing may be performed only on the combined (merged) image data. The problem is that the smoothing process to smooth out the jagged lines of drawing is complicated, and the amount of memory used for the image becomes large, and a large amount of memory for the image is required, which is expensive. Can be solved.

It is a figure which shows schematic structure of the conventional smoothing processing apparatus. It is a figure which shows typically the relationship between the background image and drawing in the conventional image display. It is a figure which shows typically the mode of the line drawn on the background image in the conventional image display. It is a figure which shows schematic structure of the electronic blackboard apparatus in the Example of this invention. It is a flowchart which shows the screen display processing procedure of the electronic blackboard apparatus in the Example of this invention. It is a flowchart which shows the drawing display process sequence of the electronic blackboard apparatus in the Example of this invention. It is a figure for demonstrating the outline | summary of the drawing display process in the electronic blackboard apparatus which concerns on the Example of this invention, (a) is a figure which shows the display screen which has not expanded the image, (b) is a part of image. The figure which shows the display screen which is expanding and writing with a light pen, (c) is explanatory drawing explaining the process in the background image layer and drawing layer on an image memory | storage part.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Input detection part 2 Input position calculation part 3 Trajectory drawing part 4 Image memory | storage part 5 Image acquisition part 6 Image composition part 7 Image processing part 8 Display part 10 Electronic blackboard apparatus 50 Background image layer 60 Drawing layer 70 Image 80 after image processing Display screen 200 Light pen (input means)
300 Display device

Claims (5)

An electronic blackboard device capable of drawing an image by an input means on a display screen capable of displaying an enlarged portion of a portion of a full-size background image layer,
An image storage unit for storing a full-sized background image layer and a drawing layer having a size corresponding to the full-sized background image layer;
An input detection unit for detecting an input operation by the input means to the display screen;
The coordinate position of the drawing layer corresponding to the coordinate position on the display screen where the input operation detected by the input detection unit is performed is calculated based on the display location of the background image layer displayed on the display screen and the enlargement ratio. An input position calculation unit to
A locus drawing unit for drawing a locus by the input operation with respect to the coordinate position of the drawing layer calculated by the input position calculating unit;
An image compositing unit that generates a composite image obtained by compositing a part of the background image layer and the image data of the drawing layer corresponding to the part;
An image processing unit that performs predetermined image processing on the synthesized image generated by the image synthesizing unit;
An electronic blackboard apparatus, comprising: a display unit that is processed by the image processing unit and enlarged and displayed to the same size as a display screen.   The electronic blackboard apparatus according to claim 1, wherein the input detection unit detects that the input unit continues input, and sequentially transmits an update command to the image composition unit. An image processing method in an electronic blackboard device capable of drawing an image by an input means on a display screen capable of displaying an enlarged portion of a portion of a full-scale background image layer,
  An input operation by the input means for the display screen is detected, and corresponds to the full-size background image layer from the coordinate position where the input operation is detected, the enlargement factor of the display screen, and the position information of the display location. An input position calculating step for calculating an input position in the drawing layer;
  A drawing step of drawing a locus of the input means on the drawing layer at the position calculated by the input position calculating step;
  A composite image generating step for generating a composite image by combining a part of the background image layer and the image data of the drawing layer corresponding to the part;
  An image processing step for performing predetermined image processing on the composite image generated by the composite image generation step;
  A display step of displaying the composite image processed in the image processing step enlarged to the same size as a display screen;
  An image processing method in an electronic blackboard device, comprising: The electronic blackboard apparatus according to claim 3, wherein the input position calculating step detects that the input means continues to input, and sequentially transmits an update command to the composite image generating step. Image processing method. In a computer included in an electronic blackboard device capable of drawing an image by an input means on a display screen capable of enlarging and displaying a part of a full-scale background image layer,
  An input operation by the input means for the display screen is detected, and corresponds to the full-size background image layer from the coordinate position where the input operation is detected, the enlargement factor of the display screen, and the position information of the display location. An input position calculating step for calculating an input position in the drawing layer;
  A drawing step of drawing a locus of the input means on the drawing layer at the position calculated by the input position calculating step;
  A composite image generating step for generating a composite image by combining a part of the background image layer and the image data of the drawing layer corresponding to the part;
  An image processing step for performing predetermined image processing on the composite image generated by the composite image generation step;
  A display step of displaying the composite image processed in the image processing step enlarged to the same size as a display screen;
  An image processing program in an electronic blackboard device, characterized in that

Images