JP2014006695A - Drawing processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a drawing processing apparatus capable of supporting many functions without reducing the use of a special switch or icon and bringing about the complexity of a gesture.
A display unit 12 displays on a display surface 14. The coordinate detection unit 16 detects the coordinates of an object (such as a pen or a finger) on the operation surface 22. The pressure detector 18 detects the pressure on the operation surface 22 of the object. In this embodiment, the display surface 14 and the operation surface 22 are the same plane. The drawing processing unit 20 executes a drawing process based on the coordinates of the object detected by the coordinate detection unit 16 and the pressure detected by the pressure detection unit 18. The drawing processing unit 20 controls the display unit 12 by the drawing process to perform drawing on the display surface 14.
[Selection] Figure 1

Description

  The present invention relates to a drawing processing apparatus that performs drawing processing.

  A drawing processing apparatus as shown in FIG. 12 has been put into practical use. The projector 4 displays an image on the display surface 2 under the control of the PC 6. A sensor 8 for detecting the position of a pen or a finger on the display surface 2 is provided at the top of the display surface 2. When a pen or finger is detected by the sensor 8, the PC 6 receives this and performs processing based on the detected position, and performs processing such as drawing through the projector 4. For example, a line or the like is drawn corresponding to the locus of movement of the pen or finger. In this way, a drawing processing apparatus is realized.

  In such a drawing processing apparatus, a function icon 10 is provided as shown in FIG. 12 in order to make a drawing function (deletion or movement of an object, etc.) work. The function icon 10 is selected with a pen or a finger so that a desired function can be executed.

  Further, as disclosed in Patent Document 1, a switch for instructing a function to a pen is provided so that a desired function can be executed.

  However, there is a problem that a special switch must be provided on the pen, and when the function icon 10 is provided, there is a problem that the display surface 2 becomes small. Therefore, it has been proposed to select a drawing function based on the trajectory of a pen or a finger. For example, if X is drawn with a pen or a finger, the object in the rectangular area where X is drawn can be deleted. Thereby, the function icon 10 can be eliminated (or reduced).

JP2007-328506A

  However, the conventional techniques as described above have the following problems. As the number of functions for drawing increases, there is a problem in that there are various ways of moving the pen and fingers, causing confusion.

  For example, when an object is deleted by drawing X, any of the overlapping objects cannot be selected. In order to realize this, it is conceivable to draw with a pen or a finger separately what number of overlapping objects is to be deleted (for example, if 3 is drawn, the third object is deleted).

  However, in this case, there are various ways of moving pens and fingers (gestures) corresponding to the drawing function, which may cause confusion for the user.

  The present invention solves the above-described problems, and reduces the use of special switches and icons, while providing a drawing processing apparatus that can handle many functions without causing the complexity of gestures. The purpose is to provide.

(1) (2) (3) (4) A drawing processing apparatus according to the present invention includes a display unit for displaying on a display surface, a coordinate detection unit for detecting the coordinate position of the target, and the target on the operation surface. A pressure detection unit that detects a pressure applied to the display unit, and a drawing processing unit that controls the display unit based on the coordinate position of the object detected by the coordinate detection unit and the detected pressure, and performs a drawing process on the display surface And.

  Therefore, by performing control in consideration of the pressure, it is possible to cope with many functions without causing the complexity of the gesture.

(5) The drawing processing apparatus according to the present invention is characterized in that the drawing processing means determines a drawing function based on the locus of the pen, and determines an execution amount, an execution range, or an execution speed of the drawing function based on the pressure. Yes.

  Therefore, an operation amount corresponding to the pressure can be realized.

(6) The drawing processing apparatus according to the present invention is characterized in that the drawing processing means determines the execution amount in the depth direction by pressure.

  Therefore, the execution amount in the depth direction can be determined by a pressure that is intuitively easy to understand.

(7) In the drawing processing device according to the present invention, when the pressure is equal to or lower than the first predetermined value, the drawing processing means determines the amount of movement of the object in the depth direction in proportion to the magnitude of the pressure. When the pressure exceeds the first predetermined value, the amount of movement of the object in the direction opposite to the depth direction is determined in proportion to the magnitude of the pressure.

  Therefore, the movement of the object in both directions can be determined by the operation of applying pressure in one direction.

(8) The drawing processing apparatus according to the present invention is characterized in that the drawing processing means determines a drawing function based on a trajectory of the object, and determines a depth of a target object that executes the drawing function based on the pressure. .

  Therefore, it is possible to easily select objects that overlap and are difficult to select.

(9) The drawing processing apparatus according to the present invention is characterized in that the display surface and the operation surface are the same surface.

  Therefore, it is possible to realize a drawing process that is intuitively easy to understand.

(10) A drawing method according to the present invention includes a display surface for displaying, a coordinate detection unit for detecting a coordinate position of an object, a pressure detection unit for detecting pressure applied to the operation surface by the object, and a computer And the computer controls the display unit based on the coordinate position of the object detected by the coordinate detection unit and the detected pressure, and performs a drawing process on the display surface. It is characterized by.

  Therefore, by performing control in consideration of the pressure, it is possible to cope with many functions without causing the complexity of the gesture.

  The “display unit” refers to a unit for performing display, and includes a projector, a display, a touch panel display, and the like. In the embodiment, the projector 50 corresponds to this.

  The “coordinate detection unit” refers to a unit that detects the position of an object, and not only a unit that detects the position of an object by infrared rays, ultrasonic waves, or the like, but also a position that is pressed by the object by a pressure sensor or the like. It is a concept including what to do. In the embodiment, the position detection sensor 34 corresponds to this.

  “Pressure detection unit” refers to a unit that detects a pressure at which an operation surface is pushed by an object, and is not only provided when a sensor for detecting pressure is provided on the object itself, but also provided on the operation surface. It is a concept that includes cases where In the embodiment, the pressure sensor 41 provided in the electronic pen 40 corresponds to this.

  In the embodiment, “drawing processing means” corresponds to steps S3 and S4.

  The “program” is a concept that includes not only a program that can be directly executed by the CPU, but also a source format program, a compressed program, an encrypted program, and the like.

It is a functional block diagram of the drawing processing apparatus by one Embodiment of this invention. It is a figure which shows the external appearance of a drawing processing apparatus. It is a figure which shows a hardware configuration. 4 is a flowchart of a drawing processing program 44. It is an example of a gesture table. It is a figure which shows the process by X gesture. It is a figure which shows the process by X gesture. It is a figure which shows the process by Z order movement. It is a figure which shows the process by Z order movement. It is a figure which shows the process by Z order movement. It is a figure which shows the process by Z order movement. It is a figure which shows the conventional drawing processing apparatus.

1. Functional Block Diagram of Drawing Processing Device FIG. 1 shows a functional block diagram of a drawing processing device according to an embodiment of the present invention. The display unit 12 performs display on the display surface 14. The coordinate detection unit 16 detects the coordinates of an object (such as a pen or a finger) on the operation surface 22. The pressure detector 18 detects the pressure on the operation surface 22 of the object. In this embodiment, the display surface 14 and the operation surface 22 are the same plane. The drawing processing unit 20 executes a drawing process based on the coordinates of the object detected by the coordinate detection unit 16 and the pressure detected by the pressure detection unit 18. The drawing processing unit 20 controls the display unit 12 by the drawing process to perform drawing on the display surface 14.

2. Appearance and Position Detection Sensor FIG. 2 shows an appearance of a drawing processing apparatus according to an embodiment. The front surface of the display board 21 is a display surface 14. The projector 50 displays an image on the display surface 14 under the control of the PC 48. In this embodiment, the display surface 14 also serves as the operation surface 22.

  A position detection sensor 34 is provided above the display board 21. The position detection sensor 34 is provided with two sets of sensors including an infrared light emitting unit and an infrared light receiving unit. The infrared light emitting unit irradiates infrared light toward all directions of the display surface 14. The infrared light receiving unit receives infrared reflected light from all directions of the display surface 14.

  In addition, retroreflective members 31 are provided at the left and right ends and the lower end of the display board 21. The retroreflective member 31 is configured to reflect incident infrared light in the same direction.

  Therefore, when the electronic pen 40 as an object is present on the display surface 14, infrared light from the infrared light emitting unit is blocked by the electronic pen 40 and is not received by the infrared light receiving unit. On the other hand, in the part where the electronic pen 40 does not exist, the infrared light is reflected by the retroreflective member 31 and received by the infrared light receiving unit.

  The position detection sensor 34 is provided with a coordinate position detection circuit for the electronic pen 40. The coordinate position detection circuit calculates and outputs the coordinate position on the display surface 22 of the electronic pen 40 based on the detection angle of the electronic pen 40 by the two sets of sensors.

  When the position of the electronic pen 40 is detected by the position detection sensor 34, the PC 48 receives this. The electronic pen 40 is provided with a pressure sensor 41 that detects pressure. The output of the pressure sensor 41 is given to the PC 48.

The PC 48 performs drawing processing via the projector 50 based on the detection position by the position detection sensor 34 and the detection pressure by the pressure sensor 41. For example, a line or the like is drawn corresponding to the locus of movement of the electronic pen 40. Further, based on the detection position and the detection pressure, a function for drawing (deletion, movement, page turning, etc.) is executed.

3. Hardware Configuration FIG. 3 shows a hardware configuration. A memory 32, a position detection sensor 34, a CD-ROM drive 36, a hard disk 38, a pressure sensor 41 of an electronic pen 40, and a projector 50 are connected to the CPU 30.

An operating system (such as WINDOWS (trademark) from Microsoft) 42 and a drawing processing program 44 are recorded on the hard disk 38. The drawing processing program 44 performs its function in cooperation with the operating system 42. The operating system 42 and the drawing processing program 44 are those recorded on the CD-ROM 44 and installed on the hard disk 38 via the CD-ROM drive 36. Moreover, what was downloaded via the internet etc. may be used.

4). Processing of Drawing Processing Program 44 FIG. 4 shows a processing flowchart of the drawing processing program 44. The CPU 30 first determines whether or not the position detection sensor 34 has detected the electronic pen 40 (step S1). If the position of the electronic pen 40 is detected, the CPU 30 records the position detected by the position detection sensor 34 and the pressure detected by the pressure sensor 41 on the hard disk 38 at predetermined time intervals (step S2).

  Next, the CPU 30 determines whether or not the position recorded in this way matches a previously recorded gesture (step S3). FIG. 5 shows a part of the gesture table recorded on the hard disk 38. The CPU 30 determines whether or not the position (trajectory) of the electronic pen 40 matches that described in the position information column of the gesture table. If it does not match any gesture, normal drawing processing (drawing lines, drawing figures, etc.) is executed (step S5).

  In the table of FIG. 5, if the trajectory of the electronic pen 40 is X, the object is deleted. If the trajectory (position) of the electronic pen 40 is not moved, the object moves in the Z direction, and the trajectory of the electronic pen 40 is any. It can be seen that the page turning should be executed if the movement jumps in the direction of.

  For example, assume that the user draws a trajectory as shown in FIG. 6A with the electronic pen 40. The CPU 30 determines that this is the locus of X from the recorded position information (for example, it is determined by crossing two straight lines having substantially the same length), and based on the gesture table, the end point is determined. The deletion process of the object in the rectangle constituted by P1 to P4 is performed (step S4).

  At this time, the CPU 30 refers to the recorded change in pressure shown in FIG. 6B to determine which depth of object to delete. For example, as shown in FIG. 7, it is assumed that an object J1 is placed at the forefront, then an object J2, and an object J3 is placed at the back. At this time, until now, it has been difficult to delete only the objects J2 and J3. In this embodiment, it is possible to determine which order of objects to delete according to the magnitude of pressure.

  As shown in FIG. 6B, if the maximum pressure value when the X gesture is input does not exceed the threshold value L1, the foreground object J1 is deleted. If it is between the threshold values L1 and L2, the object J2 is deleted. If the threshold value L3 is exceeded, the object J3 is deleted. When there is a pressure change as shown in FIG. 6B, the object J2 is deleted.

  In step S3, it is assumed that the user continues to apply pressure without moving the electronic pen 40 for a predetermined time or longer as shown in FIG. 8A. The CPU 30 refers to the gesture table and determines that the object is Z-order movement. At this time, the CPU 30 determines to what order the object is moved based on the pressure.

  For example, as shown in state A1 in FIG. 9, an object J1 is placed on the forefront (Z order = 2), an object J2 is placed on the next face (Z order = 1), and an object J3 (Z order = 0) is placed on the back. Suppose that At this time, the user presses any part of the visible portion of the object J1 with the electronic pen 40 for a predetermined time. Thereby, CPU30 judges that it is a Z order movement of an object.

  For example, as shown in FIG. 8B, it is assumed that a pressure larger than the pressure P1 and smaller than the pressure P2 is applied for a predetermined time (for example, 1 second) or longer. This is expressed as the continuous applied pressure is P2. In this case, the CPU 30 moves only one target object J1 (Z order 1 level) to the back. That is, a state as shown in state A2 in FIG.

  In the state A1 in FIG. 9, when the continuous applied pressure is P3 for the object J1, the CPU 30 lowers the Z order of the object J1 by two levels. That is, as shown in the state A3 in FIG. 9, the object J1 is moved to the rearmost surface.

  In the state B1 of FIG. 10, it is assumed that a pressure with the continuous applied pressure P2 is applied to the object J2. As a result, as shown in state B2, the object J2 moves to the rearmost surface.

  In the state B1 of FIG. 10, assuming that a pressure is applied to the object J2 with the continuously applied pressure being P3, the CPU 30 returns the object J2 to the original level as shown in the state B3. In other words, since the object reaches the back surface, the Z-order of the object is raised when the above continuous applied pressure is applied.

  In the state C1 of FIG. 11, it is assumed that a pressure with the continuous applied pressure P2 is applied to the object J3. As a result, as shown in the state C2, the Z order of the object J3 is increased by one (coming one plane forward).

  Further, in the state C1 of FIG. 11, it is assumed that a pressure with the continuous applied pressure P3 is applied to the object J3. As a result, as shown in the state C3, two Z orders of the object J3 rise and come to the top surface.

  In this embodiment, according to the magnitude of the continuously applied pressure, the object is moved to the back surface, and when a pressure larger than the continuously applied pressure reaching the backmost surface is applied, the object is controlled to move toward the top surface. doing. Therefore, it is possible to move the object to the back surface or the entire surface according to the magnitude of the applied pressure.

  In step S3, when the electronic pen 40 is quickly moved in a predetermined direction (moved so as to increase the acceleration), the CPU 30 refers to the gesture table and performs a page turning process.

  At this time, the CPU 30 determines the number of pages to be turned according to the magnitude of the maximum pressure at that time. For example, if the maximum pressure is large, the number of pages is increased, and if the maximum pressure is small, it is decreased.

As described above, processing according to pressure can be performed.

5. Other embodiments
(1) In the above embodiment, the display surface and the operation surface are shared, but they may be provided separately.

(2) Although the projector 50 and the position detection sensor 34 using infrared rays are used in the above embodiment, a touch panel having a display function may be used. In this case, the touch panel serves as a display unit and a pressure detection unit. In addition, a finger or the like can be used as an object instead of the electronic pen 40.

(3) In the above embodiment, infrared light is emitted from the position detection sensor 34 to detect the position. However, infrared light may be emitted from the electronic pen 40 and detected to identify the position.

(4) In the above embodiment, the Z-order movement amount (operation amount) is determined according to the magnitude of the continuously applied pressure. However, the Z-order movement amount (operation amount) may be determined according to the length of time during which the pressure is applied.

(5) In the above embodiment, the deletion, movement, and page turning of objects have been described. However, other processes can also be applied.

  For example, when the object is selected, the Z order of the selected object is changed according to the magnitude of the pressure. That is, as the pressure increases, the object on the back side is selected.

  Also, the page turning speed may be changed according to the pressure. Furthermore, the amount of screen scrolling may be determined by the product of the moving distance of the electronic pen 40 and the writing pressure.

(6) In the above embodiment, one object to be deleted is determined according to the magnitude of pressure. However, all objects from the foreground to the determined object may be deleted according to the pressure level. That is, instead of determining one object to be operated based on pressure, the range of objects to be operated (range in the Z-order direction) may be determined based on pressure.

(7) The numerical value to be input may be changed according to the pressure. For example, in numerical input, “1” may be input for a weak pressure, “2” may be input for a strong pressure, and “3” may be input for a stronger pressure.

(8) In the above embodiment, a function is selected based on the movement trajectory of the electronic pen 40, and the degree of function execution is determined based on the pressure. However, the function may be selected depending on the combination of the locus of movement of the electronic pen 40 and the pressure.

Claims (10)

A display unit for displaying on the display surface;
A coordinate detection unit for detecting the coordinate position of the object;
A pressure detector that detects the pressure applied to the operation surface by the object;
Drawing processing means for controlling the display unit based on the coordinate position of the object detected by the coordinate detection unit and the detected pressure, and performing drawing processing on the display surface;
A drawing processing apparatus. A drawing processing apparatus including a display unit for displaying on a display surface, a coordinate detection unit for detecting the coordinate position of an object, and a pressure detection unit for detecting pressure applied to the operation surface by the object is realized by a computer. A drawing processing program for controlling the display unit based on the coordinate position of the object detected by the coordinate detection unit and the detected pressure and performing drawing processing on the display surface A drawing processing program for functioning as a means. A coordinate detection unit for detecting the coordinate position of the object;
Drawing processing on the display surface by controlling the display unit based on the coordinate position of the object detected by the coordinate detection unit and the pressure detected by the pressure detection unit that detects the pressure applied to the operation surface by the object Drawing processing means for performing
A drawing control apparatus. A drawing processing program for realizing, by a computer, a drawing control apparatus including a coordinate detection unit that detects a coordinate position of an object, wherein the computer detects the coordinate position of the object detected by the coordinate detection unit and the computer A drawing processing program for controlling a display unit based on pressure detected by a pressure detection unit that detects pressure applied to an operation surface by an object and functioning as a drawing processing unit that performs drawing processing on the display surface. In the apparatus or the drawing processing program according to any one of claims 1 to 4,
The drawing processing means determines a drawing function based on a trajectory of the object, and determines an execution amount, an execution range, or an execution speed of the drawing function based on the pressure. In the apparatus or drawing processing program of Claim 5,
The drawing processing means determines an execution amount in the depth direction based on the pressure. The apparatus according to claim 6 or a drawing processing program.
When the pressure is equal to or less than a first predetermined value, the drawing processing means determines the amount of movement of the object in the depth direction in proportion to the pressure, and the pressure reaches the first predetermined value. An apparatus or a program characterized by determining the amount of movement of the object in the direction opposite to the depth direction in proportion to the magnitude of the pressure when the pressure exceeds. In the apparatus or the drawing processing program according to any one of claims 1 to 7,
The drawing processing means determines a drawing function based on the locus of the pen, and determines a depth of a target object that executes the drawing function based on the pressure. In the apparatus or the drawing processing program according to any one of claims 1 to 8,
The apparatus or program is characterized in that the display surface and the operation surface are the same surface. A drawing processing method using a display surface that performs display, a coordinate detection unit that detects a coordinate position of an object, a pressure detection unit that detects pressure applied to the operation surface by the object, and a computer,
A drawing processing method, wherein the computer controls the display unit based on the coordinate position of the object detected by the coordinate detection unit and the detected pressure to perform drawing processing on a display surface.

Images