RU2365979C2 - Input and reproduction of electronic ink - Google Patents

Abstract

FIELD: printing industry.

SUBSTANCE: invention relates to means of input and reproduction of information including electronic ink. The claimed system contains an object for receiving electronic ink and one or more objects for reproduction and to which the object for reception of electronic ink refers, notably, that the object receiving electronic ink controls images of these objects and at least one of these objects meant for reproduction is not able to operate with electronic ink alone, but can operates with electronic ink when it is included in the structure of the object receiving electronic ink.

EFFECT: possibility of input and reproduction of information on the base of pen characterised such properties as input order, patterns of halftone screen from left to right, type of writing with using various languages is provided.

18 cl, 12 dwg

Description

FIELD OF THE INVENTION

Aspects of the present invention relate to the input and reproduction of information. More specifically, aspects of the present invention relate to the administration and reproduction of electronic ink.

DESCRIPTION OF THE BACKGROUND OF THE INVENTION RELATED TO THE INVENTION

People often rely more on graphical representations of information than on textual representations. They would rather look at an illustration than a piece of text that might be equivalent to an illustration. For example, a homeowner can cut illustrations from magazines to show the contractor exactly what he expects from a kitchen or bathroom renovation. The textual description of the same material often does not achieve its purpose. The tool a homeowner can use is no more complicated than a pair of scissors.

However, in a world built on computing, attempts to capture and transmit identical content (informationally meaningful content) cause a lot of inconvenience. Typical computer systems do not provide a simple interface for capturing and transmitting graphically intensive content. Rather, they are optimized for text input and playback. For example, typical computer systems, especially computer systems using graphical user interface (GUI) systems such as Microsoft WINDOWS, are optimized for receiving user input through one or more discrete input devices, such as a keyboard for entering text, and coordinate pointing device, such as a mouse with one or more buttons, to control the user interface.

Some computing systems have expanded the input and interaction systems offered to the user, giving him the ability to use a pen to enter information into these systems. The pen can replace both devices: both the keyboard (for data entry) and the mouse (for control). Some computer systems accept handwritten electronic information or electronic ink and immediately try to convert electronic ink to text. Other systems allow electronic ink to be handwritten.

Despite the existence of the pen, various approaches to combining electronic ink and a typical graphical user interface can cause difficulties for third-party application developers. Accordingly, in this technical area there is a need for an improved electronic ink input and playback system that is friendly to third-party software developers.

SUMMARY OF THE INVENTION

Aspects of the present invention relate to one or more of the issues mentioned above, and thereby provide better input and playback of content for use by third-party software developers. In some embodiments of the invention, an electronic ink input and reproducing element can be represented as an object that is part of a structure in which each element in an interface can be determined by depth (or z-order). In some cases, an object can reproduce various elements in the interface in a z-order determined for them and then reproduce ink on the uppermost layer. In other cases, ink and other elements may be mixed together.

These and other aspects are disclosed in connection with the figures and the related description.

LIST OF DRAWINGS FIGURES

The present invention is illustrated by way of example and is not limited to the accompanying figures, in which the same reference numerals indicate the same elements and where:

FIG. 1 is a general purpose computer supporting one or more aspects of the present invention.

FIG. 2 is a display of a pen-based input system in accordance with aspects of the present invention.

FIG. 3A and 3B are various examples of interfaces and how ordering is done in each of them in accordance with aspects of the invention.

FIG. 4 illustrates ink superimposed on an area in accordance with aspects of the present invention.

FIG. 5 illustrates the constructors and properties of an object in accordance with aspects of the present invention.

FIG. 6 shows object methods in accordance with aspects of the present invention.

FIG. 7 shows events of an object in accordance with aspects of the present invention.

FIG. 8 is a correspondence relationship with objects and various modes according to aspects of the present invention.

FIG. 9A, 9B, 9C are different degrees of truncation to an area in accordance with aspects of the present invention.

DETAILED DESCRIPTION

Aspects of the present invention relate to an improved electronic ink input and playback system.

This document is divided into sections to assist the reader. These sections include ink specifications, terms, general purpose computing environments; ordering of objects; constructors, properties, methods and events of objects, relationships and truncation.

Ink specifications

As users who use ink pens know, physical ink (those that lay on paper as a result of using a pen with an ink tank) can convey more information than just a sequence of coordinates connected by line segments. For example, physical ink can reflect the pressure of the pen (through the thickness of the ink trail), the angle of the pen (through the shape of linear or curved lines, and the behavior of the ink around individual points) and the speed of the pen (through straightness, line width, and changes in line width in the direction of travel) line or curve). Thanks to these additional properties, such characteristics as emotions, personality traits, expressive manner, etc., can be transmitted more directly than with the same line width between the points.

Electronic ink (or ink) refers to capturing and displaying electronic information when a user uses a pen-based input device. The term "electronic ink" refers to a sequence of strokes, where each stroke is composed of a sequence of dots. Points can be represented using various known methods, including Cartesian coordinates (X, Y), polar coordinates (r, T), and other methods known in the art. Electronic ink can include representations of the properties of real ink, including pressure, angle, speed, color, pen size, opacity. Electronic ink can also contain other properties, including the order in which ink was laid on the page (for example, a raster pattern from left to right, then down, typical of most Western languages), a time label (indicating when the ink was applied), an indication on the author of the ink recording and the device on which it was made (at least one of the following identification data: identification data of the computer on which the ink recording was made, and identification data e pen used for the ink application), as well as other information.

Terms

Ink is a sequence or collection of strokes that have properties. The sequence of strokes may include strokes arranged in an ordered manner. This sequence can be sorted by input time or by where the strokes appeared on the page or, in co-authorship situations, by the author of the ink recording. Other ordering options are possible. A set of strokes may include strokes, or unordered strokes, or any combination. In addition, some properties may be unique for each stroke or point on the stroke (for example, pressure, speed, angle of the handle, etc.). These properties can be stored at the stroke or dot level, rather than at the ink level.

An ink object is a data structure that stores ink with or without properties.

Bar - a sequence or set of entered points. For example, during playback, a sequence of points can be connected by lines. Alternatively, the stroke can be represented as a point and a vector directed to the next point. In short, it is understood that the stroke encompasses any representation of the dots or segments associated with the ink, regardless of the latent representation of the dots and / or what connects the dots.

Point - information that determines the position in space. For example, points can be defined relative to the input space (for example, points on the surface of a digital converter), the virtual ink space (coordinates in the space where the fixed ink is placed), and / or display spaces (points or pixels of the display device).

Elements - objects located in the form of a tree, where their placement on the tree serves as their order.

General purpose computing environment

FIG. 1 is a schematic diagram of an illustrative conventional general purpose digital computing environment that can be used to implement various aspects of the present invention. In FIG. 1, computer 100 includes a processor 110, system memory 120, and system bus 130 that connects various system components, including system memory, to processor 110. System bus 130 may refer to any of several types of bus structures, including a memory bus or a memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. System memory 120 includes read-only memory (ROM) 140 and random access memory (RAM) 150.

The basic input / output system (BIOS), which contains the basic procedures that facilitate the transfer of information between elements within the computer 100, such as at startup, is stored in the ROM 140. The computer 100 also includes a hard disk drive 170 for read from and write to a hard magnetic disk (not shown in the diagram), a magnetic disk drive 180 for reading from or writing to a removable magnetic disk 190 and a drive 191 to read from a removable optical disk 192, such as a CD-ROM or others optic skie carriers, and write on it. A hard disk drive 170, a magnetic disk drive 180, and an optical disk drive 191 are connected to the system bus 130 via a hard disk drive interface 192, a magnetic disk drive interface 193, and an optical disk drive interface 194, respectively. These drives and drives and their corresponding computer-readable storage media provide non-volatile storage of machine-readable instructions, data structures, program modules and other data for a personal computer 100. Those skilled in the art will recognize that other types of computer-readable storage media are capable of storing data to which computer-assisted, such as magnetic tape cartridges, Flash memory cards, digital video discs, Bernoulli cartridges, random access memory devices TWA (RAM), read-only memory (ROM), etc., can also be used in this illustrative operating environment.

In a hard disk drive 170, on a magnetic disk 190, an optical disk 192, a number of program modules may be stored in ROM 140 or RAM 150, including an operating system 195, one or more application programs 196, other program modules 197, and program data 198 . The user can enter commands and information into the computer 100 via input / output devices, such as a keyboard 101 and pointing device 102. Other input devices (not shown) may include a microphone, joystick, game pad, parabolic satellite dish, scanner etc. Often, these and other input devices are connected to the processor 110 via a serial port interface 106 connected to the system bus, but can be connected via other interfaces, such as a parallel port, game port, or universal serial bus (USB) [currently, since the bus USB is so popular, you might want to depict the USB bus in FIG. one]. In addition, these devices can also be directly connected to the system bus 130 via the corresponding interface (not shown in the diagram). A monitor 107 or other type of display device is also connected to the system bus 130 via an interface, such as a video adapter 108. In addition to the monitor, personal computers typically include other peripheral output devices (not shown), such as speakers and printers. In one embodiment, a digitizer 165 with input from a writing medium and associated writing medium or pen 166 is provided for digitizing handwritten input information. Although in FIG. 1 shows a direct connection between the digital input 165 from the writing medium and the serial port interface 106, in practice, the digital input 165 from the writing medium can be connected directly to the processor 110 via a parallel port or other interface and the system bus 130 in any way including wireless. Also, the writing means 166 may have a camera and a transceiver for wirelessly transmitting video information captured by the camera to an interface communicating with the bus 130. Further, in addition to the camera or instead, the writing means may have other touch systems for detecting electronic ink strokes including accelerometers, magnetometers and gyroscopes.

In addition, although the digital converter 165 is shown separate from the monitor 107, the usable input area of the digital converter 165 may coincide with the display area of the monitor 107. Moreover, the digital converter 165 may be integrated with the monitor 107 or may exist as a separate device, superimposed on the monitor 107 or otherwise attached to it.

The computer 100 may operate in a network environment using logical connections with one or more remote computers, for example, a remote computer 109. The remote computer 109 may be a server, a router, a network personal computer (PC, PC), a peer device, or another node on a shared network and typically contains many or all of the elements described above with respect to computer 100, although in FIG. 1 shows only the storage device 111. The logical connections shown in FIG. 1 include a local area network (LAN) 112 and a wide area network (WAN) 113. Such network environments are often used in offices, enterprise-wide networks, intranets, and the Internet.

When used in a LAN network environment, the computer 100 is connected to the local area network 112 via a network interface or adapter 114. When used in a WAN network environment, the personal computer 100 typically includes a modem 115 or other means for establishing communication over a wide area network 113, such as the Internet. The modem 115, which may be internal or external, is connected to the system bus 130 via the serial port interface 106. In a networked environment, program modules shown as being related to the personal computer 100, or parts thereof, may be stored in a remote storage device. In addition, the system may have wired and / or wireless capabilities. For example, network interface 114 may include Bluetooth, SWLan, and / or IEEE 802.11 class connectivity. It is obvious that other wireless communication protocols can be used in conjunction with these protocols or instead of these protocols.

It should be borne in mind that the network connections shown are examples and other means of establishing a communication link between computers can be used. It is assumed that any of various widely known protocols exists, such as TCP / IP (Transmission Control Protocol / Internet Protocol), Ethernet, FTP, HTTP (Hypertext Transfer Protocol), etc., and the system can operate in a client-server configuration that allows the user to request web pages from a web server. To display and manipulate data on web pages, any of various common browsers can be used.

FIG. 2 depicts an illustrative embodiment of a Tablet Personal Computer (Tablet PC) 201 that can be used in accordance with various aspects of the present invention. Any or all of the characteristics, subsystems, and functions of the system of FIG. 1 may be included in the computer of FIG. 2. The tablet personal computer 201 includes a large display surface 202, for example, a digitizing flat panel display, preferably a liquid crystal display (LCD) screen that displays a plurality of windows 203. Using the pen 204, the user can select, select and / or record on digitizing imaging surface 202. Examples of suitable digitizing imaging surfaces include electromagnetic digital input transducers supplied by a computer iyami Mutoh or Wacom. Other types of digital converters with input from a writing medium, such as optical digital converters, can also be used. The tablet personal computer 201 interprets the movements performed using the pen 204 to manipulate data, enter text, create drawings, and / or execute conventional computer applications such as spreadsheets, word processing programs, and the like.

Pen 204 may be equipped with one or more buttons or other devices that expand its capabilities in the field of choice. In one embodiment, the pen 203 could be implemented as a “pencil” or “fountain pen”, in which one end represents the writing part and the other end represents the “erasing” end and which, when moving along the display, marks the parts of the displayed image to be erased . Other types of input devices, such as a mouse, trackball, etc., could also be used. In addition, the user's own finger could be a stylus 204 and used to select or indicate portions of the displayed image on a touchscreen or proximity sensitive display. Therefore, the term “user input device” as used herein is intended to be broadly understood and includes many varieties of well-known input devices, such as pen 204. Region 205 depicts a feedback area or contact area, allowing the user to determine where the pen is when touching the display surface 202.

In various embodiments, the system provides an ink platform, which is a set of COM services (server processes that perform some system function) COM (component object models) that the application can use to fix, manipulate, and save ink. One service allows an application to read and write ink using the described ink representations. The ink platform may also include a markup language, including a language such as Extensible Markup Language (XML). Further, as another implementation, the system can use a distributed model of DCOM component objects. Additional implementations may be used, including the Win32 programming model and the .Net programming model provided by Microsoft Corporation.

Organizing Objects

FIG. 3A and 3B depict various ways of arranging elements in an interface. In FIG. 3A, the window 301 includes elements 302 and 303. Here, element 302 has an active state, therefore, it is located in front of element 303. In FIG. 3B content is organized as a tree. Here, the root node (referred to as the “root”) 304 is the node on which all other nodes of the tree are based. The child nodes 305 and 306 are located on a tree growing from the root node 304. Their relative position in relation to each other determines how they will be reproduced: on top or under each other. Axis 307 on the left side of FIG. 3B illustrates the "z-order" of the various nodes in this exemplary tree.

FIG. 4 shows an example of how ink can be reproduced in a system having a z-ordered (or depth-ordered) ordering structure. Here, window 401 is shown with content. Content includes a content element 402 that is reproduced at position 403 and a content element 404 that is reproduced at position 405. After the previous content elements have been reproduced, ink 406 can be reproduced at position 407 on the uppermost content element (here 404 ) Ink 406 may or may not be associated with the topmost content item. For example, a user may work with letterhead 404, which accepts ink-input information as a content element 406. Here, letterhead 404 can be reproduced before ink is applied to it.

In an alternative approach, ink can be placed under other elements. For example, ink can be reproduced, and then elements are reproduced from above. Ink reproduction may alternate with the reproduction of ink.

Constructors, Properties, Methods, and Object Events

In order to control the order of distribution of content across layers, an object designed to solve this problem can be used. For simplicity, in this description, an object that can solve this problem with regard to ink is called an “ink canvas” object (since, in functional terms, it is similar to the way an artist puts layers of paint on a physical canvas). In one example, an ink canvas may be an element. In another example, the ink canvas may be an object (where all elements are objects, but not all objects are elements). For simplicity, the ink canvas is referred to herein as an object. The ink canvas object is shown in FIG. 5-7 with various constructors, properties, methods and events. It is obvious that various constructors, properties, methods, and events are shown for illustrative purposes only. Some, all or additional constructors, properties, methods and events may be present in various forms in other examples of the ink canvas, and this is not beyond the scope of the invention. An ink canvas object may contain zero or more elements or objects. The ink canvas object can reproduce ink for its constituent elements or objects, or these elements or objects can reproduce ink themselves.

The following figures and their description illustrate various examples of methods, properties, events, and constructors. It is quite obvious that in some cases, various components can be hidden from external access and, nevertheless, accessible through another mechanism. For example, some method can be used to return an ink object, selected ink strokes, ink stream, or byte array. This method can be used instead of accessing a property that may contain this information. Methods can be used to access properties or set properties, to respond to events and to trigger events. Properties can describe the state of methods and / or events. Events can indicate when properties are set or when methods are executed. Other examples follow from the above, but are not given here.

In an ink canvas object, various aspects may or may not occur. First, the ink canvas object may contain elements and / or objects. Elements and objects can be reproduced by the “ink canvas” object or can reproduce themselves. The Ink Canvas object can be contained in a tree structure. The ink canvas object can be created in a markup language (for example, in the HTML hypertext markup language, the XML extended markup language and / or the XAML application expanded markup language, etc.). An ink canvas object may include recognition capabilities (including handwriting recognition, shape recognition, pattern recognition, comment recognition, etc.). An ink canvas object may include extensible editing functionality. Finally, the ink canvas object can include a variety of application programming interfaces that allow the developer to create application programs that interact with the ink canvas object. In the ink canvas object, one or more of these aspects may be present.

FIG. 5 depicts the constructors and properties associated with the ink canvas object. The Ink Canvas object is shown at 501. Two constructors are shown at 502 and 503. Constructor 502 is an open designer with default input and playback features enabled. Constructor 503 creates a new instance of the "canvas for ink" object with a link to a specific parent.

FIG. 5 also depicts properties 504-518:

Property 504, "Custom Configurable Editing Mode," allows you to set the individually configurable editing mode.

The Default Image Attributes property 505 determines the attributes for the newly entered strokes.

Property 506 "Edit Mode" sets the current editing mode.

Property 507, “Eraser Size”, sets the size of the eraser when the erase mode is activated.

Property 528 “Shape of the Eraser” sets the shape (circle, oval, square, rectangle, etc.) of the eraser when the erase mode is activated.

The Ink property 508 allows access to the ink contained in the Ink Canvas object.

The Ink Trim property 509 determines when ink will be truncated to the size of the displayed area of the ink canvas.

The “Inverted Editing Mode” property 510 indicates which editing mode (or other language or state) will be active when the user’s writing tool is turned upside down. It should be borne in mind that additional writing tools can be used. Accordingly, additional properties 510 may be used to determine other modes that will be associated with other ends of the writing means.

The Pen Inverted property 511 indicates whether the pen is currently inverted.

Property 512 "Move Allowed" enables and disables the movement of the created ink.

Property 513 "Resizing Allowed" enables and disables resizing of the created ink.

Property 514 "Turn Enabled" enables and disables the rotation of the created ink.

Property 515 “Access to Selected Elements” allows access to newly selected elements that are descendants of the current canvas 501 for ink.

Property 516 “Access to Selected Strokes” allows access to the currently selected strokes that are associated with the current canvas 501 for ink.

Property 517 “Use of Individually Configurable Cursor” indicates that the developer is using a custom mouse cursor and that the current cursor should be saved.

The User Editing property 518 indicates that the ink canvas 501 is currently inking ink.

Property 527 "Selected groups" shows which stroke or ink objects are grouped for groupings or operations recognized by the parser.

In addition to the above properties, the ink canvas object 501 may or may not include one or more ink recognition properties.

Property 519 “Recognized Ink” indicates that the ink is recognized. Recognition may or may not be associated with the currently selected or selected before that stroke or strokes.

The Detected Word property 520 indicates which stroke set or ink object was recognized as a word.

The Detected Image property 521 shows which stroke set or ink object was recognized as an image.

The Detected String property 522 shows which stroke set or ink object is recognized as a string.

Property 523 "Found Paragraph" shows which set of strokes or an ink object is recognized as a paragraph.

The Detected Shape property 524 indicates which set of strokes or ink object is recognized as a shape (and / or shape type).

The Detected Comment property 525 shows which stroke set or ink object is recognized as a comment.

Property 526 "Transformed Text" includes the text resulting from the recognition of ink. Alternatively, it may indicate that in order to reproduce one or more strokes of ink or ink objects, transformed text should be used instead of the visual form of the ink.

It is obvious that the above properties are provided for illustrative purposes only. In addition to, or instead of, the above properties with the Ink Canvas object, other properties may be used.

FIG. 6 depicts various techniques associated with the ink canvas object 601:

Method 602 “Get Cancel Image Attributes By Default” gets settings for a particular pen that override the default attributes. For example, a user may have one pen for editing and one for erasing. This method allows the user to control the default mode for a particular pen.

Method 603, “With the Inverted Edit Mode Changed,” raises an event that the inverted mode has changed.

Method 604, "When Changing the Inverted Edit Mode" raises an event that the Inverted Mode changes.

Method 605 “When Changing the Inverted Position of the Pen” triggers an event when the pen is used to change the inverted editing mode.

Method 606, “In Modified Individually Configurable Editing Mode”, raises an event indicating that the individually configurable editing mode has changed.

Method 607, "When Changing an Individual Configurable Editing Mode" raises an event indicating that the individually configurable editing mode is changing.

Method 608, “When the Editing Mode is Changed,” raises an event indicating that the editing mode has changed.

Method 609 "When Changing the Editing Mode" raises an event indicating that the editing mode is changing.

Method 610, “Upon Entering the Ink Canvas Decorating Element”, triggers an event when an entry is made to the ink graphic decorating element (a graphic placeholder that may or may not be shown when the user selects ink).

Method 611, “When Exiting an Ink Canvas Decorating Element,” triggers an event when the ink decorating element is exited.

The Erased Ink method 612 raises an event when the ink is erased.

Method 613 "Ink Erasing" causes an event when the ink is in the process of erasing.

Method 614 “With the Entered Bar” raises the event when the strokes are entered.

Method 615 “When Rotating a Selected Fragment” causes an event when the selected fragment is in the process of rotation.

Method 616 “With Rotated Selected Fragment” raises an event when the selected fragment is rotated.

Method 617, “When Changing the Sizes of a Selected Fragment”, raises an event when the selected fragment is in the process of resizing.

Method 618 “With Changed Dimensions of a Selected Fragment” changes an event when the dimensions of the selected fragment are changed.

Method 619 “When Moving a Selected Fragment” raises an event when the selected fragment is in the process of moving.

Method 620 "When Moving Selected Fragment" causes an event when the selected fragment is moved.

Method 621 "When Changing a Selected Fragment" raises an event when the selected fragment is in the process of changing.

Method 622, "When the Selected Fragment is Changed" raises an event when the selected fragment is changed.

Method 623 “Setting the Cancellation of Default Image Attributes” overrides the default image attributes associated with the selected strokes.

In addition to the above methods, the ink canvas object 601 may or may not include one or more ink recognition methods.

Method 624 "Ink Recognition" causes one or more events when ink is recognized.

It is obvious that the above methods are provided for illustrative purposes only. In addition to, or instead of, the above methods with the ink canvas object, other methods may be used.

FIG. 7 depicts various events that may be associated with the ink canvas object 701:

Event 702, “Custom Configurable Editing Mode Changed”, occurs when the individually configurable editing mode has changed.

Event 703, "Custom Configurable Editing Mode Changes" occurs when the individually configurable editing mode is ready to change.

Event 704 “Editing Mode Changed” occurs when the editing mode has changed.

Event 705, “Editing Mode Changes,” occurs when the editing mode is ready to change.

Event 706 “Entrance to the Ink Canvas Decorating Element” occurs when an entrance to the ink canvas decorating element has taken place.

Event 707 “Exit from the Ink Canvas Decorating Element” occurs when there is an exit from the ink canvas decorating element.

The Erased Ink event 708 occurs when the ink has been erased.

The Erase Ink event 709 occurs when the ink is ready to be erased.

Event 710 “Inverted Editing Mode Changed” occurs when the editing mode associated with the inverted writing medium is changed.

Event 711 “Inverted Editing Mode Changes” occurs when the editing mode associated with the inverted writing medium is ready to change.

Event 712 “Inverted Pen Position Changes” occurs when the user flips the pen.

Event 713, “Inverted Pen Position Changed,” occurs when the user inverts the pen.

Event 714 “Selected Fragment Changed” occurs when the selected fragment has changed.

Event 715 “Selected Fragment Changes” occurs when the selected fragment is ready to change.

Event 716 “Selected Fragment Moved” occurs when the selected fragment has moved.

Event 717 “Selected Fragment Moves” occurs when the selected fragment is ready to move.

Event 718 “Selected Fragment Resized” occurs when the selected fragment has resized.

Event 719 “Selected Fragment Resizes” occurs when the selected fragment is ready to resize.

Event 720 “Selected Fragment Rotated” occurs when the selected fragment is rotated.

Event 721 “Selected Fragment Rotates” occurs when the selected fragment is ready to rotate.

Event 722 “Barcode entered” occurs when the barcode has been entered.

In addition to the above events, the ink canvas object 701 may or may not include ink recognition events.

Event 723 "Ink Recognized" takes place when the ink was recognized.

Event 724 “Word Discovered” occurs when a word is detected.

Event “Image Detected” 725 occurs when an ink-filled image has been detected.

Event 726 “Detected String” occurs when an ink-written string was detected.

Event 727 “Paragraph Discovered" occurs when an inked paragraph is detected.

Event “Form Detected” event 728 occurs when an ink-filled form has been detected.

Event 729 “Comment Detected” occurs when an ink comment is detected.

Event 730 "Ink Converted to Text" occurs when ink has been converted to text.

It is obvious that the above properties are provided for illustrative purposes only. In addition to or instead of the above events with the “ink canvas” object, other events can be used.

Relations

FIG. 8 depicts various illustrative relationships between an ink canvas object, ink editing means, and various modes. The ink canvas object 801 includes one or more sub-elements 803. The “ink canvas” object 801 is connected to the ink editing tool 802 and processes input events (changing focus, keyboard input, input from a pen, etc.). The ink editing tool 802 organizes, among other things, the activation of a component editing mode 804 (including, but not limited to, ink-dependent modes and ink-independent modes). Ink dependent modes are compiled into an ink editing mode 805. Ink editing mode 805 provides basic heuristic activation / deactivation procedures (deactivation when lifting the writing medium, deactivation when changing the properties of the editing mode in the "ink canvas" object, etc.). Ink editing modes 805 include ink fixing modes 806, highlighting modes 807 (including contouring) and additional modes 808. Ink-independent modes include a rubber thread mode 809, a movement mode 810, a resizing mode 811, and additional modes 812.

The ink editing tool 802 controls the various modes 806-812, as shown by the arrows directed from the ink editing tool 802 to each of the modes 806-812. The various modes 806-812 may be grouped according to their relative function. For example, the creation or selection of a subset of the content in sub-element 803 can be accomplished using various selection modes, including, but not limited to, the selection mode 807 of the contouring method and the selection mode of the rubber thread 809. The highlighted content in sub-element 803 can also be modified and / or manipulated by various modes, for example, the move mode 810 and the resize mode 811 (among other modes).

Returning to the “ink canvas” object 801, it should be noted that it can be used without any descendants, which allows you to have an area where the user can draw. In addition, the ink canvas object 801 can be used on top of any element or object or control, since the ink canvas object 801 can be inclusive with respect to any other type of element. This allows developers to easily comment on anything and have any background for the ink image. It is obvious that in accordance with aspects of the present invention, ink can be reproduced at various levels (interspersed with elements, above or below elements).

An example of program code for accessing the “ink canvas” object can be as follows:

<InkCanvas>

<TextPanel FontSize = "12" FontFamily = "Arial">

XAML ink will look

<TextPanel FontWeight = "Bold"> really </TextPanel>

great!

</TextPanel>

</InkCanvas>

Because Ink Canvas can be inclusive of any other type of element, other types of panels are not required to have the ability to draw ink. The following is another example of a piece of program code that allows you to establish a connection between the ink canvas and the current panel (on which ink will be displayed):

<InkCanvas>

<DockPanel Background = "white">

<FlowPanel Background = "# 669999" Width = "100" Height = "75"

Dock = "Right">

<Text> Right </Text>

</FlowPanel>

<FlowPanel Background = "# 669966" Width = "100"

Height = "75" Dock = "Left">

<Text> Left </Text>

</FlowPanel>

</DockPanel>

</InkCanvas>

class System.Windows.Controls.InkCanvas: Canvas {

The following is an ink object associated with the element itself. It is available as a dynamic property or, for convenience, as an .Net property:

public static readonly DynamicProperty InkProperty =

PropertyManager.RegisterProperty ("Ink", ...);

public System.Windows.Ink.Ink Ink.

The following is an example of code in an extensible XAML application markup language that contains an ink object that uses an ink canvas object:

<InkCanvas

Ink = "base64sdfsdfdsf ..."

Factoid = "Default"

TopRecognitionResult = "To get her"

<! - connection of the event handler,

associated with a gesture ->

Gesture = "HandleGesture"

Stroke = "HandleStroke".

<! - set the default ink properties for the mode

input ->

DefaultDrawingAttributes.FitToCurve = true>

<Image Left = "200" Top = "75" Source = "image.png"

Alt = "alternate text" />

<def: Code>

<! [CDATA [

void OnStroke (Element sender, ClickEventArgs e)

{

// Some code

}

void OnGesture (Element sender, ClickEventArgs e)

{

// Some code

}

]]>

</ def: Code>

"To get her"

</InkCahvas>

The various sides of the ink canvas object may include one or more of the following characteristics:

Any item can be a descendant of the ink canvas in the XAML extensible markup language. Descendants can have absolute positioning.

Any dynamic event can have code attached by setting an XML attribute (extensible markup language).

Any dynamic property can be initialized by setting an XML attribute.

Ink, which may or may not be a dynamic property, can be converted to base64 ISF (ink preservation format) in serial form in an XML attribute called "ink."

Truncation

FIG. 9A, 9B, and 9C show a visual attribute of an ink canvas object. Ink displayed on an ink canvas may or may not be truncated. In one example, the size of the object "canvas for ink" can be automatically resized in order to prevent truncation of any content or only content in the form of ink. Alternatively, the ink canvas may be configured to size and truncate the content, or only ink content. Truncation can be determined by the truncation property or a combination of truncation properties (for example, the truncation property of the general content and the specific truncation property for the ink). In FIG. 9A, in area 902, the full content of the ink lettering 901 is shown. In FIG. 9B shows the entire ink label. The first part of the ink lettering is shown in area 904. The remaining part 905 of the ink lettering is outside the region 904. Here, ink truncation is absent. In FIG. 9C, ink 906 is truncated to the size of region 907. Here, truncation is included.

Aspects of the present invention have been described as an illustrative embodiment thereof. When viewing this description, those skilled in the art will come to mind also numerous other embodiments, modifications, and variations within the scope and spirit of the appended claims.

Claims (18)

1. Computer-implemented electronic ink reproducing system, comprising
an object for receiving electronic ink and
one or more objects to be reproduced referenced by the object for receiving electronic ink, the object for receiving electronic ink controls the display of these objects,
however, at least one of these objects to be reproduced is not capable of working with electronic ink alone, but is capable of working with electronic ink when included in an object for receiving electronic ink. 2. The system according to claim 1, in which the object for receiving electronic ink is the object "canvas for electronic ink." 3. The system according to claim 1, in which the object for receiving electronic ink reproduces the aforementioned one or more objects, and then reproduces any electronic ink on top of the last reproduced object. 4. The system according to claim 1, in which an object for receiving electronic ink interleaves a layer-by-layer arrangement of electronic ink and said one or more objects. 5. The system according to claim 1, in which the object for receiving electronic ink reproduces electronic ink, and then reproduces the aforementioned one or more objects on top of the reproduced electronic ink. 6. The system according to claim 1, in which the object for receiving electronic ink includes one or more modes. 7. The system according to claim 1, in which the object for receiving electronic ink includes at least one method. 8. The system according to claim 1, in which the object for receiving electronic ink includes at least one property. 9. The system according to claim 1, in which the object for receiving electronic ink is designed to provide at least one event. 10. A method for reproducing electronic ink, comprising the steps of:
include one or more reproducible objects in the composition of the object, which provides the functionality of electronic ink,
reproduce the mentioned one or more objects,
reproduce electronic ink on top of said one or more objects; and
by means of said object cause an event related to said electronic ink functionality. 11. The method of claim 10, further comprising the step of changing the property of said object. 12. The method according to claim 10, further comprising the step of executing the method associated with said object. 13. A computer-readable storage medium with a computer-executable program for reproducing electronic ink stored on it, said program comprising the following steps:
the inclusion of one or more objects to be reproduced in the composition of the object, which provides the functionality of electronic ink,
reproduction of said one or more objects,
reproducing electronic ink on top of said one or more objects; and
a call by the said object of an event related to said electronic ink functionality. 14. The computer-readable storage medium of claim 13, wherein said program further comprises the following step:
changing the property of the mentioned object. 15. The computer-readable storage medium of claim 13, wherein said program further comprises the following step:
execution of a method associated with said object. 16. A computer system for reproducing electronic ink, comprising:
means for including one or more objects to be reproduced in the composition of the object, which provides the functionality of electronic ink,
means for reproducing said one or more objects,
means for reproducing electronic ink on top of said one or more objects; and
means for triggering by said object an event associated with said electronic ink functionality. 17. The computer system of claim 16, further comprising means for changing a property of said object. 18. The computer system of claim 16, further comprising means for executing a method associated with said object.

Images