AU2008100592A4 - Document Display (Screen Reading) System and Method - Google Patents

Description

Australia Patents Act 1990 COMPLETE SPECIFICATION INNOVATION PATENT Invention title: "Document Display (Screen Reading) System and Method" The following statement is a complete description of the invention, including the best method of performing it known to me.

00 O DOCUMENT DISPLAY (SCREEN READING) SYSTEM AND METHOD CThis invention relates to a system and method for reformatting Sdocuments for display on varying display types.

In particular; it relates to a presentation system that performs rendering and reformatting of documents including imaging and navigation.

0 BACKGROUND TO THE INVENTION 0o From the very earliest days of computing, programmers have been forced to target applications to particular screen sizes and resolutions. Even the flexibility of the Web's HTML imposes these kinds of limits, with some pages looking good on some resolutions while having a poor appearance on others.

This situation was awkward yet manageable, while most of the world's information displays were confined to fixed computer monitors and televisions, most with industry-standard sizes and.

resolutions. But now, with the introduction of lightweight, low power consumption displays with wide size variation, such as liquid crystal displays and plasma units, the former display constraints are being removed. Nowadays programmers and content creators cannot make assumptions about the devices that will display the delivered information..To do so introduces inherent weaknesses in the way their content can be accessed and linked with other information.

Generally speaking, the IT industry has reacted to this challenge using traditional notions of 'device independence'. The seminal model of this approach to content presentation.is Adobe's Page Description Format (PDF). This digital file type uses similar formatting commands across a multitude of devices, thus ensuring the correct display of documents on whatever system is used to render the output to the user. This ensures the information looks the OO same whatever resolution it displays on, with detail being degraded 0 oon less sophisticated rendering devices. However this detail is not lost if viewed on a low resolution monitor, as the user can often zoomrn ;in if desired.

Although this method preserves the original fidelity of the information's look and feel, PDF files are static, typically being Srendered to a pre-determined paper size. The end-user's device ist expected to navigate around this. This can be difficult, particularly if 0 o the original document was rendered to a size much larger than the o00 10 end-user's device, such as trying to look at a Foolscap page on a cell 0 o phone sized display. Intrinsic to this method of ihformation distribution is the expense of converting documents from their original form to the description language of PDF. Such conversions can limit a document's reuse, with recipients experiencing difficulty re-editing and thus reusing the information in a similar form in different contexts.

The problem is exacerbated in Web pages where formatting is mixed up with the substance of content. It is not always easy to determine whether content is a bitmap picture, a textural heading bitmap, a navigational token bitmap or all or only some of the above.

It is also difficult to determine whether a table is a logical unit of information or a layout separator. The ambiguity of display formats often compromises the ability of display devices to render the information in a way that suits the end-user environment. So file formats such as PDF and HTML often result in compromised viewing situations when rendered by devices not originally targeted by a document creator. This is becoming increasingly unmanageable in today's world of device proliferation, where advances in battery, communications and flat display technology are multiplying end user display options.

0 To overcome these deficiencies, many in the IT industry 0propose a differentkind of device-independent format. Using standards such as XML, information presentations as diverse as text, ;pictures and.program user interfaces are being described in a manner whereby the substance of the content is stored separately from its layout or display formatting instructions. This provides the display device with the opportunity to make value judgments on how N content should be displayed, both in the context of its.use and the display environment in which it is to be rendered.

0 10 While this may be a great step forward in solving technical issues it results in content creators, publishers and developers losing control of how information is to be displayed. This is unacceptable because the look and feel of documents and programs is an essential ingredient for product differentiation. Moreover, content is often deliberately presented by its creator in such a way as to give more or less significance to its various parts. So altering the look and feel of content for convenient display might also change its intended meaning.

Of even greater concern is the arbitrary degradation of information that each end-user device may impose when rendering information on low resolution systems. The look and feel of the document, including the layout and navigation, is sometimes completely different from what is rendered on higher resolution displays. This forces users to learn a different way of using an application or document on each class of device displaying the information.

So while abstracting content away from its format is technically possible, in practice formatting and layout provides a context which gives meaning to content. This has been addressed in part by employing templates, which when applied alter XML documents to be more suited to their intended display environments.

This offers some improvem6nt compared to static formats such as 00 PDF or HTML. Individual document conversion and hard coding can be abolished, being handled once for each device and each document class or application type using a complex matrix of templates.

(N However using device and document templates with XML cannot eliminate all of the rendering disadvantages due to multiple display sizes. The use of templates assumes developers and content o creators can know in advance all the device types that will try to render their information. And having no control over these devices 00 0 makes content degradation and user interface variation inevitable.

0 This is caused by differences in capabilities between devices, as mandated by their size, capacity of their power source and indented use, creating learning curves to effectively present the same content across multiple device types. Altering XML documents with templates this way may also compromise their reusability when passed to other rendering engines or editors on more advanced systems.

Another problem that is not addressed by either flexible XML or fixed description formats is the formatting issues associated with document readability over different viewing distances. For example, a billboard sized screen may have four million pixels. A hand-held device may have the same. One user's eyes are 30 centimeters away; another's are 30 meters away. But even when two users look at the same device from the same distance, different magnifications of the content may be appropriate, depending on the quality of their eyesight. This is a key usability flaw in all device-centric formatting regimes, be they fixed or flexible.

The problems above are further compounded by modern endusers beingcconnected through networks such as the internet. In times past, most users accessed informatioh from one or at the most two devices their desktop or notebook PC. But in a world of inter- OO connected devices, users may soon expect to be able to read documents located on their PC or business servers on any handheld Ndevice via a wireless link, for example a mobile phone. Therefore ;these problems are being encountered by users sharing documents, as well as where a reader and author are the same person.

The range of possible display sizes information must be accessible through is further being proliferated through portal O technology. Portals assemble information on behalf of end-users, 0 typically presenting it on Web pages made up of a series of 'infooo 10 boxes'. Even info boxes displaying the same information may vary in 0 o size, depending on how important each end-user considers the' contained information to be. Therefore the arbitrary nature of portal information viewing areas means maintaining a consistent look and feel to content is becoming even harder to achieve.

What is lacking, is a presentation system which strikes a balance between the competing interests-of end-user preferences, document owner/creator desires, rendering device constraints and network transmission considerations. This must be achieved in such a way asto preserve the content's look and feel, navigability, usability and reuse, with high fidelity across a multitude of devices.

Prior patent documents have been identified that relate to the.

reformatting of documents. Reference may be had to United States Patent Application number 2001-0011364, in the name of Stroub.

-Stroub reformats documents into columns that have a fixed number of characters per line. The number of columns is selected to suit a given screen. The approach of Stroub is useful for simple text but is of limited value for more complex content.

Another approach is described in US 6175845 in the name of IBM Corp. The IBM approach is to implement navigation between parts of a document by inferring the significance of content to users.

Not having a unique multi-user, multi resolution, multi-magnification 0 cache, the system reformats content each time it is requested by the user or when.the user resizes the viewing area. However contentbased analysis and per-view reformatting on demand are particularly "processor intensive mechanisms for the display of content. As a Ci 5 result, this method is impractical for most applications.

In US 5818446 IBM Corp also describes a system for 01 changing user interfaces, principally document navigation, again o based on analyzing the information being displayed. Using display software to change the user interface according to certain criteria 0 10 which is compared against the characteristics of the content on hand 0 Ci has some.glaring limitations. The method doesn't deal with critical factors influencing usability such as display area size and requires end-users to learn multiple interfaces to view content on the same device.

The prior art does not describe a system or method which reformats documents for display on varying display types while minimizing repeat processing and optimizing display for optional transmission over a computer network.

OBJECT OF THE INVENTION It is an object of the present invention to provide a system and method for reformatting documents for display on varying display types.

It is a further object to minimize repeat processing and optimize display for optional transmission over a computer network.

Further objects will be evident from the following description.

I

7 00 DISCLOSURE. OF THE INVENTION 0 In one forri, although it need not be the only or indeed the g broadest form, the invention resides in a document presentation c, system comprising: C\ 5 a rendering unit that analyses user or publisher preferences to determine content layout and navigation; Sa formatting unit that resizes and rearranges content according to the l n content layout and navigation determined by the rendering unit; 0 a display unit that presents content to a user and responds to user interaction; and 0 a cache unit that stores reformatted content for display by the display unit.

The rendering unit may further establish device characteristics such as the presence or absence of external buttons, joysticks or speech recognition, altering the on-screen navigational features accordingly. Alternately, for simplicity or to maximize the content viewing area, devices relying on such external navigation may mandate that no on-screen navigation featutes be made available to end-users, except perhaps within the content itself, such as hyperlinks. In this case, the rendering unit might simply provide the formatting unit with the boundaries into which content is to be reformatted, The formatting unit may further perform content manipulation including one or more of blank space reduction, blank space insertion, text condensing, margin adjustment, and tab stop adjustment.

.The display unit may also incorporate processes for detecting system misuse, such as attempted unauthorized access and have functions to monitor the efficiency of reformatting and content display. These may offer end-users various alternatives should an error occur, including using information stored in a management or 0 stakeholder subsystem (such as that described in our co-pending N international application titled "A System for.Secure Distribution of Electronic Content and Collection of Fees) to help appropriately restore the user's display. Additionally, the display is also responsive N 5 to pre-defined 'copy-zones', whereby users can be otherwise .prohibited from selecting and copying content to their clipboard.

ON .In a further form, the invention resides in a method of .reformatting content for display on a display device including the steps of: 00 retrieving content from a repository; 1N determining characteristics of a display device that is to display the content, including the area (such as the number and dimensions of pixels) available for display of the content and any associated control structures on the display; rendering content areas and any associated control structures to suit the display characteristics; and reformatting content for display of the content in the available content areas, said reformatting including resizing and rearranging.

Suitably the reformatting includes: identifying wrapping graphic elements and repositioning said graphic elements to avoid wrapping; identifying section breaks and inserting blank space to push content to a next column; and identifying bleeding graphic elements and repositioning said graphic elements to avoid bleeding.

The invention may have particular application to the presentation subsystem described in our co-pending application titled, "A System for Secure Distribution of Electronic Content and Collection of Fees", which is incorporated herein by reference.

00oo

O

.BRIEF DESCRIPTION OF THE DRAWINGS S-To assist in understanding the invention, preferred INO embodiments will be described with reference to the following figures in Which: C 5 'FIG 1 shows an overview of a presentation system; n FIG 2 is a flowchart showing pagination steps; FIG 3 is a flowchart of the graphics wrapping process from FIG 2; 00 0 FIG 4 is a flowchart of the graphics bleeding process from FIG 2; c NI FIG 5 displays a document formatted for a PDA display; FIG 6 shows the same document as FIG 6 reformatted for a television monitor, FIG 7 shows the same document as FIG 6 reformatted for a mobile phone display; FIG 8 shows how one of the invention's a display units interacts with one of its Cache units; and FIG 9 shows the elements of a reformatted document and rendering unit components.

DETAILED DESCRIPTION OF THE DRAWINGS Referring to FIG 1, there is shown a schematic of a presentation system in an application context. Content is provided to the system from, for example, a stakeholder subsystem (like that in our co-pending application mentioned above) that allows preparation of composite documents containing one or more of text, images, applets, scripts and other material. The stakeholder subsystem wi!! normally also store a master copy of the document.

The composite document is passed to the presentation system that consists.of a number of units including a rendering unit, formatting unit, cache and display unit. The presentation system presents a

I

00 reformatted version of the document to an end user for local

O

display or to a display server connected over a computer network to the end-user's display-device via remote display protocols.

-Communication with other subsystems may be effected by XML or other messaging, as described in our co-pending application.

As depicted in FIG 1, the cdmposite-document is converted to a basic frame structure based on information obtained about the users o display. Navigation and layout elements, such as arrows, page and .column links, etc. are added within the available display-space. The 00 rendered document is then reformatted to suit the display by- 0rearranging text, graphics, and other elements to satisfy viewing preferences defined by the originator and/or the user, taking into account the characteristics of the display device.

The document is stored in a cache for future use in a location which may also identify the display characteristics of the stored document. This leads to a novel document retrieval process as described in greater detail below. A copy of the reformatted document retrieved from cache is displayed to the user.

The Presentation system operates in four stages. It consists of four units, for display, cache, formatting and rendering of documents: The Display Unit is responsible for maintaining the end user interaction and imaging documents for local display or network transmission using remote display protocols. The display unit also incorporates a number of features to detect misuse of the system.

To help facilitate the previously mentioned portal 'info-box' scenario, the display unit may suitably occupy the entire area of the end-user's screen or may be embedded within a portion of a document or application user interface. The display unit itself may also divide its viewing area into sections between a number of screen-paginated, fixed sized or traditional scrolling content. And it O0 may also allow end-users to adjust the dimensions of such content 0 oareas, or do so automatically, providing more display area for less scrolling of bleeding content not fitting in a column.

;Z

The multi-resolution, multi-magnification document caches ID 5 feed documents to the display unit from. the cache. This minimizes the need for processing by reusing previously formatted content. If a Ci document is not.aailable in the cache to suit the combination of the ON *end-user's device, magnification or other publisher or end user 0 preferences, an attempt may be made (by either the cache or display o00 10 unit) to find an appropriately reformatted document in another cache.

It o If one cannot be found, the formatting and rendering units are o activated to provide one.

The formatting units minimize the need for end users to scroll though documents by dividing them into smaller more manageable sections. These reformatted documents may or may not fit completely on the screen, depending on how the content has been marked up, the device size, how the content'or it's images are being viewed, and publisher and end-user preferences. The reformatting process resizes and moves content to an appropriate size, as well as 00 S 10 employing various 'blank space' reduction and insertion techniques.

oThese include condensing text, reducing tab stops, adjusting margins etc. The basic layout of the document (such as the number of columns) in which this is done is predetermined by a rendering unit.

The rendering units examine the dimensions of the available viewing area, and analyses end-user and publisher preferences to determine a suitable document layout and navigation system. This basic layout is then used by the formatting unit to measure and manipulate content.

The rendering unit may fill the entire available display area or render in dimensions or magnifications w.hich are a near match to an end user's or publisher's preference or display device characteristics.

Likewise the display unit can also. request documents from the Cache which are a near match to its available display area or desired magnification. Using existing reformatted content nearly matching the display area-size or desired magnification can speed up document access for end users and increase computing efficiency by reducing the need for repeat reformatting. The system if required, can determine the next near match incrementally, such as providing the largest rendering dimensions fitting the display, when made available in fifty-pixel x and y axis or at 20% magnification level increments. A Cache unit may offer a display unit such an available near match if it 00 0 cannot yet fulfill the exact.request. Or end users may be given the 0 S. choice between a near match and a document exactly fitting their display device and viewing preferences. A near.match may also be s offered to an end-user for example, while a large document takes time to be reformatted nearer or in accordance with their exact specification, O Information pertaining to end-user interactions, such as document navigation, may be encrypted. This prevents unauthorized Sdisplay units or external viewers from improperly accessing content.

0 Documents may also be password protected to prevent opening by Cl unauthorized display units or viewers.

The rendering-unit and formatting unit perform a number of steps that can be best thought of as a pagination process that is shown in FIG's 1-3 and described in greater detail in the following steps: Pagination Procedure The following steps are suitably performed by the rendering unit: 1. Create a new location (such as a file-system directory) in cache with a name or identifier based on documents name, screen resolution, magnification or an indicator of the intended displayable columns and their sizes; 2. Copy document from publisher repository into newly created cache directory; 3. Check the document for publisher preferences 4. Open system's master rendering document; Use current (end-user) display settings and publisher preferences to set basic frame structure.

0 0 the following steps are performed by the formatting unit: C Open the cached document for reformatting; Z* 2. Scan for potentially hostile or problematic contributed IN code, such as embedded applications and macros; disabling where appropriate 3. Delete all hyperlinks from document for navigation ON 'encryption, replace with colored underlined text; S4. Remove empty paragraphs, adjust inter-paragraph 00 spacing; 0 10 5. Compress or expand tab stops, indentations etc, optimizing document for specified column width and magnification; 6. Optionally group graphical elements which overlap, so as to maintain their relative position with one another during the rest of this procedure 7. Reduce all graphical elements larger than a column's width or height to.fit except those marked-up as scrollable; 8. Adjust width of caption boxes; 9. Check for section break(s) on page, if so insert blank space to start content in next section in next column; Unless marked-up to allow wrapping, detect if graphical elements on screen horizontally 'wrap' next to each other, moving them down so as to appear vertically separated down the document; 11. Check for graphical elements which bleed off the bottom of the display area and: a. If element is marked-up as 'un-movable' then do nothing, or 14 00 b. if text above element is of the same attributes as the o text next to and below it, move element up the page to fit it on the screen if possible, or Move the element to the next screen page or I 5 column, inserting blank space or moving any text after the shape into the preceding column if Cl appropriate; o 12. Record (optionally encrypting) top and bottom visible 0 column bou'ndaries in relation to the current area of the 00 document being displayed (by the number of points from 0 the top of the document for example) or a reference to the document's first and last currently visible characters (see FIG 9); 13. Remove any previous blank space buffers; 14. Insert blank space 'buffer' after previously established last character or column bottom boundary position; Move document up so blank space buffer is at top of screen-column; 16. Write progress to cache location for multi-user splash screen reports; 17. Repeat steps 13 to 20 over entire document; 18. Add more blank-space to the bottom of document; 19. Break document up into more manageable sub-document chunks if necessary; 20. Suitably add icons and controls to screen areas used for navigation,. as provided by the rendering unit, according to the number of columns paginated in the document and the number of columns that will be simultaneously displayed on the screen; 00 21. Create default summary information from first paragraphs if Sit has not already been included by the content's creators; 22. Save the changes to the cached document and associated .frame set and navigation documents C 5 A certain amount of set-up is required to capture user information if maximum advantage is to be obtained from the method. The information can be captured in a new session process l n according to the following steps: New Session Process 00 1. Start session Required start-up document name and location is passed to system; 2. Display full display area splash screen, turn off user interaction; Obtain username and password if required, evaluate and grant access; 4. Lock end-user display, stopping all input; Create end-user cache if one does not already exist; 6. Load settings from any previous settings or default settings such as: a. To-Do lists b. History lists c. Magnification levels d. Number of column preferences e. Searches f. Home page location g. Contents page location 0 0 Optionally load the last used document N i. Various other settings; Va cO 0 00OO 0 oo

O

7. Create end user command structure based on available display area: j. Icon menus with words for larger screens k. Icon menus without words for smaller screens 1. No icon menus (or a reduced set) for some very simple devices such as public kiosks or miniature hand-helds, where navigation and commands might be implemented externally as buttons or joysticks on the device; 8. Open start-up document using Open Document Procedure.

Open Document Procedure 1. User clicks on hyperlink or document to be open is supplied from other procedure; 2. Obtain username and password (if required); 3. Check management system for permission to open document (if required); 4. Check if document exists in Publisher's repository; If document is not found, display error message or page; 6. Display full display area splash screen, turn off user interaction; 7. Close all currently closed documents; 8. Select navigation system according to in the following order of priority, as marked up in document or known by system from end-user input: a. Display area restrictions i. Ascertain or calculate maximum width and height to be used for columns in the display area 00 ii. Establish the range of rhagnifications permitted o in the display area b. Publisher compulsory preferences i. Scrolling only or scrolling with pagination ii. Magnification level C iii. Number of columns Sc. End-user preferences o0 i. Scrolling only or scrolling with pagination Sii. Magnification level iii. Number of columns d. Publisher's default display preferences i. Magnification level ii. Number of columns; 9. Checks if file is cached (see FIG if not, checks if document is in the process of being paginated and waits or if not, invokes Pagination Procedure; Determine filename of cached document appropriate for the above navigation system; 11. Checks if cached file is newer than published .original, if not invokes Pagination Procedure before proceeding; 12. Optionally copies document into end-user specific cache; 13. Loads document into each column; 14. Determines appropriate position of content to be displayed in each column by:' a. Programmatic control, as in the case of forward/back navigation from previous documents or b. Default first and second pages or '1% 00 o c. Bookmark position specified by user or 0 -Bookmark position specified by hyperlink; Decrypts position in document of required columns; 16. Moves scrolls) document to populate columns with required content; 17. Insert additional information in document, such as o automatic links to other content; 0 018. Load virtual sidebars with marked-up content; 0 oO o 19. Enable scroll buttons if any content exceeds on-screen column dimensions; Update history list; 21. Update to-do list; 22. Update command structure (menu) options; 23. Remove full-screen splash screen and enable user control; 24. Inform management system of successful display; Inform management system of display of monitored items on screen; 26. Start next document preloads if required.

The order of steps described may be changed or some steps may be omitted to optimize the system for particular uses. Where these processes occur in memory or behind splash screens, the terms 'visible' or 'displayed' are for explanative convenience only, referring to that part of a process which could be seen should an end-user be allowed to view it.- The command structure and navigation set-up by the rendering unit may also be linked to end-user device hardware, such as page and arrow keys or a microphone (or associated speech 00 o0 recognition engine) for voice-activated navigation, It may also be Saccessed programmatically by other third-party applications.

SAt various times during rendering, formatting or display, all or N. parts of documents may be removed from video or program memory 'made invisible' so as to speed up or otherwise optimize their manipulation by the system or end users.

O The outcome of the system and method can be seen clearly in the examples-of FIG's 5-7. A master document was produced by a 0O stakeholder subsystem to contain a graphic element and a number of text blocks. In FIG 5 the content is reformatted for display on a mobile device, such as personal digital assistant/communicator combination. The navigation elements described above are evident at the bottom and top of the display. The navigation elements include navigation. arrows as well as page or column numbers.

FIG 6 shows the same content reformatted for a television screen. It should be noted that the magnification is larger and repositioned with respect to a larger image. Similarly, in FIG 7 the same content is reformatted for display on a mobile phone-sized screen.

The presentation subsystem may be used in a commercial publishing environment in the following manner: 1. Stakeholder subsystems provide information to the interface subsystems, allowing links to the presentation subsystems to be published in Web pages; 2. An end-user requests to see a document by clicking on a link; 3. The interface subsystems forward locational information to the management subsystems, such as IP address or locational information from an end-user device; 12:0 4. A logon session is created (such as via a secure Web O page or remote display protocols or locally from the invention's own N interface) to find out who the user is in relation to the publisher, which if successful, causes the management subsystem to create a unique session number for that user's session with the presentation subsystem; The logon session forwards locational information to ^O the Management subsystem; o 6. The display unit forwards locational information to the 00 10 Management subsystems; 0.7. The display unit finds the document in the Cache unit. If the document is.not in cache, the display unit obtains the document's location from a management sub-system, allowing it to draw on the publisher's master document repository. The management subsystem evaluates the request, authorizing it according to the business models associated with the document; these business models may include invoking substitute content based on the provision of such locational information.

8. Once authorized by the management subsystem, the display unit seeks a document from the cache corresponding to the display area, user and publisher preferences; 9. If one can be found (the majority of cases), it is loaded and displayed for image transmission, if not, the rendering unit is engaged to determine an appropriate layout and navigation system and the reformatting unit then handles the content accordingly; The caching or display unit may attempt to obtain a suitable document from another's Presentation subsystem's cache, rather than initiate fresh reformatting.

11. After being loaded from the cache, the document image is displayed via remote display protocols; 0 12. The display unit accepts navigation commands from the user; 13. The display unit monitors end-user activity in relation to time or session charges as controlled by the management subsystem; The display unit monitors 'revenue content' such as advertising or any content usage patterns of interest, informing the o management subsystem of details of its exposure; 00 15. The display unit also provides account management tools and activity reports to end users; 16. The display unit also provides end-users integrated searching between sites, documents and the content within a document; 17. The display unit also provides histories of previously seen documents, favorites and 'to-do' lists of must-see documents; S18. From time to time, the caching unit may delete from itself infrequehtly used documents. Conversely, it may be.pre-loaded with previously formatted documents in anticipation of heavy use.

This may be implemented under Management system control according to the business models associated with a document.

The above scenario would not contain as many steps if the invention is used to display documents on an end-users machine to their cell phone over the Internet. Organizations running the publishing system in-house may also require fewer steps. Depending upon the implementation, the order of steps may also vary. However in all cases, the unique four-stage architecture 6f the presentation subsystems remain the same. The Cache, display, formatting and rendering units may be deployed on different machines for loadbalancing purposes.

00 It will be appreciated that the presentation subsystem, and in 00 o particular the display unit, is not limited to on-screen display./For ci -a rcl 00 example, content may be senrt directly to a commercial prnter for onie-time hard copy printing, to a sound studio for one-rie Iistenti'g.

NO or to a chinema Woa viewig.

00 00 In all the embodiments of the invention described, a 'screen' also may be Cunderstood as the display area in which a document is to be imaged, such as within a box on a Web page. Also the term 'document' may Salso refer to other content, such as video or audio associated with n document.

It will also be appreciated that the presentation system 0 optimizes documents focumen u doment image transmission and display Cover computer networks. These optimizations include: i. Suppressing screen updates during document reformatting with the judicious use of full-display area splash-screens; 2. Suppressing screen updates during document navigation using column-sized splash-screens; 3. Suppressing screen updates by reducing scrolling through pagination for available display areas. Where scrolling is required, the system mandates scrolling be done in steps rather than gradually. All this is achieved by moving content up or to the next column where possible, while still allowing individual elements to 'bleed' (a publishing term) off the base of the screen for scrolling at the same time, where size reduction or movement is Inappropriate. Oversize pictures may also be reduced and enlarged by clicking on them. Thus on a single page some content may be moved, some content may be reduced, some content will fit, while some may be allowed to bleed for scrolling. Thus text will hardly ever need to be scrolled whereas ireducible content (auto-detected or marked up as such) such as maps which are bigger than the screen will always need to be scrolled to get the full picture.

However where a long skinny strip map appears next to text, the text will be paginated to fit on the screen while the strip map is 'bled off for scrolling. (This is unique to an automated I I

OO

0 system.) Thus end users might never need to scroll to read C the main body of text and not be interested enough in the oversized material to bother scrolling (See FIG 9); 4. Suppressing screen refreshes by filtering end-user commands N 5 likely to have been caused in error, such as over-scrolling due to response time delays over the network; Suppressing screen updates by using 'direct' navigation o techniques, which avoid flicking through columnular screen 0pages to see the desired text, such as between the 'found' 0 o10 words within a document resulting from a search. This 0reduces the amount of screen refreshes before the desired portion of text is found and makes the end-user experience much quicker;- 6. Provision of direct page navigation icons, Go To Page commands and bookmarks; Provision of 'next found' and 'previous found' navigation between documents reduces having to redisplay search results documents to go to the next result; 8. Provision of 'Next' and 'Previous' screen navigation to compliment the more traditional 'forward' and 'back' navigation. This has the effect of coordinating inter-document with screen page navigation within a document, reducing the need to start viewing a document from its beginning. The fourbutton approach allows the system to automatically return users conveniently to the exact screen-page in a document where they were viewing it last. So Forward and Back buttons replay where a user has been, While Next and Previous buttons allow screen page navigation to deviate from the previously established paths; The presentation system also provides particular advantage for viewing documents in small windows, such as'those allocated by an information portal in a typical Web page containing other 93U 00 o information. In this scenario a number of deployment options are C-i possible, including: The entire presentation system can run on the end-user's I computer platform as their personal reformatting seniice. This makes sense when the information within a document has been customized for individual use, requiring reformatting on an individual basis; o 2. Being processor intensive, reformatting may be done on a o separate server, while display and caching of an individual's 00 documents remains on their machine or on a dedicated 0 -display server; 3. The display remains on the-end-user's machine, but to eliminate the same reformatting of a document many times, caching is centralized on a fileserver. To further reduce processing, if a document is not in the cache and is presently being reformatted for inclusion in the cache, further requests will use the same output without starting a duplicate reformatting process; 4. The entire system can be run on a server, displaying on enduser display areas via remote display protocols, being a convenient all-in-one implementation for smaller organizational units; The display unit can be run on separate servers to the other units within the presentation system. This allows computing resources to be allocated on the basis of need, with the faster processors within an,organization being dedicated to reformatting.

Another use of the presentation system is to browse documents in a similar manner to the way in which web pages are browsed, only with better end-user control. This can be done without the need to convert the documents to HTML, thus promoting 00 O information reusability. The presentation system provides the l following features to support this application: 1. Auto-contents page generation, allowing the flagging of documents to be placed in a to-do list, plus instant summary detail information; 2. Auto-search page generation, listing results in the directory hierarchies in which they were found, thus preserving their o context in relation to other documents and topics. Such Ssearches can be added or subtracted to each other, as Well as o 10 having the to-do and summary features contents pages.

SSearches can be preserved for later viewing or updating; 3. Automatic document usage tracking, allowing administrators to know exactly which documents were viewed by whom and for how long. This is able to use standard network logon information and standard documents, eliminating the need for running a separate management system or membership services..

The presentation system can also be deployed in an ASP scenario. In this scenario, end-users send their documents to a service provider, to be custom formatted by the system to an appropriate screen-size and magnification. Typically, the service provider may also cache the document. The results are then viewed on display servers via remote display protocols or on the system's display units deployed on local machines. Features supporting software as a service include: 1. Document formatting and cache usage tracking The system allows monitors how documents are drawn from the cache, and provides details of document usage such as usernames, IP addresses, times, format popularity and the like in various logs or to a messaging system. This allows the system operators to better manage and charge for their services.

e,1( 00 0 2. Multi-user support The system uses three kinds of caches. A general multi resolution magnification cache is used to store ;previously formatted content. This may also include temporary Istorage areas to be used in the process of document formatting. Copies of documents may be placed in an enduser's or the display unit's current session cache to enable O their personalized use while avoiding contention issues with o other users. Finally, a user-cache stores user-defined content 0 that needs to span end-user sessions, such as search results 00 o 10 or personal billing and usage reports. In many cases, these Smay also be stored in concentrated formats to be reconstituted on demand by the presentation subsystems for user display purposes. In this way, the bandwidth and disk storage space requirements needed to support thousands or even millions of centralized user caches can be minimized.

3. Enhanced document security Traditionally documents can be password protected and sometimes encrypted to avoid unauthorised use. However, once the document is in a computers memory it is usually fully exposed, allowing it to be easily copied by hackers. The current invention limits the usefulness of documents in memory for unauthorised use by encrypting all the references and document structures used by the navigation features described above. These are stored separately and added back into the document as required and decrypted only as they are used; meaning a full version of the content is never loaded entirely into memory at any point in time. The result is a formatted document that is practically unnavigable by any other system with very economical use of processing power, while providing better protection from hackers. This is particularly so in. the case of commercial online publishing, where the content is being displayed for image transmission by a closed system at an Application 00 o Service Provider, makirIg the above measure precautionary 0 N rather than a primary means of defense.

Anti-denial of service mechanisms Because the system monitors the use of documents by users, it is also able to search for signs of suspicious activity, such as excessive use of the invention's navigation features or repeated failed logins O or repeated 'non-revenue producing sessions'.

Management system interface Part of the system's oO resistance to attack and maintenance functions for ongoing availability and reliability are a range or self-monitoring functions. The invention also monitors itself for unusual conditions or behavior and may forcefully lock the user interface when appropriate. Access to the rendering, reformatting, cache and display units may also be restricted, requiring authorisation from an external management system before processing can occur. Based on how it is being used, the system may also automatically or under management system control take remedial actions such as sending information messages, shutting down all or the affected parts of itself, receiving instructions form a management system, disconnecting from a user or restarting.

The display unit of the system allows the running of applications embedded vwithin documents. These may include image boxes where the images of applications sent via remote display protocols are viewed. Thus an instance of the system can be embedded within itself if so desired. Applications contained within the system have tremendous reach, with their accompanying information being suitable for display within a multitude of devices and usage scenarios. Such applications may also be launched in separate windows via a hyperlink or button. The system's application support features include: 00 o 1. Embedded applications Embedded applications can be 0 Smonitored by the system, sending their time (on screen or running times) or CPU usage details to a log or messaging system. Additionally, any piece of content can be marked up "for such monitoring, including pictures or text.

Contributed code It is common for people to create their own 1 'Web sites, launching them unsupervised with the ISP. But o online applications are orders-of magnitude more expensive to Screate and maintain. The system addresses this problem by oo 0 10 allowing macros to be contributed, automatically scanning Nsource code for potentially harmful algorithms or system calls.

This code may then be executed in an interpreted environment or compiled into an 'authorised' application. Thus the system supports the execution of publicly contributed code, without the need for human supervision or risk of compromising the system.

3. Applications may also be launched in separate windows via a hyperlink or button, with their usage details also tracked by the display unit. These could be run in an execution environment outside of the system, optionally giving the externally linked program a unique name, tracking its operation usingthe operating system's process monitoring interfaces. 4. Content pre-loading In an application environment, it is often easy to predict a user's next move. Therefore to speed up interaction, particularly where custom formatting may be required before display, the pre-loading of documents is desirable. The system may support this with third party application programmer interfaces, end user commands or its own predictive algorithms.

The system can also be used as an advanced document viewer, making the reading experience more aesthetic by presenting OO imaterial in columns and minimizing scrolling. This is of particular use 0in making long documents more viewable orn-screen, which would otherwise normally be printed. The invention's desktop Viewing support features include: 1. Caption resizing Caption boxes (sometimes called balloons) accompanying pictures must sometimes be resized to fit on csmall screens. However this may reduce the size of the text ON until it becomes unreadable. Instead the system resizes the 0 Sbox in which the caption appears, extending it downwards until 00 10 all the text becomes visible. Therefore in some cases reading 0 o the text in cases will require the entire document to be Cscrolled. In order to avoid this, caption boxes may be optionally extended downward but only to the base of the viewing area, with scroll bars then being provided within the caption box to view the remaining caption text not visible on the screen.

2. Blank space formatting reduction expansion The reformatting of documents, particularly for small screen devices, often requires a reduction of blank space. If a document is formatted with tab stops or indentations, when displayed on small screens these can potentially fill most of the viewing area with blank space, causing text to wrap after only a few words. However often such indentations should not be removed, as they indicate the relative importance of one piece of content with the next. On the other hand, the same document viewed on a large screen, particularly with negative magnification, needs blank space for readability. Therefore the system is able to reduce the amount of blank space in some situations, while increasing it in others, providing the best readability for the dispJay area provided. The system does this automatically or using publisher preferences using a number 00 O of methods, including adjusting margins, indentations and tab 0 N stops.

3. Blank space creation In some situations it is desirable for the vNO system to pad a document with additional blank space. For example, a large picture at the end of a document may be better displayed fully in the next column than force the user to O scroll. In this situation the text at the end of the document would finish before the end of the column, requiring padding 0with enough blank space afterward to push the picture to the 0O next column. (Blank space has to be inserted into computer- C generated content, which is unlike a paper document, where blank space is present before.printing occurs.) 4. Iconic command structures A desktop PC environment will probably have enough room to display a command selection system, such as menus or hyperlinks, which contain words.

However this is not usually the case in smaller viewing areas, such as within a box in a Web portal or on a mobile device.

Desktop users should not be forced to learn a new interface because screen space precludes the efficient use of wordy commands. To bridge the interface consistency gap between small and large display areas, the system uses icons in as many command structures as possible, automatically presenting only the icons on smaller display areas. The function of these commands can always be accessible via mouse-over tool-tips, however the icon-only representation of commands means identical command structures can operate on both large and small viewing areas, minimizingthe learning curve to operate the invention over different viewing environments.

5. Watchword navigation A user or content creator may create a list of words or phrases to be searched upon. These are 00 automatically hyper-linked to the search document to a Smatching phrase's occurrence in documents.

a 6. Document splitting The longer the documentand the. smaller c- the display size, the longer reformatting takes to occur.

V.0 5 Additionally, the larger the document, the more system resources such as memory are required to display it.

ci Therefore it makes sense for the-system -to break longer Sdocuments into smaller chunks for quicker and easier' Shandling. This is done by using the natural breaks in a 00 1 0 .document created by pagination into screen-columns. This o automatic breaking up and presentation of documents as an unbroken whole is transparent to end users, but helps speed up document initialisation times, 7. Virtual sidebars Magazines often contain supplementary information in sidebars, however these don't translate easily into readable documents on screen. The problem is further compounded in smaller display areas, which have barely enough space for the main body of content to be presented.

The answer is to use pop-out sidebars, which are actually another area of the same document presented in a window which slides out from the edge of the screen, sliding back again when no longer required. Optionally being a part of the main document, virtual sidebar content may also be screen paginated. Content can also be linked-intd virtual sidebars, effectively creating pre-loaded hyperlinks for greater speed and efficiency, only also with greater accessibility.

8. Word processor companion Perhaps the best place for a desktop implementation is within.or connected with a word processor. After creating a document, often it is best to proof read it on a printer. By paginating the document into a'clearer, more readable form, more proofing can be done using the o same application a document was created in, simply by.

0 selecting a 'Screen-Page' item in the View menu. This saves Stime waiting for print outs as well as printing and network bandwidth costs associated with printing in large corporations.

In all cases, the term 'picture' may refer to any graphic element or embedded application within a document. Throughout-the 0specification the aim has been to describe embodiments of the 0 invention without limiting the invention to any specific combination of alternate features.

oO rcl

Claims (3)

1. 2. The system of claim 1 wherein said formatting units perform content manipulation including any one or more of blank space reduction, blank space insertion, text condensing, margin adjustment, and tab stop adjustment.
2. 3. The system of claim 1 or 2 wherein said display units include interaction for Forward and Back navigation to replay where a user has been, while Next and Previous allow screen page navigation to deviate from the previously established paths.
3. 4. The system of any of claims 1, 2 and 3 wherein the presentation system additionally includes automatic search page generation that lists results while preserving their context in relation to other documents and topics. A reformatting method minimizing the need for end users to scroll though documents within a word processor, including the steps of: ascertaining viewing preferences including definitions for document rendering and reformatting; determining the area available for display of the document and any associated control structures on the display (including navigation and end user option areas) and 00oo analysing said viewing preferences to determine a suitable document layout and 0 0 navigation system, whereby said document layout has one or more display columns; (N Sreformatting content for display in the available display column content areas, n whereby said reformatting includes inserting blank space and the resizing and rearranging of at least text and one or more graphics, in a pagination procedure of repeating steps over an entire document, said steps including recording one or more display column N boundaries; paching to minimise or reduce the need for repeat processing; inking navigation system to end-user device hardware such as page and arrow 0 keys; Snavigating content by end user interaction with said command structure or device hardware; and displaying reformatted content in available display column content areas.