Print Remotely to a Mobile Device
Field of the Invention
The present invention generally relates to a mobile device incorporating a printer. The invention more specifically relates to a mobile device such as a mobile telecommunications device, for example a mobile or cellular telephone that incorporates a printer which is able to print a wide variety of content on a print medium. However, it will be appreciated by those skilled in the art that the present invention can be used by other types of portable or mobile devices, or even non-portable devices.
Cross References
The following patents or patent applications filed by the applicant or assignee of the present invention are hereby incorporated by cross-reference:
10/815621 10/815612 10/815630 10/815637 10/815638 10/815640 10/815642
10/815643 10/815644 10/815618 10/815639 10/815635 10/815647 10/815634
10/815632 10/8,15631 10/815648 10/815641 10/815645 10/815646 10/815617
10/815620 10/815615 10/815613 10/815633 10/815619 10/815616 10/815614
10/815636 10/815649 11/041650 11/041651 11/041652 11/041649 11/041610
11/041609 11/041626 11/041627 11/041624 11/041625 11/041556 11/041580
11/041723 11/041698 11/041648 10/815609 10/815627 10/815626 10/815610
10/815611 10/815623 10/815622 10/815629 10/815625 10/815624 10/815628
10/913375 10/913373 10/913374 10/913372 10/913377 10/913378 10/913380
10/913379 10/913376 10/913381 10/986402 11/172816 11/172815 11/172814
10/409876 10/409848 10/409845 11/084769 11/084742 11/084806 09/575197
09/575195 09/575159 09/575132 09/575123 09/575148 09/575130 09/575165
09/575153 09/693415 09/575118 09/609139 09/608970 09/575131 09/575116
09/575144 09/575139 09/575186 6681045 6678499 6679420 09/663599
09/607852 6728000 09/693219 09/575145 09/607656 09/693280 6766942
09/693515 09/663701 09/575192 6720985 09/609303 09/610095 09/609596
09/693705 09/693647 09/721895 09/721894 09/607843 09/693690 09/607605
09/608178 09/609553 09/609233 09/609149 09/608022 09/575181 09/722174
09/721896 10/291522 ' 6718061 10/291523 10/291471 10/291470 10/291819
10/291481 10/291509 10/291825 10/291519 10/291575 10/291557 10/291661
10/291558 10/291587 10/291818 10/291576 10/291589 6714678 6644545
6609653 6651879 10/291555 10/291510 10/291592 10/291542 10/291820
10/291516 , 10/291363 ' 10/291487 10/291520 10/291521 10/291556 , 10/291821
10/291525 10/291586 10/291822 10/291524 10/291553 10/291511 10/291585
10/291374 10/685523 10/685583 10/685455 10/685584 10/757600 10/804034
10/793933 10/853356 10/831232 10/884882 10/943875 10/943938 10/943874
10/943872 10/944044 10/943942 10/944043 10/949293 10/943877 10/965913
10/954170 10/981773 10/981626 10/981616 10/981627 10/974730 10/986337
10/992713 11/006536 11/020256 11/020106 11/020260 11/020321 11/020319
11/026045 11/059696 11/051032 11/059674 11/107944 11/107941 11/082940
11/082815 11/082827 11/082829 11/082956 11/083012 11/124256 11/123136
11/154676 11/159196 li/182002 NPA226US NPA227US NPA228US 11/203200
11/202218 NPA231US 11/203424 NPA238US 09/575193 09/575156 09/609232
09/607844 6457883 09/693593 10/743671 11/033379 09/928055 09/927684
09/928108 09/927685 09/927809 09/575183 6789194 09/575150 6789191
10/900129 10/900127 10/913328 10/913350 10/982975 10/983029 6644642
6502614 6622999 6669385 , 10/322450 10/933285 10/949307 6549935
NPN004US 09/575187 6727996 6591884 6439706 6760119 09/575198
09/722148 09/722146 09/721861 6290349 6428155 6785016 09/608920
6741871 09/722171 09/721858 09/722142 10/171987 10/202021 10/291724
10/291512 10/291554 10/659027 10/659026 10/831242 10/884885 10/884883
10/901154 10/932044 10/962412 10/962510 10/962552 10/965733 10/965933
10/974742 10/982974 10/983018 10/986375 11/107817 11/148238 11/149160
09/693301 09/575174 09/575163 6474888 6627870 6724374 6788982
09/722141 6788293 09/722147 6737591 09/722172 09/693514 6792165
09/722088 6795593 10/291823 6768821 10/291366 10/291503 6797895
10/274817 10/782894 10/782895 10/778056 10/778058 10/778060 10/778059
10/778063 10/778062 10/778061 10/778057 10/846895 10/917468 10/917467
10/917466 10/917465 10/917356 10/948169 10/948253 10/948157 10/917436
10/943856 10/919379 10/943843 10/943878 10/943849 10/965751 11/071267
11/144840 11/155556 11/155557 11/193481 11/193435 11/193482 11/193479
09/575154 09/575129 09/575124 09/575188 09/721862 10/473747 10/120441
10/291577 10/291718 6789731 10/291543 6766944 6766945 10/291715
10/291559 10/291660 10/531734 10/409864 10/309358 10/537159 NPT022US
10/410484 10/884884 10/853379 10/786631 10/853782 10/893372 10/893381
10/893382 10/893383 10/893384 10/971051 10/971145 10/971146 10/986403
10/986404 10/990459 11/059684 11/074802 10/492169 10/492152 10/492168
10/492161 10/492154 10/502575 10/531229 10/683151 10/531733 10/683040
10/510391 10/919260 10/510392 10/919261 10/778090 09/575189 09/575162
09/575172 09/575170 09/575171 09/575161 10/291716 10/291547 10/291538
6786397 10/291827 10/291548 10/291714 10/291544 10/291541 10/291584
10/291579 10/291824 10/291713 10/291545 10/291546 10/917355 10/913340
10/940668 11/020160 11/039897 11/074800 11/074782 11/074777 11/075917
11/102698 11/102843 11/202112 6593166 10/428823. 10/849931 11/144807
6454482 09/693704 6527365 6474773 6550997 10/181496 10/274119
10/309185 10/309066 •-10/949288 10/962400 10/969121 11/185722 11/181754
11/203180 09/517539 6566858 09/112762 6331946 6246970 6442525
09/517384 09/505951 6374354 09/517608 09/505147 10/203564 6757832
6334190 6745331 09/517541 10/203559 10/203560 10/636263 10/636283
10/866608 10/902889 10/902833 10/940653 10/942858 10/727181 10/727162
10/727163 10/727245 10/727204 10/727233 10/727280 10/727157 10/727178
10/727210 10/727257 10/727238 10/727251 10/727159 10/727180 10/727179
10/727192 10/727274 10/727164 10/727161 10/727198 10/727158 10/754536
10/754938 10/727227 10/727160 10/934720 PEA30US 10/296522 6795215
10/296535 09/575109 10/296525 09/575110 09/607985 6398332 6394573
6622923 6747760 10/189459 10/884881 10/943941 10/949294 11/039866
11/123011 11/123010 11/144769 11/148237 10/922846 10/922845 10/854521
10/854522 10/854488 10/854487 10/854503 10/854504 10/854509 10/854510
10/854496 10/854497 10/854495 10/854498 10/854511 10/854512 10/854525
10/854526 10/854516 10/854508 10/854507 10/854515 10/854506 10/854505
10/854493 10/854494 10/854489 10/854490 10/854492 10/854491 10/854528
10/854523 10/854527 10/854524 10/854520 10/854514 10/854519 10/854513
10/854499 10/854501 10/854500 10/854502 10/854518 10/854517 10/934628
PLT046US 6405055 6628430 10/920230 10/920372 10/920229 10/919366
10/919241 10/919242 10/919243 10/919380 10/919381 10/919382 10/919383
10/920371 10/503924 10/503901 10/159626 10/159035 10/659023 10/659022
10/920219 10/920218 10/920220 10/920225 11/107942 11/107943 BALI19US
10/659025 10/659024 10/920221 10/920280 11/124158 11/124196 11/124199
11/124162 11/124202 11/124197 11/124154 11/124198 11/124153 11/124151
11/124160 11/124192 11/124175 11/124163 11/124149 11/124152 11/124173
11/124155 11/124157 11/124174 11/124194 11/124164 11/124200 11/124195
11/124166 11/124150 11/124172 11/124165 11/124186 11/124185 11/124184
11/124182 11/124201 11/124171 11/124181 11/124161 11/124156 11/124191
11/124159 11/124175 11/124188 11/124170 11/124187 11/124189 11/124190
11/124180 11/124193 11/124183 11/124178 11/124177 11/124148 11/124168
11/124167 11/124179 11/124169 11/187976 11/188011 11/188014 10/980187
11/003786 11/003354 11/003616 11/003418 11/003334 11/003600 11/003404
11/003419 11/003700 11/003601 11/003618 11/003615 11/003337 11/003698
11/003420 11/003682 11/003699 11/071473 11/003463 11/003701 11/003683
11/003614 11/003702 11/003684 11/003619 11/003617 10/760254 10/760210
10/760202 10/760197 10/760198 10/760249 10/760263 10/760196 10/760247
10/760223 10/760264 10/760244 10/760245 10/760222 10/760248 10/760236
10/760192 10/760203 10/760204 10/760205 10/760206 10/760267 10/760270
10/760259 10/760271 10/760275 10/760274 10/760268 10/760184 10/760195
10/760186 10/760261 10/760258 11/014764 11/014763 11/014748 11/014747
11/014761 11/014760 11/014757 11/014714 11/014713 11/014762 11/014724
11/014723 11/014756 11/014736 11/014759 11/014758 11/014725 11/014739
11/014738 11/014737 11/014726 11/014745 11/014712 11/014715 11/014751
11/014735 11/014734 11/014719 11/014750 11/014749 11/014746 11/014769
11/014729 11/014743 11/014733 11/014754 11/014755 11/014765 11/014766
11/014740 11/014720 11/014753 11/014752 11/014744 11/014741 11/014768
11/014767 11/014718 11/014717 11/014716 11/014732 11/014742 11/097268
11/097185 11/097184 10/728804 10/728952 10/728806 10/728834 10/729790
10/728884 10/728970 10/728784 10/728783 10/728925 10/728842 10/728803
10/728780 10/728779 10/773189 10/773204 10/773198 10/773199 10/773190
10/773201 10/773191 10/773183 10/773195 10/773196 10/773186 10/773200
10/773185 10/773192 10/773197 10/773203 10/773187 10/773202 10/773188
10/773194 10/773193 10/773184 11/008118 11/060751 11/060805 11/188017
6623101 6406129 6505916 6457809 6550895 6457812 10/296434
6428133 6746105 10/407212 10/407207 10/683064 10/683041 6750901
6476863 6788336 11/097308 11/097309 11/097335 11/097299 11/097310
11/097213 MTC009US 11/097212 MTCOIlUS 10/760272 10/760273 10/760187
10/760182 10/760188 10/760218 10/760217 10/760216 10/760233 10/760246
10/760212 10/760243 10/760201 10/760185 10/760253 10/760255 10/760209
10/760208 10/760194 10/760238 10/760234 10/760235 10/760183 10/760189
10/760262 10/760232 10/760231 10/760200 10/760190 10/760191 10/760227
10/760207 10/760181
Some applications have been listedby docketnumbers. These will be replaced when applicationnumbers are known.
Background of the Invention
The assignee has developed mobile or cellular telephones, Personal Data Assistants (PDAs) and other mobile telecommunication devices, with the ability to print hard copies of content, such as images or information stored or accessed by the device, (see for example, US Patent 6,405,055, filed on November 9, 1999). Likewise, the assignee has also designed digital cameras with the ability to print captured images with an inbuilt printer (see for example, US Patent 6,750,901, filed on July 10, 1998). As the prevalence of mobile telecommunications devices increases, the functionality of these devices is further enhanced by the ability to print hard copies.
As these devices are portable, they should be compact for user convenience. Accordingly, any printer incorporated into the device needs to maintain a small form factor. Also, the additional load on the battery should be relatively small. Furthermore, the consumables (such as ink, paper, etc.) should be relatively inexpensive and simple to replenish. It is these factors that strongly influence the commercial success or otherwise of products of this type.
The assignee of the present invention has also developed the Netpage system for enabling interaction with computer software using a printed interface and a proprietary stylus-shaped sensing device. As described in detail in US Patent 6,792,165, filed on November 25, 2000 and US Patent Application USSN 10/778,056, filed on February 17, 2004, a Netpage pen captures, identifies and decodes tags of coded data printed onto a surface such as a page. In a preferred Netpage implementation, each tag encodes a position and an identity of the document. By decoding at least one of the tags and transmitting the position (or a refined version of the position, representing a higher resolution position of the pen) and identity referred to by the decoded tag, a remote computer can determine an action to perform. Such actions can include, for example, causing information to be saved remotely for subsequent retrieval, downloading of a webpage for printing or display via a computer, bill payment or even the performance of handwriting recognition based on a series of locations of the Netpage pen relative to the surface.
When printing a Netpage, a printer in a mobile telecommunications device can print the Netpage tags simultaneously with visible user information. The association between the tags and information can already exist on a remote Netpage server, such as where the printer is printing a fully rendered page (including tags) provided by the Netpage server or another computer. Alternatively, the mobile telecommunications device can generate the tags (or source them remotely) and define an association between the tags and user information. The association is then recorded in the remote Netpage server.
A problem with these options is that they require the mobile telecommunications device to include Netpage tag printing capabilities. This requires an additional row of print nozzles in the printhead, and reduces the amounts of ink that can be stored for non-tag use. Whilst this is less of an issue with large, mains-powered printers, it can be an issue in small form-factor articles such as mobile telecommunications devices. Alternatively, the mobile telecommunications device can be configured to print on print media that is preprinted with Netpage tags. That way the printer need only print the user information and record an association between the visible information and the pre-printed tags.
It is desirable to provide functional applications making use of the mobile telecommunications device. Such applications can include, for example, mobile printing applications, linking, capturing and/or printing generic or specific objects to a print medium, and many other applications providing functionality to the mobile telecommunications device and various uses of types of print media.
Summary of the Invention In one particular, but non-limiting, aspect, an M-Print device is a mobile device such as a telephone or PDA which incorporates a printer. Paper is either manually presented or auto-fed from a cartridge, depending on device form factor. The printer may or may not print tags, for example infrared tags, and the printer or a sensor detects tags printed, for example pre-printed, onto blank media. The paper path either includes a tag reader, or it includes a simpler sensor for reading a linear data track on the card. The data track can encode the same identifier as the tags. Reading the identifier allows the M-Print device to associate the card's
graphic and/or interactive content with the identifier. This allows subsequent interactions with the card to be properly interpreted. The graphic and/or interactive content is stored on a network-based server, indexed by the identifier.
It should be noted that the media identifier (i.e. print media identifier) may correspond to a range of 2D coordinates without an explicit single media identifier. Hence, reference to the media identifier is to be read as a reference to an explicit or defined one or more media identifiers, or, as a reference to a range of 2D coordinates.
The device also optionally incorporates a pointer. The pointer may be used to click on a hyperlink, but generally doesn't operate at a sufficiently high rate to capture motion. Alternatively, the telephone may incorporate a fully-functional Netpage-type pen. Even when the M-Print device doesn't incorporate a pointer, the user can interact with printed cards by feeding them through the paper path. The data track reader or tag reader in the paper path extracts the identifier, which allows the device to identify the graphic and/or interactive content of the card, and object(s) linked to the card. Not all M-Print cards have to be produced by an M-Print device. For example, pre-printed M-Print cards of a collectible or promotional nature may be included in cereal packets or magazines. And even blank media may bear advertising on the reverse side. Not all M-Print cards have to be interacted with via a pointer in an M-Print device. They can be interacted with via any device, or another scanning device altogether which can read the data track or an application-specific printed barcode.
An M-Print card acts as a token for the graphic and/or interactive content of the card, including any objects linked to the card. A user can easily obtain the original digital content of the card by clicking on the card or 'virtually scanning' the card through the paper path. For example, a photo acts as a token for the original digital image, and a business card acts as a token for the contact details linked to the card. By acting as a token for its own content, a card allows a user to obtain a perfect re-print. In addition to the identifier, the data track and the tags encode a digital signature which allows the card to be authenticated. This has two purposes. Firstly, it allows a blank card to be authenticated during printing to prevent the use of non- sanctioned blanks. Secondly, it allows a card to be authenticated when used as a token, to prevent fraudulent access to the content of the card or objects linked to the card.
■ Various applications are possible using aspects, components or features of the mobile telecommunications device and associated coded print medium. Such applications can include mobile printing applications, linking, capturing and/or printing generic or specific objects to a print medium, and many other applications providing practical uses for the coded print medium and/or the mobile telecommunications device. Various particular applications are herein described.
In a first aspect the present invention provides a method of printing content on a print medium using a mobile telecommunications device, comprising the steps of:
receiving, at a server, a request for the content, the request initiated by activation, on the mobile telecommunications device, of an information link ; and, transferring the content to the mobile telecommunications device; wherein, the mobile telecommunications device includes a printer module that can print the content on the print medium.
Optionally the information link is a hyperlink embedded in a web page.
Optionally the information link is transmitted to the mobile telecommunications device from a remote device.
Optionally the information link is, or is contained within, an SMS or MMS message received by the mobile telecommunications device.
Optionally prior to receiving the request for content at the server, a content reference is transmitted to the mobile telecommunications device after activation of the information link, receipt of which results in the request for content being transmitted to the server.
Optionally the content reference is passed to a retriever module in the mobile telecommunications device, the retriever module effecting the transfer of the content to the mobile telecommunications device.
Optionally the content reference is a Uniform Resource Identifier.
Optionally the content is a selection of information from a web page.
Optionally the content is rendered at the server or an associated server prior to being transferred to the mobile telecommunications device.
Optionally the content is stored in a database in a rendered format suitable for printing by the printer module.
Optionally the print medium is provided with first coded data in a first data format, the first coded data encoding first information.
Optionally the first information is a print media identifier.
Optionally the content is indexed by and retrievable using the print media identifier.
Optionally the content includes one or more graphic images.
Optionally the print medium is provided with second coded data in a second data format, the second coded data encoding second information.
Optionally the content includes one or more interactive elements.
Optionally the second information is indicative of a two-dimensional coordinate grid.
Optionally at least one interactive element has a linked object.
Optionally the linked object is associated with a region of the print medium and the linked object is stored in an object repository.
Optionally the mobile telecommunications device is a mobile telephone.
In a second aspect the present invention provides a method of printing subscribed content on a print medium using a mobile telecommunications device, comprising the steps of: receiving, at a server, a request for the subscribed content; and, transferring the subscribed content to the mobile telecommunications device on a periodic basis; wherein, the mobile telecommunications device includes a printer module that can print the subscribed content on the print medium.
Optionally the subscribed content is pay for view content.
Optionally the subscribed content is additionally displayed on a display of the mobile telecommunications device.
Optionally the user accepts the subscribed content displayed on the display before printing the subscribed content on the print medium.
Optionally the subscribed content is, or is contained within, an SMS, MMS or email message received by the mobile telecommunications device.
Optionally the subscribed content is stored in the mobile telecommunications device and can be subsequently printed.
Optionally the subscribed content is customised for a requesting user.
Optionally the subscribed content is a selection of information from a web page.
Optionally the subscribed content is rendered at the server or an associated server prior to being transferred to the mobile telecommunications device.
Optionally the subscribed content is stored in a database in a rendered format suitable for printing by the printer module.
Optionally the print medium is provided with first coded data in a first data format, the first coded data encoding first information.
Optionally the first information is a print media identifier.
Optionally the subscribed content is indexed by and retrievable using the print media identifier.
Optionally the subscribed content includes one or more graphic images.
Optionally the print medium is provided with second coded data in a second data format, the second coded data encoding second information.
Optionally the subscribed content includes one or more interactive elements.
Optionally the second information is indicative of a two-dimensional pattern coordinate grid.
Optionally at least one interactive element has a linked object.
Optionally the linked object is associated with a region of the print medium and the linked object is stored in an object repository.
Optionally the mobile telecommunications device is a mobile telephone.
In a third aspect the present invention provides a method of printing content on a print medium using a mobile telecommunications device, comprising the steps of: allowing the print medium to be inserted into a media feed path of the mobile telecommunications device; reading a print media identifier from the print medium using a isensor module jof the mobile telecommunications device; printing the content on the print medium using a printer module of the mobile telecommunications device; and, storing the content in a database using a server able to communicate with the mobile telecommunications device, the content retrievable from the database using the print media identifier.
Optionally the print medium is provided with first coded data in a first data format, the first coded data encoding first information.
Optionally the first information includes the print media identifier.
Optionally the first format is a linear pattern.
Optionally the print medium is provided with second coded data in a second data format, the second coded data encoding second information.
Optionally the second information is indicative of a two-dimensional coordinate grid.
Optionally the second information includes the print media identifier.
Optionally the second information is indicative of regions of the print medium surface.
Optionally the printer module prints the second coded data on the print medium.
Optionally the second coded data is pre-printed on the print medium prior to inserting the print medium.
Optionally the content in the database is indexed by the print media identifier.
Optionally the content is obtained by the mobile telecommunications device.
Optionally the content is a photograph and the mobile telecommunications device includes a camera used to capture the photograph.
Optionally the content can be subsequently retrieved from the database.
In a further aspect there is provided a method, requiring the steps of: the printed print medium to be inserted into the media feed path; reading the print media identifier; and, transferring the content associated with the print media identifier from the database to the mobile telecommunications device.
Optionally the content includes one or more interactive elements.
Optionally at least one interactive element has a linked object.
Optionally the linked object is associated with a region of the print medium using the second coded data and the linked object is stored in an object repository.
Optionally a caption can be added to the content during printing by using a keypad of the mobile telecommunications device.
Optionally different access permissions can be associated with the content when stored.
In a fourth aspect the present invention provides method of retrieving information linked to a print medium using a mobile telecommunications device, comprising the steps of: reading a print media identifier from the print medium using a sensor module of the mobile telecommunications device; and, retrieving information linked to the print medium using the print media identifier and the mobile telecommunications device, the information retrievable from a database using the print media identifier.
Optionally the print medium is provided with first coded data in a first data format, the first coded data encoding first information.
Optionally the first information includes the print media identifier.
Optionally the first format is a linear pattern.
Optionally the print medium is provided with second coded data in a second data format, the second coded data encoding second information.
Optionally the second information is indicative of a two-dimensional coordinate grid.
Optionally the second information includes the print media identifier.
Optionally the second information is indicative of regions of the print medium surface.
Optionally the mobile telecommunications device includes a printer module and the printer module prints the information.
Optionally the mobile telecommunications device includes a display module and the display module displays the information.
Optionally the information is an image.
Optionally the information is contact details that are stored in a memory of the mobile telecommunications device.
Optionally the contact details are loaded into an address book.
Optionally the information is, or is contained within, an SMS, MMS or email message received by the mobile telecommunications device.
Optionally the sensor module includes an image sensor, an image processor and an image memory.
Optionally the information is linked to content provided on the print medium.
Optionally the information is an audio file.
Optionally the information is software executable on the mobile telecommunications device.
Optionally a user is charged for retrieving the information.
Optionally the mobile telecommunications device is a mobile telephone.
In a fifth aspect the present invention provides a method of printing content representative of an object on a print medium using a mobile telecommunications device, comprising the steps of: identifying an object using the mobile telecommunications device; receiving the print medium in a media feed path of the mobile telecommunications device; determining a print media identifier from the print medium using a sensor module of the mobile telecommunications device; and, printing content representative of the object on the print medium using a printer module of the mobile telecommunications device.
Optionally the content includes one or more interactive elements.
Optionally the object is obtained from a server in communication with the mobile telecommunications device.
Optionally the object is an image and is captured using a camera of the mobile telecommunications device.
Optionally the print medium is provided with first coded data in a first data format, the first coded data encoding first information.
Optionally the first information includes the print media identifier.
Optionally the first format is a linear pattern.
Optionally the print medium is provided with second coded data in a second data format, the second coded data encoding second information.
Optionally the second information is indicative of a two-dimensional coordinate grid.
Optionally the second information includes the print media identifier.
Optionally the second information is indicative of regions of the print medium surface.
Optionally the printer module prints the second coded data on the print medium.
Optionally the second coded data is pre-printed on the print medium prior to inserting the print medium.
Optionally the object is a linked object and is associated with a region of the print medium using the second coded data and the linked object is stored in an object repository.
Optionally the printer module prints the first coded data on the print medium.
Optionally the object is statically associated with a document.
Optionally the object is dynamically associated with a document.
Optionally the object is associated with a particular location on the print medium.
Optionally the object is associated with a form, as a particular field of a form or a particular instance of a form.
Optionally different access permissions can be associated with the object when stored.
In a sixth aspect the present invention provides a method of reprinting content on a print medium using a mobile telecommunications device, comprising the steps of: determining a first print media identifier, from a first print medium provided with content, using a sensor module of the mobile telecommunications device, the first print medium having been inserted into a media feed path of the mobile telecommunications device; retrieving a copy of the content, previously stored in a database, using the print media identifier; and, printing the copy of the content on a second print medium using a printer module of the mobile telecommunications device.
Optionally the first print medium is provided with first coded data in a first data format, the first coded data encoding first information.
Optionally the first information includes the print media identifier.
Optionally the first format is a linear pattern.
Optionally the first print medium is provided with second coded data in a second data format, the second coded data encoding second information.
Optionally the second information is indicative of a two-dimensional coordinate grid.
Optionally the second information includes the print media identifier.
Optionally the second information is indicative of regions of the print medium surface.
Optionally the printer module prints second coded data in a second data format, the second coded data encoding second information on the second print medium.
Optionally the second coded data is pre-printed on the first or second print medium prior to inserting the first or second print medium.
Optionally the content in the database is indexed by the first print media identifier.
Optionally the copy of the content is displayed on a display of the mobile telecommunications device.
Optionally the printer module prints first coded data in a first data format, the first coded data encoding first information, on the second print medium.
Optionally the second print medium is provided with a second print media identifier, and the second print media identifier is linked to the content in the database.
In a further aspect there is provided a method, further including, determining a second print media identifier, from the second print medium, using a sensor module of the mobile telecommunications device, the second print medium having been inserted into the media feed path of the mobile telecommunications device.
Optionally the content includes one or more interactive elements.
Optionally at least one interactive element has a linked object.
Optionally the linked object is associated with a region of a print medium using second coded data provided in a second data format, the second coded data encoding second information, and the linked object is stored in an object repository.
Optionally indicia can be added to the copy of the content during printing by using a keypad of the mobile telecommunications device.
Optionally the content printed on the second print medium includes information that has been updated in the database compared with corresponding information included in the content on the first print medium.
In a seventh aspect the present invention provides a method of printing content on a print medium and charging using a mobile telecommunications device, comprising the steps of: identifying the content on the mobile telecommunications device; printing, using a printer module of the mobile telecommunications device, the content on the print medium; and transmitting, using the mobile telecommunications device, billing information to a billing server.
Optionally the content is captured using the mobile telecommunications device.
Optionally the billing information is sent after each instance of printing content.
Optionally the billing information is sent periodically.
Optionally an entity is charged per print, the entity being one or more of: a user; a content provider; and a telecommunications provider.
Optionally the content is subscribed content.
Optionally the request for the content is initiated by activation of an information link on the mobile telecommunications device.
Optionally the content is a selection of information from a web page.
Optionally the content is periodically transferred to the mobile telecommunications device.
Optionally the content is stored in a database in a rendered format suitable for printing by the printer module.
Optionally the print medium is provided with first coded data in a first data format, the first coded data encoding first information.
Optionally the first information includes a print media identifier.
Optionally the content is indexed by and retrievable using the print media identifier.
Optionally the print medium is authenticated prior to printing.
Optionally the print medium is provided with second coded data in a second data format, the second coded data encoding second information.
Optionally the content includes one or more interactive elements.
Optionally the second information is indicative of a two-dimensional coordinate grid.
Optionally at least one interactive element has a linked object.
Optionally the linked object is associated with a region of the print medium and the linked object is stored in an object repository.
Optionally the mobile telecommunications device is a mobile telephone.
In an eighth aspect the present invention provides method of linking an object to a print medium, comprising the step of: submitting a request to associate the object with a print media identifier of the print medium, submission of the request facilitating identification of the object and the print media identifier; wherein, the association of the object and the print media identifier is recorded in a database, the object being retrievable from the database using the print media identifier.
Optionally the print medium is supplied to a user with at least one pre-linked object.
Optionally submission of the request is effected using a sensor module associated with a mobile telecommunications device.
Optionally identification of the object occurs by the mobile telecommunications device retrieving the object.
Optionally identification of the object occurs by the mobile telecommunications device capturing the object as an image using a camera.
In a further aspect there is provided a method, further including the steps of: receiving the print medium in a media feed path of the mobile telecommunications device; and,
reading the print media identifier from the print medium using the sensor module of the mobile telecommunications device.
Optionally the sensor module is at least one of: integrated with the mobile telecommunications device; and external to the mobile telecommunications device.
Optionally the print medium is provided with first coded data in a first data format, the first coded data encoding first information.
Optionally the first information includes the print media identifier.
Optionally the first format is a linear pattern.
Optionally the print medium is provided with second coded data in a second data format, the second coded data encoding second information.
Optionally the second information is indicative of a two-dimensional coordinate grid.
Optionally the second information includes the print media identifier.
Optionally the second information is indicative of regions of the print medium surface.
Optionally a printer module of a mobile telecommunications device prints the second coded data on the print medium.
Optionally the second coded data is pre-printed on the print medium.
Optionally the object is associated with a region of the print medium using the second coded data.
Optionally the printer module prints the first coded data on the print medium.
Optionally the object is associated with a form, as a particular field of a form or a particular instance of a form.
Optionally the object can be associated with a second print media identifier.
In a ninth aspect the present invention provides a method of generating an association between an object and a position on a surface, the surface having disposed therein or thereon coded data being at least partially indicative of an identity of the surface and a plurality of locations on the surface, the method including, in a computer system:
receiving indicating data from a sensing device, the indicating data being at least partially indicative of the identity of the surface and the position of the sensing device relative to the surface, the sensing device, when placed in an operative position relative to the surface, being responsive to sense at least some of the coded data and generate the indicating data using the sensed coded data; identifying, using the indicating data, the identity of the surface, the position and the object; and, generating an association based at least partially on the identity of the surface, the position and the object.
Optionally the object is stored in an object repository, the method including, in the computer system: generating the association based at least partially on the object stored in the object repository.
Optionally the method includes, in the computer system: receiving object data indicative of at least one received object; and, storing, using the received object data, the at least one received object in the object repository.
Optionally at least some of the coded data is indicative of an object type, the method including: receiving the indicating data indicative of the object type; and, identifying, using the indicating data, the object type and the object of the object type.
Optionally the method includes, in the computer system: recording the generated association in the computer system.
Optionally the method includes, in the computer system: deleting, from the object repository, the object after generating the association.
Optionally the stored objects in the object repository are ordered according to when a received object was stored in the object repository, the method including, in the computer system: updating, using the received object data, the order of received objects in the object repository; determining, using the order indicated by the object repository, a stored object which has been most recently stored in the object repository; and, generating an association based at least partially on the most recently stored object.
Optionally the method includes, in the computer system: deleting, from the object repository, the most recently stored object after generating the association.
Optionally the object repository is located on a server, the method including, in a computer system: storing, using the received object data, the received object in the object repository located on the server; retrieving, using the object repository located on the server, the object; and, recording, in the object repository located on the server, the association.
Optionally the sensing device includes a current operating mode selected from a plurality of potential operating modes including an association mode, and wherein the method includes, in the computer system: determining, using the indicating data, a selected operating mode of the sensing device; setting the current operating mode of the sensing device to the selected operating mode; and, if the current operating mode of the sensing device is set to the association mode, allowing the generation of an association.
Optionally the method includes, in the computer system: if the current operating mode of the sensing device is set to the association mode, generating an association using the next indicating data received from the sensing device.
In a further aspect there is provided a method, the coded data including at least one first coded data portion at least partially indicative of the identity of the surface, and at least one second coded data portion being at least partially indicative a plurality of locations on the surface, wherein the method includes, in the computer system: receiving, from the sensing device, indicating data at least partially indicative of an identity of the surface and the position of the sensing device relative to the surface, the sensing device being responsive to sensing at least some of the first coded data portion and at least some of the second coded data portion to generate the indicating data.
Optionally the method includes, in the computer system: receiving object data indicative of an identity of the received object; storing the identity of the object in the object repository; and, generating an association at least partially based on the identity of the object.
Optionally the generated association is indicative of: the identity of the surface; the position; and, the object.
Optionally if the object repository is empty, the method includes, in the computer system: indicating an error when an association cannot be generated.
Optionally the association is generated according to a user identity, wherein the method includes: storing, using the received object data, the received object associated with the user identity in the object repository.
Optionally the method includes, in the computer system: determining, using the object repository and the user identity, the object.
Optionally the coded data is substantially invisible to an unaided human.
Optionally the coded data is printed on the surface using at least one of: an invisible ink; and, an infrared-absorptive ink.
In a further aspect there is provided a computer system configured for generating an association between an object and a position on a surface, the surface having disposed therein or thereon coded data being at least partially indicative of an identity of the surface and a plurality of locations on the surface, the computer system configured to: receive indicating data from a sensing device, the indicating data being at least partially indicative of the identity of the surface and the position of the sensing device relative to the surface, the sensing device, when placed in an operative position relative to the surface, being responsive to sense at least some of the coded data and generate the indicating data using the sensed coded data; identify, using the indicating data, the identity of the surface, the position and the object; and, generate an association based at least partially on the identity of the surface, the position and the object.
In a tenth aspect the present invention provides a method of submitting an object to a form application using a form printed on a surface, the surface having disposed therein or thereon coded data being at least partially indicative of an identity of the form and at least one interactive element, the at least one interactive element being related to at least one association operation, the method including, in a computer system: receiving indicating data from a sensing device, the indicating data being at least partially indicative of the identity of the form and an interactive element, the sensing device, when placed in an operative position relative to an interactive element, being responsive to sense at least some of the coded data and generate the indicating data using the sensed coded data; defining, using the at least one association operation, an association between the form and an object; generating, using the association, a form submission; and, transferring, to a form application, the form submission to thereby submit the object.
Optionally the form includes at least one field, the method including, in the computer system: defining, using the at least one association operation, an association between the at least one field and the object.
Optionally the method includes, in the computer system: determining, using the indicating data, a form layout corresponding to a visual representation of the form printed on the surface; and, determining, using the form layout, the at least one field for defining the association with the object.
Optionally the at least one association operation generates an association between the at least one field and the object, wherein the method includes, in the computer system: generating, using the indicating data, the association between the at least one field and the object.
Optionally the method includes, in the computer system: recording the association between the object and the at least one field.
Optionally the at least one association operation is used to generate an association between the at least one field and an object having an object type, wherein the method includes: selecting an object having a corresponding object type; and, generating, using the indicating data, the association between the at least one field and the object of the corresponding object type.
Optionally the method includes, in the computer system: receiving, from the sensing device, indicating data indicative of a field value; and, determining, using the field value, the object type for selecting an object to be associated with the at least one field.
Optionally the method includes, in the computer system: generating, using one of the association operations, an association between the at least one field and an object stored in an object repository.
Optionally the method includes, in the computer system: deleting, from the object repository, the object after generating the association.
Optionally if the object repository is empty, the method includes, in the computer system: indicating an error when an association cannot be generated.
Optionally the at least one association operation deletes an association between at least one field and the object, wherein the method includes, in the computer system: deleting, using the indicating data, the association between the at least one field and the object.
Optionally the at least one association operation provides an indication of an association between at least one field and the object, wherein the method includes, in the computer system: providing, using the indicating data, an indication of the association between the at least one field and the object.
Optionally the computer system is in communication with a printer, the method including, in the computer system:
printing, using the printer, a second form based on the first form, wherein the second form includes a graphical representation of the object associated with the at least one field.
Optionally the method includes, in the computer system: receiving, from the sensing device when placed in an operative position relative to the at least one field, indicating data indicative of handwritten text provided in the at least one field, wherein the sensing device senses at least some of the coded data in the field during the provision of the handwritten text and generates the indicating data using at least some of the sensed coded data; performing, using the indicating data, handwriting recognition to determine text provided in the at least one field; and, generating, using the text determined in the at least one text field, the form submission.
Optionally the method includes, in the computer system: receiving, from the sensing device, movement data indicative of movement of the sensing device relative to the form, wherein the sensing device generates movement data using at least some of the sensed coded data; and, performing, using the movement data, the handwriting recognition.
Optionally the coded data is at least partially indicative of a plurality of locations on the surface, the method including, in the computer system: receiving the indicating data indicative of at least one position of the sensing device relative to the surface, the sensing device being responsive to sensing at least some of the coded data to generate the indicating data; and, identifying, using the at least one position and the form layout, the at least one field for defining the association with the object.
Optionally the coded data is substantially invisible to an unaided human.
Optionally the coded data is printed on the surface using at least one of: an invisible ink; and, an infrared-absorptive ink.
Optionally the computer system is a mobile telecommunications device.
In a further aspect there is provided a computer system configured to submit an object to a form application using a form printed on a surface, the surface having disposed therein or thereon coded data being at least partially indicative of an identity of the form and at least one interactive element, the at least one interactive element being related to at least one association operation, the computer system being configured to: receive indicating data from a sensing device, the indicating data being at least partially indicative of the identity of the form and an interactive element, the sensing device, when placed in an operative position
relative to an interactive element, being responsive to sense at least some of the coded data and generate the indicating data using the sensed coded data; define, using the at least one association operation, an association between the form and an object; generate, using the association, a form submission; and, transfer, to a form application, the form submission to thereby submit the object.
In an eleventh aspect the present invention provides a method of generating an association between an object and a sticker on a surface, the sticker having disposed therein or thereon coded data at least partially indicative of a sticker identity, the method including, in a computer system: receiving indicating data from a sensing device, the indicating data being at least partially indicative of the identity of the sticker, the sensing device being responsive to sensing at least some of the coded data to generate the indicating data; identifying, using the indicating data, the identity of the sticker on the surface; and, generating an association based at least partially on the sticker identity and an object.
Optionally the method includes, in the computer system: generating the association based at least partially on the sticker identity and an object stored in an object repository.
Optionally the method includes, in the computer system: receiving object data indicative of at least one received object; and, storing, using the received object data, the at least one received object in the object repository.
Optionally the method includes, in the computer system: determining, using the object repository, a stored object to be associated with the sticker identity.
Optionally the method includes, in the computer system: recording the generated association in the computer system.
Optionally the method includes, in the computer system: deleting, from the object repository, the stored object after generating the association.
Optionally objects stored in the object repository are ordered according to when a received object was stored in the object repository, the method including, in the computer system: updating, using the received object data, the order of received objects in the object repository; determining, using the order indicated by the object repository, a stored object which has been most recently stored in the object repository; and, generating an association based at least partially on the most recently stored object and the sticker identity.
U2005/001416
24
Optionally the method includes, in the computer system: deleting, from the object repository, the most recently stored object after generating the association.
Optionally the object repository is located on a server, the method including, in a computer system: storing, using the received object data, the received object in the object repository located on the server; retrieving, using the object repository located on the server, the stored object to be associated with the sticker identity; and, recording, in the object repository located on the server, the generated association between the stored obj ect and the sticker identity.
In a further aspect there is provided a method, the sensing device including a current operating mode selected from a plurality of potential operating modes including an association mode, wherein the method includes, in the computer system: determining, using the indicating data, a selected operating mode of the sensing device; setting the current operating mode of the sensing device to the selected operating mode; and, if the current operating mode of the sensing device is set to the association mode, allowing the generation of an association.
Optionally the method includes, in the computer system: if the current operating mode of the sensing device is set to the association mode, generating an association based at least partially on a stored object in the object repository and a sticker identity using the next indicating data received from the sensing device.
Optionally the method includes, in the computer system: receiving object data indicative of an object identity of the received object; storing the object identity in the object repository; and, generating an association based at least partially on the sticker identity and the object identity.
Optionally the generated association is indicative of: the sticker identity; the object.
Optionally if the object repository is empty, the method includes, in the computer system: indicating an error when an association cannot be generated.
Optionally the association is generated according to a user identity, wherein the method includes, in the computer system: storing, using the received object data, the received object associated with the user identity in the obiect reoository.
Optionally the method includes, in the computer system: determining, using the object repository and the user identity, a stored object to be associated with the sticker identity.
Optionally the coded data is indicative of a plurality of locations on the sticker, the method including, in the computer system: receiving the indicating data indicative of at least one position of the sensing device relative to the sticker, the sensing device being responsive to sensing at least some of the coded data to generate the indicating data; identifying, using the indicating data, the at least one position; and, generating an association based at least partially on the at least one position.
Optionally the coded data is substantially invisible to an unaided human.
Optionally the coded data is printed on the surface using at least one of: an invisible ink; and, an infrared-absorptive ink.
In a first aspect there is provided a computer system configured to generate an association between an object and a sticker on a surface, the sticker having disposed therein or thereon coded data being at least partially indicative of a sticker identity, the computer system configured to: receive indicating data from a sensing device, the indicating data being at least partially indicative of the identity of the sticker, the sensing device being responsive to sensing at least some of the coded data to generate the indicating data; identify, using the indicating data, the identity of the sticker on the surface; and, generate an association based at least partially on the sticker identity and an object stored in an object repository.
In a twelfth aspect the present invention provides a method of generating an association between an object, a location on a surface and a sticker on the surface, the sticker having disposed therein or thereon first coded data at least partially indicative of a sticker identity and at least one action, the surface having disposed therein or thereon second coded data indicative of a plurality of locations on the surface respectively, the method including, in a computer system: receiving indicating data from a sensing device, the indicating data being at least partially indicative of the at least one action and at least one position of the sensing device relative to the surface, the sensing device, when placed in an operative position relative to at least some of the sticker and at least some of the surface, being responsive to sense at least some of the first coded data and at least some of the second coded data and generate the indicating data using the sensed first coded data and sensed second coded data;
identifying, using the indicating data, the sticker identity, the at least one action, the at least one position and the object; generating, using the at least one action, an association based at least partially on the sticker identity, the at least one position and the object.
Optionally the object is stored in an object repository, the method including, in the computer system: generating the association based at least partially on the object stored in the object repository.
Optionally the method includes, in the computer system: receiving object data indicative of at least one received object; and, storing, using the received object data, the at least one received object in the object repository.
Optionally the method includes, in the computer system: moving the sensing device from the sticker to the surface to sense at least some of the first coded data and at least some of the second coded data to generate the indicating data.
Optionally the method includes, in the computer system: recording the generated association in the computer system.
Optionally the method includes, in the computer system: deleting, from the object repository, the object after generating the association.
Optionally objects in the object repository are ordered according to when a received object was stored in the object repository, the method including, in the computer system: updating, using the received object data, the order of received objects in the object repository; determining, using the order indicated by the object repository, the object which has been most recently stored in the object repository; and, generating an association based at least partially on the most recently stored object.
Optionally the method includes, in the computer system: deleting, from the object repository, the most recently stored object after generating the association.
Optionally object repository is located on a server, the method including, in a computer system: storing, using the received object data, the received object in the object repository located on the server; retrieving, using the object repository located on the server, the object; and, recording, to the server, the generated association.
Optionally the method includes, in the computer system: receiving the object data indicative of an object identity of the received object;
storing the object identity in the object repository; and, generating an association based at least partially on the object identity.
Optionally the generated association is indicative of: the sticker identity; the location on the surface; and, the object.
Optionally the association is generated according to a user identity, wherein the method includes, in the computer system: storing, using the received object data, the received object associated with the user identity in the object repository.
Optionally the method includes, in the computer system: determining, using the object repository and the user identity, the object to be associated with the sticker identity and the location on the surface.
Optionally if the object repository is empty, the method includes, in the computer system: indicating an error when an association cannot be generated.
Optionally at least some of the first coded data is indicative of an object type, the method including: receiving the indicating data indicative of the object type; and, identifying, using the indicating data, the object type and the object of the object type.
Optionally the first coded data is at least partially indicative of at least one interactive element, the at least one interactive element is related to the least one action, the method including, in the computer system: receiving, from the sensing device, indicating data at least partially indicative of the at least one action, the sensing device, when placed in an operative position relative to the at least one interactive element, being responsive to sense at least some of the first coded data and generate the indicating data using the sensed first coded data; identifying, using the indicating data, the sticker identity and at least one action and the at least one location; and, generating, using the at least one action, an association based at least partially on the sticker identity and the at least one location and an object.
In a further aspect there is provided a method, the first coded data being indicative of at least one location on the sticker, the method including, in the computer system: receiving the indicating data further indicative of a second position of the sensing device relative to the sticker, the sensing device being responsive to sensing at least some of the first coded data to generate the indicating data indicative of the second position;
identifying, using the indicating data, the at least one second position; and, generating an association based at least partially on the at least one second position.
Optionally the at least one of the first coded data and second coded data is substantially invisible to an unaided human.
Optionally at least one of the first coded data and the second coded data is printed on the surface using at least one of: an invisible ink; and, an infrared-absorptive ink.
In a further aspect there is provided a computer system configured to generate an association between an object, a location on a surface and a sticker on the surface, the sticker having disposed therein or thereon first coded data at least partially indicative of a sticker identity and at least one action, the surface having disposed therein or thereon second coded data indicative of a plurality of locations on the surface respectively, the computer system being configured to: receive indicating data from a sensing device, the indicating data being at least partially indicative of the at least one action and at least one location on the surface, the sensing device, when placed in an operative position relative to the sticker and operatively moved from the sticker to the surface, being responsive to sense at least some of the first coded data and at least some of the second coded data and generate the indicating data using the sensed first coded data and sensed second coded data; identify, using the indicating data, the sticker identity and the at least one action and the at least one location; identify the object to be associated with the sticker identity and the at least one location; and, generate, using the at least one action, an association based at least partially on the sticker identity and the at least one location and the object.
In a thirteenth aspect there is provided a method of generating an association between a sticker and an object of an object type, the sticker having disposed therein or thereon coded data at least partially indicative of a sticker identity and the object type, the method including, hi a computer system: receiving indicating data from a sensing device, the indicating data being at least partially indicative of the identity of the sticker and the object type, the sensing device, when placed in an operative position relative to the sticker, being responsive to sense at least some of the coded data and generate the indicating data using the sensed coded data; identifying, using the indicating data, the identity of the sticker, the object type and the object of the object type; and, generating an association based at least partially on the sticker identity and the object.
Optionally the object is stored in an object repository, the method including, in the computer system: generating the association based at least partially on the object stored in the object repository.
Optionally the method includes, in the computer system: receiving object data indicative of at least one received object; and, storing, using the received object data, the at least one received object in the object repository.
Optionally the method includes, in the computer system: selecting, using the object type, a stored object having the object type to be associated with the sticker identity.
Optionally the method includes, in the computer system: receiving, from the sensing device, indicating data indicative of a value related to at least some of the coded data; and, determining, using the value, the object type for selecting an object to be associated with the sticker.
Optionally the object type includes at least one of: a video object; an image object; a audio object; a text object; a file object; and, a data object.
Optionally the coded data is at least partially indicative of at least one interactive element, the at least one interactive element being related to at least one action, the method including, in the computer system: receiving, from the sensing device, indicating data at least partially indicative of the at least one action, the sensing device, when placed in an operative position relative to the at least one interactive element, being responsive to sense at least some of the coded data and generate the indicating data using the sensed coded data; identifying, using the indicating data, the at least one action; and, generating, using the at least one action, the association.
Optionally the objects stored in the object repository are ordered according to when a received object was stored in the object repository, the method including, in the computer system: updating, using the received object data, the order of received objects in the object repository; determining, using the order indicated by the object repository, a stored object which has been most recently stored in the object repository; and, generating an association based at least partially on the most recently stored object.
Optionally the method includes, in the computer system: recording the generated association in the computer system.
Optionally the method includes, in the computer system: deleting, from the object repository, the stored object after generating the association.
Optionally object repository is located on a server, the method including, in a computer system: storing, using the received object data, the received object in the object repository located on the server; retrieving, using the object repository located on the server, the stored object to be associated with the sticker identity; and, recording, in the server, the generated association.
Optionally the method includes, in the computer system: receiving object data indicative of an object identity of the received object; storing the object identity in the object repository; and, generating an association based at least partially on the object identity.
Optionally the generated association is indicative of: the sticker identity; the object.
Optionally if the object repository is empty, the method includes, in the computer system: indicating an error when an association cannot be generated.
Optionally the association is generated according to a user identity, wherein the method includes, in the computer system: storing, using the received object data, the received object associated with the user identity in the object repository.
Optionally the method includes, in the computer system: determining, using the object repository and the user identity, a stored object to be associated with the sticker identity.
Optionally the coded data is indicative of at least one location on the sticker, the method including, in the computer system: receiving the indicating data indicative of at least one position of the sensing device relative to the sticker, the sensing device being responsive to sensing at least some of the coded data to generate the indicating data; identifying, using the indicating data, the at least one position; and, generating an association based at least partially on the at least one position.
Optionally the coded data is substantially invisible to an unaided human.
Optionally the coded data is printed on the sticker using at least one of: an invisible ink; and, an infrared-absorptive ink.
In a further aspect there is provided a computer system configured to generate an association between a sticker and an object of an object type, the sticker having disposed therein or thereon coded data at least partially indicative of a sticker identity and the object type, the computer system being configured to: receive indicating data from a sensing device, the indicating data being at least partially indicative of the identity of the sticker and the object type, the sensing device, when placed in an operative position relative to the sticker, being responsive to sense at least some of the coded data and generate the indicating data using the sensed coded data; identify, using the indicating data, the identity of the sticker, the object type and the object of the object type; and, generate an association based at least partially on the sticker identity and the object.
In a fourteenth aspect there is provided a method of identifying a surface and a sticker on the surface, the sticker including a first region having disposed therein or thereon first coded data at least partially indicative of a sticker identity, and a second region, the surface having disposed therein or thereon second coded data at least partially indicative of an identity of the surface and a plurality of locations on the surface, the method including, in a computer system: receiving indicating data from a sensing device, the indicating data being at least partially indicative of the identity of the sticker, the identity of the surface and a position of the sticker on the surface, the sensing device, when placed or moved in an operative position relative to the sticker, being responsive to sense at least some of the first coded data and sense, through the second region, at least some of the second coded data and generate the indicating data using the sensed first coded data and the sensed second coded data; and, identifying, using the indicating data, the identity of the sticker, the identity of the surface and the position of the sticker.
Optionally the method includes, in the computer system: identifying an object to be associated with at least one of the sticker identity, the identity of the surface and the position of the sticker.
Optionally the method includes, in the computer system: generating an association based at least partially on the sticker identity, the identity of the surface, the position of the sticker and the object.
Optionally the method includes, in the computer system:
moving the sensing device from the first region to the second region to sense at least some of the first coded data and at least some of the second coded data to generate the indicating data.
Optionally the first coded data is indicative of an object type, the method including, in the computer system: receiving the indicating data indicative of the object type; identifying the object using the object type.
Optionally the second region is transparent in at least part of the infrared spectrum and opaque in at least part of the visible spectrum.
Optionally the second region includes graphics.
Optionally the object is stored in an object repository, the method including, in the computer system: generating the association based at least partially on the object stored in the object repository.
Optionally the method includes, in the computer system: receiving object data indicative of at least one received object; and, storing, using the received object data, the at least one received object in the object repository.
Optionally the method includes, in the computer system: recording the generated association in the computer system.
Optionally the method includes, in the computer system: deleting, from the object repository, the object after generating the association.
Optionally objects stored in the object repository are ordered according to when a received object was stored in the object repository, the method including, in the computer system: updating, using the received object data, the order of received objects in the object repository; determining, using the order indicated by the object repository, the object which has been most recently stored in the object repository; and, generating an association based at least partially on the most recently stored object.
Optionally the method includes, in the computer system: deleting, from the object repository, the most recently stored object after generating the association.
Optionally the object repository is located on a server, the method including, in a computer system: storing, using the received object data, the received object in the object repository located on the server; retrieving, using the object repository located on the server, the object; and, recording, on the server, the generated association.
Optionally the generated association is indicative of at least two of: the sticker identity; the identity of the surface; the object; and the position of the sticker.
Optionally the association is generated according to a user identity, wherein the method includes, in the computer system: storing, using the received object data, the received object associated with the user identity in the object repository.
Optionally the method includes, in the computer system: determining, using the object repository and the user identity, a stored object to be associated with the sticker identity and the position of the sticker.
Optionally the first region and second region are at least one of: distinct; overlapping; and, coincident.
Optionally the coded data is substantially invisible to an unaided human.
In a further aspect there is provided a computer system configured to identify a surface and a sticker on the surface, the sticker including a first region having disposed therein or thereon first coded data at least partially indicative of a sticker identity, and a second region, the surface having disposed therein or thereon second coded data at least partially indicative of an identity of the surface and a plurality of locations on the surface, the computer system being configured to: receive indicating data from a sensing device, the indicating data being at least partially indicative of the identity of the sticker, the identity of the surface and a position of the sticker on the surface, the sensing device, when placed or moved in an operative position relative to the sticker, being responsive to sense at least some of the first coded data and sense, through the second region, at least some of the second coded data and generate the indicating data using the sensed first coded data and the sensed second coded data; and, identify, using the indicating data, the identity of the sticker, the identity of the surface and the position of the sticker.
In a fifteenth aspect the present method of performing an action in relation to a first association between a reusable sticker and an object, the reusable sticker having disposed therein or thereon coded data indicative of a sticker identity and of a first interactive element representing the action, the method including:
receiving first indicating data from a sensing device, the first indicating data being at least partially indicative of the sticker identity and the first interactive element, the sensing device, when placed in an operative position relative to the first interactive element, sensing at least some of the coded data to generate the first indicating data; identifying, using the first indicating data, the action and the first association; and, performing the action hi relation to the first association.
Optionally the first interactive element includes at least one of: a deletion interactive element representing the action of deleting the first association; and, a generation interactive element representing the action of generating a second association.
Optionally the coded data is indicative of a confirmation interactive element, the method including, after receiving the first indicating data: receiving second indicating data from the sensing device, the second indicating data being indicative of the confirmation interactive element, the sensing device, when placed in an operative position relative to the confirmation interactive element, sensing at least some of the coded data to generate the second indicating data; and, identifying, using the second indicating data, the confirmation interactive element; and, allowing the performance of the action.
Optionally the method includes: allowing the performance of the action only if the confirmation interactive element is identified within a period of time after identifying the action.
Optionally the period of time is approximately 10 seconds. Optionally the method includes: identifying, using the first indicating data, at least one of: the sticker identity; and, the interactive element; and, identifying, using at least one of the sticker identity and the interactive element, the action to be performed in relation to the first association.
Optionally the method includes: identifying the generation interactive element and the action represented by the generation interactive element; identifying a second object to be associated with the sticker identity; and, performing the action by generating the second association between the sticker identity and the second object.
Ontionaily the method includes, prior to performing the action of generating the second association:
performing the action of deleting the first association.
Optionally the method includes, in the computer system: storing the second association in at least one of: a computer system; and, a server.
Optionally the second object is stored in an object repository, the method including, in the computer system: generating the second association based at least partially on the sticker identity and the second object stored in the object repository.
Optionally the coded data is indicative of an object type, the method including, in the computer system: receiving the indicating data indicative of the object type; and, using the object type to identify the second object.
Optionally the method includes: identifying the deletion interactive element and the action represented by the delete interactive element; and, performing the action by deleting the first association.
Optionally the method includes: deleting the object of the first association.
Optionally if the action cannot be performed in relation to the first association, the method includes: indicating an error when the action cannot be performed.
Optionally the reusable sticker includes visual graphics indicative of the first interactive element.
Optionally the visual graphics of the first interactive element are substantially coincident with the coded data.
In a further aspect there is provided a method, the coded data being indicative of at least one location on the reusable sticker, the method including, in the computer system: receiving the indicating data further indicative of a position of the sensing device relative to the reusable sticker, the sensing device being responsive to sensing at least some of the coded data to generate the indicating data indicative of the position; identifying, using the indicating data, the position; and, performing the at least one action based at least partially on the position.
Optionally the coded data is substantially invisible to an unaided human.
Optionally the coded data is printed on the reusable sticker using at least one of: an invisible ink; and, an infrared-absorptive ink.
In a further aspect there is provided a computer system configured to perform an action in relation to a first association between a reusable sticker and an object, the reusable sticker having disposed therein or thereon coded data indicative of a sticker identity and of a first interactive element representing the action, the computer system configured to: receive first indicating data from a sensing device, the first indicating data being at least partially indicative of the sticker identity and the first interactive element, the sensing device, when placed in an operative position relative to the first interactive element, sensing at least some of the coded data to generate the first indicating data; identify, using the first indicating data, the action and the first association; and, perform the action in relation to the first association.
In a sixteenth aspect there is provided a method of retrieving an image using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the image; and, retrieving, using the mobile telecommunications device, the image.
Optionally information associated with or representative of the image is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the image is retrievable from a database using the print media identifier and the database is at least one of: stored locally at the mobile telecommunications device; and stored remotely at a server.
Optionally the image is a photograph captured by a camera of the mobile telecommunications device.
Optionally the image is installed as wallpaper for the mobile telecommunications device.
Optionally linking of the image to the print media identifier uses the sensor module.
Optionally the image is received by the mobile telecommunications device prior to linking the image to the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first
format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the image to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the image.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the image using the mobile telecommunications device.
Optionally the image is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the image.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to an image, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the image retrievable from a database using the print media identifier.
In a seventeenth aspect there is provided a method of retrieving audio data using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the audio data; and, retrieving, using the mobile telecommunications device, the audio data.
Optionally information associated with or representative of the audio data is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device
Optionally the audio data is installed as a ringtone on the mobile telecommunications device.
Optionally the audio data is a voice memo recorded by the mobile telecommunications device.
Optionally the audio data is played using a speaker of the mobile telecommunications device.
Optionally the audio data is installed as a music clip in an audio data library on the mobile telecommunications device.
Optionally the audio data is received by the mobile telecommunications device prior to linking the audio data to the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the audio data to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes:
when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the audio data.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the audio data using the mobile telecommunications device.
Optionally the audio data is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the audio data.
La a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to audio data, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the audio data retrievable from a database using the print media identifier.
In an eighteenth aspect there is provided a method of retrieving video data using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the video data; and,
retrieving, using the mobile telecommunications device, the video data.
Optionally information associated with or representative of the video data is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the video data is a movie clip.
Optionally the video data is recorded by the mobile telecommunications device.
Optionally the video data is played using the mobile telecommunications device.
Optionally the video data is installed as a video data clip in a video data library on the mobile telecommunications device.
Optionally the video data is received by the mobile telecommunications device prior to linking the video data to the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the video data to the print media identifier.
• Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes : when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
41
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the video data.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the video data using the mobile telecommunications device.
Optionally the video data is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the video data.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to video data, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the video data retrievable from a database using the print media identifier.
In a nineteenth aspect there is provided a method of retrieving a web page using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the web page; and, retrieving, using the mobile telecommunications device, the web page.
Optionally information associated with or representative of the web page is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the web page is retrievable from a database using the print media identifier and the database is at least one of: stored locally at the mobile telecommunications device; and stored remotely at a server.
Optionally the web page is, or is contained within, an SMS, MMS or email message received by the mobile telecommunications device.
Optionally the web page is at least partially rendered at a server prior to being transferred to the mobile telecommunications device.
Optionally linking of the web page to the print media identifier uses the sensor module.
Optionally the web page is received by the mobile telecommunications device prior to linking the web page to the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the web page to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the web page.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the web page using the mobile telecommunications device.
Optionally the web page is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the web page.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to a web page, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the web page retrievable from a database using the print media identifier.
In a twentieth aspect there is provided a method of retrieving a document using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the document; and, retrieving, using the mobile telecommunications device, the document.
Optionally information associated with or representative of the document is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the document is retrievable from a database using the print media identifier and the database is at least one of: stored locally at the mobile telecommunications device; and stored remotely at a server.
Optionally the document is, or is contained within, an SMS, MMS or email message received by the mobile telecommunications device.
Optionally the document is at least partially rendered at a server prior to being transferred to the mobile telecommunications device.
Optionally the document can be edited using the mobile telecommunications device.
Optionally the document is received by the mobile telecommunications device prior to linking the document to the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the document to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the document.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the document using the mobile telecommunications device.
Optionally the document is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the document.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to a document, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the document retrievable from a database using the print media identifier.
In a twenty first aspect the present invention provides a method of retrieving contact details using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the contact details; and, retrieving, using the mobile telecommunications device, the contact details.
Optionally information associated with or representative of the contact details is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the contact details include information selected from the group consisting of one or more of a name, telephone number, address, email address and Internet address.
Optionally the contact details are loaded into an address book of the mobile telecommunications device.
Optionally the mobile telecommunications device automatically dials a telephone number included in the contact details.
Optionally the mobile telecommunications device automatically addresses a SMS, MMS or email using the contact details.
Optionally the contact details are received by the mobile telecommunications device prior to linking the contact details to the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first
format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the contact details to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the contact details.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the contact details using the mobile telecommunications device.
Optionally the contact details are associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the contact details.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to contact details, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the contact details retrievable from a database using the print media identifier.
In a twenty second aspect the present invention provides a method of retrieving a program using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the program; and, retrieving, using the mobile telecommunications device and the print media identifier, the program.
Optionally information associated with or representative of the program is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the program is executed by the mobile telecommunications device.
Optionally the program is installed on the mobile telecommunications device.
Optionally the program is at least one of: an application; a utility; a service; a game; an accessory; a driver; an interface; an operating system; a patch; an update; a tool; and components thereof.
Optionally the program is retrieved from a database and the database is at least one of: stored locally at the mobile telecommunications device; and stored remotely at a server.
Optionally the program is retrieved in parts.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the program to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes:
when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the program.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the program using the mobile telecommunications device. ■
Optionally the program is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the program.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to a program, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the program retrievable from a database using the print media identifier.
In a twenty third aspect the present invention provides a method of retrieving a program state using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the program state; and,
retrieving, using the mobile telecommunications device and the print media identifier, the program state.
Optionally information associated with or representative of the program state is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the program state is loaded onto the mobile telecommunications device.
Optionally loading the program state initiates at least one of installation and execution of an associated program on the mobile telecommunications device.
Optionally the program state is at least one of: a state of an application; a state of a utility; a state of a service; a state of a game; a state of an accessory; a state of a driver; a state of an interface; a state of an operating system; a state of a patch; a state of an update; a state of a tool; and a state of components thereof.
Optionally the program state is retrieved from a database and the database is at least one of: stored locally at the mobile telecommunications device; and stored remotely at a server.
Optionally the program state indicates a player location or level in a game.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the program state to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
^
U2005/001416
50
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern. '
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the program state.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the program state using the mobile telecommunications device.
Optionally the program state is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the program state.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to a program state, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the program state retrievable from a database using the print media identifier.
In a twenty fourth aspect there is provided a method of gaining access to a resource using an access token linked to a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the access token; identifying, using the mobile telecommunications device and the print media identifier, the access token; and, causing the access token to be supplied to a system, wherein the system is configured to authenticate the access token and, if the authentication succeeds, provide access to the resource.
Optioanlly information associated with or representative of successful authentication is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the resource is at least one of: an application; a utility; a service; a game; an accessory; a driver; an interface; an operating system; a patch; an update; a tool; a file; an image; audio; video; a document; a web page; and components thereof.
Optionally the access token is indicative of at least one of: a key; a cryptographic key; a password; a code; biometric information; and a digital signature.
Optionally the system is a server in communication with the mobile telecommunications device.
Optionally the access token is identified from a database and the database is at least one of: stored locally at the mobile telecommunications device; and stored remotely at a server.
Optionally access tokens are periodically supplied to the system.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the access token to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two-dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and identifying, if the digital signature is authentic, the access token.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the access token using the mobile telecommunications device.
Optionally the access token is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, identifying, if the determined position is within the region, the access token.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to an access token, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the access token identifiable from a database using the print media identifier.
In a twenty fifth aspect there is provided a method of retrieving a product using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the product; and, retrieving, using the mobile telecommunications device and the print media identifier, the product.
Optionally information associated with or representative of the product is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the product is a sample product.
Optionally the product is required to be purchased.
W
53
Optionally the product is at least one of: an application; a utility; used to obtain a service; a game; an accessory; an image; audio; video; a document; a mobile phone ringtone; mobile phone wallpaper; a database; data; a program; a program state; an access token; a ticket; a voucher; and a map.
Optionally the product is retrieved from a database and the database is at least one of: stored locally at the mobile telecommunications device; and stored remotely at a server.
Optionally one or more products are retrieved periodically by the mobile telecommunications device.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the product to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the product.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the product using the mobile telecommunications device.
Optionally the product is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the product.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to a product, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the product retrievable from a database using the print media identifier.
In a twenty sixth aspect the present invention provides a method of retrieving a bill using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the bill; and, retrieving, using the mobile telecommunications device and the print media identifier, at least one of the linked bill and information regarding the bill.
Optionally information associated with or representative of the bill is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the method furthing including causing the bill to be paid using the mobile telecommunications device.
Optionally a receipt is transmitted to the mobile telecommunications device.
Optionally the bill relates to at least one of: telecommunication services; an application; a utility; a service; a game; an accessory; an image; audio; video; a document; a mobile phone ringtone; mobile phone wallpaper; access to a database; retrieval of data; a program; a program state; an access token; a ticket; a voucher; a map; and a card.
Optionally the bill is obtained using information in a database and the database is at least one of: stored locallv at the mobile telecommunications device; and stored remotely at a server.
Optionally one or more bills are retrieved periodically by the mobile telecommunications device.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the bill to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes : when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the bill.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the bill using the mobile telecommunications device.
Optionally the bill is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the bill.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to a bill, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the bill retrievable from a database using the print media identifier.
In a twenty seventh aspect the present invention provides a method of retrieving location data using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the location data; and, retrieving, using the mobile telecommunications device and the print media identifier, the location data.
Optionally information associated with or representative of the location data is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the location data is loaded into a navigation system.
Optionally the location data is indicative of at least one of a longitude, a latitude, a country, a region, a city, a suburb, a street address, a location of a person, and a location of a device.
Optionally the retrieved location data is time stamped.
Optionally the location data is retrieved periodically.
Optionally the location data is associated with at least one of: an image; and video, captured by the mobile telecommunications device.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second copied data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the location data to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern. ,
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the location data.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the location data using the mobile telecommunications device.
Optionally the location data is associated with a region of the print medium, the method including: • reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the location data.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to location data, the print media
identifier able to be determined using a sensor module of a mobile telecommunications device, the location data retrievable from a database using the print media identifier.
In a twenty eighth aspect there is provided a method of capturing an object and linking the object to a print medium, the method including: capturing the object; and submitting a request to associate the object with a print media identifier of the print medium, submission of the request facilitating identification of the object and the print media identifier; wherein, the association of the object and the print media identifier is recorded in a database, the object retrievable from the database using the print media identifier.
Optionally the method includes: recording, using a recording device, a plurality of objects in an object repository; and determining, using the object repository, the object.
Optionally the method includes: recording, using the recording device, the plurality of objects in the object repository, wherein the plurality of objects in the object repository are ordered according to when the objects were recorded in the object repository; and determining, using the order indicated by the object repository, the object which has been most recently recorded in the object repository.
Optionally the print medium is supplied to a user with at least one pre-associated object.
' Optionally the mobile telecommunications device facilitates the capture of the object.
In a further aspect there is provided a method, further including the steps of: receiving the print medium in a media feed path of the mobile telecommunications device; and reading the print media identifier from the print medium using a sensor module of the mobile telecommunications device.
Optionally the sensor module is one of: integrated with the mobile telecommunications device; and external to the mobile telecommunications device.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in the media feed path, sensing, using the sensor module, at least some of the coded data; and determining, using at least some of the sensed coded data, the print media identifier.
Optionally the media feed path includes a printer.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by sensing at least some of the coded data using the sensor module, the digital signature; and if the digital signature is authentic, submitting the request to associate the object with a print media identifier.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally the printer prints at least some of the coded data on the print medium.
Optionally the method includes: generating, using the object, an object representation; and, printing, using the printer, the object representation on the print medium.
Optionally the object is at least one of: an image captured via a camera; a video clip captured via a video camera; an audio clip captured via an audio recorder; a location captured via a positioning system; fin altitude captured via an altimeter;
a time captured from a clock; and a temperature captured via a thermometer.
Optionally the coded data is substantially invisible to an unaided human.
Optionally the coded data is printed on the print medium using at least one of: an invisible ink; and, an infrared-absorptive ink.
In a twenty ninth aspect the present invention provides a method of performing an action in relation to an object, the method including: determining a request to perform the action in relation to the object; identifying, using the request, action data indicative of at least one of: the action; the object; and, a target device to perform the action in relation to the object; and, performing, using the action data, the action in relation to the object.
Optionally the action data is stored in an object repository, wherein the method includes: storing the action data in the object repository.
Optionally the method includes: determining a plurality of partial requests; identifying, using the plurality of partial requests, the action data.
Optionally the method includes: selecting, from the object repository, action data based at least partially on an order in which the partial requests are determined; and, performing the action based at least partially on the selected action data.
Optionally the method includes: updating the order after selecting the action data.
Optionally the method includes: determining a first partial request indicative of the action and subsequently determining a plurality of second partial requests indicative of a plurality of objects; and, performing the action in relation to the plurality of objects.
Optionally the method includes one of: performing the action in relation to each object; and,
performing the action in relation to a combination of the plurality of objects.
Optionally the method includes: receiving indicating data indicative of deleting at least some of the action data from the object repository; and, deleting, using the indicating data, the at least some action data from the object repository.
Optionally the method includes: identifying, using the request, default action data indicative of at least one of: a default action; a default target device; and, a default object; and, determining, using the request and the default data, the action data.
Optionally the method includes: deleting at least some of the action data from the object repository if the action is not performed within a period of time after the action data has been stored in the object repository.
Optionally the method includes: receiving, from a sensor, indicating data at least partially indicative of the request, the sensor, when placed in an operative position relative to a surface having disposed therein or thereon coded data, sensing at least some of the coded data and generating the indicating data indicative of the request.
Optionally the action data is at least partially indicative of at least one object property of the object, the at least one object property including at least one of: an object type; and, an object category; wherein the method includes: identifying, based on the at least one object property, at least one of the action and the target device.
Optionally the method includes: receiving, from a software application, the request.
Optionally the method includes: determining at least one router device which is capable of redirecting the action data to one of a number of possible target devices; transferring the action data to the at least one router device; determining, in the at least one router device and from the number of possible target devices, the target device able to perform the action in relation to the object; and, transferring the action data to the determined target device.
Optionally the method includes: modifying, in the at least one router device, the action data prior to transferring the action data to the determined target device.
Optionally the method includes: determining using at least one player profile, the target device able to perform the action in relation to the object.
Optionally the player profile is selected according to at least one of the following criteria: input from a user; location of a user; login status of a user; tune of day; day of week; date; recency of use; and, frequency of use.
Optionally the method includes: performing the method using at least one processing system, the processing including at least one of: a computer system; a server; and, a mobile telecommunications device.
Optionally the coded data is indicative of a plurality of locations on the surface, the method including, in the computer system: receiving the indicating data indicative of a position of the sensing device relative to the surface; identifying, using the indicating data, the position; and, identifying, using the position, the request associated with the position.
Optionally the coded data is substantially invisible to an unaided human and wherein the coded data is printed on the surface using at least one of: an invisible ink; and, an infrared-absorptive ink.
In a thirtieth aspect the present invention provides a method of downloading an object using a surface having disposed therein or thereon first coded data being at least partially indicative of a download request for the object, the method including, in a processing system: receiving first indicating data from a sensing device, the first indicating data being at least partially indicative of the download request, the sensing device being responsive to sensing at least some of the first coded data to generate the first indicating data; transferring second indicating data to a server, the second indicating data being at least partially based on the first indicating data and indicative of the download request, wherein the server identifies, using the download request, the object for download; and, receiving, from the server, download data indicative of the object.
Optionally the first coded data is indicative of a surface identity, wherein the method includes: receiving the first indicating data from the sensing device, the first indicating data being at least partially indicative of the surface identity; identifying, using the first indicating data, the surface identity;, and, submitting, to a server, the second indicating data including the surface identity, wherein the server identifies, using the surface identity, an association between the surface identity and the object.
Optionally the method includes: performing, using the download data, an action in relation to the object.
Optionally the action is related to installing the object, wherein the method includes: installing, using the download data, the object.
Optionally the action is related to printing an object representation of the object, wherein the method includes: generating, using the download data, an object representation of the object; and, printing, using a printer operatively connected to the processing system, the object representation of the object.
Optionally the first coded data is indicative of a plurality of locations on the surface, wherein the method includes: receiving indicating data from the sensing device, the indicating data being at least partially indicative of a position of the sensing device relative to the surface; identifying, using the sensed first coded data, the position; and, submitting, to a server, the download request including the position, wherein the server identifies, using the position, an association between the position and the object.
Optionally the surface includes visual graphics indicative of an interactive element representing the download request, the method including:
receiving the first indicating data from the sensing device when the sensing device is placed in an operative position relative to the interactive element, wherein the sensing device senses at least some of the first coded data in the operative position.
Optionally the method includes: receiving, from the server, a plurality of portions of download data; and, collating the plurality of portions to form the download data.
Optionally the method includes: receiving, from the server, a stream of download data; and, performing, using the stream of download data, an action in relation to the object.
Optionally the processing system includes a mobile telecommunications device, the method including: receiving, from the server, the download data over at least one telecommunications network.
Optionally the method includes: submitting, to the server, the download request including a priority value, wherein the server begins to transfer the download data according to the priority value.
Optionally if the priority value is low, the method includes: receiving, from the server, the download data during at least one of: a non-peak time to transfer data over the at least one telecommunications network; and, one or more lulls in network traffic over the at least one telecommunications network.
Optionally the method includes: queuing download requests according to the priority value in a memory store operatively connected to the mobile telecommunications device; and, transferring, according to the priority value, the queued download requests to the server.
Optionally a sensor module is integrated with the mobile telecommunications device, the method including: sensing, using the sensor module of the mobile telecommunications device, at least some of the first coded data on or in the surface.
Optionally the method includes at least one of: displaying, using the download data, the object on a display of the mobile telecommunications device; and, printing, using the download data, the object to be printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the print medium includes second coded data indicative of a print medium identifier, the method including: sensing, using the sensor module, at least some of the second coded data; identifying, using the sensed second coded data, the print medium identifier; generating association data indicative of the object being printed on the print medium and the print medium identifier; and, transferring, to the server, the association data, wherein the server uses the association data to record an association between the object and the print medium identifier.
Optionally the second coded data on the print medium is indicative of a plurality of locations, the method including: determining, using the sensed second coded data, at least one location at which the object is being printed on the print medium; generating association data further indicative the at least one location; and, transferring, to the server, the association data, wherein the server uses the association data to record an association between the object and the print medium identifier and the at least one location.
Optionally the first coded data is substantially invisible to an unaided human.
Optionally the first coded data is printed on the surface using at least one of: an invisible ink; and, an infrared-absorptive ink.
In a further aspect there is provided a processing system configured to download an object using a surface having disposed therein or thereon first coded data being at least partially indicative of a download request for the object, the processing system being configured to: receive first indicating data from a sensing device, the first indicating data being at least partially indicative of the download request, the sensing device being responsive to sensing at least some of the first coded data to generate the first indicating data; transfer second indicating data to a server, the second indicating data being at least partially based on the first indicating data and indicative of the download request, wherein the server identifies, using the download request, the object for download; and, receive, from the server, download data indicative of the object.
In a thirty first aspect there is provided a method of gaining access to a resource using an access token printed on a print medium, comprising the steps of: determining, using a sensor module of a mobile telecommunications device, the access token and a print media identifier printed on the print medium; and, causing the access token to undergo authentication, at least partially based on the print media identifier and if the authentication succeeds, gaining access to the resource.
Optionally information associated with or representative of successful authentication is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the resource is at least one of: an application; a utility; a service; a game; an accessory; a driver; an interface; an operating system; a patch; an update; a tool; a file; an image; audio; video; a document; a web page; and components thereof.
Optionally the access token is indicative of at least one of: a key; a cryptographic key; a password; a code; biometric information; and a digital signature.
Optionally authentication occurs at one or more of the mobile telecommunications device and a remote system.
Optionally an access token is only partially printed on the print medium, with access to the resource requiring more than one print medium.
Optionally more than one access token to different resources are printed on the print medium.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the access token to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and identifying, if the digital signature is authentic, the access token.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the resource using the mobile telecommunications device.
Optionally the access token is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, identifying, if the determined position is within the region, the access token.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier and an access token, the print media identifier linked to the access token, the print media identifier and the access token able to be determined using a sensor module of a mobile telecommunications device.
In a thirty second aspect the present invention provides a method of obtaining a physical product using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to information associated with the physical product; and, causing, using the mobile telecommunications device and the print media identifier, the information associated with the physical product to be transmitted to a system, whereby the system initiates the delivery of the physical product to a recipient.
Optionally information associated with or representative of the physical product is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally information associated with or representative of the delivery status of the physical product is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the system performs a payment check prior to delivery of the physical product.
Optionally the physical product is a vendible good.
Optionally information about the availability of the physical product is retrieved from a database and delivered to the mobile telecommunications device.
Optionally a receipt is transmitted to the mobile telecommunications device by the system.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the information associated with the physical product to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including:
determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the information associated with the physical product.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the physical product using the mobile telecommunications device.
Optionally the physical product is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the information associated with the physical product.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to information associated with the physical product, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the information associated with the physical product retrievable from a database using the print media identifier.
In a thirty third aspect the present invention provides a system for printing a photograph on a print medium, the system comprising: a mobile telecommunications device which comprises: a camera to capture the photograph; a printer module to print the photograph on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the photograph is optionally stored in an archive.
Optionally the sensor module is used to link the photograph to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the photograph with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the photograph can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the photograph using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the photograph.
Optionally the printed photograph is a permission token readable using the sensor module to at least one of: retrieve information associated with the photograph from the archive; and gain access to a resource.
Optionally printing the photograph causes information associated with the photograph to be archived.
Optionally the information associated with the photograph includes one or more of: the photograph; a visual description of the photograph; an image of the photograph; an interactive description of the photograph; contents of the photograph; and photograph details.
Optionally more than one photograph is printed on a print medium.
Optionally a caption is printed with the photograph.
In a thirty fourth aspect the present invention provides a system for printing a business card on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the business card on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the business card is optionally stored in an archive.
Optionally the sensor module is used to link the business card to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the business card with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored ramotelv at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the business card can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the business card using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the business card.
Optionally the printed business card is a permission token readable using the sensor module to retrieve information associated with the business card, the information including at least one of: a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
Optionally printing the business card causes information associated with the business card to be archived.
Optionally the information associated with the business card includes one or more of: the business card; a visual description of the business card; an image of the business card; an interactive description of the business card; contents of the business card; and business card details.
Optionally the business card includes at least one of: a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details printed on the print medium.
Optionally the business card is received wirelessly by the mobile communications device.
In a thirty fifth aspect the present invention provides a system for printing a calendar on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the calendar on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the calendar is optionally stored in an archive.
Optionally the sensor module is used to link the calendar to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the calendar with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the calendar can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the calendar using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the calendar.
Optionally the printed calendar is a permission token readable using the sensor module to at least one of: retrieve information associated with the calendar from the archive; and gain access to a resource.
Optionally printing the calendar causes information associated with the calendar to be archived.
Optionally the information associated with the calendar includes one or more of: the calendar; a visual description of the calendar; an image of the calendar; an interactive description of the calendar; contents of the calendar; and calender details.
Optionally the calendar is synchronised with another calender on another terminal.
Optionally the printed calendar includes advertising.
In a thirty sixth aspect the present invention provides a system for printing a reminder list on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the reminder list on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the reminder list is optionally stored in an archive.
Optionally the sensor module is used to link the reminder list to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the reminder list with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the reminder list can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the reminder list using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the reminder list.
Optionally the printed reminder list is a permission token readable using the sensor module to at least one of: retrieve information associated with the reminder list from the archive; and gain access to a resource.
Optionally printing the reminder list causes information associated with the reminder list to be archived.
Optionally the information associated with the reminder list includes one or more of: the reminder list; a visual description of the reminder list; an image of the reminder list; an interactive description of the reminder list; contents of the reminder list; and reminder list details.
Optionally at least part of the reminder list is printed as a result of a reminder clock setting associated with the reminder list.
Optionally the reminder list contains periodic entries.
01416
76
In a thirty seventh aspect the present invention provides a system for printing an almanac on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the almanac on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the almanac is optionally stored in an archive.
Optionally the sensor module is used to link the almanac to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the almanac with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the almanac can be subsequently retrieved from the archive using the υrint media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the almanac using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the almanac.
Optionally the printed almanac is a permission token readable using the sensor module to at least one of: retrieve information associated with the almanac from the archive; and gain access to a resource.
Optionally printing the almanac causes information associated with the almanac to be archived.
Optionally the information associated with the almanac includes one or more of: the almanac; a visual description of the almanac; an image of the almanac; an interactive description of the almanac; contents of the almanac; and almanac details.
Optionally the almanac is periodically printed.
Optionally the almanac includes meteorological information.
In a thirty eighth aspect the present invention provides a system for printing a web page on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the web page on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the web page is optionally stored in an archive.
Optionally the sensor module is used to link the web page to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the web page with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the web page can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the web page using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the web page.
Optionally the printed web page is a permission token readable using the sensor module to at least one of: retrieve information associated with the web page from the archive; and gain access to a resource.
Optionally printing the web page causes information associated with the web page to be archived.
Optionally the information associated with the web page includes one or more of: the web page; a visual description of the web page; an image of the web page; an interactive description of the web page; contents of the web page; and web page details.
Optionally the web page is periodically printed.
Optionally the web page is specially formatted.
In a thirty ninth aspect the present invention provides a system for printing a ticket on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the ticket on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the ticket is optionally stored in an archive.
Optionally the sensor module is used to link the ticket to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system as further including use of a database to store an association of the ticket with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the ticket can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the ticket using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the ticket.
Optionally the printed ticket is a permission token readable using the sensor module to at least one of: retrieve information associated with the ticket from the archive; and gain access to a resource.
Optionally printing the ticket causes information associated with the ticket to be archived.
Optionally the information associated with the ticket includes one or more of: the ticket; a visual description of the ticket; an image of the ticket; an interactive description of the ticket; contents of the ticket; and ticket details.
Optionally the ticket is readable by another device.
Optionally the ticket includes an identification photograph.
In a fortieth aspect the present invention provides a system for printing a timetable on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the timetable on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the timetable is optionally stored in an archive.
Onfionaiiy the sensor module is used to link the timetable to the print media identifier.
W
81
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
In a further aspect there is provided system further including use of a database to store an association of the timetable with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the timetable can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the timetable using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the timetable.
Optionally the printed timetable is a permission token readable using the sensor module to at least one of: retrieve information associated with the timetable from the archive; and gain access to a resource.
Optionally printing the timetable causes information associated with the timetable to be archived.
Optionally the information associated with the timetable includes one or more of: the timetable; a visual description of the timetable; an image of the timetable; an interactive description of the timetable; contents of the timetable; and timetable details.
Optionally the timetable is for at least one of: an educational institution; transportation; a bus; a train; a ferry; a boat; a flight; a tram; a cruise; a tour; and entertainment.
Optionally the information in the timetable is retrieved from a central server.
In a forty first aspect the present invention provides a system for printing a gambling ticket on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the ticket on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the gambling ticket is optionally stored in an archive.
Optionally the sensor module is used to link the gambling ticket to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the gambling ticket with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the gambling ticket can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the gambling ticket using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the gambling ticket.
Optionally the printed gambling ticket is a permission token readable using the sensor module to at least one of: retrieve information associated with the gambling ticket from the archive; determine if a prize is associated with the gambling ticket; and gain access to a resource.
Optionally printing the gambling ticket causes information associated with the gambling ticket to be archived.
Optionally the information associated with the gambling ticket includes one or more of: the gambling ticket; a visual description of the gambling ticket; an image of the gambling ticket; an interactive description of the gambling ticket; contents of the gambling ticket; and gambling ticket details.
Optionally the gambling ticket is readable by another device.
Optionally the gambling ticket is an instant lottery ticket.
In a forty second aspect the present invention provides a system for printing an advertisement on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the advertisement on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the advertisement is optionally stored in an archive.
Optionally the sensor module is used to link the advertisement to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the advertisement with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the advertisement can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the advertisement using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the advertisement.
Optionally the printed advertisement is a permission token readable using the sensor module to at least one of: retrieve information associated with the advertisement from the archive; obtain an incentive; obtain a redemption; obtain a voucher; obtain a discount; obtain a sample; and gain access to a resource.
Optionally printing the advertisement causes information associated with the advertisement to be archived.
Optionally the information associated with the advertisement includes one or more of: the advertisement; a visual description of the advertisement; an image of the advertisement; an interactive description of the advertisement; contents of the advertisement; and advertisement details.
Optionally the advertisement is simultaneously printed on the print medium with other content.
Optionally the advertisement is tailored to a user of the mobile telecommunications device.
In a forty third aspect the present invention provides a system for printing a receipt on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the receipt on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the receipt is optionally stored in an archive.
Optionally the sensor module is used to link the receipt to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the receipt with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the receipt can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked obj ect is stored in an obj ect repository.
Optionally printing requires paying for the receipt using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the receipt.
Optionally the printed receipt is a permission token readable using the sensor module to at least one of: retrieve information associated with the receipt from the archive; verify payment of the receipt; initiate navment of the receipt; and gain access to a resource.
Optionally printing the receipt causes information associated with the receipt to be archived.
Optionally the information associated with the receipt includes one or more of: the receipt; a visual description of the receipt; an image of the receipt; an interactive description of the receipt; contents of the receipt; and receipt details.
Optionally the receipt includes information on itemised purchases.
Optionally the receipt includes at least one of: an item description; an item price; a payment total; a payment date; an account number; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
In a forty fourth aspect the present invention provides a system for printing a bill on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the bill on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the bill is optionally stored in an archive.
Optionally the sensor module is used to link the bill to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the bill with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first
format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the bill can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the bill using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the bill.
Optionally the printed bill is a permission token readable using the sensor module to at least one of: retrieve information associated with the bill from the archive; initiate payment of the bill; pay the bill; obtain a copy of the bill; and gain access to a resource.
Optionally printing the bill causes information associated with the bill to be archived.
Optionally the information associated with the bill includes one or more of: the bill; a visual description of the bill; an image of the bill; an interactive description of the bill; contents of the bill; and bill details.
Optionally the bill includes information on itemised purchases.
Optionally the bill includes at least one of: an item description; an item price; a payment total; a payment due date; an account number; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
In a forty fifth aspect the present invention provides a system for printing a competition entry form on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the competition entry form on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the competition entry form is optionally stored in an archive.
Optionally the sensor module is used to link the competition entry form to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the competition entry form with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the competition entry form can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the competition entry form using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the competition entry form.
Optionally the printed competition entry form is a permission token readable using the sensor module to at least one of: retrieve information associated with the competition entry form from the archive; enter a competition; and gain access to a resource.
Optionally printing the competition entry form causes information associated with the competition entry form to be archived.
Optionally the information associated with the competition entry form includes one or more of: the competition entry form; a visual description of the competition entry form; an image of the competition entry form; an interactive description of the competition entry form; contents of the competition entry form; and competition entry form details.
Optionally one or more winners of the competition associated with the competition entry form receive notification via the mobile telecommunications device.
Optionally the competition entry form includes at least one of: a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; prize details; competition conditions; a competition closing date; and contact details.
In a forty sixth aspect the present invention provides a system for printing a coupon on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the coupon on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the coupon is optionally stored in an archive.
Optionally the sensor module is used to link the coupon to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the coupon with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the coupon can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the coupon using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the coupon.
Optionally the printed coupon is a permission token readable using the sensor module to at least one of: retrieve information associated with the coupon from the archive; redeem the coupon; recharge the coupon; obtain a copy of the coupon; and gain access to a resource.
Optionally printing the coupon causes information associated with the coupon to be archived.
Optionally the information associated with the coupon includes one or more of: the coupon; a visual description of the coupon; an image of the coupon; an interactive description of the coupon; contents of the coupon; and coupon details.
Optionally the coupon is provided with a validity period.
Optionally the coupon is personalised to include at least one of: an expiry date; redemption conditions; retailer details; product details; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
In a forty seventh aspect the present invention provides a system for printing a membership on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the membership on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the membership is optionally stored in an archive.
Optionally the sensor module is used to link the membership to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system as further including use of a database to store an association of the membership with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the membership can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the membership using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the membership.
Optionally the printed membership is a permission token readable using the sensor module to at least one of: retrieve information associated with the membership from the archive; prove membership status; obtain a copy of the membership; and gain access to a resource.
Optionally printing the membership causes information associated with the membership to be archived.
Optionally the information associated with the membership includes one or more of: the membership; a visual description of the membership; an image of the membership; an interactive description of the membership; contents of the membership; and membership details.
Optionally the membership is provided with a validity period.
Optionally the membership includes at least one of: a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
In a forty eighth aspect the present invention provides a system for printing a map on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the map on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the map is optionally stored in an archive.
Optionally the sensor module is used to link the map to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the map with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the map can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the map using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the map.
Optionally the printed map is a permission token readable using the sensor module to at least one of: retrieve information associated with the map from the archive; time stamp the map; generate a further map; and gam access to a resource.
Optionally printing the map causes information associated with the map to be archived.
Optionally the information associated with the map includes one or more of: the map; a visual description of the map; an image of the map; an interactive description of the map; contents of the map; and map details.
Optionally the map is of the vicinity of the mobile telecommunications device.
Optionally the map is of at least one of: a building; an area; roads; railways; waterways; a city; a country; and a region.
In a forty ninth aspect the present invention provides a system for printing a position on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the position on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the position is optionally stored in an archive.
Optionally the sensor module is used to link the position to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the position with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the position can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the position using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the position.
Optionally the printed position is a permission token readable using the sensor module to at least one of: retrieve information associated with the position from the archive; time stamp the position; generate a further position; print a map about the position; and gain access to a resource.
Optionally printing the position causes information associated with the position to be archived.
Optionally the information associated with the position includes one or more of: the position; a visual description of the position; an image of the position; an interactive description of the position; contents of the position; and position details.
Optionally the position is of the mobile telecommunications device.
Optionally the position is at least one of: a longitude; a latitude; a distance; a height; a relative location; a building; a street; a suburb; a town; a city; a state; and a country.
In a fiftieth aspect the present invention provides a system for printing location-based information on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the location-based information on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the location-based information is optionally stored in an archive.
Optionally the sensor module is used to link the location-based information to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system including use of a database to store an association of the location-based information with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media iHentifipr and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the location-based information can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the location-based information using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the location-based information.
Optionally the printed location-based information is a permission token readable using the sensor module to at least one of: retrieve information associated with the location from the archive; time stamp the location- based information; generate further location-based information; print a map covering the location; and gain access to a resource.
Optionally printing the location-based information causes information associated with the location-based information to be archived.
Optionally the information associated with the location-based information includes one or more of: the location-based information; a visual description of the location-based information; an image of the location- based information; an interactive description of the location-based information; features at the location-based information; and location-based information details.
Optionally the location is of the mobile telecommunications device.
Optionally the location-based information is at least one of: a building near the location; an address near the location; a particular type of premises near the location; and a restaurant near the location.
In a fifty first system for printing a security identification on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the security identification on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the security identification is optionally stored in an archive.
Optionally the sensor module is used to link the security identification to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the security identification with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the security identification can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the security identification using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the security identification.
Optionally the printed security identification is a permission token readable using the sensor module to at least one of: retrieve information associated with the security identification from the archive; prove security access status; obtain a copy of the security identification; and gain access to a resource.
Optionally printing the security identification causes information associated with the security identification to be archived.
Optionally the information associated with the security identification includes one or more of: the security identification; biometric information; a fingerprint; a voiceprint; an iris scan; an electronic signature; a visual description of the security identification; an image of the security identification; an interactive description of the security identification; contents of the security identification; and security identification details.
Optionally the security identification is provided with a validity period.
Optionally the security identification includes at least one of: access details; access restrictions; security clearance; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
In a fifty second aspect the present invention provides a system for printing a subscription on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the subscription on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the subscription is optionally stored in an archive.
Optionally the sensor module is used to link the subscription to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the subscription with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the subscription can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the subscription using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the subscription.
Optionally the printed subscription is a permission token readable using the sensor module to at least one of: retrieve information associated with the subscription from the archive; verify payment of the subscription; initiate payment of the subscription; and gain access to a resource.
Optionally printing the subscription causes information associated with the subscription to be archived.
Optionally the information associated with the subscription includes one or more of: the subscription; a visual description of the subscription; an image of the subscription; an interactive description of the subscription; contents of the subscription; delivery of the subject of the subscription; renewal of the subscription; and subscription details.
Optionally the subscription is for at least one of: magazines; books; medical items; wine; goods; and newspapers.
Optionally the subscription includes at least one of: a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
In a fifty third aspect the present invention provides a system for printing a greeting card on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the greeting card on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the greeting card is optionally stored in an archive.
Optionally the sensor module is used to link the greeting card to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
ODtionallv the printer module prints at least some of the coded data on the print medium.
Optionally the system including use of a database to store an association of the greeting card with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the greeting card can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the greeting card using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the greeting card.
Optionally the printed greeting card is a permission token readable using the sensor module to retrieve information associated with the greeting card, the information including at least one of: a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
Optionally printing the greeting card causes information associated with the greeting card to be archived.
Optionally the information associated with the greeting card includes one or more of: the greeting card; a visual description of the greeting card; an image of the greeting card; an interactive description of the greeting card; contents of the greeting card; and greeting card details.
Optionally the greeting card includes at least one of: a message; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details printed on the print medium.
Optionally the greeting card is printed periodically by the mobile communications device.
In a fifty forth aspect the present invention provides a system for printing educational material on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the educational material on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the educational material is optionally stored in an archive.
Optionally the sensor module is used to link the educational material to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system including use of a database to store an association of the educational material with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including:
a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the educational material can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the educational material using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the educational material.
Optionally the printed educational material is a permission token readable using the sensor module to at least one of: retrieve information associated with the educational material from the archive; and gain access to a resource.
Optionally printing the educational material causes information associated with the educational material to be archived.
Optionally the information associated with the educational material includes one or more of: the educational material; a visual description of the educational material; an image of the educational material; an interactive description of the educational material; contents of the educational material; and educational material details.
Optionally the educational material is at least one of: classroom material; lecture notes; a test; test results; instructions; a lesson plan; a tutorial; and homework.
Optionally the educational material is printed periodically.
In a fifty fifth aspect the present invention provides a system for printing a trading card on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the trading card on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the trading card is optionally stored in an archive.
Optionally the sensor module is used to link the trading card to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the trading card with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the trading card can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the trading card using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the trading card.
Optionally the printed trading card is a permission token readable using the sensor module to retrieve information associated with the trading card, the information including at least one of: trading card authenticity; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
Optionally printing the trading card causes information associated with the trading card to be archived.
Optionally the information associated with the trading card includes one or more of: the trading card; a visual description of the trading card; an image of the trading card; an interactive description of the trading card; contents of the trading card; and trading card details.
Optionally the trading card includes at least one of: a message; an image; a photograph; a personality; a sportsperson; a sports personality; a television personality; an actor; a movie star; a cartoon character; a celebrity; a musician; a rock star; a product; a quotation; a cartoon strip; a graphic design; and a character printed on the print medium.
Optionally the trading card is printed periodically by the mobile communications device.
In a fifty sixth aspect the present invention provides a system for printing a health report on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the health report on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the health report is optionally stored in an archive.
Optionally the sensor module is used to link the health report to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the health report with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the health report can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the health report using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the health report.
Optionally the printed health report is a permission token readable using the sensor module to at least one of: retrieve information associated with the health report from the archive; initiate payment for the health report; transmit the health report to a health professional; obtain a copy of the health report; and gain access to a resource.
Optionally printing the health report causes information associated with the health report to be archived.
Optionally the information associated with the health report includes one or more of: the health report; a visual description of the health report; an image of the health report; an interactive description of the health report; contents of the health report; and health report details.
Optionally the health report includes at least one of: medical information; fitness information; cosmetic information; allergy information; genetic information; drug information; medicinal information; medicine information; and mental information.
Optionally the health report includes at least one of: weight; height; body mass index (BMI); age; blood type; gender; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
In a fifty seventh aspect the present invention provides a system for printing dating information on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the dating information on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the dating information is optionally stored in an archive.
Optionally the sensor module is used to link the dating information to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the dating information with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the dating information can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the dating information using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the dating information.
Optionally the printed dating information is a permission token readable using the sensor module to at least one of: retrieve information associated with the dating information from the archive; retrieve personal information about a date; retrieve personal information about a potential date; accept a date; reject a date; initiate payment for the dating information; transmit the dating information to a dating services professional; obtain a copy of the dating information; and gain access to a resource.
Optionally printing the dating information causes information associated with the dating information to be archived.
Optionally the information associated with the dating information includes one or more of: the dating information; a visual description of the dating information; an image of the dating information; an interactive description of the dating information; contents of the dating information; and dating information details.
Optionally the dating information includes at least one of: personal interests; musical interests; sporting interests; political interests; movie interests; leisure interests; professional interests; food preferences; personality preferences; physical appearance preferences; and sexual preferences.
Optionally the dating information includes at least one of: weight; height; body mass index (BMI); age; eye color; hair color; ethnicity; gender; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
In a fifty eighth aspect the present invention provides a system for printing gaming information on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the gaming information on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the gaming information is optionally stored in an archive.
Optionally the sensor module is used to link the gaming information to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system including use of a database to store an association of the gaming information with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the gaming informa'tion can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the gaming information using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the gaming information.
Optionally the printed gaming information is a permission token readable using the sensor module to at least one of: retrieve information associated with the gaming information from the archive; retrieve a game state; identify a game state and set a state of a game from the game state; retrieve a map; identify a position on a map; identify a position on a map and set a state of a game from the map position; retrieve a game score; initiate payment for the gaming information; transmit the gaming information to a game server; obtain a copy of the gaming information; and gain access to a resource.
Optionally printing the gaming information causes information associated with the gaming information to be archived.
Optionally the information associated with the gaming information includes one or more of: the gaming information; a visual description of the gaming information; an image of the gaming information; an interactive description of the gaming information; contents of the gaming information; and gaming information details.
Optionally the gaming information includes at least one of: a game state; a game score; a high score list; a game level; a map; a brag card; a game highlight; a game screenshot; a password; an access key; a cheat code; and game instructions.
Optionally the gaming information is associated with a game played on the mobile telecommunications device.
In a fifty ninth aspect the present invention provides asystem for printing a puzzle on a print medium, the system comprising: a mobile telecommunications device which comprises:
a printer module to print the puzzle on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the puzzle is optionally stored in an archive.
Optionally the sensor module is used to link the puzzle to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the puzzle with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the puzzle can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the puzzle using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the puzzle.
Optionally the printed puzzle is a permission token readable using the sensor module to at least one of: retrieve information associated with the puzzle from the archive; retrieve a puzzle state; retrieve a new puzzle; have a puzzle answer checked; retrieve a score; initiate payment for the puzzle; transmit the puzzle to a server; obtain a copy of the puzzle; and gain access to a resource.
Optionally printing the puzzle causes information associated with the puzzle to be archived.
Optionally the information associated with the puzzle includes one or more of: the puzzle; a visual description of the puzzle; an image of the puzzle; an interactive description of the puzzle; contents of the puzzle; and puzzle details.
Optionally the puzzle includes at least one of: a crossword; a numerical puzzle; a word puzzle; a sudoku; a quiz; a puzzle state; a puzzle score; a list of puzzles; a password; and puzzle instructions.
Optionally the puzzle is printed periodically.
In a sixtieth aspect the present invention provides a system for printing audio information on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the audio information on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the audio information is optionally stored in an archive.
Optionally the sensor module is used to link the audio information to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association of the audio information with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the audio information can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the audio information using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the audio information.
Optionally the printed audio information is a permission token readable using the sensor module to at least one of: retrieve information associated with the audio information from the archive; receive audio via the mobile telecommunications device; receive an audio file; receive streaming audio; initiate payment for the audio information; initiate payment for audio associated with the audio information; select an audio channel; select an audio source; select a radio station; obtain a copy of the audio information; and gain access to a resource.
Optionally printing the audio information causes information associated with the audio information to be archived.
Optionally the information associated with the audio information includes one or more of: the audio information; a visual description of the audio information; a music chart; an image of the audio information; an interactive description of the audio information; contents of the audio information; an audio clip; an audio stream; an audio track; recorded music; synthesized music; recorded voice; synthesized voice; a sound effect; an audio channel; an audio source; a radio station; and audio information details.
Optionally the audio information includes at least one of: lyrics; words of a song; musical notes; a musical score; a song title; an album title; information about a song; a name of a musician; and information about a musician.
Optionally the audio information is associated with audio played on the mobile telecommunications device.
In a sixty first aspect the present invention system for printing video information on a print medium, the system comprising: a mobile telecommunications device which comprises: a printer module to print the video information on the print medium; and, a sensor module to sense a print media identifier of the print medium.
Optionally information associated with the video information is optionally stored in an archive.
Optionally the sensor module is used to link the video information to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the printer module prints at least some of the coded data on the print medium.
Optionally the system further including use of a database to store an association' of the video information with the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the database is at least one of stored locally at the mobile telecommunications device and stored remotely at a server.
Optionally the mobile telecommunications device including: a media feed path, such that when the print medium is presented in the media feed path at least some of the coded data is read using the sensor module, and the print media identifier is determined using the at least some read coded data.
Optionally information associated with the video information can be subsequently retrieved from the archive using the print media identifier.
Optionally the print medium includes at least one interactive element associated with a linked object, and the linked object is associated with a region of the print medium using the second coded data, and the linked object is stored in an object repository.
Optionally printing requires paying for the video information using the mobile telecommunications device.
Optionally the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module printing, if the digital signature is authentic, the video information.
Optionally the printed video information is a permission token readable using the sensor module to at least one of: retrieve information associated with the video information from the archive; receive video via the mobile telecommunications device; receive a video file; receive streaming video; initiate payment for the video information; initiate payment for video associated with the video information; select a video channel; select a video source; select a television channel; obtain a copy of the video information; and gam access to a resource.
Optionally printing the video information causes information associated with the video information to be archived.
Optionally the information associated with the video information includes one or more of: the video information; a visual description of the video information; a video clip; an image of the video information; an
interactive description of the video information; contents of the video information; a video stream; a video track; a video channel; recorded video; synthesized video; an animation; a video effect; a video source; a television channel; a television station; and video information details.
Optionally the video information includes at least one of: television program information; movie information; lyrics; words of a song; musical notes; a musical score; a song title; a movie title; a program title; information about a video; a name of a musician; a name of a producer; a name of a director; a name of an actor; and information about a person.
Optionally the video information is associated with video played on the mobile telecommunications device.
In a sixty second aspect the present invention provides a method of printing content using a print medium, comprising the steps of: determining, using a sensor module, a print media identifier from the print medium, the print media identifier having been linked to the content, and the content associated with previously printed content on the print medium; and, printing, using a printer, the content on the print medium.
Optionally the content is printed on the print medium by a printer module of a mobile telecommunications device.
Optionally the content is retrievable from a database using the print media identifier and the database is at least one of: stored locally at the printer; and stored remotely at a server.
Optionally the content is printed on a surface of the print medium opposite to a surface of the print medium having the previously printed content.
Optionally the content and the previously printed content are different parts of a document.
Optionally the previously printed content is a representation of an object and the content is information associated with the object.
Optionally the object is at least one of: a photograph; an image; a video; a video clip; a video stream; a movie; an animation; audio; an audio clip; an audio stream; a sound; a song; music; a ringtone; a program; a file; an application; a web page; and a document.
Optionally the previously printed content is a photograph and the content is at least one of: a date when the photograph was taken; a time when the photograph was taken; a location where the photograph was taken; and information about the photograph.
Optionally the content is automatically retrieved from the database and printed when the print medium is inserted into a media feed path of a mobile telecommunications device.
Optionally the type of surface of the print medium adjacent the printer selectively determines the content to be printed.
Optionally the type of surface of the print medium adjacent the printer is determined using the sensed print media identifier.
Optionally the types of surface of the print medium include: blank; matte; gloss; bordered; framed; colored; patterned; and textured.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of a mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and printing, if the digital signature is authentic, the content.
Optionally a printer module of a mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the content using the mobile telecommunications device.
In a further aspect there is provided a mobile telecommunications device for printing content on a print medium provided with coded data, the mobile telecommunications device comprising: a printer module to print the content on the print medium; and,
a sensor module, disposed in a media feed path of the printer module, to read at least some of the coded data and determine, using the at least some read coded data, a print media identifier, the print media identifier having been linked to the content, and the content associated with previously printed content on the print medium.
In a sixty third aspect there is provided a method of retrieving a ringtone using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the ringtone; and, retrieving, using the mobile telecommunications device, the ringtone.
Optionally information associated with or representative of the ringtone is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device
Optionally the ringtone is a ringback tone.
Optionally the ringtone is retrieved from a selection of ringtones.
Optionally retrieving the ringtone incurs a charge.
Optionally the ringtone is stored in an audio library on the mobile telecommunications device.
Optionally the ringtone is received by the mobile telecommunications device prior to linking the ringtone to the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the ringtone to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of the mobile telecommunications device, readins. using the sensor module, at least some of the coded data; and
determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and retrieving, if the digital signature is authentic, the ringtone.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the ringtone using the mobile telecommunications device.
Optionally the ringtone is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, retrieving, if the determined position is within the region, the ringtone.
In a further aspect there is provided a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to a ringtone, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the ringtone retrievable from a database using the print media identifier.
In a sixty fourth aspect the present invention provides a method of dialling a number using a print medium, comprising the steps of: determining a print media identifier from the print medium using a sensor module of a mobile telecommunications device, the print media identifier having been linked to the number; and, automatically dialling, using the mobile telecommunications device, the number.
Optionally information associated with or representative of the number is at least one of: displayed on a display of the mobile telecommunications device; and printed on a print medium by a printer module of the mobile telecommunications device.
Optionally the number is representative of at least one of: a telephone number; a facsimile number; and an Internet address.
Optionally the number is loaded into an address book of the mobile telecommunications device.
Optionally the mobile telecommunications device requests user confirmation before automatically dialling the number.
Optionally the mobile telecommunications device automatically addresses a SMS, MMS or email using the number.
Optionally the number is received by the mobile telecommunications device prior to linking the number to the print media identifier.
Optionally the print medium is provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern.
Optionally the sensor module is used to link the number to the print media identifier.
Optionally the print medium is provided with coded data in a format, the coded data encoding information, at least some of the information being indicative of the print media identifier.
Optionally the method includes: when the print medium is presented in a media feed path of the mobile telecommunications device, reading, using the sensor module, at least some of the coded data; and determining, using the at least some read coded data, the print media identifier.
Optionally the media feed path includes a printer of the mobile telecommunications device.
Optionally the format is a linear pattern.
Optionally the information is further indicative of a two-dimensional coordinate grid, and the format is a two- dimensional pattern.
Optionally the information is further indicative of a digital signature associated with the print media identifier, the method including: determining, by reading at least some of the coded data using the sensor module, the digital signature; and dialling, if the digital signature is authentic, the number.
Optionally the digital signature includes at least one of: a random number; a secret-key digital signature; and a public-key digital signature.
Optionally a printer module of the mobile telecommunications device prints at least some of the coded data on the print medium.
Optionally the method includes paying for the number using the mobile telecommunications device.
Optionally the number is associated with a region of the print medium, the method including: reading, using the sensor module, at least some of the coded data; determining, using the at least some read coded data, a position of the sensor module relative to the print medium; and, dialling, if the determined position is within the region, the number.
In a further aspect the present invention provides a print medium comprising a surface provided with coded data, the coded data indicative of a print media identifier, the print media identifier linked to at least one number, the print media identifier able to be determined using a sensor module of a mobile telecommunications device, the at least one number retrievable from a database using the print media identifier.
Brief Description of the Drawings
An example embodiment of the present invention should become apparent from the following description, which is given by way of example only, of a preferred but non-limiting embodiment, described in connection with the accompanying figures.
Figure 1 illustrates an example High Level Architecture;
Figure 2 illustrates example M-Doc Retriever Components;
Figure 3 illustrates an example Nugget Generation Service; Figure 4 illustrates an example Player;
Figure 5 illustrates an example PlayRequest;
Figure 6 illustrates example Values, Types and Categories;
Figure 7 illustrates an example interactive business card;
Figure 8 illustrates an example Player Sequence; Figure 9 illustrates an example RequestRouter and related classes;
Figure 10 illustrates an example UserRequestRouter;
Figure 11 illustrates a typical arrangement of routers and player agents in a Netpage system;
Figure 12 illustrates example Capability and Request Propagation;
Figure 13 illustrates an example Capability Aggregation; Figure 14 illustrates an example Capability Transformation;
Figure 15 illustrates example PlayerProfiles;
Figure 16 illustrates an example Printed Interface for selecting the current player profile;
Figure 17 illustrates example PlayRequests embedded in an interactive document;
Figure 18 illustrates an example Request Routing; Figure 19 illustrates an example Synchronous Messaging Sequence Diagram;
Figure 20 illustrates an example Asynchronous Messaging Communication Sequence;
Figure 21 illustrates an example Streaming Messaging Sequence;
Figure 22 illustrates an example Interactive Messaging Sequence;
Figure 23 illustrates an example Hybrid Messaging Sequence; Figure 24 illustrates an example Player Session Sequence Diagram;
Figure 25 illustrates an example Player Session Detailed Sequence Diagram;
Figure 26 illustrates an example Desktop Player Deployment;
Figure 27 illustrates an example Short-Range Thin Mobile Player Deployment;
Figure 28 illustrates an example Long-Range Thin Mobile Player Deployment; Figure 29 illustrates an example Smart Mobile Player;
Figure 30 illustrates an Object association being displayed in a physical Player Device;
Figure 31 illustrates an Object association being displayed in the Explorer application;
Figure 32 illustrates a Creation of an impression object association;
Figure 33 illustrates an example Tagged Sticker; Figure 34 illustrates an example Reusable Sticker;
Figure 35 illustrates an example Sticker with "Confirm Action";
Figure 36 illustrates an example Sticker with limited interactive areas to prevent accidental invocation of destructive operations;
Figure 37 illustrates example Category Specific Stickers; Figure 38 illustrates an example Swipe based printed toolbar for creating impression associations;
Figure 39 illustrates an example Swipe Based Sticker with Transparent Region;
Figure 40 illustrates an example Swipe Based Sticker with Graphics over the Transparent Region;
Figure 41 illustrates an example Impression Associations Object Model;
Figure 42 illustrates example Field Associations in the Netpage Server; Figure 43 illustrates an example Object Association Sample Application;
Figure 44 illustrates an example Underlying Form;
Figure 45 illustrates an example Overlayed Form;
Figure 46 illustrates an example Printed Contacts with Phone Numbers;
Figure 47 illustrates an example State machine for basic clipboard interaction; Figure 48 illustrates an example interactive Netpage card with common operations;
Figure 49 illustrates an example State machine for operation based clipboard;
Figure 50 illustrates simultaneously supporting both object first and command first models;
Figure 51 illustrates example Single use clipboard entries;
Figure 52 illustrates an example Single-use clipboard with timeouts; Figure 53 illustrates an example Multi-use clipboard with timeouts;
Figure 54 illustrates an example Interactive card for selecting a printer;
Figure 55 illustrates example Field details of printer selection card;
Figure 56 illustrates an example Netpage form containing various commands;
Figure 57 illustrates an example Command form showing details of office printer field; Figure 58 illustrates an example SMS Based Downloadable Content Purchase;
Figure 59 illustrates an example Netpage Play Sequence for Previewing a Ringtone;
Figure 60 illustrates an example Using play requests to deliver the product;
Figure 61 illustrates an example Using play requests to purchase the product, and traditional delivery;
Figure 62 illustrates an example Hybrid approach using traditional delivery on the last hop to the handset; Figure 63 illustrates an example Load card;
Figure 64 illustrates an example Validating an ID;
Figure 65 illustrates an example High level printing sequence;
Figure 66 illustrates an example High level sequence diagram for uploading from a mobile device;
Figure 67 illustrates an example High level sequence diagram for downloading to a mobile device, using a SMS alert to trigger the download;
Figure 68 illustrates an example Sequence fragment showing the processing of scanned ID;
Figure 69 illustrates an example Local Photo Printing Sequence;
Figure 70 illustrates an example Printing Uploads to a Photo Archive;
Figure 71 illustrates an example Capturing a Netpage document via printing; Figure 72 illustrates an example Business Card;
Figure 73 illustrates example Business Card Phone Number Fields;
Figure 74 illustrates an example Business Card Fax Field;
Figure 75 illustrates an example Business Card Web URL Field;
Figure 76 illustrates example Business Card SMS and MMS Fields; Figure 77 illustrates an example Business Card Email Field;
Figure 78 illustrates an example Street Address Field;
Figure 79 illustrates an example Business Card Photo and Name Field;
Figure 80 illustrates an example Business Card Identifier Field;
Figure 81 illustrates an example Printed photo card; Figure 82 illustrates example Interactive fields for photo card;
Figure 83 illustrates an example Scanning of an M-Print printout;
Figure 84 illustrates an example Sequence diagram for generating Netpage clicks from a mobile device GUI;
Figure 85 illustrates a schematic representation of the modular interaction in a printer/mobile phone;
Figure 86 illustrates a schematic representation of the modular interaction in a tag sensor/mobile phone;
Figure 87 illustrates a schematic representation of the modular interaction in a printer/tag sensor/mobile phone;
Figure 88 is a more detailed schematic representation of the architecture within the mobile phone of Fig. 87;
Figure 89 is a more detailed schematic representation of the architecture within the mobile phone module of Fig. 88;
Figure 90 is a more detailed schematic representation of the architecture within the printer module of Fig. 88;
Figure 91 is a more detailed schematic representation of the architecture within the tag sensor module of
Fig. 88;
Figure 92 is a schematic representation of the architecture within a tag decoder module for use instead of the tag sensor module of Fig. 88;
Figure 93 illustrates an exploded perspective view of a "candy bar" type mobile phone embodiment;
Figure 94 illustrates a partially cut away front and bottom view of the embodiment shown in Fig. 93;
Figure 95 illustrates a partially cut away rear and bottom view of the embodiment shown in Fig. 93;
Figure 96 illustrates a front elevation of the embodiment shown in Fig. 93 with a card being fed into the entry slot;
Figure 97 illustrates a cross section view taken along line A-A of Fig. 96;
Figure 98 illustrates a cross section view taken along line A-A of Fig. 96 with the card emerging from the media exit slot of the mobile phone;
Figure 99 illustrates a lateral cross section through a print cartridge; Figure 100 illustrates the media coding on the card with separate clock and data tracks;
Figure 101 illustrates a block diagram of an M-print system that uses media with separate clock and data tracks;
Figure 102 illustrates a simplified circuit diagram for an optical encoder;
Figure 103 illustrates a block diagram of the MoPEC with the clock and data inputs; Figure 104 illustrates a block diagram of the optional edge detector and page sync generator for the M-print system of Fig. 101;
Figure 105 illustrates a block diagram of a MoPEC that uses media with a pilot sequence in the data track to generate a page sync signal;
Figure 106 illustrates a schematic representation of the position of the encoders along the media feed path; Figure 107 illustrates an example of printed photograph on a print medium;
Figure 108 illustrates a first example of a printed web-page.
Figure 109 illustrates a second example of a printed web-page;
Figure 110 illustrates a third example of a printed web-page;
Figure 111 illustrates a first example of an interactive business card; Figure 112 illustrates a second example of an interactive business card;
Figure 113 illustrates a third example of an interactive business card;
Figure 114 illustrates an example of a printed movie ticket;
Figure 115 illustrates an example of a printed football ticket;
Figure 116 illustrates an example of a printed parking ticket; Figure 1 17 illustrates an example of a casino print medium;
Figure 118 illustrates an example of a printed lottery ticket;
Figure 119 illustrates an example of a printed jackpot lottery ticket;
Figure 120 illustrates an example of a printed race form;
Figure 121 illustrates an example of printed race selection on the reverse side of the race form in Figure 113; Figure 122 illustrates an example of a printed SportsTab form;
Figure 123 illustrates an example of a daily calender printed on a print medium;
Figure 124 illustrates an example of a printed flyer;
Figure 125 illustrates a printed MMS entry;
Figure 126 illustrates an example of a printed competition entry card; Figure 127 illustrates an example of a printed coupon;
Figure 128 illustrates a first example of a printed gift certificate;
Figure 129 illustrates a second example of a printed gift certificate;
Figure 130 illustrates a first example of a printed membership;
Figure 131 illustrates a second example of a printed membership; Figure 132 illustrates an example word game/puzzle printed on a print medium;
Figure 133 illustrates an example crossword printed on a print medium;
Figure 134 illustrates an example song lyrics printed on a print medium;
Figure 135 illustrates an example top music list printed on a print medium;
Figure 136 illustrates an example movie channel highlights printed on a print medium; Figure 137 illustrates an example sport highlight printed on a print medium;
Figure 138 illustrates an example TV show interaction card printed on a print medium;
Figure 139 illustrates an example map printed on a print medium;
Figure 140 illustrates an example traffic report route planner printed on a print medium;
Figure 141 illustrates an example restaurant review printed on a'print medium; Figure 142 illustrates an example destination route planner printed on a print medium;
Figure 143 illustrates an example news item printed on a print medium;
Figure 144 illustrates an example information item for television history printed on a print medium;
Figure 145 illustrates an example greeting card printed on a print medium;
Figure 146 illustrates an example university assignment printed on a print medium; Figure 147 illustrates an example physics flash card printed on a print medium;
Figure 148 illustrates an example language flash card printed on a print medium;
Figure 149 illustrates an example sports trading card printed on a print medium;
Figure 150 illustrates an example art history card printed on a print medium;
Figure 151 illustrates an example virtual makeover printed on a print medium; Figure 152 illustrates an example daily diet report printed on a print medium;
Figure 153 illustrates an example date card printed on a print medium;
Figure 154 illustrates an example dating event card printed on a print medium.
Detailed Description of the Preferred Embodiments
The following modes, given by way of example only, are described in order to provide a more precise understanding of the subject matter of a preferred embodiment or embodiments. In the figures, incorporated to illustrate features of an example embodiment, like reference numerals are used to identify like parts throughout the figures.
1.0 Printing Internet Based Content Product Architecture
An example of a M-Print print media is the size of a business card. In general, documents or web based materials that have been designed for display on a desktop monitor or to be printed on A4 or Letter paper and may not print well on such sized media. If the content is reduced for the business card media then the content may be too small for easy reading. If multiple pages of media are used to print a page then the user is required to assemble the pages in the correct order before the printout is meaningful. To have presentable, effective content on a business card sized media the content should be specifically authored for that sized media. Described herein is a general mechanism to allow the authors and providers of web applications and web sites to make explicit use of the new media size, such as a business card.
The term "Mobile Document" or M-Doc Is herein used to refer to documents specifically authored to be printed via M-Print. The format of a "Mobile Document" (i.e print medium) may vary, it can be pre-rendered and in a format ready to be sent directly to the printer, or it can be in a higher level format that requires rendering before printing. On some mobile devices it is not be possible to render the "Mobile Document" on the device, thus the "Mobile Document" is rendered before being sent to the mobile device. In regard of other mobile devices, the "Mobile Document" can be sent in the high level format and rendered on the mobile
• device. In general, to be able to render on the device the "Mobile Document" format is provided in an encapsulated format that contains the data necessary to render the M-Doc. Thus, by providing the M-Doc in an encapsulated format, the M-Doc does not necessarily have to rely on a particular font or bitmap being available on the mobile device (i.e. mobile telecommunications device).
A common usage of a "Mobile Document" is for the author of a web page to summarise contents of the web- page in a "Mobile Document", which will herein be referred to as a "Nugget", and to provide a link on the page for users to print the nugget. When the web page is static HTML the content of the nugget can also be static. If the web page is dynamic HTML then it is likely the content of the nugget may also have to be dynamically created.
Current 2.5G mobile data networks have low bandwidth, high latency, and are expensive to transfer data over. The emerging 3 G networks improve the bandwidth and latency but are still expensive to transfer data over. Mobile carriers tend to subsidise some of the data transfer mechanisms to encourage use, so it is possible to have a situation where it is significantly cheaper to send data via an MMS than it is to transfer it via a HTTP request over the same network. For this reason the proposed architecture supports multiple ways of delivering an M-Doc to a mobile device. The architecture is also designed to minimise the number of requests that need to be made from the device to retrieve a M-Doc and to also to minimise the amount of data that npfifls to be transferred to the device to transmit an M-Doc.
There are three messaging services in common use in the mobile networks at the moment: SMS (Short Message Service), EMS (Enhanced Message Service) and MMS) (Multimedia Message Service). SMS is generally designed for sending text only messages up to 160 characters long. EMS is an enhanced version of SMS consisting of several SMS messages clustered together. This mechanism is used to deliver ring tones, etc to handsets. Both SMS and EMS are implemented using existing mechanisms in the GSM or CDMA networks and do not require IP based bearers such as GPRS. MMS provides the ability to send a mixture of multimedia formats such as images, sound and movies along with a definition of how to use these multimedia formats using the Synchronized Multimedia Integration Language, SMIL. MMS does not have any theoretical size limits. MMS is implemented on top of IP bearers and requires GPRS or one the 3 G equivalents to be deployed. Since MMS uses IP bearers it is not able to self-transfer or "push" itself out to a handset, instead it uses SMS to alert the user to the fact that an MMS message is waiting in the network for the user to retrieve, so it requires a "push" and "pull" to retrieve the message, whereas SMS requires a single "push" and EMS is delivered by multiple "pushes".
1.1 High Level Architecture
Referring to Fig. 1, a M-Doc 500 residing in the network 501generally requires delivery to the mobile device
100 before it can be printed. There are two ways in which a request to retrieve and print an M-Doc 500can originate: 1 - direct user action, typically clicking on a link on a web page; or
2 - the arrival of an SMS or MMS containing a M-Doc reference 507or an M-Doc 500 itself.
A M-Doc Retriever 502 is a component responsible for fetching an M-Doc 500. The M-Doc 500 is then passed to the M-Doc Printing Service 503 and printed. The following sections explain each of these major components and their inputs and outputs in more detail.
1.1.1 Web / WAP Browser
The Web Browser 504 is a third party application available on the mobile device 100. It is used by the user to browse web pages. A web site that supports printing M-Docs 500 includes web pages that contain M-Doc Reference links. When the user clicks on a M-Doc Reference link, a M-Doc 500 reference is returned to the browser 504. The M-Doc reference 507can be handled by the browser 504in a number of ways dependent upon the operating system running on the mobile device 100.
It is also possible for the M-Doc Retriever 502 to be activated directly by passing the M-Doc Retriever 502 a web page reference. This triggers a Nugget Creation service 506 to generate a Nugget for the website which the web page reference is associated with. The ability to generate a meaningful Nugget for a website depends on the content of the website.
1.1.2 M-Doc Retriever The M-DQC retriever 502 is activated by the arrival of M-Doc reference 507 to the device.
Referring to Fig. 2, the M-Doc Retriever 502 is responsible for taking a M-Doc Reference 507 and resolving it to an M-Doc 500 to be passed onto the M-Doc Printing Service 503. There are a number of ways that a M- Doc Reference 507 can be supplied to the M-Doc Retriever 502: 1. MIME type recogniser 508 - This can be activated either by clicking on a link in a web page that causes an "HTTP Get" of an object whose MIME type is an M-Doc reference 507. Or it can be activated by the arrival on the mobile device of an Obex transfer 511.
2. Message Monitor 509 - This is a component that monitors the Inbox of the Messaging Service on the mobile device. When it receives a message from any source that contains an M-Doc reference 507, the Message Monitor 504 passes the M-Doc reference 507 onto the
M-Doc Retriever 502.
3. Web browser plugin 510 - This is triggered by explicit scripting code in a web page being browsed on a web browser 504. When the Web browser plugin is activated, it is passed a M-Doc reference 507 which is passed onto the M-Doc Retriever 502.
The M-Doc Retriever 502 receives the M-Doc Reference 507 which is in the format of a URI (Uniform Resource Identifier). The M-Doc Retriever 502 appends device specific information to URI and is dispatched via an HTTP request to the M-Doc Retrieval Service 512 running on the device. Device specific information that is appended to the URI is dependent upon how the system has been deployed and the capabilities of the device.
If a Mobile Device Capability Service 513 is deployed in the network 501 then the device specific information appended only requires identification the handset, via IMEI. If the Mobile Device Capability Service 513 is not deployed in the network 501 then the device 100 is required to append information relating to the printer 4, the formats of M-Doc's 500 the device 100 is capable of printing and the preferred delivery method. The printer information required is deployment specific. If the Tenderer is able to look up the printer characteristics based on the handset or a printer version number then only those need to be provided, but if not, then information relating the printers resolution and colour space parameters are required.
The M-Doc URI that is supplied by the application is used to retrieve the M-Doc 500. This URI contains information needed to retrieve or generate the M-Doc 500 from the application 514. If the format of the returned M-Doc 500 matches the format(s) the device 100 is capable of printing, then the document 500 is delivered to the device 100. If there is an unsuccessful match, the M-Doc 500 is rendered. This is performed by passing the document 500 to the rendering service 515 along with the printer information. The rendering service returns the document in a pre-rendered format which can be printed by a mobile device 100 containing a printer 4.
The way in which the M-Doc 500 is delivered back to the M-Doc retriever 502 can also vary. It may be returned in the reply to the original HTTP request or it may be sent via an MMS or e-mail. These later two ra<spς arp most likely to be used in an environment where the pricing policy of a carrier encourages MMS or
email use over general web browsing. The preferred delivery method may be included in the retrieval request or it may be looked up via the Mobile Device Capability Service 513.
The Rendering Service 515 may also be used directly by application writers who want to provide pre- rendered M-Doc's within their application. In this case the Rendering Service 515 is accessed via SOAP (Simple Object Access Protocol) as a web service, providing the M-Doc 500 in its authored format and obtaining the pre-rendered print format document and a thumbnail image for use in a GUI 516 of the application 514 running on the device 100.
When an MMS 517 is sent to the mobile device 100, the MMS 517 is stored in the mobile network at a MMS Message Centre 518 and an SMS is sent to the device to alert the user an MMS 517 is waiting to be fetched. With a modification this notification mechanism can be used to deliver an M-Doc 500 to a phone 100. The SMS notification can contain both an M-Doc reference 507 and an MMS notification. The request to fetch the MMS from the Message Centre 518 can be enhanced with the M-Doc reference 509, allowing the Message Centre 518 to contact the M-Doc Retrieval Service 512 to retrieve the M-Doc 500 in the body of the MMS 517. This service is called an M-Doc MMS service.
Any email, MMS, Obex or web page may contain a direct M-Doc 500 rather than an M-Doc Reference 507. In this case the M-Doc 500 is passed directly onto the M-Doc Printing Service 503. Unless the sender of the message knows the capability of the handset receiving the M-Doc 500, the M-Doc 500 may not be able to be rendered appropriately, hence the M-Doc Reference 507 approach is preferred, but in some cases, such as a subscription, the sender may know the capabilities of the handset and hence be able to by-pass the M-Doc Retrieval process and deliver the M-Doc 500 directly.
1.1.3 M-Doc Printing Service
The M-Doc Printing Service 503 prints the document 500 to the printer 4 in the mobile device 100. M-Doc's 500 may have different document formats, but the M-Doc Retriever stage ensures that it retrieves an M-Doc 500 in a format that can be printed by the mobile device 100 without any further network interactions.
1.1.4 Nugget Production
A Nugget is the distillation of the content of a web page onto an M-Print sized printout. In general this not only involves reducing the web layout so that the content fits onto the M-Print printout. The process also involves selecting the key pieces of information on the web page and explicitly composing an M-Doc 500 that presents the information appropriately. Nugget support can be provided in two ways: 1. As part of the design of the application 514
2. By a nugget generating service 519.
Providing nugget support as part of the design of web application 514 requires the author of the web interface to provide a link to a nugget on the web page. Depending on the nature of the web content the nugget could
either be statically authored along with the page or it could be dynamically authored based on the dynamic content on the web page.
For web sites that do not support Nuggets as part of the interface, nuggets can be generated by a nugget generation service 519.
Referring to Fig. 3, the Nugget Generation Service 519 is activated when a special form of a M-Doc Reference 507 is passed to the M-Doc Retriever 502 on the mobile device 100, which references a web page rather than an M-Doc. The Nugget Retrieval Service detects this and passes the request onto the Nugget Creation Service 519.
The Nugget Creation Service 519 generates a nugget for the supplied web page in one of two ways:
1. If the supplied web page comes from an explicitly supported web application, it passes the web page onto the nugget generator for that web application. Common web applications such as: Google, e-bay, Yahoo, Wikipedia and Amazon could be supported.
2. If the web page is not from a supported application, then the contents is scaled to fit into an M-Doc 500.
The nugget generator for supported applications include knowledge of the structure of the web page and the main purpose of the web application, and thus be able to extract information from the key fields and present that in a nugget. For example:
• A Google web page could be distilled to a nugget by showing the: search criteria; the top ten hits; how many other hits where returned.
• An Amazon web page could be distilled to showing the contents of the shopping cart. • A Wikipedia web page could be distilled to the term and the definition.
1.2 Applications
This section discusses some applications of Internet Based M-Document printing architecture. Any M-Doc
500 can be Netpage enabled.
1.2.1 Daily Subscription Services
Many people buy the daily newspapers to access a few small sections of the paper, eg. puzzles, crosswords or cartoons. Using M-Doc printing it is possible for a user to browse online to the content and then request a printout of the content of their choice. To avoid having to browse each day, a subscription service that "pushes" the user's desired sections out to them each day can be set up. The service could use: SMS, MMS or e-mail to "push" the M-Doc References out to the mobile device. The user can then print then content of the subscription when required.
Some of the sections of a newspaper that would suit this form of distribution are:
• Crossword puzzles: Crossword grid on one sheet; clues on another.
• Number puzzles, eg. Sudoku
• Jokes
• Cartoons • Local Weather
1.2.2 Navigation and Location Based Services
Web services such as " Wherels" (www.whereis.com) provide both the ability to get a list of directions to go from one location to another and/or a map. Using a mobile device's browser 504 the user can enter the destination and their current location and then have the map and directions delivered as an M-Doc 500 to be printed.
This gives a more convenient presentation of the map and directions to refer to while driving. Also in many regions in the world it is illegal to look at a mobile phone while driving, but it is not illegal to consult a map or written directions.
Mobile devices 100 that support location services are able to supply their location automatically. In this case it is only necessary to specify the destination to receive a map and/or a set of directions to print.
As well as assisting navigation, location based services can be used to present of list of possible destinations. For example:
• A service that prints out the list of restaurants within walking distance;
• Directions to the closest Service Station (or any type of shop);
• Directions to the closest public transport stop.
1.2.3 Company Business Cards
Corporate websites often promote a company's public image, this can be extended by providing the ability to print a "Company Business Card" that gives the general information about the company and its general contact details. As well as a general "Company Business Card", individual departments could easily have their own business cards, eg. the Service Department contact details.
Web sites for companies normally have a page dedicated to how to find them, that is, directions on how to get to their buildings from major transport hubs. These sites could easily include M-Documents 500 showing maps of: • How to get to the company's premises
• Where the closest parking is
• Where the closest Hotel is
• Directions on how to navigate from one building to another.
1.2.4 Discount Coupon / Voucher
Discount coupons can be delivered by M-Documents 500. These can be delivered via the web as part of an advertisement, either directly with the advertisement containing a link to a M-Document 500 or a coupon could be delivered to the mobile device as a reward for clicking through an advertisement to the companies web site.
A company could "push" out via SMS, MMS or e-mail vouchers to members of their loyalty scheme or just to the general public as a promotion. Another variation on this scheme is the ability to deliver a voucher or coupon to a user who enters a competition or votes on-line. For example, using an SMS to vote on a reality TV show could result in an MMS being returned with a coupon for a prize, or voting from a web site could return an M-Doc 500 with an advertisement and the possibility of a prize.
1.2.5 On-line Receipts
When performing on-line transactions from a mobile device 100 a receipt for the transaction can be returned via an M-Doc 500. This gives a printout that can be filed with a user's other receipts. The receipts can contain bar codes and/or be Netpage enabled to allow the transaction to be recalled on-line on demand. Some example on-line transactions this could be used for are:
• Betting, the nugget can record: the selected options, the odds, the money wagered and the possible payouts; • Banking, the nugget can be similar to an EFTPOS receipt;
• Purchasing, the nugget can be similar to a shop receipt;
• Paying bills;
• Taxi payment
1.2.6 Ticketing
For tickets that do not require magnetic stripes it is possible to deliver them over-the-air at the time of purchase. This could included: Public transport tickets; Theme park ride tickets; Theatre tickets; Cinema tickets.
1.2.7 Web CAM Print
While viewing a web cam on your mobile device, a user can select print and have an M-Document 500 of the image at that time sent to the users phone.
1.2.8 On-line Gaming On-line games can use Nuggets to provide additional information about the game. They can be used to provide: Cheat sheets; Maps; Character summaries; Brag cards, to demonstrate what level you have reached; Vouchers or Coupons as rewards for achievement.
2. Player Architecture
A Netpage Player 520 is a physical or virtual device capable of "playing" requests of various types, kplccy request 521 consists of three parts:
1. The target 522, which specifies which player 520 the request 521 should be played.
2. The operation 523, which specifies the action to be performed. 3. A set of values 524, which are supplied as parameters to the operation 523 \
Typically play requests 521arise in response to user actions. For example, the user clicks on a tagged surface with a Netpage pointer, or interacts with an application that is in contact with the Netpage system. Play requests 521 can be used to provide a simple feedback mechanism (such as a request to display a text string to the user), or may be used to cause more sophisticated interactions with physical devices (such as setting the thermostat temperature on a home air conditioning system).
Individual players 520 can be associated with a user 525 as shown in Fig. 4. A user 525 may be associated with multiple players 520 each of which supports the playing of possibly overlapping sets of PlayRequests 521.
It is likely that in many cases a single physical NetpagePlayer device 520 is shared between multiple users 525. For example, a hi-fi audio system in a family room may be configured as an audio player for multiple members of the family. For the sake of brevity, this section focuses on cases where physical players are exclusively used by a single user, however, it will be appreciated that this section may be applied to multiple users.
Central to the NetpagePlayer 520 concept is the notion of a PlayRequest 521 which are objects that represent a request to perform an operation on some device. This sections describes various details related to PlayRequests 521.
2.1 Structure of a PlavRequest
A PlayRequest (see Fig. 5) consists of three parts, each of which is optional:
1. An optional target 522 which specifies which Netpage player 520 the request 521 should be played, 2. An optional operation 523 which specifies the type of action to be performed on the target player
522, and 3. An optional list of. values 524 which are supplied as parameters to the operation 523.
A play request 521 may either be fully or partially specified. A fully specified play request completely specifies all of the information (target, operation, and parameters) required to unambiguously deliver the request to the target 522 and to perform the desired operation 532. A partially specified play request provides some indication of the request 521 to be played, but does not provide enough information in order for the play request 521 to be successfully delivered and played without further processing.
A target 522 may either fully or partially specify the target 522 of a play request 521. A fully specified target completely identifies the physical player 520 on which the request 521 should be played. A partially specified target provides some indication of the desired target 522, but does not provide enough information in order for the play request 521 to be delivered without further processing. An operation 523 can also be fully or partially specified. A Value 524 consists of a physical type 525 and associated data 526. For example, the physical type 525 might be "image/jpeg" and the data 526 would be the binary image data.
2.2 Values and Types
A Value 524 represents an instance of some physical type 525. Each Value 524 has an associated physical type 525 and zero or more associated type categories. The physical type identifies the structure of the data element of the Value 524. A possible mechanism would be to use MIME types. For example, if the physical type 525 is image/jpeg then the data element would contain the binary data of an image in jpeg format.
Referring to Fig. 6, a Value is also optionally associated with one or more Categories 527. A Category 527 is used to provide additional information about the value 524 which may allow it to be handled more sensibly by the system (i.e. to allow a PlayRequest to be better matched against the capabilities of candidate targets during request routing). As an example, an image value produced by a digital camera may have the physical type 525 image/jpeg, but may also be associated with a category 527 of "photo", whereas an image value produced by a fax package might also have the physical type 525 image/jpeg, but could be associated with a category 527 of "facsimile" or with no category at all.
RequestRouters can take into account both the physical type 525 of a value 524 and the categories 527 to which it belongs when determining the most appropriate way to handle a request 521.
2.3 Sample PlayRequests
To better demonstrate the PlayRequest concept, this section provides a number of sample PlayRequests 521. A PlayRequest 521 can be viewed hi tabular form as shown below by example in Table 1.
Table 1
Firstly, the Request 1 shows a fully specified PlayRequest 521 for dialling a number on a specific mobile phone.
The target field 522 is fully specified and indicates that the request 521 is to be performed on the device 520 identified by the name/address "mobile-phone-xyz56474238". Note that for simplicity, simple text strings to indicate the address of each physical target 522. The play request 521 contains an operation of "dial" which is understood by the mobile phone's NetpagePlayer 520. The request 521also includes a phone number which is a required parameter 528 to the "dial" operation 523.
As shown below, Request 2 is only partially specified due to only containing a partially specified target 522. The target 522 specifies that the request 521 should be played on a mobile phone, but does not specify which mobile phone.
Request 2
Request 3 shown below is also only partially specified. In this case, the target 522 has been completely left out. Although only being partially specified, the request 521 has a definite meaning: "dial the phone number 555 6754". The device to be used to dial the number is still to be determined.
Request 3
Request 4 is even less fully specified that Request 3. Request 4 simply contains the phone number "555 6754". The operation to be performed with the number and the device to handle the request (the target) is still to be determined and the device to handle the request (the target) is still to be determined.
Request 4
Request 5 contains a fully specified target 522, but does not specify an operation 523. Thus, the target of the request 521 is known, but what the target 522 is to do with the request (the operation) is still to be determined.
Request 5
Request 6 can be used to send a simple text message to the user. The target 522 is not specified, so the request means display the following message on whichever player is the most appropriate at the current time.
2.4 Invocation of PlavRequests Play requests 521 can arise in one of two ways:
1. The user interacts with a printed Netpage form that has been authored to include invocations of play requests 521.
2. An arbitrary application sends a play request 521 to a Netpage Server 529.
These are discussed in the following sections.
2.4.1 Authored PlavRequests
PlayRequests 521 can be authored directly into a printed Netpage document. Fig. 7 provides an example of an interactive business card 530. The business card 530 contains interactive elements 531 that can be triggered by clicking on them with a Netpage pointer. Each interactive element causes a PlayRequest 521 to be invoked. The Netpage Server 529 then arranges for the request 521 to be played by routing it to the appropriate player device 520.
For example, referring to Fig. 7, consider a user with a Netpage-enabled mobile phone device 100 with a built-in Netpage pointer. The user clicks on the mobile phone icon 532 on the business card 530 which causes the PlayRequest 521 to be triggered. The server 529 routes the play request 521 to the user's mobile phone 100 and upon receiving the request 521, the mobile phone 100 commences dialling the required number.
2.4.2 Application Invoked PlavRequests
Fig. 8 shows a typical example of an application invoked PlayRequest 521. The steps are as follows:
1. A Netpage pen 533 transmits a digital ink stroke 534 to the Netpage Server 529.
2. The stroke 534 is determined to be a request 521 to submit a Netpage form for processing.
3. The form is submitted to the corresponding Application 535.
4. As part of the form submission processing, the application 535 requests that a play request 521 be played by a Nerpage Player 520 associated with the user 525 who made the submission.
5. The Server 529 determines the target device 522 and relays the play request 521 to that device 522.
2.5 Player Devices
Netpage Player instances can be deployed on various Player devices (platforms). Individual players support some subset of the full range of PlayRequests 521 supported by Netpage. Table 2 shows some examples of Netpage Player Devices.
Table 2 - Example Netpage Player Devices
Note that while some of the devices mentioned in Table 2 are also capable of recording/capturing objects (e.g. a digital camera of a mobile phone is capable of capturing images), access to such captured data is not
accessible via the Netpage Player concept, but can be accessed via a Netpage Clipboard, which will be discussed in more detail.
2.6 Request Processing This sections describes how PlayRequest objects 521 are processed throughout the Netpage system. The processing of requests includes two operations:
1. The routing of requests 521 from one NetpagePlayer 520 to another.
2. The transformation of PlayRequests 521 (for example to change a partially specified request more specified) as they are being routed.
2.6.1 Request Routing
A play request 521 is routed from source to the eventual destination via one or more intermediary RequestRouters 536 as shown in Fig. 9. RequestRouters 536 implement the NetpagePlayer interface, and are responsible for routing each PlayRequest 521 they receive to an appropriate target NetpagePlayer 520. Each RequestRouter 536 maintains a set of potential targets 538. Eventually a PlayRequest 521 arrives at a Player Agent 537 which is responsible for actually performing the play request 521.
AU PlayRequests 521 from (or on behalf of) a user 525 are initially handled by a RequestRouter 536 inside the Netpage Server 529. This router is called the User RequestRouter 539 (see Fig. 10). Typically the UserRequestRouter 539 forwards requests to a RequestRouter 536 residing on a physical device, although such forwarding may pass through an arbitrary number of intermediary RequestRouters 536 along the way. Device based RequestRouters 536 are responsible for routing requests 521 to the various player agents 537 running on the device.
The typical scenario is shown in Fig. 11. The UserRequestRouter 539 has a set of potential targets 538 which are all RequestRouters 536 residing on physical devices. Each device's RequestRouter 536 then has a set of potential Player Agent targets. The PlayerAgents are the NetpagePlayers 520 that actually play requests 521.
2.6.2 Request Transformation Each RequestRouter 536 can optionally transform the PlayRequest 521 it receives before passing it on to a subsequent NetpagePlayer 520. The transformation typically produces a more fully specified version of the supplied PlayRequest 521, but may also produce a completely new PlayRequest 521 with no fields in common with the source PlayRequest 521.
2.6.3 Player Capabilities
Different players have different capabilities. That is, each player is capable of playing a different set of PlayRequests 521. The capabilities of a NetpagePlayer 520 are specified in a CapabilitySpecification 540. The capabilities 541 of each child player are taken into account by RequestRouters 536 when handling PlayRequests 521. The capabilities 541 of different players may overlap, potentially resulting in ambiguous
PlayRequests 521. Such ambiguities are resolved by RequestRouters using methods described in further detail below.
The CapabilitySpeciβcation 540 is not limited to simply specifying which operations 523 can be performed on which value types 524. It may also specify finer grained details. For a specific PlayRequest 521 the CapabilitySpecification 540 might specify that it can only handle a subset of possible values. For example, a player 520 that supports the playing of audio objects could place a limitation on the size of audio objects supported.
2.6.3.1 Capability and Request Propagation
As shown in Fig. 12, a PlayerAgent 537 advertises its capabilities 541 to its parent RequestRouter 542 which in turn propagates the aggregation of its children's capabilities 544 to its parent RequestRouter 543. Eventually the propagation reaches the UserRequestRouter 539 which then has an overall view of the capabilities 545 of all of the players at its disposal. PlayRequest propagation moves in the opposite direction. Requests 521 start at the UserRequestRouter which determines the most appropriate child to which the request should be sent. The (possibly transformed) request is sent to the selected child which in turn propagates the request to one of its children. Eventually the request reaches a PlayerAgent 537 which is responsible for actually playing the request.
2.6.3.2 Capability Aggregation and Transformation
As a RequestRouter propagates player capabilities (541, 544, 545) to its parent RequestRouter 536, it may perform capability aggregation and transformation. Capability Aggregation is where the router 536 combines the capabilities of its children into a single capability specification 548. Capability Transformation is where the router 536 modifies the advertised capabilities of its children due to capabilities (or perhaps limitations) of the router itself.
Fig. 13 provides an example of a simple capability aggregation. The router has two children 550, 551, the first child 550 of which advertises the capability to display jpeg images, the second child advertises the capability 553 to display plain text. The router 536 then aggregates the child capabilities 552, 553 into a single capability specification 540 which is capable of displaying both jpeg images and plain text.
Fig. 14 provides an example of a capability transformation. The PlayerAgent 537 advertises its capability 555 to display image/jpegs. The RequestRouter 536 has access to an image converter 559 that can convert images in png format to jpeg format. As such, the capability specification 555 is transformed before propagation into a capability specification 556 that includes the ability to display files in png format as well as in jpeg format.
2.6.4 Dynamic Capabilities
The capabilities advertised by a particular NetpagePlqyer 520 can change over time. For example:
1. Additional hardware or software can be installed/removed to/from a device, enabling the player to support more/less PlayRequests 521.
2. The maximum object size supported by a player may change depending on the spare capacity in the player's memory.
3. A mobile player might be capable of receiving streaming media when it is connected to the network through a high-bandwidth network. . 4. Common user interactions with the player (e.g. starting an application, changing a setting) can cause the player to advertise more or less capabilities.
Such changes in capabilities are to be communicated to the player's parent RequestRouter 536, and potentially, but not always, to the parent's parent, and so on all the way to the UserRequestRouter 539.
At the same time, as dynamic capability changes are being propagated, requests 521 are being routed in the opposite direction (as shown in Fig.12). This creates a race condition between capability propagation and request routing, such that by the time a request arrives at a RequestRouter 536, either the request can no longer be handled by the player 520, or the player 520 is no longer the most appropriate recipient for that request 521. Either case may require that a request 521 be rejected by the player 520 (be it a router or an agent) and re-routed to the appropriate player 520.
Additionally, dynamic propagation of capability changes could potentially cause an undesirable level of network traffic, harming overall system performance.
2.6.5 Request handling by the UserRequestRouter
As already discussed, all PlayRequests 521 presented to the NetpageServer 529 are handled by the
UserRequestRouter 539. The purpose of the UserRequestRouter 539 is twofold: (i) To determine the most appropriate child NetpagePlayer (the target 522) to which the request 521 should be routed; and (ii) To determine any required transformations to the request 521 that are necessary in order for the selected target
521 to be able to handle the request 521.
In order to determine both of the above, the UserRequestRouter 539 takes into account the content of the PlayRequest 521 and the context within which it is handled. The context includes a large range of factors, including, but not limited to the following:
1. The capabilities of each of the available children NetpagePlayers. Availability being partially determined by the user identity.
2. The current contents of the Netpage clipboard.
3. The originating source of the request (e.g. the Netpage pointer device which triggered the play request) and/or the route via which the request arrived.
. 4. The current player profile.
5. The current date and time.
2.6.6 Player Profiles
It is possible that multiple players registered with a user support the same PlayRequests 521. As a concrete example, consider the following scenario where a user has registered the following players. The user 525 has three registered players 520 all of which are capable of playing images: • A camera phone for playing phone numbers, plain text, and images.
• A digital camera for playing images.
• A desktop application for playing plain text, html, images, video and audio.
Now consider the case where the UserRequestRouter 539 receives the following partially specified PlayRequest 521:
The request 521 could potentially be played on any of the devices 520 mentioned. As such, the request 521 is ambiguous.
PlayerProflles 557 are one mechanism which can be used in order to allow the UserRequestRouter 539 to resolve such ambiguities. A PlayerProfile 557 provides a (typically restricted) view of the set of players 520 available for a particular user 525 and the set of PlayRequests 521 that can be played on those players 520. A user 525 may have multiple player profiles 525 indicating the various scenarios within which they use the Netpage system. At any point in time, one of these profiles 525 is set as the Current Profile 558 as shown in Fig. 15.
For example, a user might have the following profiles:
• An "office" profile that directs most player requests to their desktop PC.
• A "home" profile that directs requests to various devices throughout the user's house. • A "mobile" profile that directs player requests to various portable devices (e.g. a smart phone).
• A "car" profile that directs player requests to devices within the user's automobile.
A user can quickly change their current profile by a simple user action. For example, if in the office, the user could select the profile via a desktop GUI. Alternatively the user could use their Netpage pen/pointer to select a profile from a printed interface 559 such as that shown in Fig. 16. The system could also allow a user to specify regular scheduled times at which their current profile should switch.
2.6.7 An example request routing
Consider the interactive business card 530 shown in Fig. 7. The business card contains a number of interactive elements including the two fields 560, 561 highlighted in Fig. 17. Each of the fields 560, 561 is represented by a partially specified PlayRequest 562, 563. Clicking on either field 560, 561 with a Netpage
pointer causes the corresponding play request 562, 563 to be submitted to the Netpage Server 529 for processing.
Fig. 18 provides an example of how such a field might be routed. At step 564 we have the original play request as submitted to the server. At step 565 the UserRequestRouter interrogates the PlayRequest and the current context, and determines that the request should be routed to the user's mobile phone. As such it transforms the original PlayRequest to produce the request shown in step 566 and routes the play request to the RequestRouter on the mobile phone. At step 567 the mobile phone's RequestRouter checks whether the phone is in a quiescent state (i.e. no applications running). If so, it transforms the PlayRequest by setting the operation to "dial", and is routed to the voice communications sub-system agent 568. If, however, the SMS creation application is running, then the PlayRequest is transformed by setting the operation to "set- destination-number", and it is routed to the running SMS creation application 569. Lastly, if instead the Contacts application is running, then the PlayRequest is transformed by setting the operation to "add- contact", and it is routed to the Contacts application 570.
The end result is that the act of clicking on a telephone number on the business card can have very different results depending on the context within which it is applied. In this example, both the current context within the Netpage Server 529 and the current context on the mobile phone were taken into account when processing the PlayRequest 521.
2.7 Communicating with Players
Various communication methods are used between a Netpage Server 529, intermediate gateways 570and the Netpage client to enable the playing of PlayRequests 521 on the Player device520. Environmental factors such as the following affect the selected communication mechanism: • Available network connectivity.
• Type of player device being targeted.
• Size and type of objects being transferred and the nature of the operation being played.
This section describes categories of messaging mechanisms. Note that in a single play scenario a combination of messaging methods can be used.
2.7.1 RPC (Synchronous) Messaging
Referring to Fig. 19, in an environment where a persistent connection can be maintained between the Netpage Server 529 and the Player 520, the server 529 can send the play request 521 to the player, block till play a request is handled and a response 571 is returned. A Desktop Player in an active session can communicate to the server 529 using this method.
2.7.2 Notification (Asynchronous) Messaging
Referring to Fig. 20, notification messaging is used when the environment allows playing of an Object through an asynchronous play () request 521 initiated from the Netpage Server 529 to the Netpage Player 520, delivering the object to be played. The server 529 may continue its activities and optionally receive a future response from the Player. The example of a notification based request delivery is when Netpage server pushes an image to a Netpage Player.
Depending on the underlying network infrastructure, a suitable protocol is used to push notifications to the Netpage Player, i.e. WAP push, SMS, etc.
2.7.3 Streaming
Referring to Fig. 21, for certain media types, it is preferable to be able to stream data to a player rather than transmitting the entire object before playing commences. The reasons are that:
• Large objects may take significant time to transmit in their entirety to the player. Streaming allows for playing to take place before the entire object has arrived at the player thereby reducing latency. • Target player devices may not have the capacity to hold the entire object. In that case, streaming is one option for playing the object on the device due to this limitation.
• Unbounded objects such as live video can be transmitted by streaming.
Video and audio provide the most significant examples of types that are typically better suited to streaming. To enable the streaming Netpage Server would be involved in the player selection process and would then leave actual streaming up to the two parties. Otherwise the server is likely to be a bottleneck and a source of additional latency.
Player can perform read-ahead operations to buffer the data ahead of playing and avoid network delays and jitters which can affect the user's experience.
2.7.4 Interactive Messaging
Referring to Fig. 22, in some scenarios multiple user/pointer interactions with the Netpage Server 529 invoking multiple play requests is required to complete a user play experience. For instance consider a scenario where a user has a Netpage printout photo that he/she would like to send as a MMS message to a friend. One way of achieving this is by the user clicking on the friend's business card's MMS hyperlink. This action sends a play request to the player activating the MMS editor with the phone number to which the message is being sent. At this point user can choose to click on the photo to attach it to the MMS message. This results in the photo being sent as a seconds/ay request to the Player, wherein the photo is attached to the MMS content. The state of the player 520 allows chaining multiple play requests 521 to complete a transaction.
2.7.5 Hybrid Messaging
Referring to Fig. 23, in some scenarios a multi-transaction messaging without user interaction is performed to play an object. Some examples of hybrid messaging are:
• Consider a scenario where a low-end mobile phone player without support for the suitable push-based notification, wishes to play an unbounded object. A hybrid solution can be adopted to push a small notification to the device, notifying the player application (i.e. through SMS) to initiate a stream-based communication to the Netpage Server request (Le. WSP) for delivery of the object.
• Displaying a URL object also uses a multi-transaction hybrid messaging, where the original object (the URI) is pushed to the device using a Notification message. At this point the player (without user interaction) retrieves the URI content by sending a synchronous request/response message through HTTP.
2.7.6 Player Session Establishment
When players 520 are instantiated on devices (for instance during user login on a desktop player or on- demand by the mobile user), the player 520 registers the mobile device lOOis available for play requests by initiating & player session 580 with the Netpage Server 529.
Fig. 24 shows the basic lifecycle of a NetpagePlayer session 580. First, a process, which is typically running on a remote machine/device, calls the startPlayerSessionQ method 581 to commence a NetpagePlayer session 581 with the Netpage Server 529. A userld 582 is provided which indicates the user 525 to which the supplied player 520 should be associated. Upon reception of a startPlayerSessionQ request 581, the server 529 creates a PlayerSession object which is returned to the remote process 583. This object can be used at some later time to terminate the session by calling the terminateQ method.
Fig. 25 shows more details of the handling a player session 580 within the server 529. As shown previously, a player session is created 589 by calling the startPlayerSessionO method on the Netpage Server's
CommandProcessor. This causes the creation of a PlayerSession which in turn creates a NetpagePlayerProxy which is run within the server and acts as a proxy for the real player by implementing the NetpagePlayer interface and passing all requests on to the real player. NetpagePlayerManager::addSession() is called to register the session with the NetpagePlayerManager. The NetpagePlayerManager is a singleton object responsible for managing all NetpagePlayer sessions and also for coordinating all NetpagePlayer traffic within the server.
2.8 Player Deployment
2.8.1 Player Connectivity
Netpage Player 520 can be deployed on various devices with different network connectivity capabilities. Table 3 lists some examples of player network connectivity and transmission mechanisms. Note that a deployment environment may utilize a combination of connectivity types. Each connectivity type explains how one hop communicates to the next hop. For instance a player communicates with a wireless gateway on ^A r,d+v> +0 the Netpage Server.
Table 3 -Netpage Player Connectivity Types
2.8.2 Player Deployment Configuration
Different combinations of player devices and connectivity types can be configured to provide a suitable Netpage Player and Server integration environment. Figs. 26 to 29 demonstrate some of the more widely applicable types of deployment environments. Example pen connectivity is demonstrated for clarity.
3. Object Association Design
3.1 Object Associations Overview
A Netpage object association allows content (objects 601) to be associated with locations 513 on Netpage documents 603 and printouts. Arbitrary content types can be supported, but common examples include pictures/photos, audio, and video.
An object 601 can either be associated 616 with a document during the authoring of the document {static association) or can be associated with a particular document printout at some arbitrary time after that printout has been created {dynamic association).
Additionally, an association 616 may either be an impression association or a field association. An impression association is a dynamic association that is associated with a particular {x,y} location 613 on an impression. A field association is associated with a particular field of a form (static association) or form instance (dynamic association).
3.2 Communicating Status to the User
At times the mechanisms described require communication of status information (often errors) to the user. The simplest way to achieve this is to make use of the Netpage Player infrastructure. Special operations (e.g. show-status-ok-message and show-status-error-message) can be designated for transmitting status information to the user. The player architecture would determine, for each message, the most appropriate device (or devices) on which to display the message and the way in which to display it. For example, it may be that in certain situations the pointer is the only available player, in which case an error status might be "played" by illuminating a red LED on the pointer or playing a short sound.
3.3 Impression Associations An object 601 can be associated dynamically with a specific {x,y} location 613 on an impression. The associations 616 are stored inside the Netpage Server 529 and can then be viewed in a number of ways:
1. By interacting with the physical impression using a device that communicates with the Netpage Server 529 to retrieve the associated objects 601.
2. By interacting with a virtual view of the impression from within a graphical software application 602.
3.4 Interacting with Dynamic Associations
Referring to Fig. 30, an associated object 601 can be viewed by interacting with the physical impression using a Netpage Tag aware device. This shows an example where a tag reading device with built in screen is passed over a physical impression. The device communicates impression locations to the Netpage server 529 which responds with information regarding any associated object 601 that is currently sensed by the device. Depending on configuration, the device might begin immediately playing each associated object or present the user 525 with the option of playing the object 601. If multiple objects 601 are within the device's field of view, then the device could present the user with a list of the objects 601 for selection.
Associated objects 601 can also be viewed by interacting with a virtual view of the impression from within a graphical software application 602. There are a number of possible mechanisms for displaying associated objects 601 in such an application 602. Each mechanism is responsible for:
• Indicating the presence of an associated object (or objects 601), and • Displaying the actual content of an associated object 601.
An example mechanism is shown in Fig. 31 where a graphical "Netpage Explorer" application 602 is being used to view an impression which contains associated objects 601. The example shows an approach in which some visible token 603 (in this case a black star) is displayed that indicates the locations that contain object associations 616 . The display of the tokens 603 can be toggled by clicking on a toolbar button 609. To view an associated object 601 the user clicks (or alternatively double-clicks) on the relevant token 603 which causes the Netpage Explorer application 602 to retrieve the associated object 601 from the Netpage Server 529 and to then play the object 601. Depending on the capabilities of the Netpage Explorer application 602, the object 601 can either be played within the Netpage Explorer application 602 itself, or by an external annlirntinji.
3.5 Methods for Creating Impression Associations
This section describes various alternative techniques that may be provided to allow users to dynamically associate content with a location on an impression. They include: • Modal association mechanisms
• Sticker based mechanisms .
• Swipe Based mechanisms
• Swipe Based Stickers
3.5.1 Modal Association
A Modal Assocation involves first placing the user/pen session in a mode in which the next pointer click is interpreted as the specification of an impression location to which a current clipboard object 601 should be associated.
Fig 32 shows an example of how an impression object association 617 might be created modally. In this case, the user attaches a photo to an impression. The steps are as follows:
1. The user takes a photograph using their digital camera 610.
2. The user pushes the photograph to the Netpage clipboard on the Netpage Server 529 (possibly implicitly). 3. The user clicks with their Netpage pointer 533 on a printed toolbar 611. In this case, the user clicks on the "Attach Object" button 612. This places the pointer session into a mode in which the next click with the pointer 533 is interpreted as the specification of an impression location to which the current clipboard object 601 should be associated. 4. The user clicks on the desired location 613 on a printed page 614. This causes the Netpage Server 527 to retrieve the current object 601 from the user's clipboard 615 and to associate the object with the impression location selected in step 3.
An alternative approach requires steps 3 and 4 to be performed in the opposite order. That is, the "Attach Object" command is interpreted to mean associate the object with the impression location most recently touched by the user.
Modal association mechanisms can be implemented on top of the Netpage Clipboard 615 mechanism.
3.5.2 Tagged Stickers A tagged sticker 620 is a physical adhesive sticker which is Netpage tag encoded 617. That is, it is aNetpage impression printed onto a physical sticker. Clicking on a tagged sticker causes an object to be associated with that sticker (impression). Tagged stickers 620 can be physically attached to any surface whether it be tagged or otherwise (eg. books, desks, walls, etc) and thus provide a very flexible mechanism for dynamically associating objects with locations.
Figure 33 shows an example of a simple tagged sticker 620. In order to associate an object 601 with the sticker 620, the user would perform the following steps. l.Push object 601 into Netpage Clipboard 615 2.Physically paste sticker 620 onto any surface
3.Use Netpage pointer 533 to click on the sticker 620 to associate the object 620.
Once an object 601 has been associated with a sticker 620, there are various ways in which the user can retrieve/play the object 601. Firstly, the object 601 can be interacted with using a physical Netpage Player device 520. Secondly, simply clicking on the sticker 620 with a Netpage pointer 533 would cause the object 601 to be played. This latter behaviour suggests that sticker associations would actually be implemented as field associations 618.
3.5.3 Reusable Stickers As so far described, once an object 601 is associated with a sticker 620, that association 616 cannot be altered. A reusable sticker 621 allows for the object associated with a sticker to be changed, or erased. Such a sticker 621 is shown in Figure 34. The "Attach" button 622 is used to associate an object 601 with the sticker 621 and allows for a new object 601 to be associated with the sticker 621, overwriting any previous association 616 . The "Clear" button 623 allows for any association 616 to be removed.
Both "Attach" 622 and "Clear" 623 are destructive operations in that they remove any association 616 that may have been in place before the operation took place. As such, it may be desirable to be able to protect against accidental invocation of such operations, especially in the sticker scenario in which the entire sticker is a clickable area.
One mechanism for doing that is shown in Fig. 35 in which a sticker 621 has a "Confirm Action" button 624. In order for a destructive operation to be confirmed, the user must first select the operation and subsequently select the "Confirm Action" button 624. A suitable timeout (say 10 seconds) can be used such that confirmations must take place within the timeout period in order to be valid.
An alternative for preventing accidental invocation of destructive operations is to limit the interactivity of the sticker to small areas within the sticker as shown in Fig. 36. The associated object 601 is only played when the user selects the "Play" operation 625. The overall sticker 621 is not interactive. As such, accidental invocation of destructive operations should be much less likely.
3.5.4 Category Specific Stickers
So far we have described stickers which retrieve the object 601 most recently assigned to the Netpage Clipboard 615. The Netpage Clipboard 615 can store multiple objects 601 per user 625 with each object 601 falling into an object category or set of categories. As such, it is possible to have Categoiy Specific Stickers fO.l that retrieve current objects from the Netpage Clipboard 615 by category.
Fig. 37 provides examples. Clicking "Attach" on the left sticker causes the current clipboard object 601 with a category of "video" to be associated with the sticker 620. The sticker on the right achieves a similar effect for objects in the "photo" category.
3.5.5 Swipe Based mechanisms
The printed toolbar in Fig. 38 allows an impression association 617 to be created by swiping a command from a printed toolbar 626 to the location on an impression to which the object 601 is to be associated. The user temporarily places the toolbar 626 on top of the destination impression and swipes from the toolbar 626 to the impression. The swiping action provides the system with digital ink samples from both the toolbar and the destination impression. These samples enable the determination of both which object 601 is to be associated (for the card shown the possibilities being the current video clip, current photo, current audio clip, or in the case of the "Any" icon, the current object regardless of type) and to which impression and location on that impression the object 601 is to be associated.
3.5.6 Swipe Based Stickers
A limitation of the stickers described earlier is that they do not actually create an association 616 between the object 601 and the underlying impression on which the sticker is applied. For example, consider the situation where a sticker has been applied to a tagged impression, and subsequently an object 601 is associated with the sticker. If the underlying impression is viewed within the Nerpage Explorer application, then the sticker and associated object 601 is not be displayed since the Netpage Server 529 is not aware that the sticker has been applied to that impression.
The above problem can be solved by applying the swipe based approach to stickers. The user steps involved are:
1. Push obj ect 601 into Netpage Clipboard 615
2. Physically paste sticker 620 onto a tagged impression 600
3. Use Netpage pointer 533 to swipe from sticker 620 to impression 600.
The action of swiping across both the sticker 620 and the impression 600 creates a triple association between the impression 600, the sticker 620, and the object 601. Specifically, the Netpage server 529 is now aware of:
• The sticker 620 to which the object 601 has been associated, and
• The impression 600 on which the sticker 620 has been placed, and the location 613 on the impression 600 at which the sticker 620 has been placed, and thereby the location 613 on the impression 600 to which the object 601 is associated.
The above associations 616 allow the object 601 and sticker 620 to be displayed inside tools such as Netpage Explorer 602.
A variant of the swipe based sticker is shown in Fig. 39. It includes a transparent region 628 hich allows the tags of the underlying impression 600 to be seen through the sticker 620. This makes it possible to create a triple association 616 with a swipe that remains within the confines of the sticker 620.
In addition, the transparent region 628 may be transparent in the infrared spectrum in order for the Netpage pointer 533 to be able to see the Netpage tags on the underlying impression 600. This allows for the transparent region 628 to be non-transparent in the visible spectrum. As such, graphics can be printed over the transparent region 628. For example, a swipe based category specific sticker can be constructed which includes indicative graphics printed over the transparent region 628 as shown in Fig. 40. It is also possible that the instead of using a transparent region 628, the sticker 620 may alternatively include a hole.
3.5.7 Impression Associations Object Model
Fig. 41 shows the basic object model representation of impression associations 617. An ImpressionAssociation 617 includes a location and the object's content. An ImpressionLocation includes an {impression,x,y} tuple 629. The content of an associated object is represented as a PlayRequest 521. In the common case, the PlayRequest 521 includes a single value, but it also possible to associate targets and operations. For example, any PlayRequest 521 can be associated with an impression.
A swipe based sticker is associated with an ImpressionAssociation on the underlying impression.
3.6 Field Associations
An object 601 can be dynamically associated with a particular field of a form instance 630. Such an associated object 601 is then delivered to the relevant application as part of a submission of the form instance 630. This can be used, for example, to dynamically attach images (e.g. photos) to a Netpage form 632 and to then have those images sent to the application when the user clicks on the "submit" form command.
The relationship between field associations 618 and impression associations 617 is shown in Fig. 42. A FieldAssociation 618 consists of a specification of the field with which the object 601 is associated and a reference to the underlying impression association 617 which provides details of the actual object 601. The ImpressionAssociation 617 structure has been described. The field is specified by a FieldlnstanceAddress 631 which specifies a form 632 instance 630 and a field number 633 within that form instance 630. A Formlnstance 630 is a specific instance of & Form 632 which is printed on to a Printout 633.
2. The user can click on the large field 641 in order to retrieve the associated photo and display it on a suitable Netpage Player device associated with that user 525.
3. The overall form can be submitted by clicking on the "Submit" button 642. This causes a form submission to be sent to the relevant application. The form submission includes the photo currently associated with the large field 641.
The following sections use the sample application to describe the remaining details of the field association mechanism.
3.6.2 Form Design for the Sample Application
In order to design a form 632 that supports a simple application, two forms are specified. The first form 643 is a standard application form. The second form 644 is a special form that include fields that share the same impression coordinates as elements from the first form, but are overlayed on top of the first form's fields.
The underlying (first) form 643 is shown in Fig. 44. This includes a submit button 642 for the application and also a field of type ObjectReceiver 644. It is to this second field 644 that an object is to be assigned. The actual assignment occurs as a result of user interaction with the overlayed form as described below.
The overlayed form 644 is shown in Fig. 45. The application name for the overlayed form 644 is the system supplied "sys:object-associator" application. This is a standard internal application that expects to receive a form submission with a "submit" button having one of the names as shown in Table 4. The table describes the meanings of each of the possible submit buttons. Note that an object-associator form does not need to provide all four submit burtons, although it must minimally provide both a "set" and a "target" button.
Table 4. Submit buttons supported bv the svs: obiect-associator application
The below pseudo code outlines the handling of the set command. The main principle to note is that the center of the target field provides the {x,y} location to which the retrieved object should be associated. This {x,y} location is also used to locate a form field with which the object is to be associated. This is achieved by
determining the uppermost field on the page that intersects with {x,y} and that is also receptive to object associations. In the case of the example, the uppermost field on the page that intersects {x,y} is the target field itself, but it being a submit field, is not receptive to object associations. The next uppermost field that intersects {x,y} is the ObjectReceiver field on the underlying form. The end result is that the object is associated with a field on the underlying application form rather than the overlayed sys:object-associator form.
ObjectAssociatorApp : rhandleSetCommand (a_submission, a_formDescription) let l_setField = a_submission.getSubmitButton()
// fetch the target field for the current form let l_targetField = a_formDescription. fetchField( "target" ) // Calculate the impression location to which the object is to be // associated. The center of the "target" field is used as the // location to place the object. let l_targetCenter = l_targetField. center () let l_location = ImpressionLocation(a_submission.getImpressionId() , targetCenter) ;
// Look for a receptive field to which we can associate the object. // A receptive field is a field with a type that indicates it is // receptive to object associations, "submit" fields are not
// receptive, but most other field types are. N. B. The receptive // field is typically on another form. let l_targetField =
(the uppermost receptive field on the page that includes l_location)
// Retrieve an object of the appropriate type from the NetpageClipboard.
// The type to retrieve is indicated by the "value" element of the // "set" field let l_objectRequestType = l_setField.value() let l_clipboard = getClipboard(l_submission.userId() ) let l_object = l_clipboard.fetchObject (l_objectReguestType) // create the associations let l_impressionAssoc = createImpressionAssociation(l_location, l_object) createFieldAssociation(l_targetField, l_impressionAssoc)
}
3.6.3 Field Associations and Form Submissions
Netpage forms 632 generally have one or more form submission buttons 642. Clicking on such a button 642 with a pointer 533 causes the Netpage server 529 to perform handwriting recognition of the digital ink (if any) assigned to the form 632, and to bundle the result into a form submission which is then posted to the application associated with the form 632. The handwriting recognition largely involves converting handwriting fields (such as textual combs, and check boxes) into their digital equivalents (for example digital ink in textual combs is converted to text).
Associated objects 601 can optionally be submitted as part of such form submissions. The requirement to transfer an associated object 601 (or otherwise) as part of the form submission is specified in the form definition for that form.
3.7 Static Associations (Embedded Objects^
Objects 601 can be associated with a document at document creation time. As with dynamic associations, such associations can either be impression associations 617 or field associations 618. Static associations are specified in the Interface Description for the document. Static associations are represented as PlayRequests
521.
4. Netpage Clipboard
The Netpage Clipboard 615 is a system supplied, per user object repository to which the user can push an object 601. The object 601 thus pushed is considered to be the user's "current object" which may then be accessed by applications, in particular by the UserRequestRouter, but in general by any application that is acting on behalf of the user.
4.1 Representation of Clipboard Objects
Clipboard objects are stored as Netpage Player PlayRequest objects 521. APlayRequest 521 corresponds to a request to perform an action. It consists of three parts:
1. A target, which specifies on which player (device) the request should be executed.
2. The operation, which specifies the action to be taken.
3. A set of values, which are supplied as parameters to the operation.
A Value represents an instance of some physical type and consists of a type specification and data. The type specification has a physical type and zero or more associated type categories. The physical type identifies the structure of the data element of the Value. This document does not specify a particular representation for physical types. A possible mechanism would be to use MIME types. For example, if the physical type is image/jpeg then the data element would contain the binary data of an image in jpeg format.
A shorthand form of specifying PlayRequests will now be used in this section. As an example, instead of using the tabular form this section will use the following syntax for PlayRequests that only have a single item: value { phone-number, "555 3473"}
4.2 Mechanisms for Pushing Values to the Clipboard
In general, a user performs an explicit user action in order to push a value to the clipboard. Such actions may take various forms as described in the following sections. Once a value is in the clipboard any application can access the value. For example the value can be dynamically associated with a form field on a printed impression.
4.2.1 Push via Printed Netpage Form
Values can be pushed to the clipboard by interacting with a printed Netpage form such as that shown in Fig. 46. The form has been authored such that clicking on any of the phone numbers causes that phone number to be sent to the Netpage clipboard 615 for that user 525. For example, clicking on the phone number for "Susan Wilson " 615 causes the following value to be pushed to the clipboard 615: value { phone-number, "151 425 0617" }
4.2.2 Push via Physical Device Values 524 can be pushed to the clipboard 615 by Netpage aware devices that are capable of capturing and/or storing typed objects. Table 5 provides some example devices and scenarios in which they might push values to the Netpage clipboard 615.
Table 5. Examples of Netpage aware devices capable of pushing objects to the clipboard
4.2.3 Implicit Push
To improve usability, it may be possible for certain devices to support implicit (or auto) push which is where certain user interactions with a device cause a value to be automatically pushed to the Netpage clipboard 615. As an example, the user may configure their digital camera so that taking a photo causes the photo to be pushed to the Netpage clipboard 615.
4.3 Netpage Clipboard Interface
In order for a device or application to push a value to the Netpage clipboard 615or retrieve the current object 601, the device or application first retrieves a reference to a NetpageClipboard object for that user from the Netpage server 629. The following listing shows the NetpageClipboard interface in its most basic form. The interface allows the current clipboard value to be set, fetched and cleared.
interface NetpageClipboard
{ void setObj ect (in PlayRequest a_object) ;
PlayRequest fetchObjectO ; void clear () ;
};
The sections that follow discuss alternatives for various aspects of the Netpage clipboard interface.
4.3.1 Multiple Values Per User
The Netpage clipboard 615 is able to support multiple current values each of which belong to a different category. For example, the clipboard 615 can hold a current audio and current video at the same time.
PlayRequest values can specify one or more categories to which that value belongs. Note that an object category is generally independent of the specific physical type of the value being added to the clipboard. For example, setObjectQ might be called with a value that has a category of "photo", and a physical type of image/jpeg.
This listing shows a NetpageClipboard interface that supports multiple current values.
interface NetpageClipboard
{ void setθbject(in PlayRequest) ;
PlayRequest fetchObjectO ;
PlayRequest fetchObject (in Obj ectCategory) ; void clear (in Obj ectCategory) ; void clearAllO ;
};
Such a clipboard would still support the current object concept which would return the most recently added object. To that end, the clipboard interface in the listing has two fetchObjectO methods. The first takes no parameters and returns the most recently added object. The second takes an Obj ectCategory as a parameter and returns the most recently added object which belongs to the specified object category.
P T/AU2005/001416
158
More generally the clipboard could reuse the general capability matching mechanism required by RequestRouters in the Netpage Player architecture. This would provide the clipboard with a very powerful interface for retrieving PlayRequests.
4.3.2 Multiple Representations of Values
As with clipboards in standard desktop environments, it may be desirable to allow the Netpage clipboard to support multiple representations of values, each of which would have a different MIME type. For example, a text object could be stored as both a text/plain and a text/rtf document.
4.3.3 Using Values from the Netpage Clipboard
Once a user places a value in the clipboard, the value can be accessed by applications in response to actions by the user. The basic clipboard interaction model is shown in Fig. 47. Referring to Figs. 47 and 48, the clipboard starts empty 652. A value can then be pushed 653 into the clipboard 615. At that point an operation can be selected 654 by the user at which point the selected operation is executed against the current value in the clipboard. If an operation is selected while the clipboard is empty, then an error 655 is returned to the user.
The model presented in Fig. 47 is called the value first model as it requires the user to first select the parameter to an operation, and to then select the operation itself.
One way in which an operation can be invoked by a user is for the user to interact with a printed Netpage form 660 which contains a set of PlayRequests which specify operations. Fig. 48 shows such a printed command sheet and Table 6 describes the meaning of each operation. When a field is selected by the user (by clicking on it with a Netpage pointer), the corresponding operation is performed on the value currently stored in the clipboard (
Table 6. Description of commands
4.4 Placing Operations and Targets in the Clipboard As clipboard entries are actually stored as PlayRequests 521 it is also possible to push operations and targets to the clipboard 615.
4.4.1 Adding Operations to the Clipboard
Fig. 49 shows a clipboard model which allows operations 523 to be stored in the clipboard 615 rather than values. In this model, the user pushes an operation 523 to the clipboard 615 at step 661, and then selects the value 524 to which the command 523 should be applied at step 662. So, for example, a "play" operation could be pushed to the clipboard 615, and then a phone number could be subsequently selected from a contacts list as already shown in Fig. 46. This model is called the operation first model as it requires the user to first select an operation 523, and to then select the parameter 524 for the operation 523.
4.4.2 Allowing both Value First and Operation First Models
It is possible to simultaneously support both the value first and operation first models as shown in Fig. 50. In this model an empty clipboard 615 allows an operation 523 or a value 524 to be pushed at steps 663 or 664. This gives the user the freedom to perform operations 523 in whichever order seems natural. Also, if a user is using operation first, then once the user has placed an operation 523 in the clipboard 615, they can perform that operation 523 on as many values 623 as required simply by pushing values to the clipboard 615 at step 665(and vice-versa for value first at step 666,). In order for a user to switch between models, however, the clipboard 615 must be explicitly cleared at steps 667 and 668.
The following examples show the two models in action. In each case, the user's steps are shown numbered and the contents of the clipboard 615 are shown after each step. In the first case, the user uses the value first model by first pushing a phone number to the clipboard 615, and then selecting the operation 523 to be applied to that object:
Push value value { phone-number, "555 1287" }
Push operation value { phone-number, "555 1287" } operation { play }
At this point, an observer of the clipboard 615 (likely the UserRequestHandler) determines that the PlayRequest 521 as shown below can be produced by combining the operation 523 and value 524 PlayRequests 521. The resultant PlayRequest 521 can then be routed by the UserRequestHandler. Typically the UserRequestHandler "plays" a phone-number by sending the request to a device capable of dialling the phone number.
PlayRequest created by merging contents of clipboard:
The second case uses the operation first model:
Push operation operation { play } Push value operation { play } value { phone-number, "555 1287" }
At this point, the clipboard 615 determines that the PlayRequest 521 can be produced by combining the operation 523 and value 524 PlayRequests 521.
4.4.3 Ambiguous Usage
One problem associated with this mechanism of pushing values 524 or operations 523 to the clipboard 615 is a value 529 or operation 523 can remain in the clipboard 615 indefinitely. As such, it is easy for a user 525 to forget that an object 601 is in the clipboard 615 and for unexpected results to emerge. This is particularly the case if we simultaneously allow both the value first and operation first models. As an example, suppose the user performs the following actions:
1. Push "play" operation to the clipboard
2. Push a phone number (the number is dialled)
3. An hour later, click on another phone number.
Using' the state machine indicated by Fig. 50, step (3) would cause the number to be dialled. This may not be what the user expected as they have likely forgotten the fact that the "play" operation is currently residing in the clipboard.
There are a number of approaches to addressing these useability concerns: • Single Use Clipboard Entries
• Clipboard Timeouts
4.4.4. Single Use Clipboard Entries
Fig. 51 provides an alternate model to that previously described. In this model, using an item in the clipboard 615 at either of steps 525 or 626 results in that item being removed from the clipboard 615 at state 670. That is, operations 523 and values 524 only remain in the clipboard 615 for a single use after which the clipboard 615 is returned to the Clipboard Empty state 627. This model largely avoids the useability concerns described above, although not completely, as will be described in further detail.
4.4.5 Clipboard Timeouts
While a single-use clipboard model improves the useability of the Netpage clipboard 615, there are still problematic scenarios which result from allowing both value first and operation first models to coexist. Consider the following steps:
• Push "play" operation to the clipboard 615
• An hour later, push a phone number
In the above, it is not clear whether the user 525 has indicated that they would like to apply the "play" command to the phone number, or whether they had forgotten that they had pushed the "play" operation an hour ago and were actually attempting to simply push a phone number to the clipboard 615.
In order to address the ambiguity, the concept of clipboard timeouts can be introduced, as shown in Fig. 52. In this model, objects only remain in the clipboard for a limited duration, 60 seconds in the example for steps 675 and 676, but the exact value could be user configurable.
Fig. 52 shows clipboard timeouts in the context of a single-use clipboard. It is also possible to introduce clipboard timeouts within a multi-use clipboard, as shown in Fig. 53. Each application of an operation to a value at steps 680 and 681 resets the timeout period which allows for multiple values to be applied to an operation without having to push the operation each time. Similarly, it allows multiple operations to be applied to a value without having to push the value each time.
4.4.6 Multi Value Operations
The clipboard 615 concept can be extended to support operations that require more than one parameter 524. The basic approach is to allow multiple values 524 to be pushed to the clipboard 615. The clipboard 615 can then combine the values 524 with a pushed operation 523 to create a PlayRequest 521 with multiple parameters.
4.4.7 Adding Targets to the Clipboard
Consider the command sheet already shown in Fig. 48. Clicking on each operation with a Netpage pointer 533 causes the corresponding operation 523 to be pushed to the clipboard 615. The operation 523 does not necessarily take effect immediately. The operation takes effect when there is sufficient information available in order to determine the full details of the PlayRequest 621 being requested by the user 525. There are cases in which it proves valuable to allow the user 525 to be able to specify the target 522 of an operation 623. For example, suppose a user wishes to print a photo from their digital camera, but does not wish to print it to their default printer.
Selection of the printer can be achieved by selecting the printer from a list of printers printed on a Netpage card 700 as shown in Fig. 54. Clicking on a printer 707 on the card simply causes the details of that printer to be pushed to the Netpage clipboard 615.
Fig. 55 shows the details of each of the fields on the card. Each field corresponds to a PlayRequest (521a, 521b, 521c, 52 Id, 52 Ie, 52If, 52Ig) that specifies a target 522 and nothing else.
The following steps provide an example in which the user pushes a target to the clipboard.
1. Push photo of family dog to clipboard value { image/png category ="photo", <contents of photo of dog> }
2. Select printer by clicking on card value { image/png category ="photo", <contents of photo of dog> } target { home-color-printer }
3. Push "print" command to clipboard (e.g. using printed command sheet shown in Figure 3 value { image/png category ="photo", <contents of photo of dog> } target { home-color-printer } operation { print }
At this point, a PlayRequest 521 can be constructed that combines all the elements from the clipboard 515 as shown in Fig. 52.
PlayRequest created by merging contents of clipboard
Once the full PlayRequest 521 is determined, it is performed and, depending on the clipboard model being used, the clipboard 615 would either be cleared of all contents (the single-use model), or left as is in readiness for future related requests 521 (the multi-use model). In the latter case, the subsequent act of pushing another photo (say of the family cat) to the clipboard 615 would leave the clipboard 615 in the following state:
target { home-color-printer } operation { print } value { image/png category ="photo", <contents of photo of cat> }
At this point, the clipboard contents indicate that the user wishes to print the newly selected photo on the color inkjet printer at home. This approach allows the user to request the printout of a number of photos on a particular printer, without having to specify the target 522 or the operation 523 each time, by simply clicking on each required photo.
Even in the multi-use case, if the user is inactive for some configurable period of time, then a clipboard timeout causes the clipboard 615 to be cleared.
4.4.8 Pushing more fully specified PlavRequests
As the clipboard 615 supports the pushing of PlayRequests 521, the application author is not limited to pushing values 524, operations 523, and targets 522. It is also possible to push PlayRequests 521 that are more fully specified. For example, consider the printed command sheet 710 shown in Fig. 56. It contains various commands 711 that can be invoked by clicking on the sheet with a Netpage pointer 533.
Fig. 57 shows the configuration of one of the commands. Namely, the "print using ... office printer" command 712. As can be seen, it corresponds to a PlayRequest 521 that specifies both a target 522 and a command 712.
1. Push photo of family dog to clipboard value { image/png category ="photo", <contents of photo of dog> } 2. Click on "print using ... office printer" field value { image/png category ="photo", <contents of photo of dog> } target { office-personal-printer } operation { print }
At this point, a PlayRequest 521 can be constructed that combines all the elements from the clipboard 615 as shown in Fig. 52. As such, the "print using ... office printer" command 711 has reduced the number of clicks required by the user to perform the action from three clicks to two.
PlayRequest created by merging contents of clipboard
4.4.9 Communicating Status to the User
At times the mechanisms described may require communication of status information (often errors) to the user. One method is to make use of the Netpage Player infrastructure. Special operations (eg. show-status-ok- message and show-status-error-message) can be designated for transmitting status information to the user. The player architecture would determine, for each message, the appropriate device (or devices) on which to display the message and the way in which to display it. For example, it may be that in certain situations the pointer 533 is the only available player in which case an error status might be "played" by illuminating a red LED on the pointer 533 or playing a short sound.
5. Downloadable Content Billing
5.1 Overview
There is already an existing market place for purchasing and downloading products to mobile devices. Products such as: ringtones (monophone, polyphonic and real tone); wallpapers; games and other applications; music; music videos; films and TV. The printing capabilities of M-Print can add further to this list of products.
The traditional methods for purchasing and downloading such products are based around web browsing and SMS to initiate the download and EMS or MMS to deliver the product to the phone 100, see Fig. 58. The user enters and sends a product code via SMS at steps 720 and 721 to a vendor 723 who then delivers the product to the originating handset 100, or to the mobile number supplied with the product code at step 724.
Netpage and M-Print technologies have the ability to simplify the user experience in accessing and purchasing these products, while also being able to utilise the existing infrastructure for the billing and delivery of the products.
Fig. 59 shows the typical sequence of events for a Netpage play sequence, cast in terms of downloading a preview of a ringtone. In the general Netpage play sequence a Netpage click at step 730 triggers a form submission which in turn results in a general "play" event being routed at steps 732 and 734 to a Netpage player via the Netpage Player Architecture. For downloadable content the form submission is shown as a simple hyperlink 731 and the "play" event is shown as a download of content, in this case a ringtone.
Using a Netpage pen or pointer 533 the user 525 can click on a printed advertisement 715 in a magazine, newspaper, direct mail, on a product's packaging or possibly on a product itself. This can automatically deliver some content to the user's preferred Netpage Player 520 for that content. Most likely the Netpage Player 520 is the user's mobile phone 100, as is shown in Fig. 59. Alternatively it can commence a dialogue with the user via the device's UI to determine what the user wants to do with the product they selected via their click. For content like ringtones or phone themes, this provides a more convenient interface than the existing SMS interfaces in use today.
M-Print devices can provide a Netpage scan operation, and this can also be used to initiate a product download or purchase as above. The card that is scanned could have been printed on a M-Print printer 4 or it could be provided along with another product, e.g. a card in a breakfast cereal box.
Combining the abilities of M-Print and Netpage can lead to a powerful suite of new product promotion and sales tools. For example, a user can use a Netpage pointer 533 in a mobile phone 100 to click on the latest ringtone advertisement in their favourite magazine. This results in purchasing the ringtone, charging it to their mobile phone account, download and install it on their phone 100. It can also print on their phone a promotional card that allows a one time download of the same ringtone for them to give a friend. When their friend scans the card they receive the same ringtone downloaded and installed on their phone. Depending on the promotion running at the time the friend may receive the ringtone for free or at a discounted rate.
5.2 Downloading Content
Fig. 59 shows the typical Netpage player sequence of events that are involved in downloading a product, in this case a ringtone, from a Netpage based application. In the diagram the ringtone download event being routed to the phone in steps 732 and 734 consist of a ringtone, with the play operation of preview 716. It may have the target handset specified or it may rely on the Netpage player request routing mechanisms to determine the appropriate target 522 for the play request 521.
It has already been noted that the mobile computing environment already has some well established mechanisms for satisfying on-line product purchases. Below are three possible ways Netpage player requests can be integrated into the existing mechanisms to provide the user with a simpler user experience. In each of the cases the request to purchase or preview the product is instigated via a Netpage stroke, click or scan The differences arise in how the Netpage application 733 procures the product and delivers it to the user.
5.3 Netpage as Middle Man Fig. 60 shows a scenario where the Netpage ringtone application is used as an alternative interface and delivery mechanism to an existing ringtone vendor 723. The Netpage application 733 does not own the rights to the products it is providing. Instead it is acting as a middleman, forwarding the requests at step 736 onto the product vendor 723 on behalf of the Netpage user and routing the requested product at step 739 back to the Netpage user via the Netpage player mechanism.
This approach allows the user to benefit from the Netpage Player Architecture, which allows the user to customize the way they want the product to be routed after they have received it from the vendor. It also allows for the Netpage Player to provide extended handling of products on the mobile device. For example, the player may prompt the user if they wish to back up their existing ringtone before installing a new ringtone or it may guide the user through installing the ringtone as a custom ringtone for a particular phone number or set of phone numbers.
5.4 Netpage as a Sales Agent
Fig. 61 shows the Netpage application 733 acting as a sales agent for the product vendor 723. The play request 521 contains the user information and the product ID, and is routed to a special player 743 at step 741 that passes the request onto the vendor 725 at step 742. The vendor 723 then delivers the product in its normal way, in this case via EMS/MMS at step 744.
5.6 Hybrid Approach Fig. 62 shows a hybrid scenario where the both the Netpage Player Architecture and the existing mobile technologies are used to deliver the purchased product. The request 521 to purchase the product may be satisfied by the ringtone application 733 either internally as a pure Netpage application or acting as a middle man. The play request is dispatched containing both the purchased product and a voucher to be printed.
The play request 521 is routed as a Netpage player request and when it reaches a player 745 deployed within the mobile network, acting a mobile device proxy, it is split into a product delivery and a print job. The product is sent out via an EMS/MMS message at step 746 and delivered to the mobile device 100 in the same way as a traditionally purchased product at step 747. The print job in the form of an M-Doc reference 507 is delivered to the phone 100 via one of the mechanisms initiating a print job on the mobile device 100.
5.7 Billing for Downloaded Content
The ability to bill or charge for services and products is at the heart of all businesses. To be able to bill you need to be able to: 1. identify a party to bill;
2. have a mechanism to deliver and ensure payment of a bill; and,
3. be able to justify the bill based on records of services or products provided.
When accessing a service or purchasing a product over a mobile network the user is typically charged for both the data or call traffic involved in making the transaction and also for the product or service purchased.
For example, if a ringtone was purchased via Netpage, there is a charge for the ringtone and also a charge the data traffic used to download the content to the mobile device. It is possible for a 3rd party vendor to enter into a commercial relationship with the carrier whereby the carrier waives or reduces the data transfer costs, in return for a payment from the vendor. Mobile carriers play a central role in billing. They own the private networks used by mobile devices to connect to both the public telephone and data networks arid it is at their discretion that a mobile device has access to any services. They already have a billing relationship with each of their customers and hence are able to identify them and bill them. Over time the billing options offered by carriers have evolved from the simple post-pay phone bill to include pre-paid, post-paid and plan-based billing, where customers are committed to paying a certain amount per period for which they can access a range of services. Carriers also have the ability to adjust or waive billing based on a user's activity over a billing period, for example, if you send more than certain number of SMSs in a day then all SMSs is to be charged at a different rate.
For pre-paid accounts the account balance is checked before the transaction is commenced to ensure it has sufficient credit to pay for the service. Not all services can predict the total cost before they are delivered and in those cases it is up to the individual carriers to decide whether those services are to be made available to pre-paid customers or not.
Mobile carriers recognise the value of their ability to identify and bill customers and make it available to third parties on a commercial basis. They do not make it freely available. The ability to integrate into a carrier's billing system is typically offered in a number of different ways, of which some are:
1. SMS/MMS-based services
2. Hosting of 3rd party applications and billing the traffic for those applications differently 3. Billing of data traffic to nominated servers at different rates
4. The ability to bill on behalf of a third party, based on billing records provided by the third party.
To bill for products or services attained via Netpage interactions it is necessary to identify where in the sequence of events it makes sense to generate billing records and which party in the transaction is responsible for maintaining and acting on those billing records. To make these services available to users, with pre-paid mobile accounts it may be necessary to be able to predict ahead of time the total cost of the transaction. If we consider the SMS-based content download scenario, Fig. 58, there are three billing opportunities:
1. The SMS to initiate the transaction may be a billable SMS 2. The purchase of the content from the vendor
3. The delivery of the content via a SMS or MMS.
The first SMS is a standard SMS that the user may be billed for, it may be billed differently given that it is destined for a vendor who has a business relationship with the carrier. The second SMS/MMS is not billed to the sender, as would normally happen, but it is billed to the receiver, via an agreement between the vendor and mobile carrier. In both of these cases the mobile carrier generates and manages the billing records. The purchase cost for the content is also billed to the receiver and the vendor is responsible for generating the billing record. In most cases this billing record is forwarded onto the mobile carrier, typically once a day via a batch transfer. The carrier accumulates these records and includes them on the user's phone bill as a service for the vendor. The carrier then makes a periodic payment of funds collected on the vendor's behalf to the vendor. This alleviates the need for the vendor to establish a billing relationship with each of its customers and also allows the mobile carrier to derive more revenue from its existing billing relationship with the customer.
For the vendor to be able to generate billing records that a mobile carrier can incorporate into a customer's bill the mobile carrier needs to provide the vendor with a "customer id" or "billing id" per transaction that the carrier can use to link a billing record with a customer. The provision of customer id and the ability to generate billing records needs to be done in a secure way to reduce the possibility of fraud. To ensure the required security is maintained each vendor enters into a contractual relationship with each mobile carrier before the "customer id" data is shared with them.
In situations where a vendor cannot or does not want to work with a mobile carrier they need to implement their own means of identifying and billing their customers. Identifying a user of a mobile device without the assistance of the mobile carrier in a uniform way across all mobile devices is non-trivial.
Introducing Netpage and M-Print technologies provide a number of new billing opportunities for all parties involved. If we consider the case where Netpage acts a middle man, there are two billing opportunities:
1.When Netpage application retrieves the content from the content vendor; 2.For the network traffic used to deliver the click and the ringtone.
The Netpage application fetching the content from the vendor generates a billing record for the customer. As for the SMS case above, it is possible to arrange with a mobile vendor to accept these billing records and to bill on the application's behalf. To do this the data traffic associated with the hyperlink activation is to be tagged with a "customer id" to be associated with the billing record.
The mobile carrier tracks the data traffic used to send the click event and deliver the play request. By default that traffic would be billed in the same way as all other data traffic to and from the device. In a situation were the Netpage application is billing via the carrier it may be possible to strike a deal with the mobile carrier where by they waive the data traffic costs in return for a payment per transaction.
In the case of Netpage acting as a Sales Agent, the Netpage system is not involved in delivering the product but only in making the sale. In this case there are four billing opportunities:
1. The data traffic for the Netpage click;
2. The forwarding of the purchase request to the vendor; 3. The purchase of the content;
4. The delivery of the content
The mobile carrier tracks and generate billing records for the data traffic and the delivery of the content. As in the SMS case the delivery message is charged to the receiver rather than the sender, via an agreement with the carrier.
In this case the billing record for the content purchase generated by the ringtone vendor and would be handled in same way as for the SMS case above. It would be possible to have an agreement with the carrier whereby the cost of the data traffic and the delivery message are waived in return for a payment from the vendor.
In most cases the Netpage application would be managed by the vendor as an alternative interface to their existing business and as such it does not need to bill for its forwarding services. If it is run by a different business then it generates a billing record for the forwarding service. This may be delivered either to the user or to the vendor who has agreed to pay for forwarded requests.
The billing options for the hybrid approach are essentially the same as for when Netpage is a middle man but the number of deliveries, and hence billable events, to the mobile device is increased. In this case the bill for delivering the M-Doc may be changed to the vendor rather than the customer since it is an unsolicited promotion. Each of these billable events could be filtered by the mobile carrier based on later billing records that enter the system. For example, the cost of delivering the M-Doc may be waived or credited back, if the offer on the printout is taken up by another user.
5.8 Digital Rights Management
Closely related to billing is ensuring that the product or service is only used for the purpose(s) it was purchased for, eg. a ringtone purchased for one phone, can not be installed on more than one phone, or a music file that is downloaded as a sample can only be played X times before being purchased.
Digital Rights Management (DRM) schemes are being adopted by mobile device manufactures and mobile carriers. Where content is being delivered via the existing mobile mechanisms DRM is automatically triggered. The Netpage Player on a mobile device is implemented to hook into the DRM mechanisms on the mobile device. It prevents a user by-passing DRM restrictions on downloaded content.
5.9 Identifying the User
Mobile carriers identify the user of a mobile device when the device negotiates access to the network, either at boot time or when it comes within range of a base station. For GSM and CDMA networks a user's identity is determined by matching the International Mobile Subscriber Identity (IMSI) with a user's records held by the carrier. The IMSI is not sent during negotiation but rather an identity derived from it called a Temporary Mobile Subscriber Identifier (TMSI) is sent. Access to the IMSI can be protected by a PIN and most phones can be set up to prompt the user for a PIN when it is turned on. This is used to gain access to protected data, such as the IMSI. During the connection time negotiations the International Mobile Equipment Identity (IMEI) is also transmitted. This is not used to determine who the user is, but it is used to filter out mobile devices that are blocked from the network, e.g. stolen mobiles can be blocked based on their IMEI.
When a mobile network allows a user on a GSM network, they assign the user a SIM card and then activate the SIM card. For a non-pre-paid SDvI card the user needs to present sufficient identification information that the carrier is satisfied they know who the person is, that they are able to pay their bill, and where to send the bill. For a pre-paid account the carrier does not need such information, but some countries do require carriers to collect user identity information even for pre-paid accounts. Once the user has an activated SIM card it can be used from any handset and the correct account is billed for usage. Users are encouraged to protect their SIM cards with a PIN, so that it cannot be used until a PIN is supplied. However this is not enforced by the carriers, as it is a user choice.
The Netpage system, includes the concept of a Netpage user, each of whom has a Netpage account. Some Netpage applications require knowledge of the user. To be able to access those applications via a Netpage pointer or scanner built into a mobile device, a link between the mobile device and a Netpage user is established. To do this there is a configuration and activation step, similar to a SIM card activation where the Netpage sub-systems on the mobile device are configured and a mapping is setup between the user identity for the mobile device and a Netpage user. If the Netpage account is being established for the first time then, as with a mobile carrier, the user identifies themselves so that the Netpage network operator is able to bill the user for any Netpage related costs incurred.
There are times where a mobile user's identity cannot be determined via a mobile carrier: possibly a company does not want to or cannot get the information from a carrier; the mobile device may be connecting
to the network without a carrier being involved; or the carrier may not have the information required, eg. anonymous pre-paid accounts. In these situations the functionality available to the user can be reduced to functionality that does not require knowledge of the user's identity or additional Netpage specific information can be used to establish the user's identity to the satisfaction of the Netpage system.
Netpage-specific user identity information is stored on the device during the Netpage registration/activation process. To give the same level of user identity portability as a SIM card the information can be stored on the SIM card, if it is present. If that is not possible, due to a mobile carrier denying access to it or it not being present, it can be stored in a secure store within the device and if that is not possible, on the normal file system of the device. If the identity information is stored on the SIM card, it can automatically move with the user's carrier identity when they swap SIM cards.
6. Use cases
6.1 M-Print Blanks
The M-Print printer 4 is able to print on special M-Print blanks that are specially designed to provide optimal print quality in a M-Print printer 4. The blanks are purchased by a user in packs and loaded one-by-one into the printer when a print is being made.
To ensure valid blanks are loaded into the printer 4, a mechanism for validating the supplied blanks and rejecting imitations can be supplied. This can be done by reading an ID from the blank during printing and validating that ID either locally or via a network service.
The blanks are pre-tagged. For Netpage to be able to correctly register a printout an ImpressionID is determined from the pre-tagged blank when the printout is printed. This implies the M-Print printer is able to read the ImpressionID from the blank.
Both cases can use the ID encoded on the blank. The proposed scheme for validating the ID involves reading a second number from the blank called the signature. The signature and ID can then be validated as a pair. The proposed mechanism for this is to consult a network based service that securely stores the ID and signature pairs that have been manufactured.
Both the ID and the signature are readable by the printer 4 and in the Netpage case by a Netpage pointer 533. The M-Print printer 4 does not contain a Netpage pointer 533, but it includes a bar code reader. This means the ID and the signature are provided on the back of the blank as a linear bar code, most likely in IR ink, for the printer 4 and on the front of the blank encoded in the Netpage tag encoding for the Netpage pointer 533.
In some circumstances, validation of the ID may not be possible in real time before the printout completes. Thus, users are informed if non-genuine blanks are being loaded into the printer and warn the user that loaded non-genuine blanks may decrease the lifetime of the printer's printhead.
While complete validation of the ID may not be possible before printing, coding on the blank can be detected that indicates the orientation of the blank and also the start of the timing codes that allow the printer 4 to detect the speed at which the blank is moving through the printer 4. If these can not be detected the blank may be rejected before printing commences.
6.1.1 Loading a Card
Referring to Fig. 63, a print job has been submitted to the printer 4, before it can commence it must be supplied with a valid blank the right way up. 1. The user is prompted to insert a blank (step 750)
2. The user inserts a blank (step 751)
If the user inserts the paper upside down at option 752, the user is prompted to re-insert the blank the other way. If the loaded paper is uncoded or incorrectly coded, the user is prompted to insert a genuine M-Print blank.
6.1.2 Validate an ID
Referring to Fig. 64, during or immediately after printing the printer 4 sends back the ID and possibly the signature of the blank at step 750. In the background the M-Print services on the mobile device validates the ID at step 757, either locally at step 759 or via a network service at step 758, and if the validation fails it informs the user at step 763. There is a timing issue here in that the user may no longer be looking at the mobile device 100 when the result of validation is known, to alert the user that the blank they have printed on is not valid and that using that media shortens the life of the printhead the M-Print service on the device can deliver the message as a local SMS causing the device to alert the user of a new message.
Once the ID and signature have been validated it is passed at step 762 onto a Netpage microserver 761 for processing as the ImpressionID of the printout. The user is alerted that the last print was done on an invalid blank and continuing to use such blanks shortens the life of the printer 4.
6.2 Printing
Common to all the use cases present below is printing. From a users perspective, printing normally has two stages, a third may be added if an error occurs or the blank is invalid:
1. Loading the blank
2. Printing 3. Error reporting
The user view of loading the blank and reporting an invalid blank are covered above. The user's view of printing is both: a progress dialog that allows the user to view the progress of the print and cancel the print; and being able to see the blank move through the printer and emerge from the device.
Cancelling the print stops the printer using any more ink, but the ID and signature from the blank may still be read for validation.
6.2.1 Print 1. The user is prompted to load a card.
2. A print progress dialogue is displayed, with a cancel button
3. The blank is drawn folly through the printer and the print progress dialogue is removed
If the user wants to cancel the print jobthe user presses cancel on the print progress bar which results in the print job stopping and the blank being ejected. If an error occurs such as a paper jam, an error message may be provided to alert the user. The user may then dismiss the dialog of the error message and progress dialogs are removed. If a blank fails validation, the user is alerted of the failure.
Fig. 65 shows a Printer DC 770 as the object that exposes the graphics model used by applications 514 to build up the printed image. It shows the printing following after the application 514 has completed drawing the page. On some systems these operations may overlap or the application 514 may be requested to draw the page multiple times with different clipping regions, eg. rendering in bands, either way the logical flow should still be the same. If capturing all printed documents as Netpage documents is supported then fully composed page is lodged with the Microserver 761, the Microserver 761 treats this a document lodgement, and records a printout for that document, when the ID and signature are successfully validated and passed onto the microserver 761.
Fig. 65 shows the ID and signature being passed out from the printer 4 soon after printing has commenced, the timing of the transmission of the ID and signature is not significant for the user since they only know about it if the validation fails which occurs after the print has completed. For Netpage enabled printouts, this timing is more critical, since a situation can occur where a printout is immediately handed to another user who clicks on it with a Netpage pointer or pen 733 and expects a result. Where the printing device does not have network connectivity this may not work at all. If the printing device does have network connectivity it still might not work, or at least have a perceivable latency, while the network validation and the ID and registration of the printout is completed.
6.3 Uploading and Downloading Data
Moving data on and off mobile devices via the wireless network reliably presents a number of challenges: 1. Wireless networks are inherently unreliable and the link can be lost at any point.
This can occur due to signal loss or the mobile device having to disable the radio link to conserver power or to allow another power hungry activity to start up, eg. printing.
2. The bandwidth available on the existing 2.5G networks is limited and it could take up to several minutes to transmit a high resolution photo on or off the device
3. The cost of transferring data over a mobile network can vary and it may be significantly cheaper to delay the transfer to a non-peak time, e.g. late at night.
4. Mobile carriers might prefer non-urgent data transfers to happen during lulls in the network traffic. 5. It may be cost effective to support different means of transferring data. A HTTP Put over GPRS is the most obvious way, but it may be possible to take advantage of carrier price subsidies and send the same data via an MMS or SMS message.
Referring to Figs. 66 and 67, to provide flexibility in how data uploading and downloading is achieved and to insulate the rest of the architecture from it, each mobile device 100 has a service responsible for delivering and receiving data from the network. It queues data transfer requests 780 and guarantees delivery of the data in the an efficient manner. It supports partial transfers and resumption of transfers after a break in the data link to minimise the data sent over a wireless network. An equivalent service can be located in the network to both receive data from the mobile device and forward it on to its destinations and also to queue data being sent to the mobile device.
The network based component of this service provides a carrier integration point. A carrier may choose to host this service and bill the traffic for it differently to encourage usage of the M-Print and Netpage services. It also provides a single point of modification to take advantage of new features in the carrier networks, eg. a new data push model not based on SMS.
The device based component of this service provides a simple interface to the device based M-Print and Netpage services, while providing the ability to exploit all the features of a mobile device 100 to access network based services. This may include taking advantage of WLAN connectivity where possible.
The download sequence shown in Fig. 67 illustrates how "data push" to a mobile device can be achieved which cannot be directly reached from the general internet. It shows a SMS message being sent to the device to inform the download service that there are downloads waiting to be fetched. The message may include some information about the urgency of the downloads, to allow the device side download service to decide when it should fetch the download(s).
6 A Netpage Pointer / Scanner
In the printing scenario a blank's ID is read during printing. This ID is used to both facilitate validation of the blank as a valid M-Print blank and also as an Impression ID for Netpage. The Impression DD is used by the Netpage server 529 to associate the M-Print printout with the document that was printed onto the blank.
An M-Print blank has the ID encoded on the back of the blank in a way that is readable by the paper feed mechanism. If the blank has been pre-tagged with Netpage tags then the ID is also embedded in the Netpage tags. To initiate a Netpage interaction the first step is for the user to perform an action that retrieves the ID and supplies it to a Netpage server. The ID can be retrieved by:
1. A stroke or click with a Netpage Pen;
2. A click with a Netpage Pointer;
3. Scanning the ID on the back of the card.
The first two of these actions use Netpage specific devices to read the Netpage tags. The pen 533 provides a stream of digital ink along with the ID and the pointer provides a position on the printout along with the ED. The last uses a scanning mechanism to read the ID from the back of the printout. It can be the same scanner as is used in the M-Print printer paper feed mechanism or it can be a dedicated scanner that the printout is feed into or passed over, similar to a bar code reader. This mechanism only provides the ID, it does not provide any positional information, but Netpage applications can be authored to support a "scan" of the printout as well as a click or a stroke on the printout.
6.4.1 Activate a Netpage Application via a Scan
The user passes an existing M-Print printout back through their M-Print printer to activate the associated Netpage application.
The printout is drawn through the printer and a Netpage application is launched. If there is no Netpage application for the printout, the user is told the printout has no associated application. If the printout fails validation, the user is alerted of the failure.
The effect the user sees as a result of a Netpage application being launched varies depending on the application, some examples are:
• For a photo the use may see the photo displayed on the screen with the option to reprint it or send to someone. • For a business card the user may receive a vCard on their mobile device which can be processed in the normal way.
• For a coupon a completed SMS/MMS/email may be displayed asking the user if they wish to send it off to enter the competition.
• Any printout may be displayed on the mobile device showing the print image and allowing the user to navigate the hyperlinks and fields in the printout and activate them.
If the device has a touch screen, the user can use a pointer to select fields and generate digital ink.
Fig. 68 is a sequence fragment that shows the processing of a scanned ID from the paper feed mechanism in the printer. If a scanned ID and signature is returned to the Print Service while it is printing, see Fig. 65, it is validated and then passed onto the Netpage Microserver 761 triggering the submission of the Netpage document. The validation is performed by the Print Service 754 in this case to ensure the user can be warned about using invalid media as early as possible. If the Printer Service receives a scanned ID and signature
while it is not printing at step 790 then it passes it directly to the Netpage Microserver 761 as a pseudo-click or scan. The Microserver 761 processes it in a similar way to the way it processes a Netpage pointer click.
7. Applications
7.1 Photo Printing
Photo printing is a major application for M-Print. In its simplest form, photo printing can be done completely locally, without any dependence on network services or interactions. Printing a photo can interact with a photo archive. If a photo is printed then it is likely the user may wish to access or print the photo again. When a photo is printed it can be pushed out to the photo archive making it available for on-line retrieval or access. Netpage functionality offers a convenient and natural way of interacting with a printed photo. A Netpage enabled photo can act as a permission token, giving the holder of the printout permission to retrieve and reprint the photo from the archive. Photo archiving from mobile devices is an independent application from photo printing. Users typically take more photos that they wish to keep in an archive than they wish to print.
7.1.1 Local Photo Printing
Referring to Fig. 69, a camera phone user takes a photo at step 795 and elects to print it.
1. The user uses the default photo application 796 on their device and takes a photo at step 795 2. The user selects print from the applications menu
3. The user is prompted to load a blank
4. The print is produced
Other options include: • The user prints with a border at step 797 by selecting print options from the menu before printing and selects to print with a border, and the user can then select print from the applications menu. • The user requests the date is printed with the photo at step 798 by selecting print options from the menu and selecting the print date and time option, and the user can then select print from the applications menu. • The user adds a caption at step 799 where the user selects photo options from the menu and selects add caption, wherein the user is prompted to enter a caption and the user selects print from the applications menu.
7.1.2 Printing a Photo Archives the Photo
Referring to Fig. 70, printing a photo generally implies that the photo has more worth to the user than the photos the user has taken and not printed, it is more likely to be shared and hence more likely to be referred to in an archive. This scenario describes pushing a photo that is printed to the photo archive on the mobile device 100 to give it priority in being transferred off the device 100 and into the archive 800.
When the photo is pushed to the archive the user is given the opportunity to specify what access permission's should be applied to the photo at step 801 in the archive 800. In this scenario it is kept to public or private 802 for simplicity, but it could easily be a more complex selection from various ACLs (Access Control Lists) maintained by the user.
1. The user uses the default photo application 796 on their device 100 and takes a photo.
2. The user may set some print options 801
3. The user selects print from the applications menu 803 4. The user is prompted whether the photo should be public or private in the archive 802
5. The user is prompted to load a blank
6. The print is produced.
Optionally, default settings may be applied for archiving the images where the user may not be prompted if the default settings indicate whether all photos should be public or private.
This sequence diagram shows the most likely case, where uploading the photo to the archive occurs after printing has finished. This is the most likely case, since power demands of printing require the network connectivity section of the phone to be powered down, or at least avoided. Some devices may be able to support both, in which case the upload could occur during the print. The photo archive is accessible from both a browser on a mobile device 100 or a desktop browser. The user is able to print a photo from the archive to either a desktop printer or the printer in their mobile device.
7.1.3 Printing Archives a Netpage Enabled Photo
In this use case the user interactions are the same as for "Printing a Photo Archives the Photo", but in the background, the document, the printout, and the impression ID are registered with the Netpage infrastructure. The printout can be interacted with via a Netpage pointer 533 immediately on the device it was printed on, but it is not be active for other pointers or pens until it has been successfully uploaded to the network based Netpage services.
Referring to Fig. 71, for Netpage enabled photos that already are being archived in a general purpose photo archive it is not desirable for the Netpage server 529 to also store the photo, so the Netpage server 529 stores a reference to the photo in the archive 800, allowing it to be retrieved when necessary. The Netpage server 529 still tracks user interactions with the photo: reprints, digital ink, etc but it generally does not store the actual image itself. When the photo is pushed to the archive the pusher receives a reference to the photo that can be used to retrieve the photo when it is required..
The need to move the photo and the Netpage document associations out into the network to enable general Netpage interactive on the printed photo, gives the pushing of the photo to the photo archive more
importance. In this case the push to the archive includes a flag indicating the photo should be moved to the off device archive as soon as possible. The registering of a printout with the Netpage services can not complete until the blank has been validated since the ID is used as the Netpage impression ID.
In this case the photo reference rather than the photo is lodged with the Netpage microserver. The printout can be interacted with via a Netpage pointer on the same device after the ID and signature have been validated, but other pointers and pens can only interact with the document after it has been successfully uploaded to the Netpage network server.
8. Player Use Cases
8.1 Business Card Application
This section covers the Netpage Player PlayRequests 521 used in the interactive Netpage Business Card and describes the behaviour of the Player Agents 537 handling such objects and commands. Fig. 72 shows the sample business card 810. The fields (text 811 and images 812) are generally associated with PlayRequests 521 that (partially) specify what action is required when a user clicks on one of the fields with a Netpage pointer 533.
8.1.1 Phone Number Referring to Fig. 73, the phone number fields 817, 818 on the business card 810 are associated with PlayRequests 816, 819 that simply specify a phone number, without specifying the operation to be performed or the target of the operation. The author of the business card 810 is thus providing maximum freedom to the receiver of the business card 810 to make use of the phone number fields as they see fit. For example, one user may have their system configured to react to such PlayRequests 816, 819 by having their mobile phone dial the specified number, while another user may prefer to have such PlayRequests 816, 819 simply pushed to the Netpage Clipboard 615 for later use.
The mobile phone icon 813 is configured with a more fully specified PlayRequest 809 than the phone number fields 817, 818. The PlayRequest 809 specifies an operation ("dial") that should be performed when that field is selected. The operation overrides the default handling of phone -number values that might otherwise be performed in the absence of an explicit operation. Note that the target of the request is still left unspecified. This gives the routing system the freedom to determine the most appropriate device with which to make the call. This is especially appropriate for a business card 810 which might be handed out to hundreds of users who each typically have their own phone. Placing a specific target in the PlayRequest would have been possible, although inappropriate in this case. The landline telephone icon 813 is configured similarly to the mobile phone icon, but with a different value for the phone number.
8.1.2 Fax Number
Referring to Fig. 74, the Fax phone number field 820 is configured exactly as for the phone number fields except that the phone number value is now also marked as belonging to the "fax" category 823. This
additional information can potentially be used during request routing in order to select targets which specifically cater for "fax" phone numbers rather than targets which simply specify that they cater for phone numbers in general. The "fax" button field 821 specifies an operation ("fax") in the PlayRequest 822. The exact semantics of that operation are target dependant. For example, on a mobile phone, the Fax Agent might launch the Fax editor with the destination fax number pre-configured.
8.1.3 Web Address
Referring to Fig. 75, the web URL field 824 and "WWW" icon 825 are configured similarly to the phone number field and phone icons. The icon 825 is specifically configured to cause a web browser to be invoked 826 on the specified URL, whereas the PlayRequest 827 for the URL field is less fully specified and is therefore more flexible in terms of its possible interpretations.
8.1.4 SMS and MMS Fields
Referring to Fig. 76, the "SMS" field 829 is configured to invoke an "SMS" operation 831. This request could be routed to an SMS Agent running on the user's mobile phone which would launch the SMS editor with the destination phone number filled in. The "MMS" field 828 is configured similarly to the "SMS" field.
8.1.5 Email Address
Referring to Fig. 77, the web email address field 833 and "Email" icon 832 are configured similarly to the phone number field and phone icons. The icon 832 is specifically configured to perform a "create-email" operation 834, which can typically be handled routing the request to an agent which is capable of launching email tool with the destination email address pre-configured. The email address field 833 is less fully specified and is therefore more flexible in terms of its possible interpretations.
8.1.6 Street Address
Referring to Fig. 78, the Street Address field 836 is configured to map to a PlayRequest 837 that contains a location value 841 specified using a type of location. The specific details of this type are not specified in this document. The important thing to note is that it stores information that specifies the location in various ways. As such, the value can be handled differently by a large number of agents. Examples might be: • A Web MAP Search Agent which presents the location in a web browser by accessing a web- based map search facility
• A Print Agent on an m-print phone which prints the location details (and possibly directions) on an m-print card.
• A GPS Navigator Agent which displays the location in a handheld GPS device.
8.1.7 Photo
Referring to Fig. 79, the Name field 838 and "Photo" icon 839 are configured to map to a PlayRequest 840 that specifies a j peg photograph. Typically, this request can be routed to an agent capable of displaying the image.
8.2 Scanning Support
Referring to Fig. 80, interactive Netpage documents can be authored to specify an action upon reception of a scan event. A scan event simply contains the ID of the printed document without any {x,y} coordinate information. In the m-print context, a scan is achieved by feeding a printed card back through the paper feed mechanism. This enables the m-print device to determine the ID of the card and to transmit a scan-hit to the Netpage Server 529. Upon reception of a scan-hit, the server 529 invokes any scan action that has been registered for the identified printout.
The printed business card 820 can be authored to invoke a PlayRequest 851 in response to a scan event. Typically, such a PlayRequest 851 provides information pertaining to the entire content of the printout. In the case of the business card, the document can be authored to invoke a PlayRequest 851 that contains a text/directory object 852 that specifies most of the details from the card. Such a PlayRequest 851 would typically be routed to a Contacts Application (such as vCard Agent) which would then modify its database to include the details from the business card.
8.2.1 M-Print Photo Cards including Scan support
Fig. 81 shows a printed photo card 855. The card 855 can be made to be interactive as shown in Fig. 82. The card 855 contains two fields. The first field is a standard Netpage field 856, while the second is the scan event field 857. Both fields 856, 857 are configured to map to a PlayRequest 858 that contains the contents of the photo in electronic form (in this case as a jpeg image). Typically, this request 858 is routed to an agent capable of displaying the image, although the fact that the request is only partially specified (the target and operation field are empty) gives the request router (and therefore the user) more freedom to interpret the request as appropriate. For example, previous actions by the user may mean that clicking on the photo is interpreted as a request to associate the photo with a particular location on printed Netpage document.
8.3 Printout Interactivity on the Mobile Device GUI
When a scan of an M-Print printout is performed on a mobile device 100 the action taken can vary. One possible action is to display the printout on the mobile device's GUI with the hyperlinks and form fields active so that a user can navigate between them and fill them in or activate them, in the same way a Netpage user can on a printout using a Netpage pen or pointer.
If the mobile device has a touch screen and a stylus then it is possible to support all the interactions that a user with a Netpage pen could have with the printout. If the mobile device doesn't support a touch screen and stylus then it is possible to tab through the hyperlinks and submit fields on the form and activate them in the same way that a user with Netpage pointer and a printout could.
Fig. 83 shows a mobile phone 100 where an M-Print printout of a business card 820 has been scanned and the printout is now displayed on the phone's screen 860 with the first hyperlink 861 highlighted ready to be selected. The user can move through the active areas using standard navigation keys 862 on the mobile
device 100, in the same way they can navigate the hyperlinks on a web page. Selecting a hyperlink in this way via the GUI is the same as clicking a Netpage Pointer 533 on the printout of the business card 820.
Below is a use case illustrating the sequence of events for a user to activate a hyperlink by scanning the printout.
8.3.1 Scan a business card and send an MMS to the Person
1. The user inserts a printout into the paper feed slot on the mobile device (870) 2. The printout is drawn through the mobile device
3. The image on the printout is displayed on the mobile device (880), the first hyperlink has a focus region drawn around it
4. The user moves focus to the MMS hyperlink and selects it
5. The MMS editor on the device is displayed with the address filled out from the details on the business card (890).
The upper portion of the sequence diagram in Fig. 84 is a repeat of the sequence for the case where a scan is occurring. When the Netpage Microserver receives the "scan click" it retrieves the document and displays it on the screen using the Document Displayer. The Document Displayer allows the user to step through the hyperlinks and fields and select them. When one is selected the Netpage Microserver is sent a click event, just as if it had come from a Netpage pointer. The Netpage processing results in a play request being sent to the Netpage Player on the device, which responds by opening up the MMS editor with the message already addressed to the recipient identified by the business card that was scanned in.
9J) Mobile Telecommunications Device Overview
Whilst the main embodiment includes both Netpage and printing functionality, only one or the other of these features is provided in other embodiments.
One such embodiment is shown in Fig. 85, in which a mobile telecommunications device in the form of a mobile phone 1 (also known as a "cellphone") includes a mobile phone module 2 and a printer module 4. The mobile 30 phone module is configured to send and receive voice and data via a telecommunications network (not shown) in a conventional manner known to those skilled in the art. The printer module 4 is configured to print a page 6. Depending upon the particular implementation, the printer module 4 can be configured to print the page 6 in color or monochrome.
The mobile telecommunications device can use any of a variety of known operating systems, such as Symbian (with UIQ and Series 60 GUIs), Windows Mobile, PalmOS, and Linux.
In the preferred embodiment (described in more detail below), the print media is pre-printed with tags, and the printer module 4 prints visible information onto the page 6 in registration with the tags. In other
embodiments, Netpage tags are printed by the printer module onto the page 6 along with the other information. The tags can be printed using either the same visible ink as used to print visible information, or using an infrared or other substantially invisible ink.
The information printed by the printer module 4 can include user data stored in the mobile phone 1 (including 10 phonebook and appointment data) or text and images received via the telecommunications network or from another device via a communication mechanism such as BluetoothTM or infrared transmission. If the mobile phone 1 includes a camera, the printer module 4 can be configured to print the captured images. In the preferred form, the mobile phone module 2 provides at least basic editing capabilities to enable cropping, filtering or addition of text or other image data to the captured image before printing. The configuration and operation of the printer module 4 is described in more detail below in the context of various types of mobile telecommunication device that incorporate a printhead.
Fig. 86 shows another embodiment of a mobile telecommunications device, in which the printer module 4 is omitted, and a Netpage tag sensor module 8 is included. The Netpage module 8 enables interaction between the mobile phone 1 and a page 10 including Netpage tags. The configuration and operation of the Netpage pointer in a mobile phone 1 is described in more detail below. Although not shown, the mobile phone 1 with Netpage module 8 can include a camera.
Fig. 87 shows a mobile phone 1 that includes both a printer module 4, and a Netpage tag sensor module 8. As with the embodiment of Fig. 86, the printer module 4 can be configured to print tagged or untagged pages. As shown in Fig. 87, where tagged pages 10 are produced (and irrespective of whether the tags were pre-printed or printed by the printer module 4), the Netpage tag sensor module 8 can be used to interact with the resultant printed media.
A more detailed architectural view of the mobile phone 1 of Fig. 87 is shown in Fig. 88, in which features corresponding to those shown in Fig. 87 are indicated with the same reference numerals. It will be appreciated that Fig. 88 deals only with communication between various electronic components in the mobile telecommunications device and omits mechanical features. These are described in more detail below.
The Netpage tag sensor module 8 includes a monolithically integrated Netpage image sensor and processor 12 that captures image data and receives a signal from a contact switch 14. The contact switch 14 is connected to a nib (not shown) to determine when the nib is pressed into contact with a surface. The sensor and processor 12 also outputs a signal to control illumination of an infrared LED 16 in response to the stylus being pressed against the surface. The image sensor and processor 12 outputs processed tag information to a Netpage pointer driver 18 that interfaces with the phone operating system 20 running on the mobile telecommunications device's processor (not shown).
Output to be printed is sent by the phone operating system 20 to a printer driver 22, which passes it on to a MoPEC chip 24. The MoPEC chip processes the output to generate dot data for supply to the printhead 26, as
described in more detail below. The MoPEC chip 24 also receives a signal from a media sensor 28 indicating when the media is in position to be printed, and outputs a control signal to a media transport 30. The printhead 26 is disposed within a replaceable cartridge 32, which also includes ink 34 for supply to the printhead.
9.1 Mobile Telecommunications Device Module
Fig. 89 shows the mobile phone module 2 in more detail. The majority of the components other than those directly related to printing and Netpage tag sensing are standard and well known to those in the art. Depending upon the specific implementation of the mobile phone 1, any number of the illustrated components can be included as part of one or more integrated circuits.
Operation of, and communication between, the mobile phone module 2 components is controlled by a mobile phone controller 36. The components include:
• 'mobile radio transceiver 38 for wireless communication with a mobile telecommunications network;
• program memory 40 for storing program code for execution on the mobile phone controller 36;
• working memory 42 for storing data used and generated by the program code during execution. Although shown as separate from the mobile phone controller 36, either or both memories 40 and 42 may be incorporated in the package or silicon of the controller; • keypad 44 and buttons 46 for accepting numerical and other user input;
• touch sensor 48 which overlays display 50 for accepting user input via a stylus or fingertip pressure;
• removable memory card 52 containing non-volatile memory 54 for storing arbitrary user data, such as digital photographs or files; • local area radio transceiver 56, such as a Bluetoothrm transceiver;
• GPS receiver 58 for enabling determination of the location of the mobile telecommunications device (alternatively the phone may rely on mobile network mechanisms for determining its location);
• microphone 60 for capturing a user's speech; • speaker 62 for outputting sounds, including voice during a phone call;
• camera image sensor 64 including a CCD for capturing images;
• camera flash 66;
• power manager 68 for monitoring and controlling power consumption of the mobile telecommunications device and its components; and • SIM (subscriber Identity Module) card 70 including SIM 72 for identifying the subscriber to mobile networks.
The mobile phone controller 36 implements the baseband functions of mobile voice and data communications protocols such as GSM, GSM modem for data, GPRS and CDMA, as well as higher-level
messaging protocols such as SMS and MMS. The one or more local-area radio transceivers 56 enable wireless communication with peripherals such as headsets and Netpage pens, and hosts such as personal computers. The mobile phone controller 36 also implements the baseband functions of local-area voice and data communications protocols such as IEEE 802.11, IEEE 802.15, and BluetoothTM.
The mobile phone module 2 may also include sensors and/or motors (not shown) for electronically adjusting zoom, focus, aperture and exposure in relation to the digital camera. Similarly, as shown in Fig. 90, components of the printer module 4 include:
• print engine controller (PEC) 74 in the form of a MoPEC device; • program memory 76 for storing program code for execution by the print engine controller 74;
• working memory 78 for storing data used and generated by the program code during execution by the print engine controller 74; and
• a master QA chip 80 for authenticating printhead cartridge 32 via its QA chip 82.
Whilst the printhead cartridge in the preferred form includes the ink supply 34, the ink reservoirs can be housed in a separate cartridge in alternative embodiments.
Fig. 91 shows the components of the tag sensor module 8, which includes a CMOS tag image processor 74 that communicates with image memory 76. A CMOS tag image sensor 78 sends captured image data to the processor 74 for processing. The contact sensor 14 indicates when a nib (not shown) is brought into contact with a surface with sufficient force to close a switch within the contact sensor 14. Once the switch is closed, the infrared LED 16 illuminates the surface, and the image sensor 78 captures at least one image and sends it to the image processor 74 for processing. Once processed (as described below in more detail), image data is sent to the mobile phone controller 36 for decoding.
In an alternative embodiment, shown in Fig. 92, the tag sensor module 8 is replaced by a tag decoder module 81. The tag decoder module 81 includes all the elements of the tag sensor module 8, but adds a hardware- based tag decoder 82, as well as program memory 84 and working memory 86 for the tag decoder. This arrangement reduces the computational load placed on the mobile phone controller, with a corresponding increase in chip area compared to using the tag sensor module 8.
The Netpage sensor module can be incorporated in the form of a Netpage pointer, which is a simplified Netpage pen suitable mostly for activating hyperlinks. It preferably incorporates a non-marking stylus in place of the pen's marking nib (described in detail later in the specification); it uses a surface contact sensor in place of the pen's continuous force sensor; and it preferably operates at a lower position sampling rate, making it unsuitable for capturing drawings and hand-writing. A Netpage pointer is less expensive to implement than a Netpage pen, and tag image processing and tag decoding can potentially be performed by software without hardware support, depending on sampling rate.
The various aspects of the invention can be embodied in any of a number of mobile telecommunications device types. Several different devices are described here, but in the interests of brevity, the detailed description will concentrate on the mobile telecommunications device embodiment.
9.2 Mobile Device
One preferred embodiment is the non-Netpage enabled 'candy bar' mobile telecommunications device in the form of a mobile phone shown in Figs. 92 to 98. While a candy bar style phone is described here, it could equally take the form of a "flip" style phone, which includes a pair of body sections that are hinged to each other. Typically, the display is disposed on one of the body sections, and the keypad is disposed on the other, such that the display and keypad are positioned adjacent to each other when the device is in the closed position.
In further embodiments, the device can have two body sections that rotate or slide relative to each other. Typically, the aim of these mechanical relationships between first and second body sections is to protect the display from scratches and/or the keypad from accidental activation. Photo printing is considered one of the most compelling uses of the mobile Memjet printer. A preferred embodiment of the invention therefore includes a camera, with its attendant processing power and memory capacity.
The elements of the mobile telecommunications device are best shown in Fig. 93, which (for clarity) omits minor details such as wires and hardware that operatively connect the various elements Df the mobile telecommunications device together. The wires and other hardware will be well known to those skilled in the art. The mobile phone 100 comprises a chassis moulding 102, a front moulding 104 and a rear cover moulding 106. A rechargeable battery 108, such as a lithium ion or nickel metal hydride battery, is mounted to the chassis moulding 102 and covered by the rear cover moulding 106. The battery 108 powers the various components of the mobile phone 100 via battery connector 276 and the camera and speaker connector 278.
The front moulding 104 mounts to the emphasis to enclose the various components, and includes numerical interface buttons 136 positioned in vertical rows on each side of the display 138. A multi-directional control pad 142 and other control buttons 284 enable menu navigation and other control inputs. A daughterboard 280 is mounted to the chassis moulding 102 and includes a directional switch 286 for the multi directional control pad 142. The mobile telecommunications device includes a cartridge access cover 132 that protects the interior of the mobile telecommunications device from dust and other foreign objects when a print cartridge 148 is not inserted in the cradle 124.
An optional camera module 110 is also mounted to the chassis moulding 102, to enable image capture through a hole 112 in the rear cover moulding 106. The camera module 110 includes a lens assembly and a CCD image sensor for capturing images. A lens cover 268 in the hole 112 protects the lens of the camera module 110. The rear cover moulding 106 also includes an inlet slot 228 and an outlet slot 150 through which print media passes.
The chassis moulding 102 supports a data/recharge connector 114, which enables a proprietary data cable to be plugged into the mobile telecommunications device for uploading and downloading data such as address book information, photographs, messages, and any type of information that might be sent or received by the mobile telecommunications device. The data/recharge connector 114 is configured to engage a corresponding interface in a desktop stand (not shown), which holds the mobile telecommunications device in a generally upright position whilst data is being sent or received by the mobile telecommunications device. The data/recharge connector also includes contacts that enable recharging of the battery 108 via the desktop stand. A separate recharge socket 116 in the data/recharge connector 114 is configured to receive a complimentary recharge plug for enabling recharging of the battery when the desktop stand is not in use.
A microphone 170 is mounted to the chassis moulding 102 for converting sound, such as a user's voice, into an electronic signal to be sampled by the mobile telecommunications device's analog to digital conversion circuitry. This conversion is well known to those skilled in the art and so is not described in more detail here. A SIM (Subscriber Identity Module) holder 118 is formed in the chassis moulding 102, to receive a SIM card 120. The chassis moulding is also configured to support a print cartridge cradle 124 and a drive mechanism 126, which receive a replaceable print cartridge 148. These features are described in more detail below. Another moulding in the chassis moulding 102 supports an aerial (not shown) for sending and receiving RF signals to and from a mobile telecommunications network.
A main printed circuit board (PCB) 130 is supported by the chassis moulding 102, and includes a number of momentary pushbuttons 132. The various integrated and discrete components that support the communications and processing (including printing processing) functions are mounted to the main PCB, but for clarity are not shown in the diagram.
A conductive elastomeric overlay 134 is positoned on the main PCB 130 beneath the keys 136 on the front 40 moulding 104. The elastomer incorporates a carbon impregnated pill on a flexible profile. When one of the keys 136 is pressed, it pushes the carbon pill to a 2-wire open circuit pattern 132 on the PCB surface. This provides a low impedance closed circuit. Alternatively, a small dome is formed on the overlay corresponding to each key 132.
Polyester film is screen printed with carbon paint and used in a similar manner to the carbon pills. Thin adhesive film with berrylium copper domes can also be used. A loudspeaker 144 is installed adjacent apertures 272 in the front moulding 104 to enable a user to hear sound such as voice communication and other audible signals.
A color display 138 is also mounted to the main PCB 130, to enable visual feedback to a user of the mobile telecommunications device. A transparent lens moulding 146 protects the display 138. In one form, the transparent lens is touch-sensitive (or is omitted and the display 138 is touch sensitive), enabling a user to interact with icons and input text displayed on the display 138, with a finger or stylus.
A vibration assembly 274 is also mounted to the chassis moulding 102, and includes a motor that drives an eccentrically mounted weight to cause vibration. The vibration is transmitted to the chassis 102 and provides tactile feedback to a user, which is useful in noisy environments where ringtones are not audible.
10. Print Media Printing
A Netpage printer normally prints the tags which make up the surface coding on demand, i.e. at the same time as it prints graphic page content. As an alternative, in a Netpage printer not capable of printing tags such as the preferred embodiment, pre-tagged but otherwise blank Netpages can be used. The printer, instead of being capable of tag printing, typically incorporates a Netpage tag sensor. The printer senses the tags and hence the region ID of a blank either prior to, during, or after the printing of the graphic page content onto the blank. It communicates the region ID to the Netpage server, and the server associates the page content and the region ID in the usual way.
A particular Netpage surface coding scheme allocates a minimum number of bits to the representation of spatial coordinates within a surface region. If a particular media size is significantly smaller than the maximum size representable in the minimum number of bits, then the Netpage code space may be inefficiently utilised. It can therefore be of interest to allocate different sub-areas of a region to a collection of blanks. Although this makes the associations maintained by the Netpage server more complex, and makes subsequent routing of interactions more complex, it leads to more efficient code space utilisation. In the limit case the surface coding may utilise a single region with a single coordinate space, i.e. without explicit region
IDs.
If regions are sub-divided in this way, then the Netpage printer uses the tag sensor to determine not only the region ID but also the surface coding location of a known physical position on the print medium, i.e. relative to two edges of the medium. From the surface coding location and its corresponding physical position on the medium, and the known (or determined) size of the medium, it then determines the spatial extent of the medium in the region's coordinate space, and communicates both the region ID and the spatial extent to the server. The server associates the page content with the specified sub-area of the region.
A number of mechanisms can be used to read tag data from a blank. A conventional Netpage tag sensor incorporating a two-dimensional image sensor can be used to capture an image of the tagged surface of the blank at any convenient point in the printer's paper path. As an alternative, a linear image sensor can be used to capture successive line images of the tagged surface of the blank during transport. The line images can be used to create a two-dimensional image which is processed in the usual way. As a further alternative, region ID data and other salient data can be encoded linearly on the blank, and a simple photodetector and ADC can be used to acquire samples of the linear encoding during transport.
One important advantage of using a two-dimensional image sensor is that tag sensing can occur before motorised transport of the print medium commences. For example, if the print medium is manually inserted by the user, then tag sensing can occur during insertion. This has the further advantage that if the tag data is
validated by the device, then the print medium can be rejected and possibly ejected before printing commences. For example, the print medium may have been pre-printed with advertising or other graphic content on the reverse side from the intended printing side. The device can use the tag data to detect incorrect media insertion, i.e. upside-down or back-to-front. The device can also prevent accidental overprinting of an already-printed medium. And it can detect the attempted use of an invalid print medium and refuse printing, eg. to protect print quality. The device can also derive print medium characteristics from the tag data, to allow it to perform optimal print preparation.
If a linear image sensor is used, or if a photodetector is used, then image sensing must occur during motorised transport of the print medium to ensure accurate imaging. Unless there are at least two points of contact between the transport mechanism and the print medium in the printing path, separated by a minimum distance equal to the tag data acquisition distance, tag data cannot be extracted before printing commences, and the validation advantages discussed above do not obtain. In the case of a linear image sensor, the tag data acquisition distance equals the diameter of the normal tag imaging field of view. In the case of a photodetector, the tag data acquisition distance is as long as the required linear encoding.
If the tag sensor is operable during the entire printing phase at a sufficiently high sampling rate, then it can also be used to perform accurate motion sensing, with the motion data being used to provide a line synchronisation signal to the print engine. This can be used to eliminate the effects of jitter in the transport mechanism.
Figs. 100 to 106 show one embodiment of the encoded medium and the media sensing and printing system within the mobile telecommunications device. While the encoding of the cards is briefly discussed here, it is described in detail in the Coded Media sub-section of this specification.
Referring to Fig. 100, the 'back-side' of one of the cards 226 is shown. The back-side of the card has two coded data tracks: a 'clock track' 434 and a Mata track' 436 running along the longitudinal sides of the cards.
The coded data may be in the form of a two-dimensional grid or pattern. The cards are encoded with data indicating, inter alia: • the orientation of the card;
• the media type and authenticity;
• the longitudinal size;
• the pre-printed side;
• detection of prior printing on the card; and, • the position of the card relative to the printhead IC.
In one form, the encoded data is printed in IR ink so that it is invisible and does not encroach on the space available for printing visible images.
In a basic form, the M-Print cards 226 are only encoded with a data track and clocking (as a separate clock track or a self- clocking data track). However, in the more sophisticated embodiment shown in the figures, the cards 226 have a pre-printed Netpage tag pattern 438 covering the majority of the back-side. The front side may also have a pre-printed tag pattern. It is preferred in these embodiments that the data track encodes first information that is at least indicative of second information encoded in the tags. Most preferably, the first information is simply the document identity that is encoded in each of the tags.
The clock track 434 allows the MoPEC 326 (see Fig. 101) to determine, by its presence, that the front of the card 226 is facing the printhead 202, and allows the printer to sense the motion of the card 226 during printing. The clock track 434 also provides a clock for the densely coded data track 436.
The data track 436 provides the Netpage identifier and optionally associated digital signatures which allows MoPEC 326 to reject fraudulent or un-authorised media 226, and to report the Netpage identifier of the front- side Netpage tag pattern to a Netpage server. It should be noted that a fragment of a digital signature can also be considered a digital signature in its own right.
Fig. 101 shows a block diagram of an M-Print system that uses media encoded with separate clock and data tracks. The clock and data tracks are read by separate optical encoders. The system may optionally have an explicit edge detector 474 which is discussed in more detail below in relation to Fig. 104.
Fig. 102 shows a simplified circuit for an optical encoder which may be used as the clock track or data track optical encoder. It incorporates a Schmitt trigger 466 to provide the MoPEC 326 with an essentially binary signal representative of the marks and spaces encountered by the encoder in the clock or data track. An IR LED 472 is configured to illuminate a mark-sized area of the card 226 and a phototransistor 468 is configured to capture the light 470 reflected by the card. The LED 472 has a peak wavelength matched to the peak absorption wavelength of the infrared ink used to print the media coding.
As an alternative, the optical encoders can sense the direction of media movement by configuring them to be ^ quadrature encoders'. A quadrature encoder contains a pair of optical encoders spatially positioned to read the clock track 90 degrees out of phase. Its in-phase and quadrature outputs allow the MoPEC 326 to identify not just the motion of the clock track 434 but also the direction of the motion. A quadrature encoder is generally not required, since the media transport direction is known a priori because the printer controller also controls the transport motor. However, the use of a quadrature encoder can help decouple a bidirectional motion sensing mechanism from the motion control mechanism.
Fig. 103 shows a block diagram of the MoPEC 326. It incorporates a digital phase lock loop (DPLL) 444 to track the clock inherent in the clock track 434 (see Fig. 100), a line sync generator 448 to generate the line sync signal 476 from the clock 446, and a data decoder 450 to decode the data in the data track 436. De- framing, error detection and error correction may be performed by software running on MoPECs general- purpose processor 452, or it may be performed by dedicated hardware in MoPEC.
The data decoder 450 uses the clock 446 recovered by the DPLL 444 to sample the signal from the data track optical encoder 442. It may either sample the continuous signal from the data track optical encoder 442, or it may actually 5 trigger the LED of the data track optical encoder 442 for the duration of the sample period, thereby reducing the total power consumption of the LED. The DPLL 444 may be a PLL, or it may simply measure and filter the period between successive clock pulses.
The line sync generator 456 consists of a numerically-controlled oscillator which generates line sync pulses 476 at a rate which is a multiple of the rate of the clock 446 recovered from the clock track 434.
As shown in Fig. 101, the print engine may optionally incorporate an explicit edge detector 474 to provide longitudinal registration of the card 226 with the operation of the printhead 202. In this case, as shown in Fig. 104, it generates a page sync signal 478 to signal the start of printing after counting a fixed number of line syncs 476 after edge detection. Longitudinal registration may also be achieved by other card-in detection mechanisms ranging from opto-sensors, de-capping mechanical switches, drive shaft/tension spring contact switch and motor load detection.
Optionally, the printer can rely on the media coding itself to obtain longitudinal registration. For example, it may rely on acquisition of a pilot sequence on the data track 436 to obtain registration. In this case, as shown in Fig. 105, it generates a page sync signal 478 to signal the start of printing after counting a fixed number of line syncs 476 after pilot detection. The pilot detector 460.consists of a shift register and combinatorial logic to recognise the pilot sequence 480 provided by the data decoder 450, and generate the pilot sync signal 482. Relying on the media coding itself can provide superior information for registering printed content with the Netpage tag pattern 438 (Fig. 100).
As shown in Fig. 106, the data track optical encoder 442 is positioned adjacent to the first clock data encoder 440, so that the data track 436 (see Fig. 100) can be decoded as early as possible and using the recovered clock signal 446. The clock must be acquired before printing can commence, so a first optical encoder 440 is positioned before the printhead 202 in the media feed path. However, as the clock needs to be tracked throughout the print, a second clock optical encoder 464 is positioned coincident with or downstream of the printhead 202. This is described in more detail below.
Fig. 99 shows the printed card 226 being withdrawn from the print cartridge, 148. It will be appreciated that the printed card 226 needs to be manually withdrawn by the user. Once the trailing edge of the card 226 has passed between the drive shaft 178 and the spring fingers 238, it is no longer driven along the media feed path. However, as the printhead 202 is less than 2mm from the drive shaft 178, the momentum of the card 226 projects the trailing edge of past the printhead 202.
While the momentum of the card is sufficient to carry the trailing edge past the printhead, it is not enough to fling it out of the exit slot 150 (Fig. 98). Instead, the card 226 is lightly gripped by the opposed lock actuator
arms 232 as it protrudes from the exit slot 150 in the side of the mobile phone 100. This retains the card 226 so it does not simply fall from exit slot 150, but rather allows users to manually remove the printed card 226 from the mobile phone 100 at their convenience. This is important to the practicality of the mobile telecommunications device because the card 226 is fed into one side of the mobile telecommunications device and retrieved from the other, so users will typically want to swap the hand that holds the mobile telecommunications device when collecting the printed card. By lightly retaining the printed card, users do not need to swap hands and be ready to collect the card before completion of the print job (approximately 1-2 sees). Alternatively, the velocity of the card as it leaves the roller can be made high enough that the card exits the outlet slot 123 under its own inertia.
10.1 M-Print Flip Printing
One can allow a previously printed m-print Netpage card to be re-inserted into the printing mechanism "flipped-over", so that the side not previously printed on (i.e. the back of the card) is now facing towards the print head. The printer would detect such an insertion and would automatically print additional information on to the back of the card. The additional information would typically, but not necessarily, be application and context specific. That is:
• the application which created the original printout would determine what is printed onto the back side of the card, and
• would be able to take into account context specific information such as the impression ID of the card.
This allows applications to print information onto the back side of the card which is specific to the original printout on the front side of the card. There are many potential uses for such a mechanism. For the sake of discussion, one such case is described below.
10.1.1 Camera Use-case
1. User takes a photo using an m-print enabled camera phone
2. User prints photo onto Netpage tagged card
3. User feeds card back through printer flipped-over 4. Various details about the photo would then be printed onto the back of the card. Examples of details might be: o The date and time the photo was taken; o Location where photo was taken, either automatically determined by a geographical positioning system within the phone (eg. GPS or cell-based location detection), or manually entered after the fact by the user; and/or o Arbitrary textual information entered by the user (perhaps entered on the phone itself or via a web-based photo archiving application sometime after the photo was taken).
The time duration between the user taking the original photo and inserting the flipped-over card could be arbitrarily long. As such, the mechanism can act as a "what is this photo that I just found?" facility. Another
advantage is that it removes the need to have text obscuring parts of the photo in order to provide date/time information.
1 1. General Netpage Overview Netpage interactivity can be used to provide printed user interfaces to various phone functions and applications, such as enabling particular operational modes of the mobile telecommunications device or interacting with a calculator application, as well as providing general "keypad", "keyboard" and "tablet" input to the mobile telecommunications device. Such interfaces can be pre-printed and bundled with a phone, purchased separately (as a way of customizing phone operation, similar to ringtones and themes) or printed on demand where the phone incorporates a printer.
A printed Netpage business card provides a good example of how a variety of functions can be usefully combined in a single interface, including: • loading contact details into an address book • displaying a Web page
• displaying an image
• dialing a contact number
• bringing up an e-mail, SMS or MMS form
• loading location info into a navigation system • activating a promotion or special offer
Any of these functions can be made single-use only. A business card may be printed by the mobile telecommunications device user for presentation to someone else, or may be printed from a Web page relating to a business for the mobile telecommunications device user's own use. It may also be pre-printed.
As described below, the primary benefit of incorporating a Netpage pointer or pen in another device is synergy. A Netpage pointer or pen incorporated in a mobile phone, smartphone or telecommunications- enabled PDA, for example, allows the device to act as both a Netpage pointer and as a relay between the pointer and the mobile phone network and hence a Netpage server. When the pointer is used to interact with a page, the target application of the interaction can display information on the phone display and initiate further interaction with the user via the phone touchscreen. The pointer is most usefully configured so that its "nib" is in a corner of the phone body, allowing the user to easily manipulate the phone to designate a tagged surface. The phone can incorporate a marking nib and optionally a continuous force sensor to provide full Netpage pen functionality.
An exemplary Netpage interaction will now be described to show how a sensing device in the form of a Netpage enabled mobile device interacts with the coded data on a print medium in the form of a card. Whilst in the preferred form the print medium is a card generated by the mobile device or another mobile device, it can also be a commercially pre-printed card that is purchased or otherwise provided as part of a commercial
transaction. The print medium can also be a page of a book, magazine, newspaper or brochure, for example. The print medium can be provided with coded data in a variety of formats, the coded data encoding a range of information, preferably, at least some of the information being indicative of the print media identifier. The information can be indicative of a two-dimensional coordinate grid, and the format can be a two-dimensional pattern.
For example, the print medium can be provided with first coded data in a first format and second coded data in a second format, the first coded data encoding first information and the second coded data encoding second information, with at least some of the first information being indicative of the print media identifier, the first format being a linear pattern, and with at least some of the second information being indicative of the print media identifier and of a two-dimensional coordinate grid, the second format being a two-dimensional pattern. In a particular example form, the information is further indicative of at least part of a digital signature associated with the print media identifier, the sensor module determining, by reading at least some of the coded data, at least part of the digital signature, and the printer module can then print, if the digital signature is authentic, content on the print media.
The mobile device senses a tag using an area image sensor and detects tag data. The mobile device uses the sensed data tag to generate interaction data, which is sent via a mobile telecommunications network to a document server. The document server uses the ID to access the document description, and interpret the interaction. In appropriate circumstances, the document server sends a corresponding message to an application server, which can then perform a corresponding action.
Typically Netpage pen and Netpage-enabled mobile device users register with a registration server, which associates the user with an identifier stored in the respective Netpage pen or Netpage enabled mobile device. By providing the sensing device identifier as part of the interaction data, this allows users to be identified, allowing transactions or the like to be performed. Netpage documents are generated by having an ID server generate an ID which is transferred to the document server. The document server determines a document description and then records an association between the document description and the ID, to allow subsequent retrieval of the document description using the ID. The ID is then used to generate the tag data, as will be described in more detail below, before the document is printed by a suitable printer, using the page description and the tag map.
Each tag is represented by a pattern which contains two kinds of elements. The first kind of element is a target. Targets allow a tag to be located in an image of a coded surface, and allow the perspective distortion of the tag to be inferred. The second kind of element is a macrodot. Each macrodot encodes the value of a bit by its presence or absence. The pattern is represented on the coded surface in such a way as to allow it to be acquired by an optical imaging system, and in particular by an optical system with a narrowband response in the near-infrared. The pattern is typically printed onto the surface using a narrowband near-infrared ink.
In the preferred embodiment, the region typically corresponds to the entire surface of an M-Print card, and the region ID corresponds to the unique M-Print card ID. For clarity in the following discussion we refer to items and IDs, with the understanding that the TD corresponds to the region ID. The surface coding is designed so that an acquisition field of view large enough to guarantee acquisition of an entire tag is large enough to guarantee acquisition of the ID of the region containing the tag. Acquisition of the tag itself guarantees acquisition of the tag's two-dimensional position within the region, as well as other tag-specific data. The surface coding therefore allows a sensing device to acquire a region ID and a tag position during a purely local interaction with a coded surface, e.g. during a "click" or tap on a coded surface with a pen.
Optional embodiments of the present invention may also be said to broadly consist in the parts, elements and features referred to or indicated herein, individually or collectively, in any or all combinations of two or more of the parts, elements or features, and wherein specific integers are mentioned herein which have known equivalents in the art to which the invention relates, such known equivalents are deemed to be incorporated herein as if individually set forth.
Although a preferred embodiment has been described in detail, it should be understood that various changes, substitutions, and alterations can be made by one of ordinary skill in the art without departing from the scope of the present invention.
12. Further Example Applications
12.1 Photography
Currently the content of an MMS can be viewed on a display of a mobile phone 100, however, printing the content of the MMS has been limited to using a computer or kiosk. This has led to a low demand for MMS as is has only been seen useful for capturing a picture and sending the captured picture to a friends mobile phone.
Mobile phone printing enables users to print photographs 900 on a print medium directly from a print- enabled mobile telecommunications device, such as a mobile phone 100. This enables the user to print photographs 900 on demand rather than inconveniently using a separate computer system having a printer. The mobile telecommunications device 100 includes a camera 110 to capture the photograph 900, a printer module 4 to print the photograph 900, as illustrated in Figure 107, on the print medium, and a sensor module 8 to sense at least one print media identifier provided on or in the print medium. By sensing the print identifier provided on or in the printed photograph 900, a digital version of the photograph 900 linked to the print identifier in a database, such as a photo archive, can be obtained via the mobile phone 100, and a copy of the photograph 900 can be obtained. By obtaining a digital version of the photograph 900, the photograph 900 can be reprinted or sent to a different user's mobile phone. Preferably the print media identifier is provided on the photograph 900 in the form of coded data.
12.1.1 Photography Editing
As mobile phone technology continues to include PDA like functionality, mobile phones may have the potential to provide one or more photograph editing applications. The photo-editing functionality of the applications may vary according to screen size, memory capacity and processing power of the mobile phone. Such photo editing functionality may include at least one of:
• resizing;
• removing "red eye";
• adjusting the brightness, colours, sharpeners, etc.
• adding filters and effects; • adding text, clipart and graphics;
• mix images with crop; and,
• download new clipart, text packs and other plug-ins.
Other photo editing functionality may include generating and editing a photograph 900 including multiple thumbnails of other captured photographs 900. Such photo editing applications may be downloaded directly to the mobile phone, using a 2.5G connection, may be installed from a computer over an infrared or Bluetooth connection.
The photographs 900 may be printed on credit card sized print mediums for easy storage of blank print mediums and printed photographs 900 in a wallet or purse.
Photographs 900 may additionally be printed as a preview photograph. The user can then preview a printed version of the printed photograph, enabling the user to use a specialist outlet, kiosk or via a computer printer to print the preferred photographs. The print media identifier provided on the preferred printed photographs may then be used to easily obtain a digital version of the photograph for printing at the specialist.
By providing mobile phone printing, sending a MMS to a third party may become more appealing if the sender knows that the recipient can print the photograph 900 as well as view it on screen.
12.1.2 Photography Interactivity
Mobile phone applications can also be provided which provide interactivity with the printed photograph 900 and the obtained digital photograph, thus allowing the user to customise a modified version of the photograph 900. Such interactivity can include at least one of: • Adding text to the digital photograph, at the point(s) where the user clicks on a printed photograph. In this case the coded data may be indicative of a location in order to provide an indication of a position on the printed photograph. The user can click a centre point of the photograph to place a phrase such as "Happy Birthday" or "Missing You". Alternatively, start points and optional end points may be indicated on the photograph to indicate positioning of a phrase or the like;
• Adding graphics to a digital image, at the point(s) where the user clicks on a printed image. The user can click the top left and bottom right corners to place an image correctly on the digital version of the photograph; and,
• Adding visual effects, such as converting an image to black-and-white, or sepia.
Figure 107 illustrates an exemplary photograph 900 printed using mobile phone printing. The printed photograph 900 includes a proprietary image which can be personalized by a user by clicking on the photograph 900 to display a digital version of the photograph 900 on the mobile photo. The photograph 900 also includes clickable link to the author/photographer/owner of the image. A corporate logo can be provided on the printed photograph 900 which enables a user to click the logo in order to view the corporate web-site of the author/photographer/owner of the image.
The printed photograph 900 may be a permission token readable using the sensor module to at least one of: retrieve information associated with the photograph from the archive; and gain access to a resource. Printing the photograph may also causes information associated with the photograph to be archived. The information associated with the photograph may includee one or more of: the photograph; a visual description of the photograph; an image of the photograph; an interactive description of the photograph; contents of the photograph; and photograph details.
12.2 Web Browsing
Many mobile devices such as PDAs, notebooks and mobile phones can browse the Internet. They can be connected to the web using broadband network services via a variety of wireless technologies that include WiFi services and GPRS.
The web can be used for a variety of tasks:
• Search for information and conduct research;
• Buy products and services;
• Conduct banking and other financial transactions; • Download pictures, games and music; and
• Save web pages offline for later reference.
Presently, if a mobile phone user wishes to print a web page of interest they have two options:
1. To save the web page or URL to their mobile phone, and then later connect to a computer in order to print the page. 2. To bookmark the page's URL and return to it when they have access to a kiosk or computer printer.
Both scenarios are time consuming and lack simplicity and ease of use for the subscriber. They require access to additional devices. Additionally, the first scenario requires that the web page URL designed for mobile phone use is the same as the URL designed for computer-based browsers. WAP and GPRS pages are transmitted and displayed using a different mark-up language (WML) to computer browsers (HTML).
Mobile phone printing from print-enabled mobile phones can remove the current print shortcomings faced by users and provide them with a more dynamic and complete user experience. Printing is available on demand and as required. Additionally, the paper surface area can also be larger and include better quality definition than the handset screen.
12.2.1 Printing with Interactivity
Interactive Paper enables printed web pages to behave like on-screen web pages. Just as on-screen, all links are clickable. Just as with browser web pages, hyperlinks remain valid as long as the linked material remains available at the specified URL. Printed web pages behave in the same manner as on-screen 'live' web pages.
Referring to Figure 108, an example of a mobile printed Google Search Results web-page 905 is illustrated. The mobile printed webpage illustrates the familiarity of the print medium to web users. For example:
• A user can click on any of the links to access the individual web sites. • A user can click on the http://www.google.com link to access the search engine to conduct a new search.
• A user can click on to the 'vintage cars' link to conduct another search using the same search criteria.
• The mobile printed webpage include a date and time stamp indicating when the card was printed, and when the links were valid.
Referring to Figure 109, an example of a mobile printed Hotmail web-page 910 is illustrated. Users are able to:
• Click the Hotmail logo to access the website. • Click on the 'Info' icon to access the sender's information.
• Click on the 'Reply' icon to reply to the email.
• Click on the 'New' icon to compose a new email.
• Click on the 'Inbox' icon to view the user's Hotmail inbox.
The mobile printed web-page 910 can also be used as an 'entry pass' for an event specified in the message.
Referring to Figure 110, an example of a Safeway recipe web-page 915 is illustrated. Users are able to:
• Click on to the 'Corn Cakes with Salsa' icon to view the full recipe on the handset screen.
• Check off items on the 'shopping list' in order to make listed recipe, either with the handset sensor, and/or an ink pen.
• Click on to the website link to visit the Safeway home page.
The printed web page can be a permission token readable using the sensor module to at least one of: retrieve information associated with the web page from the archive; and gain access to a resource. Printing the web page can cause information associated with the web page to be archived. The information associated with the web page may include one or more of: the web page; a visual description of the web page; an image of the web page; an interactive description of the web page; contents of the web page; and web page details. The web page may be periodically printed. The web page can be specially formatted.
12.3 Business Cards
Mobile phone printing of business cards provides several significant advantages over traditional printing processes. A major advantage is that business cards to be printed on demand as required. Thus, there is no need to pre-print a substantial and costly run of identical cards. Furthermore, as many or as few cards as required can be printed. Moreover, changes to company name and identity, job title, address or phone numbers can be made as and when required. Alternative versions of business cards, in different languages, combinations of languages, or with different content, can be designed for printing in the appropriate situation. Additionally, full colour business card 900s can be added at low cost.
A business card printed using mobile phone printing or other printing sources can be added quickly and easily to a business card template stored within a mobile phone. Furthermore, business cards may be sent electronically using MMS or email, and then printed by the recipient from their mobile phone.
Mobile phone printing enables users to print business cards 920 on a print medium directly from a print- enabled mobile telecommunications device, such as a mobile phone 100. This enables the user to print business cards 920 on demand rather than inconveniently using a separate computer system having a printer. The mobile telecommunications device 100 includes a camera 110 to capture the business card 920, a printer module 4 to print the business card 920 on the print medium, as illustrated in Figures 107, and a sensor module 8 to sense at least one print media identifier provided on or in the print medium. By sensing the print identifier provided on or in the printed business card 920, a digital version of the business card 920 linked to the print identifier in a database, such as a photo archive, can be obtained via the mobile phone 100, and a copy of the business card 920 can be obtained. By obtaining a digital version of the business card 920, the business card 920 can be reprinted or sent to a different user's mobile phone. Preferably the print media identifier is provided on the business card 920 in the form of coded data.
1.1.1.1 12.3.1 Design Software
The business card software may be pre-installed, downloaded, or installed from another device, such as a computer system. Templates can be designed using computer software, downloaded, or sent via MMS. To design a card the following steps can be peformed
a. Click the business card icon from the phone menu. b. Select a template to modify. c. Edit name and address details. d. Select the photo function. e. Import a photograph from an existing photo library, or use the camera of the mobile phone to take a photo. This photo is automatically inserted into a designated area on the template. f. Save the business card.
As such personalized business cards can be designed. The business cards may be sent electronically using MMS or e-mail, and then printed by the recipient of the business card using a mobile phone using mobile phone printing.
1.1.1.2 12.3.2 Printing Business Cards with Interactivity
Business Cards provided with coded data provides the potential to extend the usefulness of a business card, linking it directly to relevant company, product and other data Possibilities include links to contact information, product marketing or re-ordering data, branch addresses, and even the ability to make a future appointment with a business contact.
A business card 920 can be customised as required, enabling different recipients to have personalised, direct access to relevant services, company/product information and contact details Such interactivity may include:
• Telephone the card giver on their landline or mobile phone, fax or email;
• Access relevant order history details, track current orders, and raise new orders;
• Access product information;
• Request a telephone or in-person appointment with the card giver; and • Update recipient/customer contact details.
Authentication of the user clicking the link on the business card 920 may be provided.
A first example of such a business card 920 is shown in. Figure 111. The business card 920 shown in Figure 117 example includes the following interactive elements:
•A star icon which when selected displays a map of the studio's location;
•An e-mail address which when selected sends an e-mail to the selected e-mail address;
•A phone number which when selected dials the selected phone number;
•A fax number which when selected sends a fax to the selected fax number; and,
•A web site link which when selected displays the selected web site.
A second example of a business card 925 is shown in Figure 112. The business card 925 shown in Figure 112 includes the following:
• A " Reeltime News " logo which when selected displays the selected web site.
• A phone number which when selected causes dialling that number. • An e-mail address which when selected sends an email.
Figure 113 shows a third example of a business card 930. The third example of the business card 930 demonstrates a simple use of clickable contact details, including website, e-mail address, telephone and fax. It is also possible to add an icon for booking a car in for service.
The printed business card may be in the form of a permission token readable using the sensor module to retrieve information associated with the business card, the information including at least one of: a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details. Printing the business card may cause information associated with the business card to be archived. The information associated with the business card may include one or more of: the business card; a visual description of the business card; an image of the business card; an interactive description of the business card; contents of the business card; and business card details. The business card may include at least one of: a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details printed on the print medium. The business card may be received wirelessly by the mobile communications device.
12.4 Tickets and Billing
Mobile phone printing of tickets offers significant advantages over current ticket printing and distribution systems. Although only a small percentage of total ticket sales, online ticketing is expected to exceed US$4 billion in 2004. Of these, transport and entertainment bookings are a highly significant component.
1.1.1.3 12.4.1 Transportation
In January 2003, the 'mPARK Mobile Parking Payment Service' was launched in Dublin city centre, Ireland. The service was provided from 200 existing, on-street 'Pay and Display' meters using the standard parking tariff. In common with most current mobile payment systems, mPARK requires pre-registration with Itsmobile, the m-commerce provider:
1. Registered users call a specified number and enter the parking meter's ID number, followed by the # key (the user calls the server).
2. A personalised welcome message is then displayed on the meter (the server calls the meter). 3. The user enters the parking time required.
4. The meter prints a ticket to display on the vehicle. The transaction is then complete (the meter completes the transaction and returns fee data to the server for processing) (Itsmobile, [no dateja).
The service has been successful. During a pilot phase:
• mPARK transactions were substantially higher than cash transactions, despite using the same tariff.
• No changes to the enforcement process were required.
• mPARK transactions accounted, in some areas, for almost half of all parking transactions.
• 98% of mPARK users were repeat or regular users (Itsmobile, [no date]a).
This service provides an efficient, cashless service to users and reduces the volume of cash held by each meter, reducing servicing and collection requirements. mPARK has now also been rolled out in North Sydney, Australia; Edinburgh, Scotland; and Houston, Texas.
An m-commerce provider can now offer a similar 'meterless' service, as a low cost alternative for parking managers. This service requires that a user obtain a permit to display on their vehicle, which is then validated on each use using a mobile phone. The service requires no investment in parking meters, but does require:
• Zone signage.
• Changes to enforcement methods, enabling the scanning of permits by handheld terminals. • The distribution of paper permits.
Mobile phone printing can simplify the process further by enabling the printing of customised time and location-specific permits on demand.
In December 2002, the US Department of Transportation reported that online airline ticket sales represented about 15% of total sales for major airlines, and sales continue to steadily increase (Mead, 2002). All online systems require the printing of confirmed order details, including a reference code.
In August 2004, the Australian Jetstar Airways introduced JetSMS, an SMS-based ticket-less flight booking service:
1. A pre-registered customer sends an SMS to the airline merchant requesting flight information.
2. The merchant replies with an SMS listing available flights.
3. The customer sends an SMS with selected flight(s).
4. The merchant sends an SMS to verify details of the request.
5. The customer sends SMS to confirm purchase.
6. The merchant sends a confirmation SMS containing booking details and a reference number (Jetstar Airways, 2004).
1.1.1.4 12.4.2 Entertainment
In 2002, Ticketmaster, the world's largest ticket vendor, launched ticketFast, an online booking service requiring users to print a web page confirmation ticket containing a unique barcode to be scanned at a venue's point of entry. In the US, over 1,000 venues offer the service and another 15 venues go live every week. To date, over 8.5 million ticketFast tickets have been purchased and printed by consumers (AuIt, 2004).
In August 2004, MovieTickets.com, the leading internet movie ticketing service, and AOL's Moviefone merged. Together they account for 57 percent of all internet movie ticket sales, and the AOL service receives over 12 million unique visitors each month (Zukerman, 2004).
Vendors such as Ticketmaster average US$5.25 commission for each theatre, concert, art and sporting event ticket sold. Ticket sales account for around 70% of a venue's total revenue. As a result, venues are moving toward the development of self-managed online ticketing solutions (AuIt, 2004).
In some Asian markets, theatres have introduced SMS ticketing. Mobile phone users that book seats online are sent an SMS receipt, which is used as the 'ticket' to gain entry to the venue (160characters Association, 2003).
The use of mobile printing can offer the following advantages:
• Produces high quality, low cost printouts without access to another device.
• Simplifies the development and implementation of applications.
• Provides a familiar, paper-based purchasing system. • Conforms to paper-based validation, accounting and auditing systems.
• Enables wider dissemination of m-commerce applications.
• Improved accessibility: the convenience of not having to visit a ticket vendor or venue.
• The ability to browse and evaluate all available options, select and purchase tickets when and where they wish. • Reduced ticket printing and distribution costs.
• Reduced staffing costs and payments to agency intermediaries.
• Reduced in-house requirements for hardware and consumables.
• Entertainment customers are required only to bring their ticket as evidence of a purchase, as entertainment venues frown on the use of phones or cameras during performances.
• Customer queuing at entertainment venues is further reduced.
These advantages are likely to lead to increasing use of mobile telephony to issue and authenticate tickets in many commercial arenas.
Novel related uses of print-enabled mobile phones might include:
• Installation engineers printing receipts on the spot for householders to sign their acceptance of the work.
• Sales representatives calculating and printing quotations on demand at customer premises.
12.4.3 Printing with Interactivity
Interactive paper creates opportunities to address site navigation and ticket authentication constraints.
• Interactive paper can permit the scanning and authentication of a ticket by a supplier without the need for the consumer to present additional documentation or the handset that printed the ticket.
• A ticket can become transferable, but with an unobtrusive digital audit trail, possibly specifying the identity of the purchaser and printer. • A digital audit trail can act as a strong deterrent to theft and fraudulent uses of a ticket.
• Access to printed instructions on interactive paper significantly addresses concerns about the ease of navigation.
Referring to Figure 114, an example of a movie ticket 935 is illustrated. The movie ticket 935 demonstrates the integration of online and offline content. The user is able to
• Click on the 'Sunny Afternoon' text to visit the movie web site.
• Click on the 'www.MOVIESRUS.com' link to go to the web site.
• Click on the 'gift vouchers' link to buy a gift voucher.
The 'admit' icon can be scanned at the venue in order to gain entry to the movie.
Referring to Figure 115, an example of a football ticket 940 is shown. The football ticket 940 allows the user to:
• Click on the 'gate', 'section', 'row' or 'seat' icons to view a map of the stadium layout that provides the user with directions to their seat.
• Click on to the 'spider' or 'pirates' logos to access the respective teams web site.
• Click on to 'The Metrodome' link to access the venue's web site.
The 'admit' icon is scanned at the venue to gain entry to the event.
Referring to Figure 116, an example of a parking ticket 945 is shown. The parking ticket 945 allows the user to click on to the 'new ticket' icon to purchase another parking ticket. The 'new ticket' icon links to an automated parking ticket purchasing system that requests the user to confirmation their payment details and then sends a new MMS ticket. The 'endorse' icon is scanned to validate the ticket when exiting the car park.
The printed ticket may be a permission token readable using the sensor module to at least one of: retrieve information associated with the ticket from the archive; and gain access to a resource. Printing the ticket can cause information associated with the ticket to be archived. The information associated with the ticket can include one or more of: the ticket; a visual description of the ticket; an image of the ticket; an interactive description of the ticket; contents of the ticket; and ticket details. The ticket can readable by another device. The ticket can include an identification photograph.
The printed bill can be a permission token readable using the sensor module to at least one of: retrieve information associated with the bill from the archive; initiate payment of the bill; pay the bill; obtain a copy of the bill; and gain access to a resource. Printing the bill can cause information associated with the bill to be archived. The information associated with the bill can include one or more of: the bill; a visual description of the bill; an image of the bill; an interactive description of the bill; contents of the bill; and bill details. The bill can include information on itemised purchases. The bill can include at least one of: an item description; an item price; a payment total; a payment due date; an account number; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
12.5 Gambling
Mobile phone printing of gambling information using print-enabled mobile phones provides several significant advantages for gamblers, gambling operators, financial institutions and government regulatory institutions.
In a mobile gambling Worldwide Market Analysis and Strategic Assessment 2003-2008 report commissioned by Juniper Research, Skeldon reports that:
"the global gambling market, all its forms, is an extremely large and growing industry, with valuations currently around one trillion dollars. In recent years, Internet gambling, or e-gambling, has become one of the key revenue generators, and primary routes into new territories and markets. Buoyed by this success, the industry is keen to continue its adoption of new technologies and see the mobile device market as the next major horizon" (Skeldon, 2003).
The mobile gambling market is currently worth an estimated US$50 million annually and it is expected to surge in coming years (Associated Press 2003).
Forecast growth in m-gambling is based largely on the success of text messaging. The impulsive nature of SMS messaging is conducive to games of chance. Multimedia messaging is expected to open up more possibilities.
Online gambling is heavily regulated in many jurisdictions. It is illegal in the United States, so servers are housed outside its borders. Congress has prohibited the use of credit cards for such transactions. However, overseas gambling sites have prospered by allowing payment using debit accounts, unrestricted by US law.
An Irish company, Allatto Technologies, recently published research stating that: "mobile gambling can bring big revenue for mobile operators and providers of gambling services .... about 4.5% of all mobile phone users in Ireland would use mobile gambling services". Expected average yearly revenue from each gambler is US$98.30 (EUR78). By 2006, total revenue from m-gambling would be US$882.2 million (EUR700 million) in Ireland alone (ZFONE, 2003).
In the Netherlands, Sweden, Germany, Britain and Austria, standard handsets are used to purchase lottery tickets, bet on sporting events and enter sweepstakes for prizes. Many countries in Asia have similar services.
In China, "dating services and games with cash prizes have emerged as leading drivers of mobile data use ... 'Provincial China Mobile' branches have begun to promote gambling-style services directly. Guizhou Mobile in Guizhou is working with local service providers to develop new variations of service providers such as my5678.com". These generate high levels of "SMS traffic by offering cash prizes in games of chance" (Smith-Gillespie, 2003).
Online gambling made US$5.7 billion in profits in the 2003/2004 financial year according to Christiansen Capital Advisors (Spring, 2004). Online gambling has increased gambling revenues because it has provided another channel for gambling with increased accessibility and anonymity.
In contrast to e-gambling, m-gambling offers inherent control mechanisms, such as daily spending limits. Operators can also identify which country a bettor's handset is registered in - and the applicable legal environment for betting - from the bettor's telephone number (Associated Press, 2003).- M-gambling provides regulators with opportunities to permit gambling in a safe and well controlled manner.
M-gambling is a largely anonymous pursuit, which is part of its appeal for both players and operators. The technology eliminates the need for face-to-face contact and participants never see their competitors.
Online gambling can be divided into the following categories:
• Casino gambling
• Fixed odds gambling - such as sports betting
• Lotteries and sweepstakes
1.1.1.5 12.5.1 Casino Gambling, Fixed Odds Gambling, Lotteries and Sweepstakes
Online gambling revenues are dominated largely by casino operations based in the Caribbean. Gamblers open online casino accounts where they either purchase e-cash in the form of credit tokens or dollars, or alternatively they register their credit or debit card details with the casino, so that they can pay for each bet before playing a game. Registered members can choose to play online, using a Flash player or DirectX driver, or alternatively they can download and install Java casino programs over the internet.
Operators provide members with access to their accounts via web page interfaces, email messages and, though not as widespread, SMS messages.
Betting by telephone, enabling gamblers or punters to bet on horses with bookmakers, has been available in many jurisdictions for over 40 years. Punters open a phone betting account and then place bets using ordinary voice calls.
In April 2000, NTT DoCoMo introduced the personal access terminal (PAT) horseracing betting service, run by the Japan Racing Association (JRA). NTT DoCoMo 'mobileGet' handsets were pre-loaded with a browser and pre-installed software for accessing the service (ATIP, 2000).
In March 2002, the Japan Racing Association introduced the IPAT (IP address takeover) mobile phone betting service, which enables bettors to place bets over the internet. IPAT compatible mobile phones can "view the odds, horse weights, and other data and place phone bets inexpensively from anywhere. User friendliness has also been greatly enhanced since special software is not needed" (JAIR, 2002).
To place a bet using the EPAT service, bettors:
1. Connect to the JRA website using their mobile phone;
2. Enter their subscriber details;
3. Select the race venue; 4. Enter the race number;
5. Enter the identification numbers for the types of bets;
6. Enter the horse or bracket number;
7. Enter the amount of the bet;
8. Total up the bets; 9. Enter the amount and send (JAIR, 2002).
Betters "can also view data, including track conditions and race cards, along with odds, horse weights, race results, and payouts" on the site (JAIR, 2002).
According to Forrest et al. (2004) there are two basic types of lotteries; 'online' and scratch card games. Online games are lotteries where:
• The better buys a ticket and fills in a set of numbers (or has them randomly chosen by computer).
• A set of numbers is then drawn by the lottery, and • The winners are the bettor) that chose the corresponding number set.
Most existing 'online' lotteries employ the following purchasing process:
1. Choose a game: select which lottery to play.
2. Choose a purchase type: one game or continuous subscription. 3. Choose the number of ticket cards.
4. Choose the number of draws to enter.
5. Select numbers: quick pick, self select, mixed.
6. Add selections to purchase card.
7. Confirm order and make payment (Lottery Universe, [no date]).
Traditional lottery ticket sales are falling and state-run lotteries looking to attract a new generation of customers are turning to m-gambling. In the Netherlands, Sweden and the UK, government-approved mobile lotteries have been successfully introduced. These lotteries are based on existing formats such as lotto; where players submit a set of numbers to compete in daily or weekly draws.
Players benefit from increased convenience and immediacy through SMS m-lotteries. M-lottery operators benefit from reduced administration and infrastructure costs. As m-lottery operators record user usage and other data, they have the opportunity to gain customer loyalty: access to user data affords them the opportunity to initiate dialogue with players, such as sending out SMS reminders and keeping them up to date with new initiatives. Mobile network operators are provided with an increased level of SMS traffic.
Mobile sweepstakes using SMS are a popular form of m-gambling. To play, an entrant:
1. Sends an SMS message to a sweepstakes services provider. 2. As a result, an instant SMS message is sent to the entrant revealing their numerical ranking.
3. A certain numbered message wins (Associated Press, 2003).
By using mobile phone printing at least some of the following advantages can be achieved:
• Enables bettors to print their gambling betting receipts, betting tips, scorecards, drawcards, form guides and results.
• As with tickets and billing, a conventional audit trail is created.
• Lottery operators will be able to reduce administration and infrastructure costs.
12.5.2 Printing with Interactivity
As with ticket printing, interactivity can improve the mobile gambling experience by facilitating the validation of receipts and draw cards. Such advantages can include:
• Interactive paper can permit the scanning and authentication of a receipt or draw card by a service provider without the need for the gambler to present additional documentation or the handset that printed the ticket.
• A ticket can become transferable, but with an unobtrusive digital audit trail, possibly specifying the identity of the gambler and printer.
• A digital audit trail can act as a strong deterrent to theft of a lottery ticket or draw card.
Referring to Figure 117, an example of a casino print medium 950 is illustrated. The casino print medium 950 records a winning hand, which can be presented to receive the gambler's winnings. Additionally, the winner can:
• Click on the 'mp' logo to visit the provider's web site. • Click on the 'play' icon to play another game.
Referring to Figure 118, an example of a printed lottery ticket 955 is illustrated. The lottery ticket can be combined with additional, interactive content to allow a user to
• Click on the 'date' link to view the lottery results. • Click on the 'www.japanluckylottery.com' link to visit the web site.
Referring to Figure 119, an example of a printed jackpot lottery order form 960 is illustrated. The printed jackpot lottery order form 950 demonstrates how a gambler can interact using point and click functionality, such as: • Selecting the checkbox that corresponds to the number of lottery tickets that they want to order
• Selecting the checkbox that corresponds to the number of lottery tickets that they want to order
• Placing the order by selecting the completed checkbox and then clicking on the 'SUBMIT' button
Referring to Figure 120, an example of a race form 965 is illustrated. The race form provides the user the opportunity to use a pen or pointer device to:
• Select the '$3' icon to place a "3up" race bet.
• The user is then prompted to place the reverse side of the card in the mobile phone printer and the 3 race selections are printed on to the reverse side of the card 970, as shown in Figure 121.
After the selected races have been run, the user is sent a message with the results that can then be printed and taken to a offline store for collection if required; or the winnings can be added to the user's online account.
Referring to Figure 122, an example of a SportsTab form 975 is illustrated. The SportsTab form 975 demonstrates the use of point and click functionality, which allows the user to place a bet by selecting the
required checkboxes; then selecting the completed checkbox and clicking the SUBMIT button. The user can also use the pointer to access more information about completing the form by clicking the 'Info' icon or they can click the website link to visit the website home page.
The printed gambling ticket can be a permission token readable using the sensor module to at least one of: retrieve information associated with the gambling ticket from the archive; determine if a prize is associated with the gambling ticket; and gain access to a resource. Printing the gambling ticket can cause information associated with the gambling ticket to be archived. The information associated with the gambling ticket can include one or more of: the gambling ticket; a visual description of the gambling ticket; an image of the gambling ticket; an interactive description of the gambling ticket; contents of the gambling ticket; and gambling ticket details. The gambling ticket can be readable by another device. The gambling ticket can be an instant lottery ticket.
The printed receipt can be a permission token readable using the sensor module to at least one of: retrieve information associated with the receipt from the archive; verify payment of the receipt; initiate payment of the receipt; and gain access to a resource. Printing the receipt can cause information associated with the receipt to be archived. The information associated with the receipt can include one or more of: the receipt; a visual description of the receipt; an image of the receipt; an interactive description of the receipt; contents of the receipt; and receipt details. The receipt can include information on itemised purchases. The receipt can include at least one of: an item description; an item price; a payment total; a payment date; an account number; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
12.6 Publications Almanacs, calenders, weather forecasts including local or regional reports, surf and tide reports, appointment diaries and task lists, are standard applications on computers, PDAs, smart phones and even some digital music players.
Current applications offer integrated and online capabilities, allowing these publications to be shared among multiple users, or synchronised over multiple devices. Web users can subscribe to online publications such as calendars, for a variety of commercial, lifestyle or entertainment purposes. Access can also be limited to specific users or user groups.
One example is iCalShare.com which lists over 1800 public calendars for sporting events, academic and other purposes. Mozilla provides download or subscription calendars for national holidays in many countries (http://www.mozilla.org/proiects/calendar/holidavs.html. 2004). Both sites offer calendars based on the open standard (IETF) iCalendar 2.0 format used by Mozilla and Apple.
Printing calenders onto a print medium using mobile phone printing offers the potential to combine traditional, paper-based approaches to task management with the interactivity possible on a digital platform.
12.6.1 Printing with Interactivity
The use of interactive paper combines familiar, paper-based approaches to task management with full software and digital integration. Daily, weekly and other periodic calendars can be printed, together with links to previous and next periods, and clickable links. Clickable links can mark tasks as complete, or display additional data on screen. Integration with address books, for example, can enable the clicking of an appointment link to display the address of the person or meeting. Ticking tasks when complete can require the use of a conventional pen, as well as a mobile handset.
Th printed medium provides users with shortcuts to calendar and task information on-screen or on-line. Tasks can be clicked, as well as ticked off, on completion. Clickable icons can provide links to meeting/person addresses and contact information; more detail on a specific task or activity; mark a task as completed; view next and previous periods; support multiple timezones.
12.6.2 Printing Opportunities
By printing a calender on a print medium provides users with a tactile, wallet or purse-sized quick reference cards. Users are not required to thumb through menus to access calendar information. Tasks can be ticked off on completion, using a familiar, conventional pen. Calendar or 'to do' lists can be integrated with photographs, or with m-commerce subscriptions for 'quote of the day', 'photo of the day' or even 'thought of the day'. Mobile handset-based calendar applications can be linked to a subscription calendar or event scheduling services, or synchronised with other devices. Basic templates can be printed for user completion by pen.
Referring to Figure 123, a printed Calendar 980 which demonstrates a wide range of actions, including:
• Clicking on any of the listed appointments to display, change or edit an appointment entry.
• Clicking names and locations to go to an address book entry for that person or place.
• Clicking on the back or forward icons to view entries for the previous or next day.
• Clicking on the clock icon to add a new appointment. • Clicking on the world clock to check for timezone differences.
• Clicking on any of the listed tasks to display a task and review task status.
• Clicking on to the task pad icon to add a new task.
Printed calendars, reminder lists and/or almanacs may be in the form of a permission token readable using the sensor module to at least one of: retrieve information associated with the respective calender, reminder list and or almanac from the archive; and gain access to a resource. Printing the calendars, reminder lists and/or almanacs may cause information associated with the calendars, reminder lists and/or almanacs to be archived. The information associated with the calendars, reminder lists and/or almanacs may include one or more of: the respective calendars, reminder lists and/or almanacs; a visual description of the calendars, reminder lists
and/or almanacs; an image of the calendars, reminder lists and/or almanacs; an interactive description of the calendars, reminder lists and/or almanacs; contents of the calendars, reminder lists and/or almanacs; and calendar, reminder list and/or almanac details. The printed calendar may be synchronised with another calender on another terminal. The printed calendar may include advertising. At least part of a reminder list may be printed as a result of a reminder clock setting associated with the remainder list. The reminder list may contain periodic entries. The printed almanac may include meteorological information.
1.1.2 12.7 Advertising
Mobile phone printing from enabled mobile handsets can provide businesses and institutions with the opportunity to deliver a variety of printable advertising messages and media to consenting consumers.
1.1.2.1 12.7.1 Online Marketing
According to eMarketer (2004), the total online marketing sector will reach as much as 30 to 40% of total advertising spend budgets. The Internet Advertising Bureau (IAB) Internet Ad Revenue Figures 2003 report states that, of the total US$7.2 billion online advertising market, there was exceptional growth in some areas, such as keyword search, together with a general evolution in the medium. This has had a major effect on the types of formats being used (IAB, 2004).
Empowered consumers no longer passively consume; they actively use the internet to evaluate product information from a variety of sources before making purchasing decisions. High profile companies such as Coca Cola, Dell, IBM and McDonalds are using the internet not just to advertise, but also to safeguard their reputation, informing consumers of their corporate ethics and social concerns.
1.1.2.2 12.7.2 Mobile Phone Marketing
Mobile phones offer businesses a potential direct link to consumers. In a FirstPartner Marketing and Research report, Nester et al. report (2003) that: "Mobile marketing or m-marketing is more than a trendy new media channel; it is a powerful communication tool with considerable audience reach and awareness." European high mobile phone penetration levels means that "mobile marketing campaigns can reach all audience demographics" (Nester et al, 2003).
SMS has been called the 'fifth channel' for media advertising in the United States. Companies such as Coca Cola, Smirnoff and Mercedes have all successfully used SMS to help launch new products.
Mobile messaged based marketing, that is, marketing using SMS and MMS messaging, is becoming a core channel for the mainstream marketing industry. The FirstPartner report writes that "it is estimated that the bulk of mobile marketing activity (approximately 95%) is undertaken using either SMS or Premium Rate Voice" (Nester et a!., 2003). Globally, SMS advertising is expected to surpass US$27 billion in 2004.
Mobile phone advertising can alleviate these disadvantages by:
• Satisfying more demanding customers who expect offerings and communications to be aligned with their needs, preferences and lifestyle.
• Providing the means to support a customer-centric business through a growing number of marketing activities, such as website, call centre and store or branch communications (Marcus and Collins,
2003).
With increasing penetration of MMS-enabled handsets, a flow of multimedia messages - colour pictures, video and music —should drive more growth.
Advertising formats are likely to change to adapt to the print medium, enabling users to benefit from printing new product information, discount offers and contest entries. Printing from mobile phones enable consumers to take full advantage of personalized advertising messages sent to their mobile phones.
12.7.3 Printing with Interactivity
Advertising formats are likely to change to adapt to the interactive potential, enabling users to easily navigate access to product information, discount offers and contest entries. Interactivity is likely to enable even closer integration of personalised advertising materials, loyalty cards and related customer relationship management activities.
Referring to Figure 124, an example of a printed flyer 985 is illustrated. The flyer demonstrates the integration of basic online and offline content:
• Click on the 'wonderland' logo to visit the web site. • Click on the 'special code' to redeem the voucher discount and purchase tickets to Wonderworld.
The printed advertisement can be a permission token readable using the sensor module to at least one of: retrieve information associated with the advertisement from the archive; obtain an incentive; obtain a redemption; obtain a voucher; obtain a discount; obtain a sample; and gain access to a resource. Printing the advertisement can cause information associated with the advertisement to be archived. The information associated with the advertisement can include one or more of: the advertisement; a visual description of the advertisement; an image of the advertisement; an interactive description of the advertisement; contents of the advertisement; and advertisement details. The advertisement can be simultaneously printed on the print
medium with other content. The advertisement can be tailored to a user of the mobile telecommunications device.
1.1.3 12.8 Competitions
Mobile phone printing from print-enabled mobile phones can enable consumers to print and interact with competition entries and confirmation messages in an immediate, cost effective and efficient way.
Mobile phone competitions are successful because consumers can more easily participate in competitions. The convenience and cost-effective nature of mobile phone technology has seen a substantial increase in competitions by a wide-range of businesses, across mass communications channels, to promote products and services.
1.1.3.1 12.8.1 Voice-based Competitions
Voiced based mobile phone competition entry is predominately used to 'register a vote' whereby the consumer is responding to a TV program or other marketing campaign.
1.1.3.2 12.8.2SMS Competitions
The majority of current mobile marketing campaigns use simple text messages or SMS to run competitions. These are a mix of both push and pull campaigns:
• Single response 'pull' campaigns such as "Text to win" tend to be the point of entry into mobile marketing for most brands and agencies. • Single response 'push' campaigns, which involve consumers who submit their mobile phone details to 'opt-in' marketing databases, include the use of sending short codes to enter voting choices to enter competitions (Nester et al. 2003).
SMS 'push' promotions involve sending an outbound SMS to a target audience. As a result, consumers may: • Reply by SMS
• Call a telephone number
• Look out for promotions on product packaging
• Visit a website, or
• Receive a discount.
SMS 'pull' promotions are characterised by a customer seeing a promotion on other media/channel and using SMS as the response mechanism. The most common is the 'text to win' format SMS competition
In 2003, the Australian Arnott's Snackfoods' Austin Powers promotion generated over 10 million SMS messages, the most seen in the Asia Pacific region for a sales promotion - even more than the 2002 "Coke Cool Summer" promotion in China. Packets of some snack foods ranges featured Austin Powers characters on the front and a 'Groovy Game Tag' inside. Consumers sent a code from that Game Tag using SMS to a specified number (Anderson et a 2003).
Competition entrants received either an SMS reply notifying them of any prize winnings, or the opportunity to download one of ten Austin Powers mobile phone logos or riαgtones exclusive to the campaign.
The UK's pioneer mobile marketing agency, Text Marketer, have produced a 'Txt-2-Win' system that smaller companies can afford to implement. Consumers text a code to a number for a chance to win a prize. The system automatically assigns a prize (or not) to that consumer and sends a message to their phone with the appropriate response. Text Marketer's clients include Shiseido UK, Belhaven Brewery, McDonalds and Cadbury (Text Marketer, 2003).
1.1.3.3 12.8.3SMS Supporting Television Marketing
Television is another communications channel using SMS marketing for interactive voting, quizzes and competitions and games.
Visiongain, an independent media company, reports that "the rise in vote-based formats such as Pop Idol and Big Brother can successful increase the popularity of the shows themselves. Combined with the launch of pre-paid handsets, TV generated voting through SMS could be a major factor in driving the success of take up of mobile technology" (eWirelessNews, 2002).
Furthermore, Visiongain report that "the SMS channel for voting has proved particularly popular in Europe. O2 UK revealed that, on Saturday 16 November 2002, more than 200,000 votes were cast via premium SMS in the space of a one hour TV show Popstars - The Rivals" (eWirelessNews, 2002).
1.1.3.4 12.8.4 MMS Competitions
Multimedia message (MMS) competitions are not as widespread as SMS competitions, although they are gaining in popularity.
In December 2002, Vodafone UK went live with an MMS photo competition. The 'Share life as you live it' competition ran for three months and was a huge success. Vodafone launched the competition to introduce its users to MMS messaging (Carbon Partners, 2002).
In June 2003, Swisscom Mobile started Switzerland's first MMS photo competition, where anyone could submit a funny photograph with the chance to win a trip to the Maldives (Textually.org, 2003).
In June 2004, Digital Rum (UK), a provider of m-commerce solutions and mobile picture services launched the "What's Hot?" service for T-Mobile users in the UK and the Czech Republic. The service was first launched in a number of other T-Mobile European countries in November 2003 including Germany and the Netherlands. T-Mobile users are encouraged to submit pictures into categorized competitions including tattoos, pets or Euro 2004, by sending the picture with the title of the competition to the entry number (Andrews, 2004).
12.8.5 Print Opportunities and Interactivity
By using mobile phone printing, the combination of camera and print-enabled mobile handsets can make it possible for new competition formats to emerge. At the small end of the scale, mobile phone subscribers can leave a 'calling card' or business card in an entry box to enter a traditional prize draw. Camera phone users can already submit photos to some MMS competitions. This is likely to increase, both online as MMS messages and offline as printouts. Photo editing software is likely to develop this market further. Interactive multimedia competitions, similar to the early 1980s Cadbury's 'Conundrum' treasure hunt also become possible. This competition had 12 prizes scattered around the UK, the clues to which were hidden in 12. paintings and rhymes. Printing, together with location-based services, creates added potential for new, innovative and interactive forms of entertainment and consumer participation.
One example may be a printed "Treasure Hunt" card. Participating users can print out cards related to clues and answers in a treasure hunt. The Treasure Hunt game might be a mobile phone software based application, with a user clicking a card to jump back to that location in the current game. Alternatively, the treasure hunt could be an online game in real time with substantial prize winnings and user participation. Clues could take the form of riddles or questions that users can answer by sending a brief SMS message. Alternatively, users might have to guess a location from a photographic or mapping image. Users might have to click a GPS icon on the image to verify their location.
Referring to Figure 125, a printed MMS entry 990 is illustrated. The MMS Competition Entry 910 demonstrates a simple integration of online and offline content, wherein the user is able to:
• Click on the 'phone number' to dial or send another MMS to the phone number. • Click on the 'envelope' icon to display the sent messages folder.
• Click on the 'photo' icon to display the photo.
Referring to Figure 126, an example of a printed competition entry card 995 is illustrated. The printed competition entry card 995 example provides the user with the opportunity to print the entry form as required
and then use the pen or pointer device to vote for the contestant of their preference and submit their vote to the poll. Unlike a ballot paper, it might be ethical for a group of friends to circulate the entry form and all to vote for their favourite contestant.
The printed competition entry form can be a permission token readable using the sensor module to at least one of: retrieve information associated with the competition entry form from the archive; enter a competition; and gain access to a resource. Printing the competition entry form can cause information associated with the competition entry form to be archived. The information associated with the competition entry form can include one or more of: the competition entry form; a visual description of the competition entry form; an image of the competition entry form; an interactive description of the competition entry form; contents of the competition entry form; and competition entry form details. One or more winners of the competition associated with the competition entry form can receive notification via the mobile telecommunications device. The competition entry form can include at least one of: a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; prize details; competition conditions; a competition closing date; and contact details.
1.1.4 12.9 Coupons
Mobile phone printing of coupons can provide significant advantages to consumers, manufacturers and retailers over existing coupon printing systems.
Coupons are a sales promotion method that offers consumers discounts to products and services. Coupons have been around for over 100 years. More than 3,000 manufacturers and retailers now offer coupons. In response, over 88% of consumers redeem nearly 430 billion coupons annually. Coupons are used to: • Market new products
• Promote special offers
• Re-launch repackaged or improved products (Innovative Advertising & Marketing, 1999).
1.1.4.1 12.9.1 E-Coupons
Prior to the internet, coupon distribution channels included:
• On product packaging, to encourage repeat purchases
• In coupon books sent out in newspapers allowing customers to redeem the coupon at a retailer
• A cut-out coupon as part of an advert • On the back of till receipts (tutor2u, [no date]).
The internet provides retailers with the opportunity to gather more detailed personal information about existing and potential customers' product preferences. As a result, marketers can segment consumers into
direct marketing target groups according to demographic, ethnographic and psychographic criteria. In addition, retailers are no longer bound by geographic boundaries; they are now able to market products nationally or globally (Global Reach, 2001).
The offline coupon industry is worth around US$6 billion and, if current trends continue, the online industry could match or exceed that growth. Forrester Research, a leading internet research company, estimates that around 40% of online US households are using online coupons (internet retailer, 2004).
Coupons (or 'e-coupons') printed from the web provide authentication codes for retailer validation and expiration dates for the consumer. E-coupons can be printed to be redeemed in-store or used during an online purchase. Both forms of e-coupon are providing retailers with a competitive edge:
• Tracking redeemed e-coupon numbers and codes provides tangible data on the success, or otherwise, of sales promotions.
• There are no printing or consumables costs. • Consumers are provided incentives to purchase specific products, or from specific retailers.
E-coupon sales growth is a direct result of retailers marketing to new customers and driving sales online to reduce costs. Retailers are making e-coupons available to customers by means of:
• Opt-in email newsletters that include e-coupons, e-coupon codes or link to printable e-coupons. • Couρon-on-demand websites that typically offer both e-coupons to redeem online and printable e- coupons for in-store redemption.
• Directly from the retailer's website.
12.9.2 Print Opportunities and Interactivity Marketing using SMS and MMS has not yet extended to mobile coupon sales promotions. Unlike a gift voucher scheme, which can be redeemable by SMS, broader coupon or voucher programmes are unlikely to develop without the ability to print the material. Users can store e-coupons in their handsets to print as required or, alternatively, access e-coupons from the web to print on demand. Mobile phone printing can provide manufacturers and retailers with a new, more closely targeted, sales promotion channel. Interactivity combined with mobile phone printing creates added potential for high quality, easily distributed, and personalised sales promotions.
Referring to Figure 127, a printed Moulin Rouge coupon 1000 is illustrated. The user is able to:
• Click on the 'book' icon to make a reservation by email. • Click on the 'menu' icon to view the menu web page.
• Click on the 'phone number' to dial the restaurant.
The printed coupon can be a permission token readable using the sensor module to at least one of: retrieve information associated with the coupon from the archive; redeem the coupon; recharge the coupon; obtain a
copy of the coupon; and gain access to a resource. Printing the coupon can cause information associated with the coupon to be archived. The information associated with the coupon can include one or more of: the coupon; a visual description of the coupon; an image of the coupon; an interactive description of the coupon; contents of the coupon; and coupon details. The coupon can be provided with a validity period. The coupon can be personalised to include at least one of: an expiry date; redemption conditions; retailer details; product details; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
1.1.5 12.10 Gift Vouchers
Consumers buy gift vouchers because they understand that it is a guarantee that the recipient can choose their gift themselves. Gift vouchers are also ideal for shoppers who are unable to decide on exactly what to buy.
77% of retailers, according to US research by Faulkner and Gray, experience increased sales and revenue. The most popular reasons for offering gift cards are:
• To boost sales and profits
• Consumer demand
• Savings on costs to tender (2002).
There are several types of pre-paid gift vouchers:
• Paper gift vouchers or certificates
• Plastic gift cards
• Online gift vouchers, such as those offered by Amazon.com and other online retailers.
Research suggests that consumers prefer to purchase pre-paid vouchers or cards, which can be redeemed at multiple retailers or locations (WNIM, 2002).
The US gift card and gift certificate industry almost quadrupled in 6 years, moving from US$10.5 billion in 1997 to an estimated US$38 billion in 2002. Annual retail growth rates for gift vouchers and cards were reported as:
• Gift or spending cards 80%
• Paper gift vouchers or certificates 15%
• Overall annual growth 30% (Prepay Technologies, 2003).
In the United States, House Bill 3036, signed in March 2004, made it unlawful for gift cards issued after June 2004 to contain expiration dates, with some limited exceptions. Retailers can no longer charge service or
inactivity fees and, when the value of gift cards or certificates falls below US$5, consumers will be able to redeem them for cash (Consumer Protection Division, US Office of the Attorney General 2004).
The UK voucher market, from 2001 to 2002, had a total market growth of 16.4%; total gift voucher sales in 2002 were valued at US$2.5 billion. Corporate sales of vouchers (B2B) rose 21.8% while direct sales of vouchers to consumers rose by 10%. The UK market is still predominantly paper based. It is estimated that the total UK gift voucher market will grow 250% to reach US$5.2 billion by 2007 (Prepay Technologies, 2003).
The corporate gift voucher market is also growing, as many companies use gift vouchers to reward staff and customers as well as to promote goods and services. For businesses, gift vouchers are extremely flexible and often represent a more appropriate, thoughtful gift than cash bonuses and other incentives.
1.1.5.1 12.10.1 Paper and Plastic Gift Vouchers
For retailers, paper gift voucher systems have the following disadvantages:
• Lack of marketing, promotional and merchandising excitement, without the flexible options that plastic gift cards have.
• Offline paper gift voucher transactions are difficult to control and track and offer virtually no management information.
• Possibility of unauthorized production.
• Laborious Point of Sale (POS) transactions.
• Lost interest opportunity as paper gift voucher balance is cashed out (Faulkner and Gray, 2002).
Plastic has boosted both gift card and gift voucher sales. Retailer benefits from offering swipe-able are significant. Plastic cards are:
• An effective revenue and loyalty builder.
• Powerful marketing tool that enables retailers to boost brand and corporate identity.
• Accurate, real time information management. • Offer greater accountability.
• Online transactions reduce opportunities for fraud.
• Flexible locations for card issuance and redemption.
• Point of sale (POS) and back-office cost reductions.
• Improved income opportunities (Faulkner and Gray, 2002).
Consumer benefits of plastic cards include:
• Improved convenience and speed of service through quicker in-store transaction time.
• The opportunity to purchase goods and services through additional channels: online as well as in- store (Faulkner and Gray, 2002).
The increasing popularity of plastic gift cards, has led to the emergence of 'electronic gift supervouchers' that can be redeemed at a variety of different online retail stores.
1.1.5.2 12.10.2 Online Gift Vouchers
On the internet, consumers can purchase gift vouchers: • From retail websites
• Via direct mail retail newsletters
• From gift voucher reseller websites.
Currently, consumers that purchase gift vouchers over the internet are offered three delivery options: email, SMS, or post.
When a recipient receives an emailed gift voucher, it contains a 'voucher claim code' and, depending on the source, the voucher itself (such as an image attachment). The recipient is instructed that the gift voucher can be redeemed by either: 1. Printing the attached gift voucher and presenting it in store, or
2. Entering the 'voucher claim code' during the online shopping checkout process.
Gift vouchers that are delivered electronically provide security codes for retailer validation, and expiration dates for the consumer.
1.1.5.3 12.10.3 Online and SMS Gift Vouchers
Gift vouchers have only recently extended to SMS and MMS forms of delivery. In September 2004, 'Corney & Barrow', with Eagle Eye Technology, launched a service to redeem SMS drinks vouchers, purchased online, at 11 Corney & Barrow bars in London.
Purchasers logon to buymeabeer.com, select a drink, enter a mobile phone number and pay by credit card. An SMS is sent to the mobile phone. Bar staff redeem the voucher on presentation of the phone and message.
As mobile data services gain user acceptance, it is likely that this and similar services will move to a cashless, purely mobile form of purchase and delivery.
12.10.4 Print Qpportunites and Interactivity
Mobile phone printing can provide retailers with the opportunity to deliver printable gift vouchers to consumers using MMS. It can enable gift voucher recipients to print gift vouchers and 'voucher claim codes' at the time they select their goods or service. Only one party to the transaction requires a print-enabled mobile phone. Vouchers can be printed by gift givers at time of purchase, and given to recipients by hand or post. Such recipients do not need to have their own mobile phone, print-enabled or otherwise.
Vouchers can be personalised, and integrated with order histories and data on personal preferences. Interactive mobile phone printing can integrate with both clicks and mortar shopping channels. The medium can bring Amazon.com-style purchase recommendations to mobile phone users.
Referring to Figure 128, an example gift voucher 1005 is illustrated. The user is able to:
• Click on the web site link to view the product catalog.
• Click on the 'conditions apply' link to view the gift voucher conditions web page.
• Click on the 'SMS us' icon to send an email to the gift voucher 'sender'. • Click on the 'find a store' icon to view store locations, including the nearest store based on GPS data, if available.
Referring to Figure 129, an example gift certificate 1010 is shown. The user is able to:
• Click on the web site link to make a purchase; • Click on the 'store locations' link to view store locations.
12.11 Memberships
Mobile phone printing from print-enabled mobile phones enables consumers to print membership cards in a timely and effective manner.
Consumers become members of clubs, organizations and businesses in order to be able to gain access to information or to purchase products and services. Some common examples include:
• Fan clubs • Social clubs
• Shopping clubs
• Book clubs
• Movie and video clubs
• B2B memberships • Organizational and institution memberships
• Bank and Credit Union memberships
• Student union memberships.
Online memberships usually consist of a private website available to a certain set of people with common interests and goals. Similar to a library, online memberships take on a certain form, often containing resources such as books, magazines, articles, and even audio and video material.
The internet has enabled web-based clubs to develop, such as social clubs where members chat and organize offline social events. Many web-based clubs require that members print out their club membership details in order to verify their membership when attending offline events.
Online membership of a club, organization or business can provide members with offline membership advantages including:
• Membership discounts
• Invitations to special events.
Many online business-to-business (B2B) organizations require that businesses become members in order to participate iri forums, access information and receive discounts. The Surfrider Foundation ([no date]) offers a 'retail membership program' that retail businesses can join online. Surfrider retail members are provided with membership cards that can be used both online and offline to receive discounts, giveaways or promotional merchandise from a wide range of retailers.
For consumers Blockbuster Online (2004) offer special games or movie membership passes that enable consumers to rent games or movies online. Members receive special offers such as e-coupons that can be redeemed in-store.
In the US, the Regal Entertainment Group (2004b) offer consumers the opportunity to become members of the Regal Crown Club whereby members earn credits for monies spent on movie admissions at participating theatres. Regal Crown Club membership may be obtained online. New members are sent an email verifying their membership details and a membership card is sent to their nominated address.
12.11.1 Print Opportunities and Interactivity Mobile phone printing enables businesses to streamline the membership process, by sending membership cards to members' mobile phones using MMS. As such, costs can be reduced. Members can store cards on their handset and print as required. Membership bodies can better integrate their online and offline activities. For example, potential new members can also join at offline events, complete an application and receive a membership card on the spot. Online changes to membership status or details can be made more attractive to both members and businesses. Interactivity eases navigation to membership activities, improving mobile access to membership bodies by their members.
Referring to Figure 130, an exemplary printed membership card 1015 is illustrated. The membership card 960 enables a user to
• Click on the River Crossing Technical College logo to visit the college website.
• Click on the 'name' or student number links to view student registration details.
• Click on the 'course' link to view course information and schedules.
• Click on the 'campus' link to view a map of the campus. • Click on the 'admin' link to visit the administration web page.
• Click on the 'library' link to visit the main library web page.
• Click on the 'search' icon to visit the search web page.
Referring to Figure 131, a second example printed membership card 1020 is illustrated. The printed membership card 970 enables user to:
• Click on the Videoland link to visit the web site to review latest releases.
• Click on the 'phone number' link to dial the phone number.
• Click on the 'membership' link to update membership details.
• Click on the 'lost or stolen' cards link to report lost or stolen cards. This link may be clickable by any handset.
• Click on the 'special offers' icon to view current special offers.
• Click on the 'membership rewards' icon to view current membership rewards.
The printed membership can be a permission token readable using the sensor module to at least one of: retrieve information associated with the membership from the archive; prove membership status; obtain a copy of the membership; and gain access to a resource. Printing the membership can cause information associated with the membership to be archived. The information associated with the membership can include one or more of: the membership; a visual description of the membership; an image of the membership; an interactive description of the membership; contents of the membership; and membership details.. The membership can be provided with a validity period. The membership can include at least one of: a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
12.12 Games and Puzzles
Mobile phone printing of games and puzzles that are traditionally printed on paper provides consumers with several significant advantages. Despite the success of hand-held video games, mobile phone games and DVD consoles in cars, traditional paper-based games have not lost their appeal. These games include connect-the- dots, tic-tac-toe (also known as 'noughts and crosses'), crossword puzzles and a vast array of word and knowledge-based games. Most print newspapers, magazines and comic books usually include a section with paper-based games. Specialist publications are also sold at newsagents and other vendors.
The overall mass market appeal of paper based game publications has been steadily declining as: Games are readily available on the internet and most websites offer them for free.
Most mass market publications are printed using low quality paper.
Many consumers do not feel the need to purchase an entire volume of games when their interest in a game is spontaneous or intermittent.
The internet has benefited consumers as:
Many websites offer free games and puzzles to print and play.
Consumers can select from a wider range of games and puzzles as many people are designing their own unique games.
Consumers are able to select as many or as few games to print, without restrictions on print volumes.
The web provides consumers with an easy and convenient way to source paper-based games. Games that combine traditional puzzles with a degree of interactivity or progression are also possible.
12.12.1 Mobile Games and Puzzles
Dell Crosswords, the most popular name in the US for crossword puzzles and word search games, now sells puzzles and games to mobile phone users, as well as online. The consumer purchases the crossword or word search game software from the Dell Crosswords website. This is then downloaded to a computer and installed on a mobile phone via USB, wireless or infrared connection, or installed directly over the air. Once installed, users can download a new puzzle or game each day, to play using a keypad, stylus or pen. To request a puzzle or game:
1. Click 'Dell Crosswords' icon from the phone menu.
2. Select the 'request game' option. 3. Click 'send'.
4. A game is sent to the user's phone using SMS, MMS or email.
12.12.2 Print Opportunities
Daily, printable games, puzzles and quizzes can be incorporated into news and other paid subscriptions. Paid subscribers can receive games or puzzles periodically to print as required. It is possible to work with some paper size limitations, such as by printing a crossword grid on one page with the clues on a second.
12.12.3 Interactivity Opportunities
Gamers can enter into draws and competitions, interacting with service providers in real-time.
Referring to Fig. 132, the printed Find the Art Words! 1025 example demonstrates the following possibilities: Click each of the letters of the found words.
Select the completed checkbox and then click the SUBMIT button when the word puzzle is completed.
Referring to Fig. 133, the printed Quick Crossword 1030 example provides the user with the opportunity to use the pen or pointer device to:
Fill in each of the words in the crossword.
Click the clue to receive another hint or the answer.
Click the 'results' link to retrieve the full crossword solution.
The printed gaming information may be a permission token readable using the sensor module to at least one of: retrieve information associated with the gaming information from the archive; retrieve a game state; identify a game state and set a state of a game from the game state; retrieve a map; identify a position on a map; identify a position on a map and set a state of a game from the map position; retrieve a game score; initiate payment for the gaming information; transmit the gaming information to a game server; obtain a copy of the gaming information; and gain access to a resource. Printing the gaming information may cause information associated with the gaming information to be archived. Information associated with the gaming information may include one or more of: the gaming information; a visual description of the gaming information; an image of the gaining information; an interactive description of the gaming information; contents of the gaming information; and gaming information details. The gaming information may include at least one of: a game state; a game score; a high score list; a game level; a map; a brag card; a game highlight; a game screenshot; a password; an access key; a cheat code; and game instructions. The gaming information may be associated with a game played on the mobile telecommunications device.
Furthermore, the printed puzzle may be a permission token readable using the sensor module to at least one of: retrieve information associated with the puzzle from the archive; retrieve a puzzle state; retrieve a new puzzle; have a puzzle answer checked; retrieve a score; initiate payment for the puzzle; transmit the puzzle to a server; obtain a copy of the puzzle; and gain access to a resource. Printing the puzzle may cause information associated with the puzzle to be archived. Information associated with the puzzle may include one or more of: the puzzle; a visual description of the puzzle; an image of the puzzle; an interactive description of the puzzle; contents of the puzzle; and puzzle details. The puzzle may include at least one of: a crossword; a numerical puzzle; a word puzzle; a sudoku; a quiz; a puzzle state; a puzzle score; a list of puzzles; a password; and puzzle instructions. The puzzle may be printed periodically.
12.13 Music
Global sales of recorded music in 2003, in both video and audio formats, were valued at US$32 billion. In July 2004, Jupiter Research reported that US digital music sales for 2004 will more than double 2003 sales to an excess of more US$270 million. It will grow rapidly to US$1.7 billion in 2009, totalling 12% of US consumer spending on music. The consultancy BearingPoint has reported that, in Europe and other regions, ringtones are a billion dollar business and that ringtones, digital radio and games may provide the new
revenue streams that the US music industry is seeking. Until 2004, growth in the digital music market was held back by concerns about digital rights management - the protection of intellectual property. A variety of different proprietary standards currently exist. Rapid market growth has taken place in 2004 despite these concerns. In a September 2004 report titled Music Enabled Handsets- Next 3 G Device Focus, Strategy Analytics reports that digital music is the next 3G opportunity beyond still and video imaging, while total music-enabled device sales will scale to 54 percent of global handset sales in 2009. Nokia is developing relationships with Loudeye OD2 and Universal Music, and marketing specialist 3300 and 5510 handsets. Motorola is aggressively pursuing music-focused alliances with MTV and Apple. Both cases illustrate the importance that music content will play in the emerging music-enabled device market. Strategy Analytics also reports that: MP3, a file format without digital rights protection, will remain the dominant audio format in the mobile market because of its strengths in the wired broadband domain; and Mobile converged devices will account for 50% of music enabled device sales through 2006.
Wireless operators and major record companies including Sony Music, T-Mobile, Universal Music and Vodafone are all working on plans to make sure that the mobile phone will soon be as important a channel as the internet in the short term, and as traditional record stores in the long term.
Mobile music can be divided into three different content streams: Downloaded music; Streaming music; Interactive music content.
12.13.1 Downloaded Music
In Western Europe the legal music download market has taken off in 2004. The market is expected to be worth US$ 4.41 billion (EUR3.5 billion) a year by 2009. 2004 has marked the launch of new music download sites in Europe such as Apple's iTunes Music Store, Sony's Connect, and Napster. Currently, half of the online music consumers are between 16 and 24 years. However, Forrester Research reports that as online music services expand their offerings and become easier to use that they will also gain momentum with older consumers. Forrester Research forecasts that Britain, France and Germany will dominate the market, with over 60% of legal music downloads in Europe sold in these three countries in 2009. Spain and Italy will grow strongly to account for around 20% of the European market by 2009.
Apple reports that it sold five million tracks in Europe in the first 10 weeks after the launch of British French and German iTunes stores. The market leader, it has since expanded its coverage of Europe to 12 countries. Worldwide, it has sold over 150 million protected AAC-format tracks, mainly through its US website which opened in April 2003. Loudeye's OD2 division, 'On Demand Distribution', is Europe's leading music download distributor to retail partners. OD2 tracks are sold in Microsoft's WMA format with digital rights protection. OD2 has launched interactive music services with retail partners including MSN (in 6 European countries); Ninemsn (Australia); Tonlist (Iceland); NEC's Packard Bell 'Music Station' (France, Germany and the UK); the charity Oxfam in the UK; and Eircom in Ireland. The company is now working with Nokia to deliver services to Nokia handsets.
12.13.2 Streaming Music
Online radio stations, record companies and musicians websites all offer legal streaming music services to enhance the user experience and to promote their products. TJK digital media company, 7 Digital Media has designed and built a proprietary download engine to enable digital media distribution on behalf on record labels, broadcast, retail and brand partners. Their client base includes Universal, EMI, Warner Music, Sony
BMG, V2, Echo, Independiente, 02 and many others and they have distributed content via over 175 partner sites including AOL, MSN, Lycos, Freeserve, Yahoo!, NME and XFM. BMG Records and Atlantic Records use 7 Digital Media to manage single promotions and billing via SMS and credit/debit card for both the chart toppers. They provide:
Secure, global distribution of digital media.
Acceptance of payments via SMS, Credit Card, Debit Card and BT (UK PSTN) phone bill. Compatibility with most digital media formats.
Consumers of streaming audio usually use a generic media player such as RealPlayer, QuickTime or Windows Media Player to listen to their favourite online radio stations or to hear songs and tunes from other websites. Real Networks provides the RealPlayer for mobile devices using the Symbian, PALM and Pocket PC operating systems, including select Nokia handsets. Its key features include: Playback of RealAudio, RealVideo and 3GPP compliant content via streaming or download.
Seamless integration with RealPlayer for PC to drag and drop MP3 and RealAudio files to devices. Access to news, sports and entertainment updates.
Access to downloadable content including music videos, travel guidance, auto review and much more.
Microsoft is planning to make its media software available to chip and handset makers to enable more consumers to play music in the Windows Media format on their mobile phones. Motorola and NEC have Microsoft's media decoders integrated into their handsets for 3G mobile networks. In contrast, server-side Apple QuickTime technology is in use by operators such as Verizon Wireless, Sprint, NTT DoCoMo and KDDI. QuickTime manages media for photograph e-mailing and other data services.
12.13.3 Mobile Music Content Services
Nokia has developed a mobile file sharing network, adapting peer-to-peer (P2P) file sharing schemes used by internet users, that has been tested on their 6600 model handsets. The network can currently support image and text sharing. Developing the ability to share digital music is considered a priority. Pop stars such as
Anastacia, John Mayer and Madonna are all promoting mobile phones by providing special promotional offers that include, ringtones, MP3 and voicemail downloads, and SMS competitions. In the United States,
Preferred Voice (PVI), a personalisation services provider, is offering 'Rockin' Ringback', where users choose an audio file for callers to their phone to listen to while the phone is ringing. Selections can be
personalised for different callers, days and times. PVI hope that this will provide wireless carriers with a new way to increase average revenue per user and decrease churn. The service has been successfully deployed for 19 US carriers. The market opportunity for ringbacks is regarded as substantial. Korea's main mobile operator, SK Telecom has achieved more than 30% penetration in just 2 years.
.12. ,13.4 Print Opportunities
Consumers will be able to print Karaoke lyrics, playlists, cover art, related trading cards, gossip and news messages, and also competition information and entries.
12.13.5 Interactivity Opportunities
The ability to interact with playlists, cover art, related trading cards, gossip, news and competition entries will encourage consumer use of value added services.
Referring to Fig. 134, the printed Silver Angels Lyrics 1035 example demonstrates the following: Click on the 'Silver Angels' logo to visit the artists' website. Click on the 'MP3' link to download the song. Click on the 'email' link to send a fan email to the group. Ringtone and ringback options are also possible.
Referring to Fig. 135, the printed DigiRadio Top 10 card 1040 example shows how a user can listen to, and order, music using a printed menu of interactive links:
Click on the 'DigiRadio' logo to visit the web site.
Click on the 'Week 41 ' link to view the full chart.
Click on each of the 'listen' icons to listen to the music online.
Select the 'order' checkboxes of the singles that they want to purchase (this assumes that the format of the music has been pre-selected by the user). If the user has selected to purchase singles from the Top 10 list they can then select the completed checkbox and click on the SUBMIT button to send the order.
The printed audio information may be a permission token readable using the sensor module to at least one of: retrieve information associated with the audio information from the archive; receive audio via the mobile telecommunications device; receive an audio file; receive streaming audio; initiate payment for the audio information; initiate payment for audio associated with the audio information; select an audio channel; select an audio source; select a radio station; obtain a copy of the audio information; and gain access to a resource. Printing the audio information may cause information associated with the audio information to be archived. Information associated with the audio information includes one or more of: the audio information; a visual description of the audio information; a music chart; an image of the audio information; an interactive
description of the audio information; contents of the audio information; an audio clip; an audio stream; an audio track; recorded music; synthesized music; recorded voice; synthesized voice; a sound effect; an audio channel; an audio source; a radio station; and audio information details. The audio information may include at least one of: lyrics; words of a song; musical notes; a musical score; a song title; an album title; information about a song; a name of a musician; and information about a musician. The audio information may be associated with audio played on the mobile telecommunications device.
12.14 TV and Video
Mobile TV and video consists of three different content streams: Camera phone based video recording and publishing. Streaming TV broadcast services. TV-like interactive content.
12.14.1 Mobile Video
The worldwide value of consumer video subscription services delivered via the internet is forecast to exceed US$4.6 billion in 2008. The market is expanding to include more types of content, as well as extending to mobile phones. An LG A survey of 228 telecommunications experts at the ITU Telecom Asia 2004 event in Korea, indicated that the convergence of mobile handsets with other digital devices could have a major impact on the markets for both digital still cameras and video cameras. Convergence will eventually combine phone, camera, video camera, music and other features. 95% of respondents said that it was either very likely or somewhat likely (73% and 22% respectively) that consumers will eventually choose a single converged 3G device over multiple devices. Of these, 72% expect to see the transition within the next two years and 24% within 3-5 years. Of the functions available in new 3G handsets, respondents stated that video telephony (41%), TV/Video on demand (23%) and video or photo mailing (20%) were the most important. EarthCam Mobile, a wireless Java application with an online companion site enables people to view webcatns from around the world, including traffic and weather cams, on a mobile phone.
SK Telecom in Korea already offers on-demand video programming, and plans to offer 39 digital video channels delivered via satellite. NTT DoCoMo is in trials for streaming television broadcasts on its 3G FOMA networks. In the US, Sprint PCS launched a streaming video service earlier this month offering television content from stations such as CNN, NBC Universal, FOX Sports and The Weather Channel. A new MMS content service, FanTESStic, the UK's first MMS interactive soap opera broadcast, was launched in September 2004 by Endemol UK, the largest independent TV producer in Britain, together with Opera Telecom, a mobile services provider. FanTESStic consists of 80 comic strip-style episodes delivered over a 16-week period. Mobile users are charged US 90c per episode or US$2.72 for five episodes, with charges appearing on the user's monthly mobile phone bill. Openwave Systems is developing and providing customisable, personalised video messaging for 3G phones, such as personal, celebrity or game video greetings for different people. Users are expected to share popular video clips as MMS messages. Popular
applications of streaming video content are expected to be clips of sports highlights and music videos available on demand. Journalists and bloggers (web log users) are expected to use mobile phone video technology to cover news stories live from the scene.
12.14.2 Mobile TV Broadcast Services
Mobile TV provides a new channel for existing media players while, for mobile operators, it provides a value-enhanced service and increased revenue per user. The British Broadcasting Corporation believes that IP-based broadcasting, delivered via numerous access devices, will become increasingly important, and that convergence will increasingly separate content from delivery. Leading mobile phone manufacturers Motorola, NEC, Nokia, Siemens and Sony Ericsson are co-operating to develop mobile broadcast services. In 2003, NEC developed the world's first working prototype of a mobile phone capable of receiving terrestrial digital TV broadcasting. Mobile phone TV services are being introduced on the Japanese market while the European market for commercial mobile broadcast services is envisaged to start opening up towards the end of 2005. In the United States, MobiTV is a live TV streaming service for mobile phones developed by Idetic. MobiTV's service is currently available on some Sprint PCS Vision handset models.
12.14.3 Mobile Interactive TV
Interactive TV allows viewers to interact directly with TV broadcasts, to play games, or send messages. Currently, there are over 32 million digital television receivers in use in Europe, of which at least 25 million have interactive capability. The leading mobile interactive TV software and applications server company is Macromedia, which has licensed Macromedia Flash to most interactive television platform providers. Digeo, OpenTV and Motorola are embedding Macromedia Flash Player into their set top boxes. Macromedia also produce Flash Lite, a product for mass-market mobile phones, taking account of processing power, memory and network connectivity issues. Existing online Flash content can be repurposed for access by enabled mobile phones. Macromedia technology is embedded into all new NTT DoCoMo i-mode handsets. The first handsets became available in Japan in May 2003.
12.14.4 Print Opportunities
Printing of digital TV frames such as important sports events. Printing of TV schedules. Printing of interactive TV messages including ads, special offers, competition details and entries. Printing of MMS pay- per-view messages, news and gossip.
12.14.5 Interactivity Opportunities
Interactivity can help to promote the use of value-added services by promoting the use of interactive printed cards as collectables, subscription services and shortcuts to playbacks and MMS messaging.
Referring to Fig. 136, the printed Dtv Movie Channel Highlights 1045 demonstrates the following possibilities:
Click on the 'Dtv' logo to visit the service provider's website.
Click on each of the 'information' icons to visit each programs information web page. Click on the 'envelope' icon to send an email.
Referring to Fig. 137, the printed Dtv Weekly Soccer Review 1050 example shows the following: Click on the 'Dtv' logo to visit the service provider's website. Click on the 'play' icon to play the video. Click on the 'email' icon to send the video link to another person.
Click on the 'archives' icon to visit the video archives web page.
Referring to Fig. 138, the printed Who Wants To Be A Millionaire TV show 1055 example provides the user with the opportunity to participate in a Home Viewer Question competition by printing the entry form and then using the pen or pointer device to complete and submit their entry.
The printed video information may be a permission token readable using the sensor module to at least one of: retrieve information associated with the video information from the archive; receive video via the mobile telecommunications device; receive a video file; receive streaming video; initiate payment for the video information; initiate payment for video associated with the video information; select a video channel; select a video source; select a television channel; obtain a copy of the video information; and gain access to a resource. Printing the video information may cause information associated with the video information to be archived. Information associated with the video information may include one or more of: the video information; a visual description of the video information; a video clip; an image of the video information; an interactive description of the video information; contents of the video information; a video stream; a video track; a video channel; recorded video; synthesized video; an animation; a video effect; a video source; a television channel; a television station; and video information details. The video information may include at least one of: television program information; movie information; lyrics; words of a song; musical notes; a musical score; a song title; a movie title; a program title; information about a video; a name of a musician; a name of a producer; a name of a director; a name of an actor; and information about a person. The video information may be associated with video played on the mobile telecommunications device.
12.15 Location-Based Services
Location based services (LBSs) are those which combine an estimate of a mobile device's location or position with other information so as to provide added value to the user.
The estimate of location or position can be entered by a user, derived from a Global Positioning System
(GPS) receiver or, increasingly, ascertained from a mobile phone handset. Mobile phone handset positioning can be ascertained through a range of methods. The more precise methods usually involve handset
triangulation and signal timing checks with multiple base stations (such as Time Difference of Arrival, Angle of Arrival, or combinations of methods).
The US Department of Labor (DoL) recently cited geotechnology as one of the three technologies with the greatest growth and job-creation potential in the current decade, along with biotechnology and nanotechnology. The DoL estimates the current value of the geotechnology market at US$5 billion, and expects the market to grow to US$30 billion by 2005 (Wireless World Forum). There is a need for location- based services. It is important to package LBS functionality for an individual target market. LBS applications overlap handset-based applications and m-commerce applications.
12.15.1 Positioning and Navigation
The most commonly acknowledged application of location-based services is to enable a user to determine their immediate geographical location through a map or plan for the purposes of identification and navigation.
In 2003, almost 700,000 Global Positioning System modules were sold in Europe. Approximately 65% were bundled with a handheld computer, which indicates that they were sold as a navigation package. Until recently, handheld computers from Hewlett-Packard and PalmOne were the smallest devices with enough power to store maps of an entire country and calculate routes.
New model smartphones from Nokia, Siemens and Sony Ericsson are now capable of running LBS software applications. Germany's T-Mobile has started offering a free Nokia 6600 phone loaded with Route 66 navigation software to customers who purchase a subscription.
Since 2004, TomTom, a European in-car navigation system company, offered its navigation solutions on smartphones. The TomTom Mobile software is available on MMC cards, allowing for insert-to-use functionality rather than prior installation. TomTom Mobile includes 3D maps, spoken instructions, door-to- door directions using house numbers, storage of favourite routes and destinations, and added information about thousands of points of interest.
The Symbian application, Directions On The Go, designed for Nokia mobile phones, offers complete onboard device navigation, and does not require an operator carrier signal. The user simply selects major metropolitan areas or cities from a website and loads the selection onto an MMC card via a free card reader that ships with the product. Once the MMC card is added to the mobile phone, the user can then calculate and display turn-by-turn door-to-door directions right on the phone:
1. Enter a starting point;
2. Enter a destination;
3. Calculate directions on the mobile phone.
Directions On The Go has many useful features, including:
Immediate route calculation of door to door directions; Directions in text or graphically displayed on map; Pan, scroll and zoom features on maps; Location find by address, street name, tap on map, nearby point of interest or fuzzy logic;
Built-in points of interest; GPS support to locate and track current position.
In addition to these mainstream uses of positioning and navigation applications, other novel uses are possible. Informal groups exist, for example, with the purpose of visiting GPS 'waypoints' or 'confluence' points - latitude and longitude integer degree intersections. The Degree Confluence Project is attempting to visit each such intersection point in the world, and to photograph each location.
12.15.1.1 Print Constraints
The standard print size and design constraints apply. The interactivity of on-screen navigation has benefits that are not yet adequately duplicated by printing a large map or plan over multiple cards.
Referring to Fig. 139, a printout 1060 from a mobile phone can be useful in contexts like driving, where using a hands-on mobile phone is illegal. Mobile phone printouts are ideal when information will fit on one or two cards with high quality resolution - the same level or quality of detail may not fit on one or two . handset screens. For novel uses of location-based services, printing can provide a record of handset location that can be used as evidence of having visited a location.
12.15.1.2 Printing with Interactivity
The interactivity of on-screen navigation has benefits that are not yet adequately duplicated by printing a large map or plan over multiple cards. Interactive paper can be used to develop mini-guides that can be printed on demand, with clickable links to online and printable content.
Referring to Fig. 140, the printed Route Planner Map 1065 example demonstrates the following illustrative uses:
Click on the map to launch a GPS application. Click on the 'Route Planner' link to launch the GPS application.
Click on the 'Sydney Opera House' link to view the 'place of interest' information.
Click on the 'restaurant guide' icon to view a list of restaurants in the local area.
Click the 'P' parking icon to find out parking times and rates.
Click on the 'bus' icon to view bus timetable information in the local area.
The Route Map example has date and time information so that the GPS system can retrieve the correct information as requested by the user.
The Route Planner Traffic Report example demonstrates the following opportunities:
Click on the 'route planner' link to launch the GPS application.
Click on the 'Drummoyne' link to load a map of Drummoyne to determine an alternative route. Click on the 'Woolloomooloo' link to load a map of Wolloomooloo to determine an alternative route. Click the 'check for updates' link to retrieve the latest traffic report for the selected area.
The Route Planner Traffic Report example includes date and time information so that the GPS system can retrieve the correct information as requested by the user. The user may have selected to receive updates at a certain time of the day, such as when they leave the office. Consequently, the 'Check for Updates' link allows the user to request additional information as required.
A printed map may be a permission token readable using the sensor module to at least one of: retrieve information associated with the map from the archive; time stamp the map; generate a further map; and gain access to a resource. Printing the map may cause information associated with the map to be archived. The information associated with the map may include one or more of: the map; a visual description of the map; an image of the map; an interactive description of the map; contents of the map; and map details. The map may be of the vicinity of the mobile telecommunications device. Furthermore, the map may be of at least one of: a building; an area; roads; railways; waterways; a city; a country; and a region.
Likewise, a printed position may be a permission token readable using the sensor module to at least one of: retrieve information associated with the position from the archive; time stamp the position; generate a further position; print a map about the position; and gain access to a resource. Printing the position may cause information associated with the position to be archived. Information associated with the position may include one or more of: the position; a visual description of the position; an image of the position; an interactive description of the position; contents of the position; and position details. Furthermore, the position may be at least one of: a longitude; a latitude; a distance; a height; a relative location; a building; a street; a suburb; a town; a city; a state; and a country.
Similarly, the printed location-based information may be a permission token readable using the sensor module to at least one of: retrieve information associated with the location from the archive; time stamp the location-based information; generate further location-based information; print a map covering the location; and gain access to a resource. Printing the location-based information may cause information associated with the location-based information to be archived. Information associated with the location-based information may include one or more of: the location-based information; a visual description of the location-based information; an image of the location-based information; an interactive description of the location-based
information; features at the location-based information; and location-based information details. The location- based information may be at least one of: a building near the location; an address near the location; a particular type of premises near the location; and a restaurant near the location.
Still furthermore, the printed timetable may be a permission token readable using the sensor module to at least one of: retrieve information associated with the timetable from the archive; and gain access to a resource. Printing the timetable may cause information associated with the timetable to be archived. Information associated with the timetable may include one or more of: the timetable; a visual description of the timetable; an image of the timetable; an interactive description of the timetable; contents of the timetable; and timetable details. The timetable may be for at least one of: an educational institution; transportation; a bus; a train; a ferry; a boat; a flight; a tram; a cruise; a tour; and entertainment. Information in the timetable may be retrieved from a central server.
12.15.2 Information Applications
Geographic information systems can be the source or base for other forms of informative location based services, including:
Road traffic: best routes, alerts such as road closures
Public transport: station locations, timetables, pricing, buying tickets, alert on approach messages Weather reports: local or regional reports, surf and tide reports
Area guides: including restaurants, hotels, parking, museums, points of interest Find A Friend: instant messaging, dating Advertising: coupons, flyers etc.
12.15.2.1 Road Traffic Reporting
NTT DoCoMo launched the i-mode 'i-area' information services across Japan in July 2001. The service is location-based by dividing the county into 482 zones, each with local information. The ATIS Corporation provide users with 24-hour updates on traffic congestion, accidents and estimated travel times covering national highways and expressways.
TomTom Mobile has a traffic reporting service called TomTom Traffic, which users can subscribe to in France, Germany, the Netherlands and the UK. The service allows users to obtain an overview of traffic incidents in their area, likely delay times and alternative routes. It graphically represent incidents with icons on a map, has clear spoken instructions, and offers real time traffic alerts for the users route or area. It also contains an itinerary planner.
12.15.2.2 Public Transport
Train timetable information is available to UK subscribers to Hutchison's 3 mobile network. The 'MyTrains' service allows customers to access rail information by clicking on the 'travel' icon in the handset's services menu. After the initial setup, information is stored and retrieved as required. The service enables customers to access train timetables and the very latest real time arrival and departure information easily and conveniently.
12.15.2.3 Area Guides
Maps are not provided solely for road navigation, they are also designed for tourist and leisure interest. Such maps enable users to find services like restaurants, theatres and historic sites. While most LBS software and online services come with preloaded points of interest, some like the TomTom Mobile system allow the user to add their own.
12.15.2.4 Tourist and leisure guides can link to websites, phone numbers, and email addresses
There is potential for LBS based mobile tourist guides, with editorial content such as restaurant reviews and promotional content such as coupons and vouchers DoCoMo launched this type of service for i-mode in 2001, including an 'i-area' restaurant guide and hotel information.
12.15.2.5 Utility Guides
Geographic information systems record information on a wide range of physical features and human activities. This increasingly includes the location of sewerage, electricity, telecommunications and other utilities. With forecast improvements to memory and storage capacity, mobile handsets might begin to access this data for use during surveying and construction projects.
12.15.2.6 Social Enablers
It is predicted that 'dating on the go' will leverage LBS technology to promote dating services will allow users to enjoy more enhanced localised dating experiences, where people can find a venue for a date using their mobile phone.
12.15.2.7 Advertising
Businesses could use LBS to deliver promotional material to consenting consumers in their local area. Examples of location based services might include:
Find the closest Italian restaurant and the business sends the user a discount coupon;
Find the closest hotel and the business sends the user a special offer;
Find the closest hairdresser and the business sends the user a free hair mask voucher.
Consumers who might not wish to subscribe to push services might well seek to pull relevant information when they request it.
12.15.2.8 Print Constraints
The interactivity of on-screen navigation has benefits that are not adequately duplicated by printing a large map or street plan over multiple cards.
12.15.2.9 Print Opportunities
Printing opportunities include:
Printing of quick reference guides and information on destinations, rather than on-route directions.
Printing of data 'pulled' or 'pushed' to the handset based on user location and requests for services or information. Printing in advance for situations where the use of mobile handsets is illegal (such as while driving).
Printing utility and other construction data for use in hazardous situations, such as construction work, where there is potential for loss or damage to a mobile handset.
Printing of real-time data including traffic reports, public transport timetables, weather reports, surf and tidal information. Printing of tourist and leisure guides, including places of interest reviews, guides and general information.
Printing of photographs as proof of time and location such as for archaeological discoveries other notable events.
12.15.2.10 Printing with Interactivity
Interactivity opportunities include:
Interactivity changes printing from a passive click, print and read action to one where users can interact with companies and organizations presented in a guide. Click to call a service provider directly.
Referring to Fig. 141, a printed Restaurant Opera 1070 example demonstrates a number of ways to interact with a service provider:
Read a review. Click the phone number to call the service provider.
Click on the 'reserve' link to make a reservation.
Click on the 'menu' link to view available menu options.
Click on the website link to visit the service provider's main website.
Referring to Fig. 142, the printed Route Planner "Destination" 1075 example shows how a user can add notes and information from an address book or CRM application into a route planning application. The user is provided with the opportunity to use the pen or pointer device to display the map from the printed record that has been added to the GPS software application. This feature enables business people, including tradespeople and real estate agents, to keep additional information about their customers on their mobile phone handsets, which they can access in a timely and efficient manner. Alternatively, the printed cards can be printed as required as a quick reference before visiting a customer.
12.16 Lifestyle Services
12.16.1 Membership Subscription Services
A push application can be defined as any digital content that is sent to a consumer as a result of a subscription. Push application content can be broadly categorized as belonging to several different groups, including: News and mass media, including current affairs news, breaking news and sports news; Global and regional economic, market and industry information; and Specialized niche market information.
Most digital content that is sent to subscribers is in the form of email newsletters. An increasing number of mobile operators, including Japanese DoCoMo and European operators Vodafone and 02, provide news and business information subscription information in the form of text alerts. Many push application services are fee-based, whereby users pay a monthly or annual subscription fee.
Some push services are provided on a complimentary basis to consumers, often because push content providers find it profitable to sell email newsletter advertising space to other businesses. For consumers, this can become a disadvantage: relevant digital content is accompanied by significant advertising content. In recent years, the sale of email address lists, an increase in spam, and overflowing email inboxes has also made many lists far less attractive.
Consumers want push application services to provide quality rather than quantity: Current, concise information; In a timely and efficient manner; Relevant to their information requirements. It is envisaged that the delivery of digital content from personalized push applications can be based on individual user-defined preferences. Consumers will be able to subscribe to digital content services that should provide them with the ability to:
Choose the news, magazine and journal sources; Define topics of interest;
Define keywords within topics of interest; Choose the receive abstract or full article;
Choose to select information that includes digital media content or text only; Select the delivery: frequency, time and method of delivery; Change their preferences at any time.
Consumers will increasingly be afforded the opportunity to exercise more control over the type of digital content they receive. For example, a consumer may seek information on 'movies' from the '1950s' that starred 'Gene Kelly'. When the consumer has received sufficient relevant information, they may choose to change their preferences or unsubscribe from the service. As push application service providers implement new delivery systems in order to provide consumers with their preferred digital content, they are also using additional digital communications channels, such as SMS and MMS. Trends in consumers' digital content requirements mean that more and more businesses are choosing to send SMS messages to consumers that contain only the specific information that the consumer has requested.
Printing provides a familiar way of sharing subscription information, whether this includes breaking news or niche data. Push subscriptions can be designed to integrate with print applications, such as calendars. Daily appointments diaries or task lists can be combined with daily subscription content, including photographic art, impressionist or other art, daily quotes, jokes, cartoons or thoughts.
Interactive paper allows subscribers to interact with printed content to generate additional on-screen and printable content. Subscribers can follow printed links, and share paper copies of reports and material with friends and colleagues.
Referring to Fig. 143, the printed News4U example demonstrates printing of a news item 1080 including the following possible interactions:
Click on the 'Art & Design' logo to visit the Art & Design main web page. Click on the 'NEWS4U' logo to visit the web site. Click on the underlined text 'David' to view a photo of the painting.
Referring to Fig. 144, the printed Today in Television 1085 example demonstrates the following interactive possibilities:
Click on the 'TV logo to visit the web site. Click on the 'TodaysHistory.com' link to visit the web site. Click on the 'Today in Television' link to view the top shows for the day.
Click on each of the 'year' links to view additional information about each listed program.
The printed subscription may a permission token readable using the sensor module to at least one of: retrieve information associated with the subscription from the archive; verify payment of the subscription; initiate payment of the subscription; and gain access to a resource. Printing the subscription may cause information associated with the subscription to be archived. Information associated with the subscription may include one or more of: the subscription; a visual description of the subscription; an image of the subscription; an interactive description of the subscription; contents of the subscription; delivery of the subject of the subscription; renewal of the subscription; and subscription details. The subscription may be for at least one of: magazines; books; medical items; wine; goods; and newspapers. The subscription may include at least
one of: a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
12.16.2 Greetings and Gift Cards
Greetings cards can be segmented according to occasion, for example:
Religious or seasonal holidays, such as Christmas, Easter, Passover and Eid; Annual events, like Valentine's Day, Mother's Day, Father's Day;
Everyday events, like birthdays, new babies, wedding anniversaries, congratulations, good luck, get well and thank you cards.
The UK greetings card industry is worth over US$2.17 billion annually, according to Mintel, making it the most successful such industry in the world. Market reports puts the average number of cards sent at 55 per person per year, more than one a week. In the United States, 90% of households buy greeting cards, purchasing an average 35 cards a year. Approximately 7 billion greeting cards are purchased annually, generating more than US$7.5 billion in retail sales. According to a recent study for the US Greeting Card Association, 64% of Americans still prefer traditional methods of personal communication, such as sending and receiving paper and ink greetings cards. Although people rely on a variety of ways to stay connected, when it comes to a special touch, items such as greetings cards are valued and tangible in a way that purely digital content is not. In 2003, the Greeting Card Association of Canada reported that electronic greetings cards, or e-cards, have had only a nominal effect, capturing only around 1 or 2 percent of the market.
Jupiter Research states that paid e-cards represent around 0.7% of the US market with 20% annual growth.
Statistics for usage of free e-cards appear unavailable, while some providers — like BlueMountain.com — use an annual subscription model, rather than pay per card. E-card site users skew heavily female, and toward relatively high income and education levels that reflect high-speed Internet access and a degree of comfort with sending and receiving online cards. Growth rates and demographics for e-cards are viewed favourably, and the market may develop, with publishers like Hallmark able to rapidly introduce new themes, as well as enabling personalised greetings cards' with consumer input.
12.16.2.1 Personalization Software
Software to customize, or personalize, greetings cards may be pre-installed, installed directly over the air, or installed from another device such as a computer. Templates can be designed using a computer, downloaded, or sent via MMS. To design a greeting card a user may be required to:
1. Click the greeting card icon from the phone menu
2. Select a template to modify
3. Edit text
4. Add any other special effects or images 5. Save the greetings card.
12.16.2.2 Print Opportunities
Card designers and manufacturers should benefit from shorter time to market, and a better match between supply and demand. Consumers will be able to design and print greetings and gift cards on demand. Design and personalisation software can be purchased and installed on the mobile phone. Personalisation can create a
'designer' look by adding photographs, special effects and personalized language and prose at a low cost.
Mobile phone users may send e-cards for a recipient to print at their convenience. The medium is better suited to spontaneous events and experiences rather than the main annual events. Design templates could take advantage of this, being targeted to the 'congratulations on your achievement', 'cheer up', or 'get well soon' experiences where immediacy is an advantage.
12.16.2.3 Interactivity Opportunities
Interactivity may assist in generating demand for value added services by facilitating responses by card recipients, including 'thank you' cards and MMS messages.
Referring to Fig. 145, the printed Christmas & New Year card 1190 example shows how a card recipient can click a logo to send a reply: Click on the 'SendaCard' logo to visit the web site to send a card.
The printed greeting card may be a permission token readable using the sensor module to retrieve information associated with the greeting card, the information including at least one of: a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details. Printing the greeting card may cause information associated with the greeting card to be archived. Information associated with the greeting card may include one or more of: the greeting card; a visual description of the greeting card; an image of the greeting card; an interactive description of the greeting card; contents of the greeting card; and greeting card details. The greeting card may include at least one of: a message; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details printed on the print medium. The greeting card may be printed periodically by the mobile communications device.
12.16.3 Education
A wide range of institutions and trainers can provide digital educational content: Primary and secondary education;
Higher educational institutions such as colleges and universities, including trade and vocational colleges;
Business soft skills such as time management and presentation skills; Computer and IT related courses; Personal self-development and recreational courses such as first aid and pre-natal courses.
Developments in distance learning and web-based delivery methods mean that classrooms are evolving beyond the traditional learning environment, and institutions are spreading beyond their campuses. CNN have reported that "although brick and mortar institutions still dominate the educational landscape, a new form of schooling - called online or e-learning - has skyrocketed in popularity in recent years" Eduventures, predict that the US online distance learning market will grow by more than 38% in 2004, taking US$5.1 billion in revenue". In higher education, CNN report that "90 percent of four-year public schools and more than half of four-year private schools offer some form of online education, according to the United States Distance Learning Association". Primary and secondary institutions also offer online content. The Organisation for Economic Co-operation and Development (OECD, 2004) define the different types of Online learning' or 'e-learning' as:
Web supplemented - including course outlines and lecture notes online, use of email and links to external online resources.
Web dependent - where students are required to use the internet for key 'active' elements of a program, such as online discussions, assessment, online project/collaborative work.
Mixed mode — where students are required to participate in online activities, such as online discussions and assessment that replace face-to-face classroom learning.
Fully online.
Educational institutions, businesses and students alike could use printed content for:
Examination and course information;
Class timetables and re-scheduling events;
Newsletters;
Online forum participation; Submission of 'Blogs' (web logs — an instant publishing application);
Requests for information;
Examination results.
The internet is an important channel for the dissemination and distribution of digital education content, including: Flashcards; Tutorials; Quizzes, games and tests; Presentations; Video and audio; and Reference sources. Digital educational content can be obtained in two ways: Downloaded from the internet, or Electronically sent to a person from an educational institution or business. Browser-enabled mobile phones provide users with the ability to receive educational content on their handsets and download content from the web.
12.16.3.1 Print Opportunities
The initial paper size is likely to be well suited for the printing of flash cards, exercise and tests in, for example, learning a language. The format can also suit the dissemination of scheduling information, examination results and other administrative materials.
12.16.3.2 Interactivity Opportunities
A user can click a question to download a printable answer or explanation, or view the response on-screen.
Referring to Fig. 146, the printed HDU University Assignment 1095 example demonstrates the following interactive possibilities:
Click on the 'HDU University' logo to visit the university website. Click on the 'assignment' link to view additional information about the assignment. Click on the 'submit' link to send the assignment.
Click on the email address link to send an email about the assignment. Click on the web site link to visit the assignment web page.
Referring to Fig. 147, the printed HDU University Flash Card 1100 example demonstrates the following interactive uses:
Click on the 'HDU University' logo to visit the web site.
Click on the 'Course: HYP621' link to view additional course information.
Click on the 'IDEAL GAS LAW link to view additional information on the topic.
Referring to Fig. 148, the printed HDU University Spanish Flashcard 1105 example demonstrates how a user can:
Click on the 'HDU Universidad' logo to visit the university's Spanish school website. Click on the 'get clue' link to download or print a clue to the meaning of the Spanish text. Click on the 'get answer' link to view the correct answer.
The printed educational material may be a permission token readable using the sensor module to at least one of: retrieve information associated with the educational material from the archive; and gain access to a resource. Printing the educational material may cause information associated with the educational material to be archived. Information associated with the educational material may include one or more of: the educational material; a visual description of the educational material; an image of the educational material; an interactive description of the educational material; contents of the educational material; and educational material details. The educational material may be at least one of: classroom material; lecture notes; a test; test results; instructions; a lesson plan; a tutorial; and homework. The educational material may be printed periodically.
12.16.4 Trading Cards
Collecting product or collectable trading cards began as a by-product of product advertising. Trading cards are divided into two broad categories: Sports and Collectables. In the United States alone there are an estimated 60 million sports fans, of which 3 million are sports collectors. Sports' collecting is the most
actively traded item on the internet. Over US$5 billion in sports items is traded annually and trading cards are the top performer. Collectable trading cards are an integral part of many products' merchandising, positioned alongside toys, comics, movies and television. Collectable trading cards include products such as Pokemon, Buffy the Vampire Slayer, Teenage Ninja Turtles, Twilight Zone and Harry Potter. Trading cards are distributed through newsagents, supermarkets, toy stores, department stores, mail order catalogues, over the web and through trading card clubs.
The collector's main objective is to collect a complete set of cards. A complete set may include between 150 and 250 cards. A small percentage of trading cards are sold as boxed sets; however, most are sold as individual packets of cards that include between say 5 and 7 cards. Individual packets of cards typically include regular cards and perhaps a 'chaser card'; chaser cards are harder to find and are therefore more valuable. Collectors unavoidably end up with duplicate cards because, even though individual packets do not contain duplicates, there may be duplication between packets. Some collectors trade their duplicate or unwanted cards over the web, through exchanges or auction sites such as EBay. Over the past several years, this new secondary market has become an important part of increasing the traditional sales of trading cards. To extend revenue from boxed trading card sets, manufacturers and games producers have released trading card games. The main advantage is that new cards are periodically released to add new players or features. These are purchased as individual packets.
The existing trading card sales and distribution network has created the following problems for consumers:
Not being able to buy cards at their convenience, as the reseller may not be local.
Complicated ordering and purchasing processes when using mail order catalogues or the internet.
Lengthy waiting periods for the delivery of purchased cards. All cards not bought directly from an outlet are sent by mail. No guarantee of delivery.
The authenticity of purchased cards, as many cards sold are counterfeit.
When problems arise with the contents of a delivery, such as missing or incorrect cards, the return mail costs are normally paid by the consumer.
When cards are not thought to be authentic, the consumer may pay to send card to an authentication dealer for evaluation.
Financial loss as a result of having purchased counterfeit cards.
12.16.4.1 Print Opportunities
Most distribution problems are due to counterfeit and delivery issues. Mobile phone printing will eliminate many of these issues. The delivery system is simplified because the consumer is able to print authentic cards immediately after purchase, delivered directly to a handset. Mobile phone printing of trading cards makes the purchasing process more dynamic and instantaneous for consumers. Manufacturers and resellers benefit from reduced print costs and shipping costs. Manufacturers can better match supply and demand, and reduce time- to-market lifecycles. The randomness of packet distribution and chaser cards can be replicated in online
systems. A user could receive an unseen, set number of cards per transaction, including both regular and chaser cards. As with current distribution methods, consumers can be expected to trade their surplus cards in pursuit of those they seek. New market opportunities for trading cards may arise as the mobile phone printing and distribution method will make smaller scale, niche markets more cost effective.
It is envisaged that mail order and web purchases will function differently using mobile phone printing. To purchase over the web or over the air:
1. Select the cards to order.
2. Pay for the cards using the shopping cart. 3. Select the 'mobile phone delivery' shipping option.
4. Enter the mobile phone number (for web-based delivery).
5. Select the 'confirm order' option, to complete the purchase. To purchase by mail order:
1. Using product information from an advert or catalogue, select the cards to order. Each card is identified with a unique product code.
2. SMS the unique product codes of the cards to the relevant sales phone number.
3. Check the order details, for example, that the correct cards are displayed on screen.
4. Select the 'confirm order' option to complete the purchase. '
The purchased trading cards are automatically debited to the consumer's mobile phone credit card or bank account, depending on stored payment details. After purchase, the consumer receives the cards on their mobile phone as an MMS message.
12.16.4.2 Interactivity Opportunities
Interactivity can help to eliminate the issue of card counterfeiting by providing a simple method of authenticating a valid trading card. Clicking a card could enable a simple database check to ensure that a card is genuine.
Referring to Fig. 149, the printed Soccer Collectibles card 1110 example demonstrates the following interactive uses:
Click on the 'web site' link to visit the web site. Click anywhere to check the authenticity of the card.
Referring to Fig. 150, the printed Art History card 1115 example demonstrates similar uses: Click on the 'infoART' logo to visit the web site. Click on the 'Cezanne, Paul' link to visit the painter's web site. Click anywhere to determine the authenticity of the card.
The printed trading card may be a permission token readable using the sensor module to retrieve information associated with the trading card, the information including at least one of: trading card authenticity; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details. Printing the trading card may cause information associated with the trading card to be archived. Information associated with the trading card may include one or more of: the trading card; a visual description of the trading card; an image of the trading card; an interactive description of the trading card; contents of the trading card; and trading card details. The trading card may include at least one of: a message; an image; a photograph; a personality; a sportsperson; a sports personality; a television personality; an actor; a movie star; a cartoon character; a celebrity; a musician; a rock star; a product; a quotation; a cartoon strip; a graphic design; and a character printed on the print medium. The trading card may be printed periodically by the mobile communications device.
12.16.5 Health and Beauty
Printing from print-enabled mobile phones provides consumers with a range of print opportunities.
12.16.5.1 Mobile Health
Health and fitness concerns are high on the agenda in most developed economies. In the US, the weight control products and services market is worth US$15.2 billion in 2004, and are estimated to grow 6.7% annually to 2008. Health and fitness systems are focused on a combination of planning and journaling a user's calorie intake and exercise program. Consumers can use these systems online or offline from their mobile phone handsets. Operators such as Vodafone predict that a new wave of technology will see more mobile phones being used to monitor vital body signals such as heart rate, stress levels and blood pressure. This is likely to be integrated with applications to utilise the data, and increase the usage of such facilities.
Current medical trials already include the use of mobile phones by UK hospitals to record information from diabetic patients, enabling rapid analysis and advice.
12.16.5.2 Online Health & Fitness Services
Websites either offer online calculators for free, pay-per-use or periodic site membership. Most applications require that a consumer enters their information online and then receives the results online. The different types of online calculators include: Calories burned; BMI (Body Mass Index); Food calories and nutritional values; A combination of the above factors.
12.16.5.3 Offline Health & Fitness Services
Offline health and fitness applications are available for mobile devices, including Fitness Coach, and Weight- By-Date. Fitness Coach for Nokia 5140 is a fitness planner and journal that tracks fitness progress as the user
progresses though a fitness program and records data such a heart rate. The user can then save this information, wirelessly transfer it to a PC, or send it to a coach or trainer for assessment.
Weight-By-Date Mobile is a PDA software solution for measuring the results of diet and exercise. Features include: Journals for exercise and calories burned; Exercise plans; Track body measurement changes; Track nutritional intake; Create recipes; Record weight loss; View and print colourful progress charts; Calculate body fat percentage.
12.16.5.4 Beauty
The beauty industry is generally divided into four categories (The Economist, 2003): Skincare: Goldman Sachs estimates that this has a global value of US$24 billion; Haircare: US$18 billion; Cosmetics: US$38 billion; Perfume: US$15 billion. The sector is growing at up to 7% a year; more than twice the rate of the developed world's GDP. L'Oreal, the sector's market leader, has recorded annual compound profit growth of 14% for the past 13 years. Growth in this sector is being driven by increased discretionary incomes among ageing populations in the West, and by the growing incomes of people in developing countries. China, Russia and South Korea have become important markets. In India, the sales of anti-aging products are growing by 40% a year.
12.16.5.5 Offline Beauty Services
Virtual makeover software programs are one of the most popular offline beauty applications. Virtual makeovers allow consumers to try out new hairstyles, make up and accessories using their own photographs, in order to experiment with their overall appearance. Cosmopolitan's Virtual Makeover is a popular PC application that has sold over one million copies. The program allows the user to experiment with a large variety of hairstyles, makeup and accessories; and to then print, save and email their favourites. A common issue experienced by users of virtual makeovers is getting a photo of themselves into digital format. Accessing online services from browsers on camera phones, or emailing photographs from camera phones, can help to resolve this problem.
12.16.5.6 Online Beauty Services
Tens of thousands of websites offer beauty advice and instructions. Beauty advice can range from 'how to put on makeup' to 'how make your own facial mask from common kitchen products'. Many beauty advice websites are related to a beauty product or brand such as L'Oreal, or a magazine such as Cosmopolitan. The L'Oreal Beauty Club (Australia) is a free subscription newsletter. Consumers can sign up for the newsletter at the L'Oreal website, registering their details and answering questions about L'Oreal products. The newsletter: Informs readers of new L'Oreal products; Informs readers of makeup, beauty and hairstyling techniques and trends; Advertises special offers and provides coupons; Offers competitions to win L'Oreal products.
12.16.5.7 Print Opportunities
Mobile phone health and beauty content services can consist of preloaded or downloaded software applications; online informational content; and subscription based content. Printed health and fitness results can act as an incentive for many consumers, offering a visual reminder of successes (and failures) to keep on- target and help track performance. Camera phones are ideal for obtaining digital images for virtual makeover applications. Printing 'virtual makeover' looks means that different looks can be compared - not necessarily possible on handset screens. Makeover looks can be taken to the hairdresser or beautician to have the makeover performed. They can also be taken to a store to assist in selecting the right products to buy.
1216.5.8 Interactivity Opportunities
Interactivity should encourage the use of new value added interactive services: selecting a colour swatch for hair colours; selecting clothing clothing; downloading and printing recipes; selecting a complementary wine.
Referring to Fig. 151, the printed Virtual Makeover 1120 example enables the user to: Click on the 'TheNewYou.com' logo to visit the website. Click on the 'new look' link to visit the virtual makeover web page.
Referring to Fig. 152, the printed Daily Diet Report 1125 example demonstrates the following: Click on the 'Healthy Eating' logo to launch the software application.
Click on the 'total calories' link to view the full reports. Click the 'wine' text to select an appropriate wine.
The printed health report may be a permission token readable using the sensor module to at least one of: retrieve information associated with the health report from the archive; initiate payment for the health report; transmit the health report to a health professional; obtain a copy of the health report; and gain access to a resource. Printing the health report may cause information associated with the health report to be archived.
Information associated with the health report may include one or more of: the health report; a visual description of the health report; an image of the health report; an interactive description of the health report; contents of the health report; and health report details. The health report may include at least one of: medical information; fitness information; cosmetic information; allergy information; genetic information; drug information; medicinal information; medicine information; and mental information. The health report may include at least one of: weight; height; body mass index (BMI); age; blood type; gender; a name; an address; a telephone number; a facsimile number; an e-mail address; a web address; a photograph; and contact details.
12.16.6 Dating Services
Online dating services have become an accepted part of single life for people of all ages, backgrounds and interests. In May 2003, more than 45 million people accessed online dating sites in the US. In the UK, 3.5 million people are accessing online dating services a month. In the US, spending on personals and dating has enjoyed steady growth since early 2001. In 2003, it was the largest paid content category with consumers spending US$449.5 million, ahead of Business/Investment and Entertainment/Lifestyles spending. As with book buying and auctioning used toys, the web has reduced the costs of engaging with romantic prospects and provided a new channel to exchange personal information, including: Pictures; Text, including email and chat or instant messaging; Video clips. The success of online dating services reflects the significance of the internet in many people's daily lives. It especially appeals to time-poor, young, urban professionals who want to meet new people outside of their social circle.
Furthermore, growth in online dating is underpinned by social factors such as a growing acceptance of being single, delayed marriage, having children later in life, rising divorce rates and increasing acceptance of the medium. Match.com has been a global leader in online dating services for the past few years, with a global membership and 27 localised dating sites in 18 local languages. Match.com members can see and read about their most likely matches, based upon criteria that they can specify, and can elect to contact or reply to messages from members, as they prefer. The Personals division of Yahoo is a major player in the online dating services market. In December 2003, Yahoo Personals was the second most popular such site with 4.1 million visitors, up 28% from December 2002. Together with smaller, and special interest sites such as
"GothicMatch.com", the sector generated more than $400 million in 2004. Most of the large dating websites, including Yahoo and Match.com, allow users to browse member profiles and post a profile for free. Paid subscription membership is required to contact other members. Instant Messaging capabilities, together with audio and video, transform static profiles and email into actual real time conversations and experiences.
12.16.6.1 Mobile Dating Services
A growing number of dating services offer SMS communication services. Lavalife Mobile is a service where users can search profiles and exchange text messages from mobile phones either via SMS or WAP. Users register by sending an SMS to Lavalife, and they can then create a profile online via a computer, SMS or a
2.5G service. Depending on the user's location, the service costs around US$0.50 per message sent or received. Online dating service providers believe that mobile technologies, such as location-based applications, camera phones and the use of video, will drive future growth. MMS messaging and video clips are expected to become a mainstream part of mobile phone dating services.
12.16.6.2 Print Opportunities
The initial paper size provides a handy wallet- or purse-sized photograph or photo/text combination. Printing from print-enabled mobile phones provides opportunities for printing photos, profiles and information about
an online friend. Printing of membership cards, invitations and tickets for offline events, date cards and reminders. Printing special emails or IM sessions for sentimental value. Printing of coupons and offers from the dating service and related partners.
12.16.6.3 Interactivity Opportunities
The initial paper size provides an interactive wallet- or purse-sized photograph or photo/text combination. Printing from print-enabled mobile phones provides opportunities to interact with data and easily use a variety of communications modes.
Referring to Fig. 153, the printed dateSpace Profile 1130 example enables a user to: Click on the 'IM' link to send an instant message. Click on the 'email' link to send an email. Click on the 'hotlist' link to add the profile to a personal hotlist. Click on the 'info' link to view additional information about the profiled person.
Referring to Fig. 154, the printed dateSpace Invitation 1135 example demonstrates an interactive event invitation:
Click on the 'spring ball' link to view the dateSpace Spring Ball web page. Click on the 'RSVP' link to send an email confirmation.
The printed dating information may be a permission token readable using the sensor module to at least one of: retrieve information associated with the dating information from the archive; retrieve personal information about a date; retrieve personal information about a potential date; accept a date; reject a date; initiate payment for the dating information; transmit the dating information to a dating services professional; obtain a copy of the dating information; and gain access to a resource. Printing the dating information may cause information associated with the dating information to be archived. Information associated with the dating information may include one or more of: the dating information; a visual description of the dating information; an image of the dating information; an interactive description of the dating information; contents of the dating information; and dating information details. The dating information may include at least one of: personal interests; musical interests; sporting interests; political interests; movie interests; leisure interests; professional interests; food preferences; personality preferences; physical appearance preferences; and sexual preferences. The dating information may include at least one of: weight; height; body mass index (BMI); age; eye color; hair color; ethnicity; gender; a name; an address; a telephone number; a facsimile number; an e- mail address; a web address; a photograph; and contact details.