WO2004095316A1

WO2004095316A1 - Initiating data communication by capturing image

Info

Publication number: WO2004095316A1
Application number: PCT/IB2004/050496
Authority: WO
Inventors: Gerhardus E. Mekenkamp
Original assignee: Koninklijke Philips Electronics N.V.
Priority date: 2003-04-24
Filing date: 2004-04-23
Publication date: 2004-11-04

Abstract

A method is provided of enabling to initiate data communication via a data network. The method comprises enabling to capture an image for being converted into data for use as an address on a network. The image comprises, e.g., a mosaic of cells in a two-dimensional array, or a figurative component such as a trademark or service mark.

Description

Initiating data communication by capturing image

FIELD OF THE INVENTION

The invention relates to a method of enabling to initiate communication with a data network. The invention further relates to a device for communication with the network

BACKGROUND ART Cell phones are being marketed that allow users to obtain information via data services such as WAP or I-mode. WAP stands for "wireless application protocol" and refers to a global standard for Internet services over mobile phone networks. A WAP cell phone is capable of displaying special web pages that can be used for electronic banking, purchasing via the Internet, receiving news updates, etc. The term "i-mode" stands for "information mode" and refers to an Internet phone marketed in Japan and providing email services and limited browsing.

Devices such as mobile phones currently come equipped with camera chips as a standard feature. Market reports estimate that in 2002 about 20 million (20M) so-called "camera phones" were sold worldwide. The embedded digital camera enables to instantly share a snapshot with a remote party. A similar trend of designed- in camera chips has appeared in the PDA market. Solid-state cameras thus have become a commodity in the consumer electronics (CE) environment, i.e., the mass market.

SUMMARY OF THE INVENTION The inventor proposes to use a camera chip embedded in a personal electronics device as an interface to a service on a network. A dedicated graphics pattern is made accessible, e.g., on a poster or a sign, or as printed in a booklet or magazine, or dynamically composed using individually addressable pixels as on an LCD monitor. The camera of the device is used to capture the graphics pattern. The pattern gets decoded and translated, using special circuitry, into an address such as a URL of a site on the network, e.g., in order to download information via the network on the device, or to initiate another network transaction. An advantage of this invention is that the user of the device does not have to manually enter the address of the site to which he/she is to be connected. Another advantage is that the camera enables remote sensing of the pattern. Another advantage is that the user does not need to set up a wired or wireless connection, as initiating the connection is done in a specific operational mode of the device upon capturing the pattern.

The graphics pattern is, for example, a two-dimensional mosaic of cells within an area that differ in reflectivity (e.g., black-white) or that have different colors or gray scales. The pattern uses a predetermined syntax so as to be able to fully exploit the data storage and data communication capabilities initiated by capturing the pattern with a (low- cost) digital camera.

Alternatively, the pattern is a figurative image, e.g., a company logo or service logo, or is a word such as the name of a city, town or other locale, a name of a company or service or a brief text. Accordingly, the image is dual- or triple-purpose. First, it advertises the presence of the service or company. Second, the semantics are clearly visible and understandable to the user. Third, upon the device having translated the image into an address, the user is enabled to contact the relevant party or service through pointing the device at the image. More specifically, the invention relates to an electronic device with a digital camera for capturing an image and converter circuitry for converting the captured image into data for use as an address on a network. Preferably, the device is a handheld device so as to facilitate capturing the pattern. An embodiment of the device comprises communication circuitry for data communication with the network under control of the address. In this manner, upon switching the device in a specific operational mode, the capturing of the pattern automatically initiates the procedure to communicate with the entity represented by the address. Preferably, the device has multiple operational modes, one of which being the mode for capturing the pattern and converting it into a network address. Having available multiple operational modes enables the user to selectively disable the address conversion, which is unnecessary when, e.g., the camera is being used to just take a snapshot of the environment and send the snapshot from the device to a friend via email. In another embodiment of the device, the address acquired through capturing the pattern is stored in a memory in the device for later use. For example, a TV broadcast (movie, commercial, documentary, etc.) is accompanied by a graphics pattern rendered on the screen of the TV display monitor. The device, e.g., a touch screen remote control such as the PRONTO of Philips Electronics and equipped with a camera chip, is used to capture the pattern that represents a URL on the Internet from which the user can download additional information about the broadcast. The pattern is captured and the address encoded therein is used later to access the relevant web site. For completeness: 2-dimensional bar codes are widely used, examples of which are known in the field as: Aztec code, Code 49, Matrix code, SuperCode, QR (Quick Response) code, Ultracode, and hueCode. Examples of fields of application of these codes are: labeling items for database, tracking, sorting and identification purposes, storing of text on medical cards or business cards, storing of pictograms such as Japanese Kanji and Kana characters. Depending on the type of code, codes are read using, e.g., CCD scanners or CCD video camera's, moving-beam laser scanners. For a nice overview see, e.g., "2-dimensional Bar Code Page" by Russ Adams of Adams Communications at www.adamsl.com/pub/russadam/stack.html. For a detailed description of a hueCode see, e.g., US patent 5,369,261 issued to Shamir and incorporated herein by reference.

BRIEF DESCRIPTION OF THE DRAWING

The invention is explained in further detail, by way of example and with reference to the accompanying drawing wherein: Fig. 1 is a block diagram of a system in the invention; and

Fig. 2 is a diagram of a process in the invention.

Throughout the figures, same reference numerals indicate similar or corresponding features.

DETAILED EMBODIMENTS

Fig. 1 is a block diagram of a system 100 in the invention. System 100 comprises a handheld device 102, e.g., a WAP cell phone or an Internet enabled PDA, that comprises a digital camera 104 for capturing a graphics pattern 106, and conversion circuitry 108 for converting the captured pattern into digital data. Device 102 further comprises communication circuitry 110 for communication with a server 112 via a network 114. The digital data represents an address on network 114, e.g., a URL of a specific page at the server 112. Circuitry 108 sends the address data to communication circuitry 110 to establish the connection with server 112 via network 114. Once the connection has been established, the communication between device 102 and server 112 uses the conventional operational modes and protocols known from, e.g., WAP or i-mode. Device 102 has a rendering component 116, e.g., an LCD or touch screen for graphics or video information, and/or a loudspeaker for audio information, for rendering the information supplied by server 112 via network 114. Alternatively, or in addition, rendering component 116 is used to render the information contained in the data that has resulted from converting the captured image. For example, the pattern of the image comprises encoded data representative of an email address, a street address, a URL, further textual information and/or selectable options, etc. From these, the user may choose a desired mode of communication or entry via rendering component 116 through a suitable UI (not shown) such as a touch screen, or may abort the procedure altogether before the communication channel is established.

An example of the field of use is the following scenario. A railroad or airline company provides a service on a network, through which their customers can get the most current information about arrival and departure times, relevant terminals, delays, etc. The company has posted signs at the station or at the airport with graphics pattern 106, e.g., in colored block-code. The signs are visually readily recognized as being special signs. The signs may also have an auditory beacon (not shown) for facilitating targeting of the sign by the visually impaired. The customer needs to target this sign with the camera embedded in his/her cell phone 102. The captured pattern gets converted into a string of bits. The conversion is accomplished by converter circuitry 108 accommodated, e.g., in the cell phone. The string of bits is representative of an address, e.g., a URL, a telephone number or an email address, etc, on data network 114. The address thus acquired is used to establish a connection between cell phone 102 and server 112 for, e.g., downloading or otherwise receiving information. The pattern may also get converted into text, graphics information such as icons, or audio information that is directly rendered via component 116. In another scenario, information is provided about a product advertised on a billboard or in a magazine or brochure. The advertisement comprises image 106 representative of the coded network address of server 112 for obtaining further information about this product. In this scenario there may be no need at all for instant communication with server 112. Device 102 may therefore need only an onboard camera 104 with a memory to store the image, but need not have communication circuitry 110. Instead, device 102 then needs an output (not shown) for supply of the digital image to a converter 108. Device 102 may be a PDA, network-enabled or not or, simply, a digital photo camera.

In yet another scenario, a museum, art gallery, auction, or zoo, etc., displays its objects (e.g., historical artifacts, paintings and sculptures, antique automobiles, animals) together with (small) images 106. Visitors take pictures, preferably with a digital camera, of an object in the vicinity of which associated image 106 is being displayed. Later on, the visitor downloads the pictures from the camera to his/her PC and opens them in a photo- browsing tool. The tool shows the picture taken, and uses image 106 to connect, automatically or under user control, to server 112 for downloading additional information (e.g., text, sounds) to be rendered with the relevant picture. The tool is preferably a dedicated piece of software for which the supplier can choose his own standard for coding the network address in the image.

Fig. 2 is a diagram of an example of a process 200 in the invention. In step 202, an image is captured by a digital camera. In step 204, the captured image data are converted using a hardware converter or a software converter. Conversion uses, e.g., a lookup table or a software program to process the image data. The converted image data is parsed in step 206, e.g., in order to extract content information that can be rendered to the user in step 208, which can be an option, and to extract the address for being used for the network communication in step 210.

Fig. 2 makes clear that a various embodiments of data processing systems can be configured to implement process 200. As discussed with reference to Fig.l, a first embodiment has capturing step 202, conversion step 204, parsing step 206, rendering step 208 and initiating step 210 carried out by a single apparatus, e.g., a WAP-enabled cell phone or an Internet-enabled PDA. A second embodiment, referred to above, has step 202, or steps 202 plus 204, carried out by one system, e.g., a digital camera or camera-enabled remote control , and has steps 204-210 or steps 206-210 carried out by another system, e.g., a PC or a set top box upon starting a specific software tool.

Claims

CLAIMS:

1. An electronic device, comprising a converter for converting a captured image into data for use as an address on a network.

2. The device of claim 1, comprising a digital camera.

3. The device of claim 1, comprising communication circuitry for data communication with the network under control of the address.

4. The device of claim 1, having an operational mode wherein the converter is disabled.

5. The device of claim 1, comprising a cell phone.

6. The device of claim 1, comprising a PDA.

7. The device of claim 1, comprising a remote control for control of electronic equipment.

8. The device of claim 1, comprising a memory for storing the address.

9. The device of claim 1, comprising a handheld apparatus.

10. The device of claim 1, comprising a rendering component for rendering content information.

11. The device of claim 1 , wherein the converter is programmable.

12. A method of enabling to initiate data communication via a data network, the method comprising enabling to capture an image for being converted into data for use as an address on a data network.

13. The method of claim 12, wherein the address comprises a URL.

14. The method of claim 12, wherein the address comprises a telephone number.

15. The method of claim 12, wherein the address comprises an email address.

16. The method of claim 12, wherein the image comprises a mosaic of cells in a two-dimensional array.

17. The method of claim 12, wherein the image comprises a figurative component.

18. The method of claim 12, wherein the image comprises a trademark or service mark.

19. The method of claim 12, wherein the converting is programmable.

20. A method of using an image for coding of an address on a data network.

21. An image with a graphical pattern that is convertible to an address on a network.

22. A converter for converting image data captured by a camera into an address on a data network.

23. The converter of claim 22, comprising a look-up table.

24. The converter of claim 22, comprising software for processing the image data.

25. The converter of claim 22, being programmable.