JP4855130B2 - Information processing apparatus and data recording / storing method - Google Patents

Description

  The present invention relates to an information processing apparatus and a data recording / storing method capable of receiving data from a plurality of visible light communication light sources.

  Opportunities to use a navigation system are increasing when searching for a desired store, for example, a restaurant or a tavern in the city. In addition, a service has already been started in which the position of a mobile phone terminal is specified using a GPS satellite and guidance to a store or the like is guided using a map on the screen. In this case, since the GPS positioning calculation cannot be performed only with the processing device of the mobile phone terminal, a method of specifying the position while linking with the base station is used. In addition, since map information for the whole country cannot be stored in the storage unit of the mobile phone terminal, a separate server is prepared for map information, and only the images required by the mobile phone terminal are received for navigation. ing.

  Moreover, in patent document 1, a part of the image of the place image | photographed with the terminal is extracted, and it transmits to a server, An arbitrary object is transmitted to the part to the terminal by carrying out pattern matching, It superimposes on a terminal, Navigation is performed by displaying. In Patent Document 1, when a landscape including a certain object is captured as an image, only the object is extracted from the image, and the image is transmitted to the server. The server matches the image with the template image stored in the server, and searches for the region where the shooting location is. The server transmits an object (for example, an arrow) to be displayed on the terminal from the search result toward the terminal. The terminal stores an object template in the storage unit, and derives the template from the information transmitted from the server and displays it on the screen.

In addition, there is a technique of pasting an arbitrary image or cutting out an image at a light source position where the luminance varies in a predetermined pattern such as visible light communication (see Patent Document 2). According to this, there is provided an image processing method for processing a plurality of image signals arranged in a time axis direction including a light emitting region whose luminance varies in a predetermined pattern, and the plurality of image signals are binarized in the time axis direction. A logical symbol of “1” and “0”, a step of obtaining a total value of logical symbols of “1” and “0”, a total value of “1” and a total value of “0” And pattern matching based on the difference value between the two and extracting the image of the light emitting source region, and pasting the image at the extracted image position and cutting out the image.
JP 2005-182350 A JP 2002-262180 A

The above-described navigation system of Patent Document 1 incurs a packet communication fee for receiving information from the server, captures a landscape including an object as an image, extracts only the object from the image, When sending images to the server, the image information is small, but it is expected to be several kilobytes to several tens of kilobytes in size, and extra packet communication fees are required, so users cannot use it frequently. There's a problem.
Also, in Patent Document 2, when it is attempted to capture all information, it takes a long time depending on the amount of data. Therefore, when a camera shutter can be pressed like an ordinary camera, information reception is not possible. Since the photographed image is saved before completion, all the information cannot be taken in and cannot be used for store search or navigation.
Also, when trying to capture all information, it may take a long time depending on the amount of data, so it is necessary to capture information at high speed so as not to cause camera shake as much as possible while keeping the user shooting. is there.

  The present invention has been made in view of such a problem, and the object of the present invention is that no extra communication fee is required for receiving information, and that the camera's shooting button is pressed. However, an object of the present invention is to provide an information processing apparatus and a data recording / storing method capable of storing an image and information in association with each other by releasing a shutter after receiving all information from the information transmission source.

In order to achieve the above object, an information processing apparatus according to the present invention includes an imaging unit that images a subject, a light source of visible light communication detected from data captured by the imaging unit, and a light emission pattern of the detected light source. Decoding means for decoding the data of visible light communication from, and recording storage means for recording and saving the data decoded by the decoding means in association with the imaging data when recording and saving the data imaged by the imaging means And a processing means for performing a shutter process after receiving all necessary information of the light source from the light source when the user performs a shutter operation.

An information processing apparatus according to the present invention detects an image capturing unit that captures an image of a subject, a light source of visible light communication from data captured by the image capturing unit, and performs visible light communication based on a light emission pattern of the detected light source. A decoding means for decoding data; a recording / saving means for recording and saving the data decoded by the decoding means in association with the imaging data when recording the data captured by the imaging means; A processing means for completing the reception of the necessary information from the light source in a state in which the image can be stored when all the necessary light source information is not received from the light source when the operation is performed; It is characterized by providing.

An information processing apparatus according to the present invention detects an image capturing unit that captures an image of a subject, a light source of visible light communication from data captured by the image capturing unit, and performs visible light communication based on a light emission pattern of the detected light source. Decoding means for decoding data and recording / saving means for recording and saving the data decoded by the decoding means in association with the imaging data when recording and saving the data captured by the imaging means are shifted in time. and detecting a visible light communication light source of the same emission pattern, comprising: a light source the same number of light source detecting means, said decoding means, visible from the light emission pattern by shifting the time of the light source detected by the light source detecting means It is characterized by decoding optical communication data .

The data recording / storing method of the present invention detects a light source for visible light communication from imaging data, decodes visible light communication data from a light emission pattern of the detected light source, and records and stores the imaging data. A data recording / storing method in which the decoded data is recorded / saved in association with the imaging data, and when the user performs a shutter operation, the shutter process is performed after receiving all necessary information on the light source from the light source. It is characterized by that.
The data recording / storing method of the present invention detects a light source for visible light communication from imaging data, decodes visible light communication data from a light emission pattern of the detected light source, and records and stores the imaging data. A data recording / storing method in which the decoded data is recorded / saved in association with the imaging data, and when the user performs a shutter operation, all the information on the light source required from the light source is not received. Is characterized in that an image can be stored and reception of necessary information from the light source is completed.

  Since the present invention uses visible light communication, it does not require an extra communication fee for receiving information, and even when the camera's shooting button is pressed, it is transmitted from the information source by visible light communication. After receiving all the information that has been received, the shutter can be released and the image and information can be stored in association with each other, so that the received information can be displayed superimposed on the image and used for store search and navigation .

  First, a search system for searching for a store or the like using an information processing apparatus with a camera will be described. FIG. 1 is a diagram for explaining the outline of the search system, and FIG. 2 is a diagram showing the outline of the search system in a processing flow. First, search conditions (number of people, classification (Izakaya, French, etc.), amount, availability information, etc.) necessary for the user to select a store are entered from the information processing device 11, and the conditions are sent via the base station 12 by e-mail. To the store search server 13 or access a site operated by the store search server system, and transmit it in the input form. At that time, the information processing apparatus 11 acquires position information of the location where the user is currently located by GPS or the like, and transmits the information together with a search condition from an email or an input form. Further, a telephone number, name, etc. (user information) are also transmitted as IDs for identifying users (step 101).

  The information transmitted from the information processing device 11 reaches the store search server 13 via the base station 12. The store search server 13 picks up a store from the location information sent from the user by picking up a store within a radius of 50 to 100 m from the user's location, that is, a range where the user can shoot from the camera provided in the information processing apparatus 11. Search for stores that match the search criteria sent by the user. Next, in the picked-up stores, instruction information, user information, etc. are sent to stores that match the search conditions and stores that do not match (step 102).

  In a store that matches the search condition, information such as the store name and reservation URL is stored in the information processing apparatus 11 of the user by visible light communication or infrared communication using a signboard of a store equipped with a light emitting source (LED). Send. Further, in a store that does not match the search condition, arrow information that indicates in which direction the matching store is viewed from the information processing apparatus 11 of the user is displayed by a light source (visible light communication or infrared communication). LED) is sent to the user information processing apparatus 11 from a signboard or the like (step 103).

  When the user points the imaging unit (camera) of the information processing apparatus 11 toward a signboard or the like composed of LEDs or the like, a store that matches the search condition blinks on the display screen 14. A user who has obtained information from a signboard of a store through visible light communication or infrared communication can find out where the desired store is by looking at the display screen 14 of the information processing apparatus 11 in an easy-to-understand manner. Can do. Further, by selecting the store, the store information can be confirmed and the store can be reserved (step 104).

  In the above-described search system, the information processing apparatus of the present invention is configured so that the user wants to save the currently displayed screen during reception of visible light communication, and when the user presses the shooting button, The shutter is not released until the information is received, the shutter is released when all the information is received, and the received information is stored in association with the image.

  More specifically, in the information processing apparatus of the present invention, when the user presses the shooting button, if all the information of the light source has been received, the shutter is released and the image and the information are associated with each other and stored in the storage unit. If all the information of the light source has not been received, data reception is continued, all data is received, and if there is another unreceived light source, data is received from the unreceived light source. If there is no unreceived light source, the shutter is released for the first time, and the image and information are stored in association with each other. The information is extracted by superimposing and selecting the highlighted display on the screen with a cursor or the like.

  3 and 4 are diagrams illustrating display examples on the display unit of the information processing apparatus. Assume that the screen for pressing the shutter button is as shown in FIG. Information on the light emission sources 1602 and 1603 has already been acquired, and pop-ups 1604 and 1605 are displayed. When the shutter button is pressed, the screen is scanned for light sources that have not received information. At that time, if the light emission source 1606 is detected, the camera is put in a standby state without releasing the shutter until reception of the information is completed. This situation does not occur if the screen is fixed in the same state for a long time, but the user is actually looking for a light source in various directions, and if he finds the desired light source, he will immediately save the image. Might do. Therefore, if the image is stored immediately, the information that has not been received cannot be obtained and the image is stored, and there is no information when the image is used later, resulting in inconvenience. In order to prevent this, the information processing apparatus of the present invention receives all information, stores the received information in association with an image, and needs information on the light source 1606 from the stored image data. As shown in FIG. 4, a pop-up 1608 is displayed, and information can be extracted by selecting with a cursor or the like.

  Next, a first embodiment of the present invention will be described. FIG. 5 is a block diagram showing the information processing apparatus according to the first embodiment of the present invention. Here, a mobile phone terminal will be described as an example of the information processing apparatus. The information processing apparatus 20 is almost the same as a general mobile phone terminal. When performing visible light communication, an imaging unit (camera) 25 that images a subject is used as a light receiving unit. When performing infrared communication, it is necessary to prepare a light receiving unit for infrared light separately. In addition, a display unit 28 that displays an image captured by the imaging unit 25 and data received through visible light communication, an operation unit 27 that inputs search conditions, and a baseband unit 24 that transmits search conditions. And the RF unit 22 and the antenna 21, the GPS receiving unit 23 for obtaining the position information, the storage unit 29 for storing the position information of the information light emitting source, and the process for decoding the data received (received) by the imaging unit 25, And a terminal processing unit 26 that controls processing of each component. In this embodiment, visible light communication is received using the imaging unit 25. However, if the amount of data to be handled increases, a separate light receiving unit for visible light communication is prepared. The light receiving unit may be used.

  FIG. 6 is a configuration diagram illustrating an example of a store search server. The store search server 30 may be a server that covers the whole country, or may be a server that is divided for each region. The store search server 30 searches store information from the search conditions sent from the user information processing device, and also picks up stores near the location where the user is located from the location information sent from the user information processing device. It comprises a search unit 33, a storage unit 31 that stores information such as names of stores in the whole country or region, and location information, and a server processing unit 32. In the server processing unit 32, in order to indicate the direction of the store that matches the search condition as viewed from the user's information processing device, the store that matches the user's information processing device and the search condition, and other stores Based on the position information (this store may or may not match the search condition), it is calculated in which direction the matching store is seen from the information processing apparatus of the user. Based on the information, it is determined which direction is to be instructed to the information processing apparatus of the user. The information is transmitted to the store along with user information and search results.

  FIG. 7 is a configuration diagram illustrating an example of a store-side terminal. The store side terminal 40 stores, in the storage unit 41, user information of the user who performed the search, user search information, store information transmitted to the user, location information of the store, and the like. The information transmission unit 43 is a signboard equipped with a light emitting source (LED) necessary for performing visible light communication for transmitting store information and arrow information indicating the direction in which the matched store is present to the user. Depending on the store, the reservation information can be received from the user, so the store processing unit 42, the operation unit 44, and the display unit 45 confirm the reservation status or perform an operation for transmitting detailed information to the user again.

  FIG. 8 is a diagram illustrating an example of a light emission source of the store side terminal according to the first embodiment. The assumed light emission source is an LED mounted on a signboard. As the signboard, it is conceivable that the characters “OPEN” 302 for notifying that the store is opened, the name of the store, and the like are described. An LED 303 is arranged in the center of the signboard, and the LED 303 blinks to perform communication.

  FIG. 9 is a diagram illustrating a format example of data transmitted from the light emission source of the store side terminal according to the first embodiment. From the light emitting source 303, unique word (UW) information, store name information, store location information, store URL information, store menu information, store congestion status information, store service information, and arrows indicating directions to other stores It is assumed that data composed of information or the like is transmitted. In particular, if there is store URL information, the store reservation system can be easily accessed when making a reservation. Store service information includes store coupons and points, and provides services that are highly useful to users. These pieces of information are data divided for each unique word (UW) information, and the light emission source 303 repeatedly transmits the information.

  FIG. 10 is a diagram illustrating a format example of data stored in the storage unit of the information processing apparatus according to the first embodiment. The storage unit indicates position information on the screen of the light source, store ID information, store name information, store position information, store menu information, store congestion status information, store service information, and directions to other stores. Arrow information and the like are stored. The store ID information is included in the store name information in the data example of FIG. By holding the store ID information, it is possible to determine from this ID whether the store has already received the information or not. The location information of the store is described by an address for easy understanding, but actually, latitude and longitude information is also included like GPS.

  FIG. 11 is a flowchart for explaining the operation of the information processing apparatus according to the first embodiment of this invention. When the camera is activated to receive the visible light signal (S201), the terminal processing unit 106 receives or receives the unique word included in the transmission data, whether or not there is a light emission source in the screen. It is judged whether it is not (S203). If the unique word cannot be received and there is no light source in the screen, the camera is pointed in various directions by the user to search for the light source (S202).

  If there is a light source in the screen, pay attention to one light source and receive the unique word of the light source (S204). When the unique word is received, data reception and data decoding are started (S205). The reception of data sent from the light source is completed (S206), and the light source position on the screen is highlighted (S207).

  If there is another light source in the screen (S208), a unique word from another light source is received and data is received. When there is no other light source and the shooting button is pressed by the user to save the currently displayed screen (S209), it is determined whether or not the user has performed an operation for saving the received information together with the image. (S210) When the user who presses the shooting button performs an operation to save the received information together with the image, the shutter is released and the image and information (position information on the display section of the light emitting source are also displayed). Are stored in association with each other, and the reception operation of visible light communication is terminated (S212). Information received by visible light communication is not required by the user, and when an operation for saving only an image is performed, only the image is saved (S211), and the visible light communication receiving operation is terminated. If an image is displayed by a separate operation and information is to be referred to, the information is displayed superimposed on the light source position on the screen when the screen is displayed (S213).

  As described above, the present invention releases the shutter after all information transmitted from the information transmission source by visible light communication is completed, and stores the image and the information in association with each other. It can be displayed superimposed on the image and used for store search and navigation. In addition, if information received by visible light communication is required by the user, the image and the information are stored in association with each other. If the information is not required, only the image can be stored, so that the user is not wasted time. .

  Next, how data is received and stored data will be described with reference to a screen display example of the display unit shown in FIG. The information processing apparatus receives information from the light emission sources 602 and 603, and displays pop-ups 604 and 605 including a store genre and a store name on the display unit of the information processing apparatus.

  The stored data can be used when a desired store is searched by the above-described search system and eating and drinking is performed at the store. When eating and drinking in a store and considering to search for the next store, it is generally considered that a search is performed again using the search system after going out of the store. However, rather than going out of the store and searching again and finding a store that meets the desired conditions and making a reservation, the search is made with the number of people, genre, etc. already determined before accounting. , Making a reservation often reduces the waiting time at the store, which is often advantageous for the user. However, at present, if it is in a store, an extra packet communication fee is required, such as accessing a mobile phone communication network and downloading a map to an information processing device. It is difficult to judge.

  However, when searching for a store using the search system, if the image at that time is saved and the store information is received, the store on the image is the desired store when searching again. If there is, in the screen display example of FIG. 12, the store can be indicated by the cursor 606, and the detailed information shown in FIG. 13 can be displayed on the display unit. In this way, since the user can refer to the image where the current store is found, the user can easily determine how far the current store is from the newly searched store.

  Moreover, you may make it download information using the visible light communication from the illumination in a shop. When transmitting the search conditions, it is necessary to access the mobile phone communication network, but when downloading information, no extra packet communication fee is required.

  Next, a second embodiment of the present invention will be described. FIG. 14 is a format example of data transmitted from the light emitting source (LED) of the shop side terminal according to the second embodiment. In the second embodiment, the data transmitted from the LED 801 includes two unique words 1 (UW1) and unique word 2 (UW2) as shown in the data format example of FIG. In the first embodiment, in order to receive all information, there is no problem when a light receiving element with a high receiving speed of several Mbps is used, but when it is used with a light receiving element with a slow speed of several tens of bps. This puts a burden on the user because he has to hold the camera for a long time. Therefore, when the user thinks that it is sufficient to know the store location and information, it is sufficiently effective for the user if the simple mode is selected and only necessary information can be received.

  FIG. 15 is a format example of data stored in the storage unit of the information processing apparatus in the second embodiment. The storage unit of the information processing apparatus stores location information on the screen of the light emission source, store ID information, store name information, and store location information. In order to reduce the data to be received, store menu information, store congestion status information, store service information, and arrow information indicating the direction to other stores are not received.

  FIG. 16 shows a flowchart for explaining the operation of the information processing apparatus of the second embodiment. The process up to S705 for receiving the unique word 1 (UW1) and starting the data reception is the same as in FIG. When the unique word 2 (UW2) is received during the data reception (S706), it is determined whether the user has selected the “simple mode” or the “detail mode” (S707). If it is the simple mode, data reception from the light emitting source is completed at that time (S709). In the detailed mode, reception of data after unique word 2 (UW2) is started (S708), and data reception is completed (S710). The position of the light source that received the data is highlighted (S711), and it is determined whether there is another light source (S712). If there is another light source, a unique word 1 (UW1) from another light source is received.

  When there is no other light source and the user presses the shooting button to save the currently displayed screen (S713), it is determined whether or not the user has performed an operation for saving the received information together with the image. (S714) When the user who presses the shooting button performs an operation to save the received information together with the image, the shutter is released and the image and information (position information on the display section of the light emitting source are also displayed). Are stored in association with each other, and the reception operation of visible light communication is terminated (S716). Information received by visible light communication is not required by the user, and when an operation for saving only an image is performed, only the image is saved (S715), and the visible light communication receiving operation is terminated. If it is desired to display an image by a separate operation and refer to the information, the information is displayed superimposed on the light source position on the screen when the screen is displayed (S717).

  As described above, since it takes a lot of time to receive all the information, in the second embodiment, by storing the image when the information processing apparatus receives the necessary information, The burden on the user can be reduced.

  Next, a third embodiment of the present invention will be described. The light emission source assumed in the third embodiment is an LED mounted on the signboard shown in FIGS. 17 and 18. In the signboard shown in FIG. 17, several LEDs are arranged on the black “OPEN” character, one red LED 1004, one blue LED 1005, and one green LED 1006, and the others are white LEDs. In this case, the background color is preferably black, but the background color and the character color can be changed depending on the situation. The signboard shown in FIG. 18 is devised so that the three-color LEDs of red LED 1008, blue LED 1009, and green LED 1010 are arranged inside the signboard so that the letters “OPEN” appear to shine in three colors.

  By using such a light emission source (signboard), reception of visible light communication data can be completed earlier. The method will be described using the signboard shown in FIG.

  The red LED 1008, the blue LED 1009, and the green LED 1010 are arranged on the signboard shown in FIG. 18 which is an information light emitting source, and the data frames transmitted by each of them are shown in FIG. 19, the red LED is 1102 and the blue LED is 1104. The green LED is 1106. The data transmitted from the three LEDs are all the same and are shifted in time. The time for shifting is determined by the number of light sources and the amount of data.

  In order to know where the beginning of the data is, a unique word (UW) is generally set, and when the unique word (UW) is received, the subsequent information may be as desired. I understand and try to receive all the information. If there is only one information emission source and the unique word (UW) is located at the head of the data frame, the reception start is started from the “menu” information in the data frame 1102 of FIG. If so, it will take some time until a unique word (UW) is detected. Therefore, a plurality of, for example, three information light emitting sources such as a red LED 1008, a blue LED 1009, and a green LED 1010 are prepared, and the data of the data frames 1102, 1104, and 1106 shifted in time are received. In this way, even if reception is started in the middle of the data frame 1102, information can be received by detecting the unique word (UW) of the data frames 1104 and 1106, and the time can be reduced. . In this case, the information processing apparatus owned by the user needs to include three light receiving units.

  Since the three light sources can be recognized as different light sources if they are close to a certain extent, they may be the same color light source, but if they are sufficiently far away, are they three light sources? Since one light source cannot be distinguished, the three light sources have different colors such as red, blue, and green so that the three light sources can be recognized as different ones. An image actually displayed on the screen is shown in FIG. If the colors are separated, light can be received even from a distance.

  In the third embodiment, the information processing apparatus can receive information from three light sources by using three light receiving units. For example, when the light receiving unit first receives a unique word from the blue LED at the time when light reception is started, the other light receiving units stop receiving light (turn off the power). Alternatively, other light receiving units start scanning other light sources. Alternatively, since the light reception from the light emitting sources other than blue can be started when the unique word is received, the other light emitting units may receive the menu information from the red LED and the congestion status from the green LED. By doing so, the time until all information is received can be shortened.

  In addition, if the user needs less information, for example, if there is no problem if the store name and location information are known by searching for the store, the menu or congestion situation that is later in time, etc. By not receiving the information, the storage time is further shortened. For example, when a unique word is detected from information from a blue LED while receiving information from a red LED, the information processing apparatus determines that the information required by the user can be extracted if there is data up to that point. Save the image. Even when there are several stores having a plurality of light emitting sources, it is possible to expect a further reduction in time by receiving the minimum necessary data as described above.

  FIG. 21 is a flowchart for explaining the operation of the information processing apparatus according to the third embodiment. This is the same up to A in FIG. When the user presses the shooting button to save the currently displayed screen (S1314), it is determined whether the user has performed an operation for saving the received information together with the image (S1315). When the user who pressed the button does not need the information received by visible light communication and performs an operation for saving only the image, only the image is saved (S1316), and the reception operation for visible light communication is terminated. When the received information is stored together with the image, it is confirmed whether the mode preset by the user is the simple mode or the detailed mode (S1317). When the simple mode is selected, there is no need to store any more data, so the shutter is immediately released and the image and information (including position information on the display section of the light source) are stored in association with each other. (S1321). The simple mode is a mode that receives only the store name, position information, and the like since all information transmitted from the light source is not necessary, and the detailed mode is a mode that receives all information.

  If the detailed mode is selected in S1317, since there is information that has not been received, all the data is received again (S1318). At this time, since the information already received is not necessary, the data after the unique word 2 (UW2) in FIG. 14 is received. When all the information is received (S1319), it is determined whether there is any other unreceived light source (S1320). If there is an unreceived light source, information is received from the light source (S1318). Only when all the information is received without an unreceived light emitting source, the shutter is released, and the image and information (including position information on the display section of the light emitting source) are associated with each other and stored (S1321). If an image is displayed by a separate operation and information is to be referred to, the information is superimposed and displayed on the light source position on the screen when the screen is displayed (S1322).

  Note that if the shutter button is pressed to save the currently displayed screen, the image may be saved in a state where reception of necessary information is not completed. Therefore, when the shutter button is pressed, the information processing apparatus is set in a state in which the image can be stored. If reception of necessary information is not completed, pay attention to the display screen as shown in FIG. Information 1404 that prompts the user to save the information may be displayed, and when reception of necessary information is completed, information 1406 that informs the end of storage may be displayed on the display screen as shown in FIG.

  If there is a data length in the information, the time required to receive all the information is calculated from the data length in the information processing apparatus, and the remaining time information 1502 is notified to the user as shown in FIG. Therefore, it may be displayed on the screen.

  Further, according to the present invention, when camera shake occurs, it is possible to keep the detection error accompanying the movement within an allowable range by increasing the frame rate of the image sensor. It is also possible to calculate the motion vector data between a plurality of frame buffers, refer to the motion vectors between frames, and take out a set of corresponding points to cope with them.

It is a figure explaining the outline | summary of a search system. It is a figure showing the outline | summary of a search system with a processing flow. It is a figure which shows the example of a display in the display part of information processing apparatus. It is a figure which shows the example of a display in the display part of information processing apparatus. It is a block diagram which shows the information processing apparatus which concerns on 1st Example of this invention. It is a block diagram which shows an example of a shop search server. It is a block diagram which shows an example of a shop side terminal. It is a figure which shows an example of the light emission source of the shop side terminal which concerns on 1st Example. It is a figure which shows the example of a format of the data transmitted from the light emission source of the shop side terminal which concerns on 1st Example. It is a figure which shows the example of a format of the data memorize | stored in the memory | storage part of the information processing apparatus which concerns on 1st Example. It is a flowchart explaining operation | movement of the information processing apparatus of 1st Example. It is a figure which shows the example of a screen display in the display part of information processing apparatus. It is a figure which shows the example of a display of the detailed information in the display part of information processing apparatus. It is a format example of the data transmitted from the light emission source of the shop side terminal which concerns on 2nd Example. It is a format example of the data memorize | stored in the memory | storage part of the information processing apparatus which concerns on 2nd Example. It is a flowchart explaining operation | movement of the information processing apparatus of 2nd Example. It is a figure which shows the signboard equipped with LED. It is a figure which shows the signboard equipped with LED. It is a figure which shows the flame | frame of the data which red LED, blue LED, and green LED transmit. It is a figure which shows the example of a screen display of three light sources of red, blue, and green. It is a flowchart explaining operation | movement of the information processing apparatus of 3rd Example. It is a figure which shows the example of a screen display which displays the information which calls attention. It is a figure which shows the example of a screen display which displays the information which notifies that the preservation | save was complete | finished. It is a figure which shows the example of a screen display which displays remaining time information.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11,20 Information processing apparatus 12 Base station 13,30 Store search server 14 Display screen 21 Antenna 22 RF part 23 GPS receiving part 24 Baseband part 25 Imaging part (light-receiving part)
26 Terminal processing unit 27, 44 Operation unit 28, 45 Display unit 29, 31, 41 Storage unit 32 Server processing unit 33 Information retrieval unit 40 Store side terminal 42 Store processing unit 43 Information transmission unit 302 Characters 303, 801 LED
602, 603, 1202, 1602, 1603, 1606 Light source 604, 605, 1604, 1605, 1608 Pop-up 606 Cursor 1004, 1008 Red LED
1005, 1009 Blue LED
1006,1010 Green LED
1102, 1104, 1106 Data frame 1404 Information to call attention 1406 Information to notify the end of storage 1502 Remaining time information

Claims (5)

Imaging means for imaging a subject;
Decoding means for detecting a light source for visible light communication from data captured by the imaging means, and decoding data for visible light communication from a light emission pattern of the detected light source;
A recording / storing unit that records and stores the data decoded by the decoding unit in association with the imaging data when recording and storing the data captured by the imaging unit;
When the user performs a shutter operation, a processing unit that performs shutter processing after receiving all necessary information of the light source from the light source ,
An information processing apparatus comprising: Imaging means for imaging a subject;
Decoding means for detecting a light source for visible light communication from data captured by the imaging means, and decoding data for visible light communication from a light emission pattern of the detected light source;
A recording / storing unit that records and stores the data decoded by the decoding unit in association with the imaging data when recording and storing the data captured by the imaging unit;
If the user does not receive all necessary information about the light source from the light source when the user operates the shutter, the image can be saved and reception of the necessary information from the light source is completed. Processing means;
An information processing apparatus comprising: Imaging means for imaging a subject;
Decoding means for detecting a light source for visible light communication from data captured by the imaging means, and decoding data for visible light communication from a light emission pattern of the detected light source;
A recording / storing unit that records and stores the data decoded by the decoding unit in association with the imaging data when recording and storing the data captured by the imaging unit;
A number of light source detecting means for detecting visible light communication light sources having the same light emission pattern at different times;
The information processing apparatus, wherein the decoding unit decodes visible light communication data from a light emission pattern in which a time of a light source detected by the light source detection unit is shifted. The light source of visible light communication is detected from the imaging data, the visible light communication data is decoded from the light emission pattern of the detected light source, and the decoded data corresponds to the imaging data when recording and saving the imaging data A data recording and saving method for recording and saving with
A data recording / storing method characterized in that when a user performs a shutter operation, shutter processing is performed after receiving all necessary information of the light source from the light source . The light source of visible light communication is detected from the imaging data, the visible light communication data is decoded from the light emission pattern of the detected light source, and the decoded data corresponds to the imaging data when recording and saving the imaging data A data recording and saving method for recording and saving with
If the user does not receive all necessary information about the light source from the light source when the user operates the shutter, the image can be saved and reception of the necessary information from the light source is completed. A data record storage method characterized by the above.

Images