JP6480118B2 - Method and system for recording information in space - Google Patents

Description

  The present invention relates to a method and system for recording information in a space.

  Tomu Kawada, the inventor of the present invention who is the leader (the eldest son) of the AR Three brothers, researches and develops AR (Augmented Reality) from the usual, and is familiar with the technology. AR analyzes the image captured through the camera in dot units and determines the object from the contour and feature points at the time of image determination, but while Kawata is repeating research, the phenomenon is that the object is two-dimensional ... that is, a plane I realized that I was just catching it.

  For example, when communicating about desks and works of art, it is only now possible to convey information in two-dimensional form such as taking pictures and supplementing them with text. There is no touch or smell of the desk, the outline or depth of the works of art here. In other words, the information is not rich. Kawada thought that if the depth could be added to this two-dimensional, the information would be three-dimensionalized. Then, the present invention starts from the question "how can we do it?"

  For example, Dohaemon's invention of "anywhere door" is not possible because it requires physical transfer of matter, but it is not possible to spatially transfer three-dimensional matter in front of you as "information" Or, Kawada thought so.

So what should I do?
Kawada thinks of combining multiple pieces of information to make information transmission means multi-dimensional. However, on the other hand, it was considered that there is a limit to three-dimensionalizing information by means of transmission represented by binary numbers of "010101 ..." on the current Internet. The Internet needs to be wired, and the volume of transmission is estimated to be 1000 times that of the present by 2020, but there is no improvement other than thickening the fiber cable, which is the growth of civilization The future is expected to come to a halt. Therefore, we chose to use "light" as the main means of transmission, and to combine "sound", "ultrasound", "color", etc. with it.

  The reason for adopting light as a core technology is the goodness of being able to reproduce information transmission means such as the current "010101 ... binary" Internet by blinking and fluctuation of light. In addition to that, there is no need for lines such as the Internet when transmitting information, and it is possible to exchange data across OS and terminal standards. If it is possible to exchange light beyond standards, it is possible to have information such as signage that overflows in the city be remembered in a portable device such as a badge for storing light, for example.

  However, the difficulty of combining these is that a plurality of information communication means of different nature are made to cooperate according to a use. For example, since light and sound / ultrasound waves have different reference speeds, it is necessary to give "common language" and "collaboration rules (pattern)" there. This is an extremely difficult effort, but Kawada had similar experiences in the past when it came to giving "common language" to different protocols, and it lived. Kawada, who previously worked at a sewing machine manufacturer, has developed a patented technology that connects a three-part sewing machine, a two-part computer, and a person who controls them, using a "punch, pull, stop" machine. However, the difficulty this time has increased is that it is necessary to put light and ultrasound into practical use while taking into consideration the interference of sunlight and ultrasound in the living environment. There is also a limitation called smartphone model specifications. In order to clear these limitations, in addition to inventing an intermediate technology to communicate different protocols, it was important to clear the task that multiple communication means such as "sound", "ultrasound" and "color" are complementary It was filtered to work well.

  Based on the above ideas, Kawada completed one basic invention.

The first aspect of the invention is
A method of storing information in space,
(1) a step of the information communication terminal device receiving at least space-mediated transmission information consisting of one or a combination of one or more of sound, color, light, and ultrasound at its spatial position;
(2) detecting, at least, terminal attribute information consisting of one or a combination of two or more of time, inclination / direction, and acceleration at which the information communication terminal device receives the space-mediated transmission information;
(3) a step in which the information communication terminal device or a server connected to the information communication terminal device identifies the space position of the information communication terminal device by decoding the received space media transfer information;
(4) a step in which an information communication terminal device or a server connected to the information communication terminal device associates and stores the attribute information of the terminal with the spatial position of the identified information communication terminal device;
(5) A step of associating and storing attribute information of the terminal in an intermittent spatial position by repeating the steps (1) to (4) at predetermined timing by the information communication terminal device;
Is a method that has

The second aspect of the present invention is
A method of using information stored in space by the above method,
The server to which the information communication terminal device is connected stores the attribute information of the information communication terminal device in association with the specified spatial position of the information communication terminal device, and
Based on the spatial position of the information communication terminal device, the server determines whether to pass the attribute information of the information communication terminal device to a service providing system that provides a service to the information communication terminal device The process to
The service providing system receives attribute information of the information communication terminal device from the server, and based on the spatial position and the attribute information, providing predetermined services provided by the service providing system;
Is a method that has

  If this invention is applied to smartphones, the compatibility between various OSs such as iOS, Android, Windows (registered trademark) has been extremely insufficient until now to have one function, but "light" It can be unified by mediating "sound", "color" and "ultrasound", and it is possible to omit the mass of the point card etc. in the wallet that many people are thinking strangely.

  Until now, even with a single payment function, each store installed a dedicated terminal, and it took time and effort to connect it to the Internet. If this technology penetrates, a world where consumers can easily make payments with two smartphones can be realized.

  In addition, ultrasound is also large as one of the depth of information transmission that is produced in this way. Ultrasonic waves can detect the feeling of material and the contour of an object. This is similar to how dolphins recognize obstacles and prey by ultrasound. As a result, there is a possibility that a rich communication of information that can more easily convey the feel of the desk material, the form and hardness of works of art can be created in the near future.

  Hereinafter, the details of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a schematic block diagram showing a system according to an embodiment of the present invention. FIG. 2 is also a schematic view showing the operation. Similarly, a schematic block diagram illustrating a system for utilizing spatial location tags as well.

As mentioned above, the invention completed by inventor Kawada is:
A method of storing information in space,
(1) a step of the information communication terminal device receiving at least space-mediated transmission information consisting of one or a combination of one or more of sound, color, light, and ultrasound at its spatial position;
(2) detecting, at least, terminal attribute information consisting of one or a combination of two or more of time, inclination / direction, and acceleration at which the information communication terminal device receives the space-mediated transmission information;
(3) a step in which the information communication terminal device or a server connected to the information communication terminal device identifies the space position of the information communication terminal device by decoding the received space media transfer information;
(4) a step in which an information communication terminal device or a server connected to the information communication terminal device associates and stores the attribute information of the terminal with the spatial position of the identified information communication terminal device;
(5) A step of associating and storing attribute information of the terminal in an intermittent spatial position by repeating the steps (1) to (4) at predetermined timing by the information communication terminal device;
Method.

In addition, it is a method of using information stored in space,
(6) The server to which the information communication terminal device is connected stores the attribute information of the information communication terminal device in association with the specified spatial position of the information communication terminal device, and
(7) Whether the server passes the attribute information of the information communication terminal device to the service providing system for providing a service to the information communication terminal device based on the spatial position of the information communication terminal device The process of determining
(8) the service providing system receives attribute information of the information communication terminal device from the server, and based on the spatial position and the attribute information, provides a predetermined service provided by the service providing system;
Method.

  First, "store information in space" means to virtually leave the footprint (space position tag) of the information communication terminal in our actual activity space. For example, as shown in FIG. 1, it is assumed that the user 1 is located in the space of the environment holding the information communication terminal device 2. In this case, the space-mediated transmission information composed of the combination of the space-specific sound, light, color, and ultrasound received by the information communication terminal device 2 is decoded (analyzed), and the space of the information communication terminal device 2 at that time is It is specified where and where. Then, this information and the attribute information of the information communication terminal device 2 itself are virtually left in the space as the space position tag P.

  In this embodiment, the decoding is performed by the spatial position information processing server 3 on the cloud receiving the space mediation transmission information from the information communication terminal device 2 and querying the space mediation transmission information DB 4 a. Be done. For example, on the basis of the combination of the specific background music and the specific illumination at the above-mentioned spatial position, the spatial position P is decoded as "in a convenience store A" or the like.

  Further, in this embodiment, as shown in FIG. 1, the information communication terminal device 2 oscillates the ultrasonic waves U1 and U2 by itself and detects the reflected ultrasonic waves to thereby obtain the horizontal distance to the adjacent obstacle and It is configured to be able to measure the vertical distance. Thereby, it is possible to know, for example, at which position in the convenience store A the information communication terminal device 2 is located. This information is also used to specify the spatial position P as space-mediated transmission information. Thereby, as shown in FIG. 2, it is possible to decode, for example, specifically at which position in the area A or the area B the information communication terminal device 2 is located.

  Then, when the user 1 moves as shown by the arrow in FIG. 2, the information received by the information communication terminal device 2 and the decoded information are tagged as spaces as intermittent space positions P1 to P7. . In this example, it is shown that movement from area A to area B is known from the received space-mediated transmission information.

  As a result, since it is virtually left as a space position tag P in the space where the information communication terminal device 2 is located at which point in the space at a certain point in time, various services can be provided by using it. I will talk about that later.

  Also, by integrating those tags P, it is possible to "define" the atmosphere of the space including the size of the space. That is, it is possible to define the size of the space by integrating the distance between the moving terminal device 2 and the obstacle in the space at each point in time.

  Hereinafter, the method of recording information in the space will be described in more detail in the order of the constituent requirements of the above (1) to (5).

(1) About "the process of receiving at least at least the space-mediated transmission information consisting of a combination of two or more of sound, color, light, and ultrasonic wave at its spatial position" Here, "information communication terminal apparatus" (Information communication terminal device 2) is typically a mobile phone (smartphone), but may be a device which has no communication function by itself but can receive and store space-mediated transmission information. For example, a device such as a batch attached to the chest of the user. Later retrieval of information from this device will make available space-mediated transmission information received by this device.

  In addition, as the space mediation transmission information, sound, color, light, ultrasonic waves (and their combination) have been mentioned, but it becomes possible to specify and define the space in which the information communication terminal device 2 exists. It is a thing. For example, in the case of a station, it may be surrounding background sound or lighting itself, its color, or transmission information of ultrasonic waves exceeding the audible range. These individual pieces of information and their combination make it possible to specify and define the space.

  In addition, it is possible to receive information at high speed by combining and diversifying not only one but also a plurality (two or more) of space-mediated transmission information. That is, as described above, the communication means represented by the binary number "010101 ..." of the current Internet has a limit on the amount of communication (communication speed) per unit time, and by 2020, it is 1000 times the current In order to cope with the amount of information that has been estimated, it is necessary to diversify the means of information transmission.

  In addition, by using space-mediated transmission information, physical lines such as the Internet are not necessary, and it is possible to exchange information beyond the standards of OSs and terminals. According to this method, it is possible to receive information such as signage that overflows in the town one after another.

  In addition, in the case of space-mediated transmission information, it is necessary to consider the interference of sunlight and various noises and noise in the living environment. In the present invention, in order to cope with this problem, a plurality of communication means such as "sound", "ultrasound" and "color" work complementarily, so it is easy to filter out their noise. Become.

  Further, in this embodiment, the information communication terminal device 2 itself incorporates an ultrasonic wave transmitter, and detects the ultrasonic waves reflected in the horizontal direction and the height direction according to the direction of the terminal device 2 to detect an obstacle. It is possible to measure the distance to The ultrasonic waves received at this time are also included in the space-mediated transmission information. By providing such a function, it is possible to measure the correct position of the information communication terminal device in the space, and in some cases, to measure the dimensions of the room.

(2) "Step of detecting terminal attribute information consisting of at least a combination of one or more of time, inclination / direction, and acceleration at which the information communication terminal device receives the above-described space-mediated transmission information" Is a step of recording attribute information of the terminal itself when the information communication terminal device 2 receives the space-mediated transfer information. Specifically, at least one of time, inclination / direction, and acceleration when the space-mediated transmission information is received. In addition to this, video information captured by this portable terminal may be recorded. Further, information that allows a third party to specify the terminal itself may be recorded, for example, a telephone number or a personal ID.

(3) “Step of identifying the spatial position of the information communication terminal device by decoding the received space media transfer information by the information communication terminal device or a server to which the information communication terminal device is connected”
In this step, the space-mediated transmission information received in the step (1) is decoded (decoded) to specify the space position P of the information communication terminal device 2.

  For example, suppose that the space is a specific convenience store. In this case, the communication device receives music flowing into the convenience store, the color of the floor or ceiling display shelf, lighting, and other ultrasonic waves exceeding the audible range. Further, by detecting the reflected wave of the ultrasonic wave transmitted from the information communication terminal device 2, the distance to the floor or wall is measured.

  In this embodiment, a database (spatial identification information database) storing identification information of sound, light, color, and ultrasound for identifying space-mediated transmission information specific to each space in the spatial position information processing server 3 4) are prepared in advance, and the information communication terminal device 2 inquires the server 3 about the space mediation transmission information to identify and specify the space. At this time, the reflection of the ultrasonic wave is used to specify the position in space. For example, the position in the store is specified by the distance to the obstacle in the water ratio direction measured by ultrasonic waves. Also, the height of the terminal can be detected.

  Decoding of the above-mentioned space mediating transmission information may be performed by the information communication terminal device 2 itself or may be performed by the server 3.

  In the present invention, as described above, a communication protocol is defined so that noise floating in the space can be filtered out by combining a plurality of (two or more) space-mediated transmission information with each other, and the above-mentioned decoding is performed It is executed according to the protocol.

In addition, when the spatial position can not be decoded only by the above-mentioned space-mediated transmission information, this may be performed using other auxiliary information. For example, a surrounding scene may be photographed by the camera function of the information communication terminal device 2 and the spatial position may be specified using this.
(4) "Process of storing information communication terminal device or server to which this information communication terminal device is connected, associating and storing attribute information of said terminal with space position of said specified information communication terminal device" This information communication terminal The attribute information of the device 2 means at least position information that can be detected by the terminal itself, information on orientation (tilt), one or more combinations of acceleration information, and preferably information for identifying the terminal (telephone number, personal ID, etc. ). By associating this with the spatial position P, it is possible to virtually leave information of the terminal on the space. This information is accumulated in the spatial position tag database 4b of the server.
(5) “The step of associating and storing the attribute information of the terminal in the intermittent spatial position by repeating the steps (1) to (4) at the predetermined timing by the information communication terminal device” As shown in FIG. 2, the footprint of this information communication terminal can be intermittently left on the space.

  Next, each function of said (6)-(8) is demonstrated about the method of utilizing the information (space space position tag) recorded on the said space.

  FIG. 3 is a schematic configuration diagram showing a system configuration for this.

  The space position information processing server 3 is indicated by 3 in the figure, and the space position transmission DB 4 a and the space position tag DB 4 b storing the space position tag P are connected to the server 3. The information communication terminal device 2 is connected to this server. Further, reference numeral 6 denotes a space mediation transfer information recording device (for example, a device such as a batch dedicated to information recording) which can not directly connect to the space position information processing server 3 described above. The device 6 can be connected to the spatial position information processing server 3 via, for example, the PC 7.

  And, a service provider system for providing processing service using spatial position tag P is shown by 8 in the figure. For example, when electronic money for transportation system use is installed in the terminal device 2, the service provider system 8 is a transportation system charging system. In this case, permission 9 is set such that the transport system charging system can track only the space information position tag P left around the station.

  The position information processing server 3 collates the permission 9 of the service user system 8 with the spatial position tag P to provide the service with the attribute information of the information communication terminal device 2 associated with the position tag P. To the provider system 8. Thereby, for example, assuming that the ticket gate of the station has passed, it is possible to provide a charging service to the information communication terminal device 2. Moreover, according to such a system, it can be assumed that the ticket gate itself becomes unnecessary in the future.

  Also, the service provider may be a retail commercial facility such as a convenience store. For example, in the case of a convenience store, it can be used for payment in the same way as the above-mentioned transportation charge, and it is possible to obtain customer flow line information on which position (height) of the store the terminal was. It is possible to use for devising such as the type and the position of display when replacing the

  Furthermore, not only charging but also various services can be provided by using the service provider system 8 described above.

  Hereinafter, for example, service provision to participants in a concert hall will be described as an example.

  In this example, the spaceborne transmission information at the concert hall is the songs, lights flowing at the concert. In addition, the acceleration of the terminal detected by the information communication terminal device 2 may be used for this.

  First, when it is detected that the information communication terminal device 2 has entered the concert hall, the service provider system 8 receives the permission from the space position information processing server 3 based on the permission 9 "in the hall". It becomes possible to take out the spatial information position tag and the attribute information of the portable information communication terminal 2, thereby permitting the access to the service providing system 8 of the information communication terminal 2.

  For example, the information communication terminal device 2 first downloads the dedicated application 10 from the service providing system 8. The application 10 receives information and instructions 10 prepared based on the space position tag P of the information communication terminal device 2 from the service provider system 8 and executes the information. For example, the following processing is possible.

  (A) It is determined from the space mediation transmission information received by the communication terminal device 2 where the mobile communication terminal is located in the concert hall, and the screen of the mobile communication terminal device 2 is made to emit light in a color according to its position.

  (B) The music played at the concert hall is determined from the space media transfer information received by the information communication terminal device 2, and the screen of the mobile communication terminal device 2 is made to emit light in a color according to the music. In addition, the timing of light emission or the like is varied according to the acceleration.

  (C) A song to be played at the concert hall is determined from the space media transfer information received by the communication terminal device 2, and the lyrics of the song and other related information are displayed on the screen of the communication terminal device 2.

  Also, as another example, an application example in which the space itself moves as in the case where the space is in an elevator or a train company will be described.

  When the space moves in this manner, for example, information on movement of the space may be transmitted to the application 10 downloaded to the terminal device 2. For example, when the space is an elevator, an outside scene corresponding to the height of the elevator may be sent to the application for display. In the case of a train, various information on the current position of the train may be sent to the application 10.

  According to the invention described above, the compatibility between various OSs such as iOS, Android, and Windows (registered trademark) has been extremely insufficient until now to have one function. By using "sound", "color" and "ultrasound" as a medium, it is possible to unify, and it is also possible to omit the mass of point cards and the like in a wallet that many people find troublesome.

  Until now, even with a single payment function, each store installed a dedicated terminal, and it took time and effort to connect it to the Internet. If this technology penetrates, a world where consumers can easily make payments with two smartphones can be realized.

  The present invention is not limited to the above embodiment, and it goes without saying that various modifications can be made without departing from the scope of the invention.

U1. U2 ... ultrasonic wave P1-P7 ... space position tag 1 ... user 2 ... information communication terminal equipment 3 ... space position information processing server 4a ... space mediation transmission information DB
4b ... space position tag DB
6 ... Device 7 ... PC
8 ... service user system 9 ... permission

Claims (12)

A method of storing information in space,
The information communication device receiving, at least at its spatial position, space-mediated transmission information consisting of a combination of two or more of sound, color, light, ultrasound;
Detecting at least terminal attribute information comprising a combination of one or more of time, inclination / direction, and acceleration at which the information communication device receives the space-mediated transmission information;
An information communication device or a server to which the information communication device is connected decodes the received space media transfer information to specify the space position of the information terminal device;
An information terminal device or a server to which the information communication device is connected stores the attribute information of the terminal at the spatial position of the identified information terminal device;
Storing the attribute information of the terminal at an intermittent spatial position by the information terminal device repeating all the steps at a predetermined timing;
The information stored in a specific spatial position based on the spatial position where each service providing system has permission for a plurality of service providing systems in which the server provides a predetermined service to the information terminal device Determining whether to pass terminal device attribute information;
The service providing system receives, from the server, attribute information of the information terminal device stored at a spatial position where the service has the permission, and based on the spatial position and the attribute information, the service providing system receives the information terminal device. Providing the predetermined service provided by the service providing system;
How to have it. The method of claim 1, wherein
The step of receiving the space-borne transmission information is receiving space-mediated transmission information consisting of a combination of two or more of sound, color, light, and ultrasound specific to the spatial position.
A method characterized by The method of claim 1, wherein
The ultrasonic wave as the space mediation transmission information includes a reflected wave of the ultrasonic wave oscillated by the information communication terminal device itself in order to specify the position of the information communication terminal device in the spatial position. A method characterized by In the method according to claim 1,
further,
Capturing an image of a space when the information communication terminal device receives the space-mediated transmission information;
When the information communication terminal device or the server to which the information communication terminal device is connected decodes the received space media transfer information, the image is also referred to to specify the space position of the information communication terminal device. How to feature. The method of claim 1, wherein
The server has a reference database storing sound, color, light, and ultrasound information associated with a specific spatial position;
A method characterized in that the step of specifying the space position is the step of specifying the space position by the server querying the reference database for the received space mediation transmission information. In the method according to claim 1,
When the space itself in which the spatial position of the information communication terminal device is moved, the predetermined service provided by the service providing system is provided based on the position after the movement, the spatial position, and the attribute information. A method characterized by A system for storing information in space,
Means for the information communication terminal device to receive space-mediated transmission information consisting of one or a combination of one or more of sound, color, light and ultrasound specific to the spatial position;
A means for detecting terminal attribute information comprising a combination of one or more of time, inclination / direction, and acceleration at which the information communication terminal device receives the space-mediated transfer information;
An information communication terminal device or a server to which the information communication terminal device is connected decodes the received space media transfer information, thereby specifying a space position of the information communication terminal device;
An information communication terminal device or a server to which the information communication terminal device is connected associates the attribute information of the terminal with the spatial position of the identified information communication terminal device and stores the information;
A means for associating and storing attribute information of the information communication terminal device at intermittent spatial positions by the information communication terminal device repeating all the means at a predetermined timing;
Whether the server passes the attribute information of the information communication terminal device to a plurality of service providing systems that provide services to the information communication terminal device based on the spatial position where each service providing system has permission Means for determining whether or not
The service providing system receives, from the server, attribute information of the information terminal device stored in the spatial location where the user has permission, and based on the spatial location and the attribute information, the service providing system provides the predetermined information. Means of providing the services of
With a system. The system according to claim 7 , wherein
The means for receiving space-mediated transmission information is to receive space-mediated transmission information consisting of a combination of two or more of sound, color, light, and ultrasound specific to the spatial position.
A system characterized by The system according to claim 7 , wherein
The ultrasonic wave as the space mediation transmission information includes a reflected wave of the ultrasonic wave oscillated by the information communication terminal device itself in order to specify the position of the information communication terminal device in the spatial position. A system characterized by In the system according to claim 7 ,
further,
A means for capturing an image of a space when the information communication terminal device receives the space-mediated transmission information;
When the information communication terminal device or the server to which the information communication terminal device is connected decodes the received space media transfer information, the image is also referred to to specify the space position of the information communication terminal device. Characteristic system. The system according to claim 7 , wherein
The server has a reference database storing sound, color, light, and ultrasound information associated with a specific spatial position;
The system according to claim 1, wherein the means for specifying the space position specifies the space position by the server querying the reference database for the received space mediation transmission information. In the system according to claim 7,
When the space itself in which the spatial position of the information communication terminal device is moved, the predetermined service provided by the service providing system is provided based on the position after the movement, the spatial position, and the attribute information. A system characterized by