JP5966714B2 - Evaluation system, program - Google Patents

Description

  The present invention relates to an evaluation system that allows an evaluator to evaluate an object in the real world.

  In order to promote sales of their own products and services, the providers of products and services carry out various sales promotion activities. On the other hand, with advances in communication technology, customers and other recipients (hereinafter referred to simply as “evaluators”) can evaluate products and services, and each evaluator can share the evaluation results on the Web, etc. It has become. For example, there is a Web site where an arbitrary evaluator can post a review article for a specific product. Potential buyers interested in products and services tend to emphasize not only the information provided by the provider but also the evaluation results of the evaluator.

  On the Internet, a technique for publicizing evaluation results of various types of information by an arbitrary evaluator is known (see, for example, Patent Document 1). Patent Document 1 describes that a message is evaluated by pressing a predetermined button, and the evaluation is notified to a message sender or displayed on a list.

  However, evaluation of goods and services by such an evaluator is possible only for information on the Web. When posting a review article for a specific product, a website dedicated to the product is prepared in advance.

  In addition, a technique for judging an evaluator's evaluation of an object existing in the real world, not information on the Web is frequently seen (see, for example, Patent Document 2). According to Patent Document 2, the behavior of a visitor is picked up, returned, brought into a fitting room, purchased, or not purchased by an IC tag attached to the product and an antenna for identifying the tag. Analyzing as a type, the visitor's behavior is associated with the store visitor and time to make a series of purchase behavior, and weighting is set in advance via the input / output means according to the type of behavior included in the purchase behavior A product information providing system is disclosed that aggregates the results and adds the results of the aggregation and the purchase behavior or behavior that is the basis of the aggregation to the input / output means in response to a request from the input / output means.

  However, the product information providing system disclosed in Patent Document 2 has a problem that the store visitor cannot actively give evaluation to the product. That is, the product information providing system disclosed in Patent Document 2 does not take into account that the customer's actions are automatically evaluated and the customer intentionally gives the product an evaluation.

  As described above, in the conventional technology, there is no mechanism in which an evaluator actively gives an evaluation to a product or service that exists in the real world or shares the evaluation.

  Moreover, since the merchandise information providing system disclosed in Patent Document 2 manages evaluation information to the end, the customer cannot confirm whether the evaluation result by the customer is correctly reflected and the evaluation result cannot be confirmed. There is.

  In the real world, where the evaluator was at the time of evaluation may be important. However, there is a problem that a position detection system such as GPS (Global Positioning System) may not be able to detect the position indoors. There is also a problem that a module for GPS is required.

  In view of the above problems, an object of the present invention is to provide an evaluation system in which an evaluator can actively give evaluation to a target in the real world and utilize position information at the time of evaluation.

The present invention provides a computer with a specific operation detection step for detecting a predetermined specific operation, an identification information acquisition step for acquiring identification information of an evaluation target, and position information of the current position or the current position. a position information obtaining step of obtaining the position estimate information for estimating the identification information storing step of storing the previous SL identification information in the storage unit, the identification information stored in the storage unit, and the position information or the the location estimation information to execute a transmission step of transmitting to the external device, receiving the location-related information associated with the position information estimated from the position information or the position estimate information from said external device, the holding a program, the first information the position information or said location estimate of each computer to the identification information received by the associated from the computer And which, associated with the evaluation information updating means, position information said estimated from the positional information or the position estimation information to update the evaluation information of the target of the evaluation associated with the identification information received from the computer A position-related information creating unit that creates position-related information including a result obtained by counting the number of pieces of position information in a predetermined area; and a transmission unit that transmits the position-related information to a computer. It is characterized by that.

  It is possible to provide an evaluation system that enables an evaluator to actively give an evaluation to an object in the real world.

It is an example of the figure which shows the schematic procedure of the evaluation system of a present Example. It is an example of the schematic block diagram of an evaluation system. It is an example of the hardware block diagram of an evaluation device. It is an example of the hardware block diagram of a server. It is an example of a functional block diagram of an evaluation system including an evaluation device. It is a figure which shows an example of ID displayed on the display part. It is an example of the figure which shows an evaluation result table and an object specific table typically. It is a figure which shows an example of related information. It is a figure which shows an example of position-> service provision DB. It is an example of the figure which illustrates typically the position service information which a position service information generation part produces | generates. It is a figure which shows an example of the top page displayed on the browsing client. It is an example of the flowchart figure which shows the procedure in which an evaluation device evaluates object. It is an example of the flowchart figure which shows the procedure in which an operation | movement detection part detects gesture operation | movement. It is an example of the operation | movement sequence diagram of an evaluation system. It is an example of the flowchart figure of the process of FIG.14 S12. It is a diagram showing an example of the number of evaluations displayed on the evaluation device, It is an example of the flowchart figure which shows the procedure in which a browsing client requests | requires evaluation data with respect to a server. It is an example of the figure which shows the schematic procedure of an evaluation system (Example 2). It is an example of the schematic block diagram of an evaluation system (Example 2). It is an example of functional block diagrams, such as an evaluation device (Example 2). It is an example of the figure which illustrates image data DB typically. It is an example of the figure which illustrates the outline of a visual search typically. It is a figure which shows an example of the document image by which skew correction was carried out. It is an example of the figure which illustrates grouping based on a word boundary typically. It is an example of the figure explaining the feature-value which makes 0 and 1 feature-value. It is a figure which shows the example of calculation of the angle which a word boundary forms. It is an example of the figure explaining the feature-value based on word length. It is an example of the figure which shows the specific example about how a vertical layout is integrated with a horizontal layout. FIG. 26 is an example of a diagram illustrating a method for combining horizontal and vertical trigram information obtained in FIG. 25. It is an example of the flowchart figure which shows the procedure in which an evaluation device transmits image data to a search server.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.

FIG. 1 is an example of a diagram illustrating a schematic procedure of the evaluation system of the present embodiment.
(1) The evaluator carries the evaluation device 12. The evaluation device 12 is, for example, a portable communication terminal. When an evaluator encounters an evaluation object 11 of interest while moving in the real world, the evaluator generally walks and stops slowly. The evaluator can also evaluate the product after purchase.

The evaluation device 12 continuously detects an evaluation target 11 capable of wireless communication. If communication is possible, the evaluation device 12 communicates with the evaluation target 11 and receives an ID. The ID is identification information for specifying the evaluation target 11.
(2) When the evaluator wants to evaluate the evaluation target 11 with an interest, the evaluator performs a predetermined specific operation. The specific action is arbitrary as long as it is an action that the evaluator consciously takes at the time of evaluation (it may not be an action that occurs unconsciously). For example, the evaluation device is moved in the space (gesture), voice input, operation of the evaluation device 12 or the like.
(3) Further, the evaluation device has a function of communicating with a plurality of wireless communication stations 16, acquires identification information of the wireless communication stations 16 when communicating with each wireless communication station 16, and determines received signal strength To do. The evaluation device transmits the identification information of the wireless communication station 16 and the received signal strength (hereinafter referred to as wireless base station information) to the server 13.
(4) The evaluation device 12 transmits the ID and the radio base station information to the server 13 when detecting the specific operation.
(5) The server 13 identifies the evaluation object 11 based on the ID and totals the number of evaluations. The tabulation of the evaluation number is to count up the evaluation number of the received ID every time the same ID is received. If the server 13 does not have the same ID, a new ID is registered and the evaluation number is set to 1. Therefore, it means that the evaluation target 11 having an ID with a large number of evaluations compiled by the server 13 is evaluated by many evaluators. When the evaluation means “good thing”, it means that the evaluation target 11 is evaluated as being better by many evaluators.

Further, the server 13 estimates the position of the evaluation device using the radio base station information. If the position of the evaluation device is known, information useful for the evaluator of the position (hereinafter referred to as position service information) can be transmitted to the evaluation device.
(6) The server 13 transmits the evaluation number and location service information (for example, weather) to the evaluation device.
(7) The evaluation device displays the evaluation number and location service information on the display unit.

  As described above, in the evaluation system of this embodiment, the evaluator can actively evaluate the product or service in the real space. Moreover, the evaluation system can provide not only the evaluation result to the evaluator but also useful information to the evaluator linked to the position of the evaluation device.

[Configuration example]
FIG. 2 shows an example of a schematic configuration diagram of the evaluation system 500 of the present embodiment. The evaluation system 500 includes an evaluation target (wireless communication chip 15) 11, an evaluation device 12, two or more wireless communication stations 16, a server 13, and a current position estimation service system 17. The browsing client 14 may be added to the evaluation system 500. In addition, although the person who carries the evaluation device 12 is referred to as an evaluator, the evaluator may be any person or a person who is given a certain qualification.

<Target of evaluation and wireless communication chip>
A wireless communication chip 15 is arranged on the evaluation target 11. The wireless communication chip 15 is, for example, an IC tag using, for example, RFID (Radio Frequency Identification). The IC tag has a relatively small chip and an antenna, and stores at least an ID. The IC tag reads out and transmits the ID when it receives radio waves or electromagnetic waves, or spontaneously. In general, the wireless communication chip 15 can be identified with the evaluation target 11. That is, it may be physically integrated with the evaluation target 11 and may be difficult to separate. However, it need not be physically integrated or difficult to separate.

  The wireless communication chip 15 is created by, for example, a semiconductor manufacturing process. Such a three-dimensional wireless communication chip 15 is affixed or embedded on the surface of a three-dimensional object or a flat object. The wireless communication chip 15 can be formed using a printing technique. The printing may be performed by any printing technique, for example, screen printing, flexographic printing, an inkjet method, or the like. Such a planar wireless communication chip 15 is formed directly on the surface of a three-dimensional object or a planar object, or attached after being formed by printing.

  The wireless communication chip 15 as an IC tag may be any type, such as a passive type that does not have a battery, an active type that has a battery and spontaneously transmits radio waves, or a semiconductor that has a battery but does not spontaneously transmit radio waves. Any of passive type may be used. The radio frequency band may be defined by national or regional standards, but the frequency band is not limited. For example, there are frequency bands such as 135 kHz or less, 13.56 MHz, UHF band (860 to 960 M), and 2.45 GHz. Further, an IC tag of a specific standard such as NFC (Near Field Communication) or Transfer Jet (registered trademark) can be used.

  For example, the active or semi-passive wireless communication chip 15 has a communication distance of around 100 meters. The wireless communication chip 15 that communicates at a UHF band frequency even in the passive type has a communication distance of 10 meters or more. For this reason, it is advantageous when evaluating the object 11 of the distant evaluation as viewed from the evaluator. On the other hand, since the wireless communication chip 15 that communicates at a frequency of 13.56 MHz has a communication distance of several centimeters, it is advantageous when an evaluator selectively evaluates a specific evaluation target 11 from many evaluation targets 11. It is.

  The ID is numbers, symbols, alphabets, or identification information in which these are combined. As product ID codes, JAN (Japanese Article Number) codes, EAN codes (European Article Number), and UPC (Universal Product Code) codes are known. The ID is preferably unique in the whole world, the whole country, or the country or region. However, since the ID is assigned by the provider of the evaluation target 11, the ID may be duplicated depending on the scale of the evaluation system 500. There is also. However, the IC tag stores not only the ID but also information to be evaluated. Information stored in the IC tag is arbitrary information for facilitating management, and includes various information such as a product name, a provider name, a product size, a color, and a lot number. Therefore, the ID and other information hardly match. When the IDs overlap, the server 13 determines whether or not other information matches. If the other information does not match, the server 13 determines that the ID is another evaluation target 11. In this case, a branch number is assigned separately from the ID, and the uniqueness of the ID can be managed on the server side.

  On the other hand, when the evaluation system 500 is deployed in a specific range such as an exhibition or a department store, it is only necessary to count the number of evaluations in a specific range, so it is unique only in a specific range such as an exhibition or a product department. If it is enough.

  In addition to the IC tag, the wireless communication chip 15 uses Bluetooth (registered trademark), infrared light and visible light (for example, NMEA 0183, a communication standard / specification established by the National Marine Electronics Association of the United States (NMEA)). An irradiation device, a wireless LAN, or the like may be used.

  The evaluation target 11 only needs to have the wireless communication chip 15 and may be a tangible or intangible object. In the case of a tangible object, any object such as a product, an exhibit, a loaned item, a property owned by oneself or another person, a single item, a waste item, a feature fixed on a road, or a building can be an object 11 to be evaluated. Intangible objects include services (services), sightseeing spots, sights, places, spaces, etc., but can be evaluated because the wireless communication chip 15 can be placed by being linked to some tangible object. For example, services include restaurants, beauty salons, cleaning, repairs, human resource introduction, education, transportation, infrastructure services, administrative services such as ward / city halls, and medical institutions. In the case of service, the provider can arrange the wireless communication chip 15 at a service providing place, a place with a shop name, a table in a store, a cashier counter, a terminal of a store clerk, and the like. In the case of a sightseeing spot, a sight, a place, or a space, it can be placed on the nearest station, a bus stop, a signboard for explaining a sightseeing spot, or the like.

<Evaluation device>
The evaluation device 12 only needs to have a communication device capable of communicating with the wireless communication chip 15 and the server 13. For example, in the case of a smartphone, tablet, straight PC, mobile phone, PDA (Personal Digital Assistant), notebook PC, etc., the evaluator carries the evaluation frequently without using a specific evaluation device 12 because the evaluator carries it frequently. The object 11 can be evaluated. Further, as will be described later, the evaluator evaluates the evaluation target 11 with a specific operation, and therefore, the evaluation device 12 can be an object having a shape that facilitates the specific operation. For example, in the case of a baton, the evaluator can evaluate the evaluation object 11 simply by swinging down the baton. Further, a name tag is provided to visitors at an exhibition or the like, and this name tag can be used as the evaluation device 12.

  The evaluation device 12 periodically searches for the wireless communication chip 15 and receives an ID from the wireless communication chip 15 when the wireless communication chip 15 is detected. The fact that the wireless communication chip 15 has transmitted the ID may be recorded. When the evaluation device 12 detects the specific operation after receiving the ID, the evaluation device 12 transmits the ID to the server 13. When the ID is received but no specific operation is detected, the ID of the evaluation device 12 is finally discarded.

  As another example of the communication procedure, the evaluation device 12 may search for the wireless communication chip 15 when detecting a specific operation, and receive an ID from the wireless communication chip 15 when the wireless communication chip 15 is detected. . Upon receiving the ID, the evaluation device 12 transmits the ID to the server 13.

  The evaluation device 12 preferably stores the transmitted ID. Thereby, when the evaluator carrying the evaluation device 12 operates the browsing client 14, the evaluated ID can be input to the browsing client 14 to check the evaluation number of the evaluation target 11 evaluated by the evaluator 11. . Alternatively, the evaluation device 12 can be operated to check the evaluation number of the evaluation target 11 evaluated by the server 13 itself.

  The evaluation device 12 executes a program 114 (application), which will be described later, and performs processing characteristic of the present embodiment. The program 114 is downloaded from the server 13 or a file server operated by the server 13.

<Wireless communication station>
The wireless communication station 16 is a base station for performing wireless communication with a mobile station. The mobile station of this embodiment is the evaluation device 12, but the communication method may be any communication method such as wireless LAN, cellular phone (CDMA, LTE), WiMAX, or the like. In the case of a wireless LAN, the base station may be conventionally called an access point.

  There are at least two wireless communication stations 16 and the evaluation device 12 communicates with two or more wireless communication stations 16 from the same location. The wireless communication station 16 transmits identification information for identifying the own device to the evaluation device 12. The evaluation device 12 determines the received signal strength (RSSI (Received Signal Strength Indicator (Indication))) when the identification information is received. In the case of a wireless LAN base station, the information for identifying its own device is MAC (Media (Access Control address) address and SSID (Service Set Identifier) In the case of a mobile phone or WiMAX, it is identification information given to the base station by each telecommunications carrier.

  Moreover, the evaluation device 12 may acquire the position information of the evaluator using a GPS signal transmitter (transmitting a satellite positioning signal) of IMES (Indoor Messaging System) as the radio base station information 16. That is, the evaluation device can acquire position information by IMES.

<Server>
The evaluation device 12 communicates with the server 13 via a network. The network is a network in which, for example, a mobile phone network, a wireless LAN network, or WiMAX is combined with an IP network (a network that communicates using an Internet protocol). That is, a mobile phone network or a gateway of a WiMAX communication carrier is connected to the IP network, and a wireless communication station (access point) 16 of the wireless LAN is connected to the IP network via a router. The evaluation device 12 is connected to a mobile phone network or a WiMAX base station (which may be the wireless communication station 16) and communicates with the server 13 via a gateway, or a wireless LAN access point (which is a wireless communication station). 16 may be connected to the server 13 from the access point via the router.

  The IP address of the server 13 is registered in advance in the program 114 executed by the evaluation device 12. The evaluation device 12 may be given a global IP address in advance, or a base station or an access point may temporarily give a local IP address.

  The server 13 has two functions. One is a function for totaling evaluations (hereinafter referred to as a totaling function 21), and the other is a function for providing the number of evaluations to the browsing client 14 (hereinafter referred to as a providing function 22). The number of evaluations is the sum of the number of received IDs for each ID, or the weight of one reception (counting one reception as a number other than one. For example, one time depending on the strength of the gesture The received number is added to the alpha or the count number is changed according to the ID range and the current position).

  In the providing function, the server 13 provides the evaluation number to the browsing client 14. The browsing client 14 is an arbitrary information processing apparatus, but the evaluation device 12 may become the browsing client 14 as it is. The browsing client 14 and the server 13 are connected via a network. The browsing client 14 connects to the server 13 via, for example, a browser, receives and displays the evaluation number, and receives and displays the evaluation number transmitted as an e-mail. The URL (or IP address) of the server 13 is known to the browsing client 14 or is provided by a DNS (Domain Name Server).

  When the evaluation device 12 operates as the browsing client 14, the evaluation number can be received as a response to the transmitted ID. That is, the program 114 operating on the evaluation device 12 is responsible for communication.

  Thus, the viewer who operates the browsing client 14 can confirm what kind of evaluation object 11 has a high evaluation and how much the evaluation object 11 he / she has evaluated has received. . In addition, since the provider of the evaluation target 11 knows or at least obtains the ID of the evaluation target 11 provided by himself, the number of evaluations of the evaluation target 11 provided by inputting the ID into the browsing client 14 Can be confirmed.

<Current location estimation service system>
The current position estimation service system 17 estimates the position of the evaluation device using the radio base station information received from the server or the evaluation device. The current position estimation service system 17 has a database of the wireless communication station 16 and can specify position information (latitude / longitude / table section) associated with the identification information of the wireless communication station 16. Therefore, if a plurality of wireless communication stations 16 with which the evaluation device communicates can be specified, the position of the evaluation device can be estimated from the radio wave intensity.

  As a server for providing such a service, there is a place engine (registered trademark, hereinafter abbreviated), a server provided by a telecommunications carrier, or the like. In this embodiment, either service may be used, and any mechanism may be used as long as the position of the evaluation device can be estimated. For example, in the outdoors, the position may be detected using GNSS (Global Navigation Satellite Systems).

  In FIG. 2, the server and the current position estimation service system 17 are illustrated separately for the sake of explanation, but the server 13 and the current position estimation service system 17 may be provided as a so-called cloud service. That is, the server 13 and the current position estimation service system 17 may be separate or the same, and the evaluator may not be able to recognize the existence of the server 13 and the current position estimation service system 17.

[Hardware configuration diagram]
FIG. 3 shows an example of a hardware configuration diagram of the evaluation device 12. The evaluation device 12 includes a CPU 101, ROM 102, RAM 103, flash ROM 104, display unit 105, operation unit 106, media I / F unit 107, wireless LAN communication unit 108, carrier communication unit 109, camera 110, microphone 111, acceleration sensor 112, In addition, a short-range wireless communication unit 113 is included.

  The CPU 101 controls the overall operation of the evaluation device 12 by executing a program 114 stored in the flash ROM 104. The ROM 102 stores IPL (Initial Program Loader) and static data. The RAM 103 is used as a work area when the CPU 101 executes the program 114.

  The flash ROM 104 stores an OS executed by the CPU 101 (for example, Android (registered trademark), iOS (registered trademark), Windows (registered trademark)), middleware, and a program 114 that provides the following functions of the evaluation device 12. ing. The program 114 may be called an application.

  The display unit 105 is a liquid crystal, an organic EL, or a projector, and displays a UI (User Interface) screen. A graphic control unit (not shown) interprets a drawing command written in the video RAM by the CPU 101 and displays various information such as a window, a menu, a cursor, a character, or an image on the display unit 105. Note that the display unit 105 integrally has a touch panel and displays various soft keys that accept user operations.

  The operation unit 106 is a hard key that accepts an evaluator's operation, a touch panel, or a soft key displayed on the touch panel. The operation details of the hard key, the touch panel, and the soft key are notified to the CPU 101.

  The media I / F 107 controls reading or writing (storage) of data with respect to a recording medium such as a flash memory.

  The program 114 is a file in an installable or executable format, and is distributed on a computer-readable recording medium. Further, the program 114 is distributed to the evaluation device 12 in a file that can be installed from the server 13 or can be executed, for example.

  The wireless LAN communication unit 108 transmits and receives data by controlling the modulation method, transmission speed, frequency, and the like based on IEEE802.11b / 11a / 11g / 11n. When data is received, the received radio wave is converted into a digital signal, and when data is transmitted, data requested to be transmitted from the CPU 101 is modulated according to a communication standard and transmitted as a radio wave.

  The carrier communication unit 109 performs various communications by a telecommunications carrier contracted by an evaluator of the evaluation device 12. The telecommunications carrier is, for example, a mobile phone carrier, a WiMax carrier, or the like that communicates with a communication standard such as CDMA or LTE. The carrier communication unit 109 is equipped with a SIM (Subscriber Identity Module Card) card. The SIM card is an IC card that stores contractor information issued by a telecommunications carrier to a contractor, and mainly stores a unique number called IMSI (International Mobile Subscriber Identity), a mobile phone number, and the like. .

  The carrier communication unit 109 performs modulation or the like according to a communication method determined by a telecommunications carrier and communicates with a base station (not shown) connected to the Internet. The base station is connected to the carrier server 13 of the telecommunication carrier, and the carrier server gives a temporary IP address to the evaluation device 12 and transmits the ID to the IP network via the gateway.

  The camera 110 is a color image pickup unit including a CCD or CMOS photoelectric conversion element. When the camera 110 is a stereo camera or has a distance measuring function using ultrasonic waves or the like, the distance to the evaluation target 11 is known, and therefore the size of the evaluation target 11 can be estimated from the focal length of the lens. In this case, discrimination based on the image of the evaluation target 11 is facilitated.

  The microphone 111 collects the evaluator's voice and converts it into an electrical signal. In addition, the program 114 operating on the evaluation device 12 performs so-called speech recognition that converts this electrical signal into text data.

  The acceleration sensor 112 is a sensor that detects acceleration in the x-axis, y-axis, and z-axis directions. The acceleration sensor 112 detects the direction of the evaluation device 12 and detects the moving direction in space. In addition to the acceleration sensor 112, a gyro sensor, a geomagnetic sensor, a fingerprint sensor, or the like may be provided. The gyro sensor detects the angular velocity of the evaluation device 12 with respect to the x-axis, y-axis, and z-axis. The geomagnetic sensor detects the direction from the direction of geomagnetism. Combining the detection results of these sensors makes it possible to detect complex specific operations.

  The short-range wireless communication unit 113 performs RFID communication with the wireless communication chip 15. In the case of the passive type, communication is performed according to the following procedure. The short-range wireless communication unit 113 transmits radio waves to a predetermined range. This radio wave includes a control signal (command) for controlling the wireless communication chip 15. The wireless communication chip 15 receives the radio wave, and the antenna resonates with the radio wave to generate an electromotive force. The generated power starts the circuit and performs a process according to the control signal (a process for reading and transmitting the ID). . The wireless communication chip 15 modulates a carrier wave having a predetermined frequency with an ID and transmits it as a radio wave. The short-range wireless communication unit 113 demodulates the radio wave and extracts the ID.

  The short-range wireless communication unit 113 may be Bluetooth (registered trademark), UWB (Ultra Wide Band), or the like, and may have a function of RFID communication separately from these.

  FIG. 4 shows an example of a hardware configuration diagram of the server 13. The server 13 may have a general information processing apparatus configuration.

  The server 13 includes a CPU 301, ROM 302, RAM 303, HDD 304, graphic board 305 to which a display 320 is connected, a keyboard / mouse 306, a media drive 307, and a communication device 308. The CPU 301 controls the entire server 13 by executing the program 310 stored in the HDD 304 using the RAM 303 as a working memory. A keyboard / mouse 306 is an input device that receives an operation of a system administrator. The media drive reads and writes data on optical media such as CDs, DVDs, and Blu-ray discs. The communication device 308 is, for example, an Ethernet (registered trademark) card for connecting to a network.

  The HDD stores an OS (Windows Linux (registered trademark), etc.), middleware, and a program 310 that provides the totaling function 21 and the providing function 22. The program 310 is a file in an installable or executable format, and is distributed by being recorded on a computer-readable recording medium. The program 310 is distributed as a file that can be installed or executed from a server 13 (not shown).

  Although the hardware configuration of the browsing client 14 is the same as that of the server 13, it does not need to be the same.

[About functions]
FIG. 5 shows an example of a functional block diagram of an evaluation system including an evaluation device. The evaluation device 12 includes a communication unit 31, an Internet communication unit 32, a control unit 33, a storage unit 34, and an operation sensing unit 35. The evaluation device 12 is controlled by the control unit 33. The control unit 33 controls the communication unit 31 and the Internet communication unit 32 according to a predetermined procedure, and transmits the ID received from the wireless communication chip 15 to the server 13. Note that the Internet communication unit 32 can receive the evaluation number.

<Evaluation device>
The communication unit 31 acquires the ID from the wireless communication chip 15 by controlling the short-range wireless communication unit 113. The Internet communication unit 32 controls the carrier communication unit 109 and the wireless LAN communication unit 108 to communicate with the server 13 based on an application layer protocol such as FTP or HTTP, and transmits the ID to the server 13.

  As shown in the figure, the Internet communication unit 32 communicates with the server 13 via the wireless communication stations 16-1 and 16-2 (hereinafter simply referred to as the wireless communication station 16). For example, in the case of a wireless LAN, each wireless communication station 16 periodically transmits a signal called a beacon. The beacon includes an SSID, a MAC address, a supported frequency, a QOS, and the like, and the wireless LAN communication unit 108 can receive the beacon if the radio communication station 16 reaches the radio wave range. In general, the Internet communication unit 32 selects a wireless communication station 16 having the highest received signal strength of a beacon (by specifying an SSID) and starts communication. Further, in order to limit the evaluation devices that can be connected to the wireless communication station 16 (in order to improve security), the wireless communication station 16 communicates with the evaluation device by encrypting using an encryption key. Note that the SSID and encryption key of the wireless communication station 16 are registered in the evaluation device 12 in advance.

  After starting the communication, the Internet communication unit 32 acquires an IP address and a default gateway from the DHCP server, and connects to the IP network.

Since there are a plurality of evaluation targets 11 in the communicable range of the communication unit 31, a plurality of wireless communication chips 15 may return IDs in a short time. In this case, the ID transmitted from the Internet communication unit 32 to the server 13 is controlled as follows.
・ Send all ・ Send only one last ID ・ Send only one ID selected by the evaluator ・ Send only one ID with the highest signal strength Send all This is a case where the evaluation target 11 may be evaluated collectively, and is effective for evaluating a series of commodities such as daily necessities and interiors having a uniform design. The last ID is the last ID received when a predetermined time or more has passed after receiving the newest ID until the next ID is received (that is, when reception of the ID is interrupted). is there. It is assumed that the evaluator is moving and stops when he / she is interested in the evaluation target 11, but the last ID is likely to be the ID of the evaluation target 11 he / she is interested in when he / she stopped. For this reason, the ID of the evaluation object 11 evaluated by the evaluator can be transmitted to the server 13 by transmitting the last ID.

The ID selected by the evaluator is an ID selected by the evaluator from several IDs.
FIG. 6A is a diagram illustrating an example of an ID that is communicated by the communication unit 31 and displayed on the display unit 105. For example, there are three evaluation targets 11 (cups in the figure) in the communication range, and the display unit 105 displays three IDs. In this case, the evaluator specifies the ID of the evaluation target 11 being evaluated by causing the evaluation device 12 to communicate with the evaluation target 11 again. When the short-range wireless communication unit 113 has directivity, the evaluation target 11 facing the evaluation device 12 returns an ID, and thus the evaluator can specify the ID of the evaluation target 11. When the wireless communication chip 11 transmits information such as a product name to the evaluation device 12, the evaluation device 12 displays the product name and the like together with the ID on the display unit 105, so that the evaluator can easily select the ID.

  The ID having the highest radio wave intensity is the evaluation target 11 that is closest to the evaluation device 12. FIG. 6B is a diagram illustrating an example of an ID selected based on the radio field intensity. Since the communication unit 31 can specify the ID of the wireless communication chip 15 having the strongest radio wave intensity, the evaluation device 12 surrounds the ID with a rectangular frame or reverse-displays the ID, for example. If the evaluator is interested in the evaluation target 11, it is considered that the evaluator is approaching the evaluation target 11, and therefore the ID of the evaluation target 11 being evaluated by the evaluator can be transmitted.

  Note that the Internet communication unit 32 may transmit the ID of the wireless communication chip 15 having the highest radio wave intensity to the server 13 without causing the evaluator to select the ID.

  Here, it may be preferable for the Internet communication unit 32 to add information other than the ID. For example, the server 13 may not be able to specify the evaluation target 11 only by the ID (when the ID is not registered or when the ID 11 is the same but a different evaluation target 11 is registered). Therefore, the Internet communication unit 32 transmits related information that may be related to the evaluation target 11 together with the ID.

  The related information includes, for example, information received from the wireless communication chip, a unique number of the evaluation device 12, position information (when the evaluation device has a position detection function), time information, a direction of the evaluator, and an evaluation target 11 images, comments input by the evaluator about the evaluation target 11, and the like. Information received from the wireless communication chip is arbitrary information for facilitating management as described above. The unique number is, for example, an IMSI or a mobile phone number. The position information is detected by a GNSS (Global Navigation Satellite Systems) included in the evaluation device 12. It can also be calculated from the radio wave intensity from a plurality of base stations and the position of the base station. Even if these functions are not provided, the current position of the evaluation device is estimated by the current position estimation service.

  The traveling direction is information indicating east, west, north, and south, and is specified by time-series position information or a detection value of a geomagnetic sensor, for example. The image of the evaluation target 11 is taken by the camera 110. The comment is, for example, the name of the evaluation target 11 or specific evaluation contents, and is input to the evaluation device 12 by the evaluator.

  When the evaluation system 500 is developed within a specific range such as an exhibition or a department store, it is also effective to include personal information permitted by the evaluator to be transmitted in the related information. Personal information is mainly contact information, and includes company name, name, address, telephone number, e-mail address, and the like. There are many cases where the evaluator is interested in the evaluation target 11 and wants detailed materials of the evaluation target 11, and there are not a few providers of products and services that want to contact such evaluator. For example, there are many such needs in exhibitions.

  The storage unit 34 stores the ID received by the communication unit 31, and preferably position information (when the evaluation device has a position detection function) and time information when the ID is received. When the evaluator takes an image of the evaluation target with the camera 110, the image of the evaluation target 11 is stored.

  For example, the motion sensing unit 35 senses that the acceleration detected by the acceleration sensor 112 has occurred due to a specific motion and notifies the control unit 33 of it. The specific action detected by the acceleration sensor 112 is referred to as a gesture action. The specific motion sensed by the motion sensing unit 35 is, for example, a motion in which the evaluation device 12 is vertically shaken. In this case, the motion sensing unit 35 senses an acceleration that continuously changes from a downward acceleration to an upward acceleration. To do. In addition, the specific operation can be defined as an operation in which the evaluator shakes the evaluation device 12 several times up and down, an operation that shakes the evaluation device several times in the right and left directions, an operation that protrudes forward, etc. Detects changes in acceleration. The motion sensing unit 35 stores a change in typical acceleration of each specific motion in advance, and detects the specific motion of the evaluator by comparing it.

  Further, the specific operation may be not only a gesture operation but also an input by voice as a specific operation, and an operation on the hard key, soft key, or touch panel of the evaluation device 12 may be a specific operation.

  Also, taking a picture may be a specific action. In addition, it is also possible to set the condition for ID transmission to detect a plurality of specific actions by combining voice input or an operation to the evaluation device 12 with a gesture action.

  Further, the motion sensing unit 35 can distinguish and detect a specific operation with a good evaluation and a specific operation with a bad evaluation. In this case, a change in acceleration typical of a specific action of good evaluation and a specific action of bad evaluation is stored in advance, and the specific action of the evaluator is detected by comparing with each of them.

<Server>
Aggregation function The aggregation function 21 of the server 13 includes a reception unit 23, a transmission unit 27, a location service information generation unit 28, an evaluation number addition unit 25, an ID determination unit 24, a target identification unit 26, and an evaluation information management DB 20. doing. The evaluation information management DB 20 may not be included in the server 13 as long as the server 13 can access it.

  The receiving unit 23 receives the ID (related information when there is related information) and the radio base station information from the evaluation device 12. The receiving unit 23 sends the ID to the ID determining unit, and transmits the radio base station information to the current position estimation service system 17. Since the current position estimation service system 17 returns position information to the server 13, the position service information generation unit 28 generates position service information. The generation of location service information will be described later.

  The ID determination unit 24 specifies the evaluation target 11 based on the ID. As described above, the evaluation target 11 may or may not be specified by the ID. For example, when an ID is assigned only to the evaluation target 11 registered in advance in the server 13, the ID determination unit 24 can uniquely identify the evaluation target 11 from the ID. Such a situation can be realized in the real world where the evaluation system 500 is deployed in a specific range such as an exhibition or a department store. On the other hand, when various providers give arbitrary IDs to the evaluation target 11 without involving the server 13, it becomes difficult to specify the evaluation target 11 only by the ID. That is, there are cases where IDs are not registered in the server 13 or IDs overlap.

  If there is an ID that matches the ID already registered in the evaluation information management DB 20, the ID determination unit 24 notifies the evaluation number adding unit 25 of the ID. When there is a possibility that the IDs overlap, the IDs that overlap are narrowed down based on the related information, and the evaluation number adding unit 25 is notified of the IDs.

  If there is no ID that matches the ID already registered in the evaluation information management DB 20, the ID determination unit 24 newly registers the ID in the evaluation information management DB 20 and notifies the evaluation number addition unit 25 of the ID. The evaluation number of the newly registered ID is zero.

  Note that the ID determination unit 24 may refer to the unique number included in the related information and discard the ID when the ID has already been received from the same evaluation device 12. By carrying out like this, it can suppress that the same evaluator evaluates the object 11 of the same evaluation many times.

  FIG. 7A is an example of a diagram schematically illustrating an evaluation result table stored in the evaluation information management DB 20. In the example of the figure, “number of evaluations” and “related information” are associated with “ID”. The evaluation number adding unit 25 increases the evaluation number by one in principle. As shown in FIG. 8, the related information includes the above-described unique number, position information, image of the evaluation target 11, comments, information received from the wireless communication chip, and the like. The position information is position information received from the evaluation device when the evaluation device has a position detection function, and is position information acquired by the current position estimation service system 17 when the evaluation device does not have a position detection function.

  The number of evaluations in FIG. 7A is the number of evaluations when ID transmissions are tabulated as good evaluations. When counting bad evaluations, two evaluation numbers such as “evaluation number (good)” and “evaluation number (bad)” are totaled.

  Moreover, it is preferable that the server 13 can identify what the evaluation target 11 is evaluated. For this reason, the server 13 has a target identification table.

  FIG. 7B shows an example of a target identification table stored in the evaluation information management DB 20. The evaluation result table and the target specification table can be implemented as one table. In FIG. 7B, “product ID” and “target information” are registered in association with “ID”. When the evaluation system 500 is deployed in a specific range such as an exhibition or department store, since the relationship between the ID and the product or service of the evaluation target 11 is specified, not only the ID of the evaluation target 11 but also the product ID, name, provider, price, etc. are known. The product ID is identification information for the product provider to specify the product. Since the product ID is managed by the provider, it may be unique within the same provider. “Name” describes, for example, the name of a product or service (for example, the brand name of camera A, camera B, camera C, restaurant, etc.) and the “provider” is, for example, the manufacturer of the evaluation target 11・ The seller is described. “Price” describes the price of the product, but is not required. In addition, the common names of products and services may be registered in the target specification table. Therefore, the browsing client 14 can browse the evaluation number by specifying the ID or the name of the evaluation target 11 or the provider.

  In addition, when an ID is given to the evaluation target 11 without the server 13 being involved, it is not possible to specify what evaluation target 11 the ID is alone. Therefore, it is preferable that the server 13 continuously constructs target information from related information.

  When the ID determination unit 24 determines that there is no ID that matches the ID registered in the evaluation information management DB 20, the target specifying unit 26 of the server 13 uses the ID and related information of the evaluation information management DB 20 to evaluate 11 is specified. For example, the target specifying unit 26 parses comments of related information to extract nouns, and specifies a name and a provider by a search using a dictionary or a search engine.

  When the motion sensing unit 35 senses a specific motion, the program 114 can display an input field such as a name, a provider, and a price on the display unit 105. When the evaluator explicitly inputs and transmits a name, a provider, a price, and the like, the target specifying unit 26 can reliably register the target information by using them.

  In addition, the wireless communication chip may store information such as a name, a provider, and a price. When the ID is transmitted to the evaluation device 12 together with the ID, the target specifying unit 26 uses the wireless communication chip information. The evaluation target 11 can be specified.

  In addition, the target identifying unit 26 identifies a store at the position indicated by the position information of the related information from the map data, and identifies the name and the provider. Store names (providers) are not often registered in map data, and it is possible to search for names of products and services handled from store names. Therefore, a name and a provider can be specified by putting position information and an address in a known search engine.

  The target specifying unit 26 can also specify the evaluation target 11 from the image. By searching the database and the Internet using the image matching method described in the second embodiment, an image that matches the image of the evaluation target 11 is specified, and the product name and seller are extracted from the description of the image. Specify the name, provider, and price. The target specifying unit 26 registers the information of the evaluation target 11 specified in this way in the target specifying table.

  When the ID is notified from the ID determination unit 24, the evaluation number adding unit 25 increases the evaluation number associated with the ID in the evaluation result table by one. By doing so, a high evaluation can be given to the evaluation target 11 having a large number of transmitted IDs.

Generation of location service information will be described. The location service information generation unit 28
a) Collecting service information related to a location to obtain location service information b) In some cases, the evaluation result table is edited based on the location information to obtain location service information.

In the case of a), the server 13 has a location → service provision DB in the evaluation information management DB 20.
FIG. 9 is a diagram illustrating an example of the position → service provision DB. “Weather” is registered for each “region”. The position service information generation unit 28 generates position service information including the weather of the place where the evaluator is located by converting the position information into an area and referring to the position → service providing DB.

  In addition to the weather, information such as disasters, train delays, and traffic jams can be registered in the location-> service provision DB. It is also possible to register store sales information, restaurant information, local information, etc. for each more detailed area. The location → service provision DB is updated by the server 13 collecting information periodically, or the latest information is collected and updated for each region using RSS (Rich Site Summary).

  From the evaluator's point of view, there is an advantage that when it is desired to easily know the surrounding information such as the weather, it is only necessary to evaluate a nearby evaluation target.

In the case of b), the location service information generation unit 28 totals the number of evaluations based on the location information.
FIG. 10 is an example of a diagram schematically illustrating location service information generated by the location service information generation unit 28.

In FIG. 10A, the evaluation targets evaluated by the evaluator in the area where the evaluator exists are tabulated. When the server 13 acquires location information such as ID and Tokyo, for example, the location service information generation unit 28 counts the number of evaluation target IDs (evaluation number) transmitted from Tokyo with the same ID.
(i) The location service information generation unit 28 specifies a record corresponding to Tokyo from the field of related information ID = 10112. That is, the number of evaluations transmitted from Tokyo among ID = 10112 is counted.
(ii) Next, the location service information generation unit 28 refers to the target identification table and converts the ID into a name. ID = 10112 is converted to camera A.
(iii) The location service information generation unit 28 associates the evaluation number counted in (i) with the name to obtain location service information.

In FIG.10 (b), the object of evaluation evaluated in the area where an evaluator exists is totaled. For example, when the server 13 acquires location information such as ID and Tokyo, the location service information generation unit 28 counts the number of IDs to be evaluated transmitted from Tokyo.
(i) The location service information generation unit 28 refers to the location information of the related information and reads the ID included in Tokyo. That is, ID = 10112 is counted from Tokyo, ID = 10113 is counted from Tokyo, and ID = 10114 is counted from Tokyo.
(ii) Next, the location service information generation unit 28 refers to the target identification table and converts the ID into a name. ID = 10112 is converted into camera A, ID = 10113 is converted into camera B, and ID = 10114 is converted into camera C.
(iii) The location service information generation unit 28 associates the evaluation number counted in (i) with the name to obtain location service information.

  Note that the location service information generation unit 28 may sort the Tokyo evaluation numbers in descending order, and may use only the top evaluations as the location service information, for example.

  In addition, the value which totaled a case, b case, and c case of FIG.10 (b) can also be calculated. That is, the number of evaluations is totaled without distinguishing the type of camera in the area unit of Tokyo. This makes it possible to verify regional characteristics such as high evaluation of the entire camera in Tokyo.

Provided Function Returning to FIG. 5, the provided function 22 of the server 13 includes a browsing request receiving unit 27, an evaluation data creating unit 28, and an evaluation data transmitting unit 29. The browsing request receiving unit 27 receives a browsing request for the evaluation number from the browsing client 14. When the browsing client 14 accesses the server 13 with a browser, for example, the browsing request receiving unit 27 transmits the HTML data of the top page to the browsing client 14.

  FIG. 11A is a diagram illustrating an example of a top page displayed on the browsing client 14. The top page includes an upper display area 501 and a search area 502. In the upper display area 501, the IDs of the top 10 evaluations and the evaluation numbers are displayed. Further, a product name or the like may be displayed. In the search area 502, search by ID and search by name are possible. In the search by ID, “Enter ID” is described, and in the search by name, “Enter name” is described. In addition to these, the product ID, the provider and the like may be input. For example, when the product ID is known, the operator of the browsing client 14 can reliably receive the evaluation number of the target 11 to be evaluated with the product ID. Thus, the operator of the browsing client 14 can search the evaluation number of the evaluation object 11 by a desired method.

  When the browsing request receiving unit 27 receives an ID or name from the browsing client 14, the evaluation data creating unit 28 creates evaluation data. When the ID is received, the evaluation data creation unit 28 searches the evaluation result table for the ID, and reads the evaluation number of the record (row) with the matching ID. In addition, when there is target information, it is preferable to read the target information together. The evaluation data creation unit 28 creates, for example, HTML evaluation data that includes at least an ID and the number of evaluations and can further include target information. The evaluation data transmission unit 29 transmits the evaluation data to the browsing client 14. When the product ID is received, the same processing is performed after converting the product ID into an ID.

  For example, when a name is received, the evaluation data creation unit 28 searches for all IDs matching the name from the evaluation result table (that is, if there are a plurality of IDs), and reads the evaluation number associated with each ID. The evaluation data creation unit 28 creates, for example, HTML evaluation data that includes at least an ID and the number of evaluations and can further include target information.

  Thereby, the browsing client 14 can display evaluation data as shown in FIG. In FIG. 11B, a search result area 503 is newly displayed on the top page. In the search result area 503, an ID, the number of evaluations, a name, and a provider are displayed. In this way, the browsing client 14 can display the number of evaluations of a certain real world evaluation target 11. In addition to the illustration, in principle, the browsing client 14 can display information managed by the server 13. For example, a comment, an image of the evaluation target 11, a location (position information) where the evaluation target 11 is located, and the like can be displayed.

  Further, the evaluation data creation unit 28 can process the number of evaluations and the like. The evaluation data creation unit 28 refers to the time information, for example, totals only the number of evaluations for the last hour, refers to the position information, totals the number of evaluations for each region, or refers to the unique number The number of evaluations by evaluator can be aggregated.

<Current location estimation service>
The server 13 transmits the radio base station information to the current position estimation service system 17. The radio base station information is an SSID, a MAC address, and a received signal strength (RSSI) for each radio communication station. The Place Engine will be described as an example. In Place Engine, the position of the terminal is estimated using the MAC address, SSID, and RSSI in the IEEE 802.11 standard.

  Since the Place Engine has a location database of each access point, the location of the access point can be specified by at least one of the MAC address and the SSID. Based on the known access point position information and RSSI, the position of the evaluation device is estimated and returned to the server 13.

  The operator of the evaluation system 500 described above provides an ID, the number of evaluations, related information, a product ID, and target information regardless of whether it is free of charge. For example, when the evaluation system 500 is applied to an exhibition or a department store, the ID and the evaluation number are provided to the exhibitor or the store in the department store. In this case, it is effective to provide related information, particularly personal information. Exhibitors in the exhibition and stores in the department store can grasp the evaluation object 11 with high evaluation based on the ID, and can contact an evaluator who is interested in the evaluation object 11.

  Further, when the evaluation system 500 is applied to an SNS (Social Networking Service) or a website, the SNS and the website can provide the evaluation target 11 having a high evaluation in the real world to the viewer of the website. As a result, the number of visitors to the SNS and website increases, and an increase in advertising revenue can be expected.

[Operation procedure]
FIG. 12 shows three communication procedures. These are merely examples, and any communication procedure may be employed, and other communication procedures may be employed.

  FIG. 12A is an example of a flowchart illustrating a procedure for evaluating the evaluation target 11 by the evaluation device 12 according to the present embodiment. The procedure in FIG. 12A is repeatedly executed while the evaluation device 12 is executing the program 114.

  The communication unit 31 establishes communication with the wireless communication chip 15 (S10). Establishing communication means that the wireless communication chip 15 and the communication unit 31 can communicate with each other, or that exchange of identification information with each other enables data transmission / reception. The communication procedure may follow a standard such as RFID. Communication establishment may be detected by receiving an ID. The communication unit 31 periodically searches for the wireless communication chip 15 and receives the ID when the wireless communication chip 15 exists in the communication range. Once the ID is received, the communication establishment state may not be maintained, and some information may be repeatedly transmitted and received to confirm that the other party exists.

  When the communication is established, it is also effective for the evaluation device 12 to notify the evaluator that the ID has been received by generating music or vibration or displaying a message or icon on the display unit 105. Since the evaluator receives the ID, the evaluator can grasp that the evaluation object 11 can be evaluated.

  When communication with the wireless communication chip 15 is established (Yes in S10), the control unit 33 determines whether or not the operation detection unit 35 has detected a specific operation (S20). This process will be described later.

  When the motion sensing unit 35 senses a specific motion (Yes in S20), the control unit 33 stores the ID of the wireless communication chip 15 in the storage unit 34 (S30). As described above, it is effective to store related information together.

  When communicating with a plurality of wireless communication chips 15, as described above, the evaluator or the evaluation device 12 may select one ID or may store all IDs.

  Thereafter, the control unit 33 obtains wireless base station information by performing communication with the wireless communication station 16 and stores it in the storage unit (S40).

  The control unit 33 causes the Internet communication unit 32 to transmit the ID and radio base station information stored in the storage unit 34 to the server 13 (S50).

  Next, the procedure of FIG. 12B will be described. In FIG. 12B, contrary to FIG. 12A, the motion sensing unit 35 senses a specific motion prior to establishment of communication.

  In FIG. 12B, when the motion sensing unit 35 senses a specific motion (Yes in S20), the control unit 33 instructs the communication unit 31 to communicate with the wireless communication chip 15.

  When the communication unit 31 establishes communication with the wireless communication chip 15 (Yes in S10), the ID of the wireless communication chip 15 is stored in the storage unit 34 (S30). Also in this case, it is preferable that the evaluation device 12 notifies the evaluator that the ID has been received by music or the like.

  The control unit 33 acquires wireless base station information by performing communication with the wireless communication station 16 and stores the wireless base station information in the storage unit (S40). The control unit 33 causes the Internet communication unit 32 to transmit the ID and radio base station information stored in the storage unit 34 to the server 13 (S50).

  In addition, what is necessary is just to perform acquisition of wireless base station information by step S40 including before step S10.

  In the procedure as shown in FIG. 12B, it is not necessary for the communication unit 31 to always search for the wireless communication chip 15, so that power consumption can be suppressed. In addition, since the specific operation and the reception of the ID are a series of processes, the evaluator can easily determine whether or not the ID of the evaluation target 11 for the purpose of evaluation has been received.

  Further, as shown in the procedure of FIG. 12C, a plurality of specific operations may be detected before the ID is transmitted.

  In FIG. 12C, when the motion sensing unit 35 senses the first specific motion (Yes in S20), the control unit 33 instructs the communication unit 31 to communicate with the wireless communication chip 15. The first specific action is, for example, a gesture action.

  When the communication unit 31 establishes communication with the wireless communication chip 15 (Yes in S10), the operation detection unit 35 determines whether or not the second specific operation is detected (S20-2). The second specific operation is, for example, a touch panel operation. When the second specific operation is detected, the control unit 33 stores the ID of the wireless communication chip 15 in the storage unit 34 (S30). Also in this case, it is preferable that the evaluation device 12 notifies the evaluator that the ID has been received by music or the like.

  Thereafter, the control unit 33 obtains wireless base station information by performing communication with the wireless communication station 16 and stores it in the storage unit (S40). The control unit 33 causes the Internet communication unit 32 to transmit the ID and radio base station information stored in the storage unit 34 to the server 13 (S50).

  In the procedure as shown in FIG. 12C, the ID can be received by the first specific operation and the ID can be transmitted by the second specific operation. Therefore, the evaluator confirms the ID of the evaluation target 11 for the purpose of evaluation. The ID can be transmitted to the server 13 later. Further, when a plurality of IDs are received in the first specific operation, one ID can be selected.

<Detection of specific operation in S20>
When the specific action is a gesture action, detection of the specific action by the action sensing unit 35 will be described. FIG. 13 is an example of a flowchart illustrating a procedure in which the motion sensing unit 35 senses a gesture motion.

  The acceleration sensor 112 records the acceleration in time series (S201).

  The motion sensing unit 35 takes out a time series of acceleration from several seconds to several hundred milliseconds in the past (S202).

  The motion sensing unit 35 time-matches a typical series of accelerations stored in advance and a detected series of accelerations (S203). For comparison, for example, DP (Dynamic Programming) matching is used. In DP matching, a difference between a typical series of accelerations and a detected time series acceleration is calculated as a distance.

  The motion sensing unit 35 determines whether the distance is within the threshold (S204). If the distance is within the threshold (Yes in S204), the motion sensing unit 35 senses a specific motion (S205) and is not within the threshold (No in S204). The specific operation is not detected (S206).

  Note that determination by DP matching is an example, and a specific operation can be detected by a known pattern recognition technique.

<Server operation>
FIG. 14 is an example of an operation sequence diagram of the evaluation system 500.
S1: The communication unit 31 of the evaluation device 12 and the wireless communication chip 15 establish communication.
S2: The communication unit 31 of the evaluation device 12 receives the ID from the wireless communication chip 15. S3: The evaluator performs a specific operation to evaluate the evaluation target 11. The motion sensing unit 35 senses a specific motion.
S4: The internet communication unit 32 of the evaluation device 12 communicates with the wireless communication station 1 and receives a MAC address and the like.
S5: The internet communication unit 32 of the evaluation device 12 calculates the received signal strength when communicating with the wireless communication station 1.
S6: The internet communication unit 32 of the evaluation device 12 communicates with the wireless communication station 2 and receives a MAC address and the like.
S7: The Internet communication unit 32 of the evaluation device 12 calculates the received signal strength when communicating with the wireless communication station 2.
S <b> 8, S <b> 9: The Internet communication unit 32 transmits two sets of ID and wireless base station information (MAC address, received signal strength) to the server 13 via the wireless communication station 16.
S10: The receiving unit 23 of the server 13 transmits the radio base station information to the current position estimation service system 17.
S11: The current position estimation service system 17 estimates the current position of the evaluation device 12 based on the radio base station information, and transmits the position information to the server 13. The server 13 registers the position information in the evaluation information management DB 20 in association with the ID.
S12: The aggregation function of the server 13 performs a series of processes. This process will be described with reference to FIG.
S13, 14: The transmission unit 27 transmits the evaluation number and location service information to the evaluation device 12 via the wireless communication station 2 (or the wireless communication station 1).
S15: The control unit 33 displays the evaluation number and location service information on the display unit.

  FIG. 15 is an example of a flowchart of the process in step S12 of FIG.

  The evaluation number adding unit 25 counts up the evaluation number of the ID received from the evaluation device 12 with respect to the evaluation result table (S121).

  The transmission unit 27 reads the evaluation number of the ID received from the evaluation device 12 from the evaluation result table (S122).

  The location service information generation unit 28 generates location service information based on the current location (S123). The location service information generation method may be either a) or b) described above, or both. An instruction as to what kind of location service information generation is to be transmitted may be received from the evaluator.

  FIG. 16 is a diagram illustrating an example of the number of evaluations displayed on the evaluation device 12. An ID 511, a name 512, a camera A evaluation number 513, a Tokyo camera A evaluation number 514, a current location 515, a Tokyo weather 516, and surrounding information 517 are displayed. The user can confirm the evaluation target evaluated with the name 512 and can confirm how much the camera A is evaluated with the evaluation number 513 of the camera A.

  In addition, the number of evaluations 514 of the camera A in Tokyo displayed using the evaluator's position information can confirm how much the camera A is evaluated in Tokyo. After confirming that the current location is correctly estimated by the current location 515, information near the current location can be acquired from the Tokyo weather 516 and the surrounding information 517.

  Note that a link to a website may be displayed on the display unit of the evaluation device 12, and a part or all of the information in FIG. 16 may be displayed when the evaluation device 12 connects to the website. The server 13 can display advertisements and news related to the camera A on the website.

<Operation of provided functions>
FIG. 17 is an example of a flowchart illustrating a procedure in which the browsing client 14 requests evaluation data from the server 13. It is assumed that the browsing client 14 is already displaying the top page at the start of the procedure of FIG.

  The browsing client 14 receives the operation of the evaluator, and transmits a browsing request for the evaluation number using, for example, an ID as an argument (S210).

  The browsing request receiving unit 27 of the server 13 receives the browsing request (S310).

  The evaluation data creation unit 28 searches the evaluation information management DB 20 for an ID, reads the evaluation number that matches the ID registered in the evaluation result table, and creates evaluation data including the ID and the evaluation number, for example, in HTML (S320). ). At this time, it is preferable that related information of the evaluation target 11 is also transmitted.

  Further, the evaluation data creation unit 28 can also transmit the total number of evaluations based on the aggregation method (for each time zone, each region, and each evaluator) added to the browsing request. For example, when the viewer and the evaluator are the same person, since the browsing client 14 can transmit the unique number or the stored ID, the viewer can check the evaluation number of the evaluation target 11 evaluated by the viewer.

  The evaluation data transmission unit 29 transmits the evaluation data to the browsing client 14 (S330).

  The browsing client 14 receives the evaluation data (S420), analyzes the HTML data, and displays it on the display (S430).

  As described above, the evaluation system 500 according to the present embodiment actively evaluates any real product or service in the real world simply by the evaluation device 12 acquiring the ID and the evaluator operating the evaluation device 12. be able to. The evaluation device 12 can display not only the evaluation result but also the evaluation result edited based on the current location. In addition, information related to the current location can be provided to the evaluator.

In this embodiment, an evaluation system 500 having different ID acquisition paths will be described.
FIG. 18 is an example of a diagram illustrating a schematic procedure of the evaluation system 500 of the present embodiment.
(1) The evaluator carries the evaluation device 12. The evaluation device 12 is, for example, a portable communication terminal. When an evaluator encounters an evaluation object 11 of interest while moving in the real world, the evaluator generally walks and stops slowly.

When the evaluator wants to evaluate the evaluation target 11 that he is interested in, the evaluator performs a specific operation either before or after the shooting to shoot the evaluation target 11. In the case of an object, the object may be photographed directly. In the case of a service, a signboard or a store is photographed in a place related to the service.
(2) The evaluation device 12 transmits the image data to the search server 18. The search server 18 is a server having an image data DB (or feature database) in which image data of the evaluation target 11 is associated with an ID.
(3) The search server 18 searches the image data DB 42 based on the image data transmitted by the evaluation device 12, specifies the ID of the evaluation target 11, and transmits it to the evaluation device 12.
(4) Moreover, the evaluation device 12 has a function of communicating with a plurality of wireless communication stations 16, acquires identification information of the wireless communication stations 16 when communicating with each wireless communication station 16, and sets received signal strength. decide.
(5) The evaluation device 12 transmits the ID and the radio base station information to the server 13 as in the first embodiment.
(6) Subsequent processing is the same as in the first embodiment, and the server 13 transmits the evaluation number and location service information to the evaluation device 12.

  Therefore, according to the present embodiment, the evaluation device 12 can acquire the ID by taking a picture without communicating with the wireless communication chip 15 and receiving the ID. As in the first embodiment, the number of evaluations and location service information based on the current location can be provided.

[Configuration example]
FIG. 19 shows an example of a schematic configuration diagram of the evaluation system 500 of the present embodiment. 19, only the main part of the part described in FIG. 3 will be described. The evaluation system 500 of the present embodiment includes an evaluation target 11, an evaluation device 12, a server 13, and a current position estimation service system 17. The browsing client 14 may be added to the evaluation system 500.

  In this embodiment, the wireless communication chip 15 is not arranged on the evaluation target 11. Although it may be arranged, the evaluation device 12 receives the ID from the search server 18. The evaluation target 11 is the same as that in the first embodiment.

<Evaluation device>
The evaluation device 12 may be any device that has the camera 110 and can communicate with the server 13 and the search server 18. For example, in the case of a smartphone, tablet, straight PC, mobile phone, PDA (Personal Digital Assistant), notebook PC, etc., the evaluator carries the evaluation frequently without using a specific evaluation device 12 because the evaluator carries it frequently. The object 11 can be evaluated.

  When the evaluator photographs the evaluation object 11, the whole or a characteristic part thereof should be photographed. For example, the photograph is taken so that the entire object or logo is included. In the case of a service, the evaluator photographs a store signboard, the entire store, and the like. In the case of a sightseeing spot, a sight, a place, or a space, the nearest station or bus stop, a signboard for explaining a sightseeing spot, etc. may be photographed, or a so-called good sight or scenery is photographed. These assumed image data are registered in the search server 18.

<Search server>
The search server 18 may be an information processing device. The hardware configuration diagram of the search server 18 is the same as that of the server 13.

  The communication method in which the search server 18 communicates with the evaluation device 12 is the same as the case where the server 13 and the evaluation device 12 described in the first embodiment communicate. In the figure, the server 13 and the search server 18 are shown separately, but the server 13 and the search server 18 may be mounted in one information processing apparatus. The search server 18 searches the image data DB 42 for image data that matches the image data captured by the evaluation device 12.

[About functions]
FIG. 20 shows an example of a functional block diagram of the evaluation device and the like of this embodiment. 20A shows a functional block diagram when the search server 18 performs pattern matching, and FIG. 20B shows a functional block diagram when the search server 18 performs a visual search. 20, description of the same components as those in FIG. 5 is omitted.

  In this embodiment, the evaluation device 12 is configured to communicate with the search server 18. In addition, since the evaluation target 11 does not need to have the wireless communication chip 15 (may be), the evaluation device 12 does not need to have the communication unit 31. On the other hand, the evaluation device 12 includes a photographing unit 36 for photographing the evaluation target 11 with the camera 110.

  There are several variations in the procedure from image data capture to ID reception. For example, the operation sensing unit 35 can be triggered by detecting a specific operation. The imaging unit 36 captures the evaluation target 11 with the camera 110 and acquires image data. Similar to the first embodiment, it is preferable to store the time information and position information obtained in the storage unit 34.

  The Internet communication unit 32 controls the carrier communication unit 109 and the wireless LAN communication unit 108 to communicate with the search server 18 and transmit image data to the search server 18. An evaluator may photograph one evaluation object 11 a plurality of times. In addition, even if the evaluator performs the photographing operation once, the photographing unit 36 can easily retrieve the image data DB 42 by photographing several pieces of image data. Thus, unlike the ID, it may be effective for the Internet communication unit 32 to transmit a plurality of pieces of image data of the same evaluation target 11. In addition, the Internet communication unit 32 acquires wireless base station information via the wireless communication station 16.

  In this embodiment, shooting can be regarded as a specific action. In this case, the evaluator can acquire the ID simply by operating the program 114 and shooting the evaluation target 11. Further, when the evaluator wants to review and evaluate the captured image data later, it is also effective to detect a specific operation after the imaging.

  The control unit 33 stores the ID received from the search server 18 in the storage unit 34. The control unit 33 transmits the ID stored in the storage unit 34 to the server 13. The subsequent processing is the same as in the first embodiment.

Therefore, the procedure of the evaluation device 12 is as follows.
1) Detection of specific operation → Shooting (receives radio base station information before and after this) → Transmission to search server 18 → Reception of ID → Transmission of ID 2) Shooting (detection of specific operation. Radio base station information before and after this Reception) → transmission to search server 18 → reception of ID → transmission of ID 3) shooting (reception of radio base station information before and after this) → detection of specific operation → transmission to search server 18 → reception of ID → transmission of ID 1 ) Is, for example, a gesture operation. The program 114 is activated by the evaluator swinging down the evaluation device 12 or the like, or the already activated program 114 activates the photographing unit 36. When the evaluator photographs the evaluation target 11 with the camera 110, the photographing unit 36 stores the image data in the storage unit 34, and the control unit 33 transmits the ID to the search server 18.

  In the case of 2), when the evaluator photographs the evaluation target 11 with the camera 110 while the program 114 and the photographing unit 36 are already activated, the image data is transmitted to the search server 18.

  In the case of 3), when the evaluator takes an image of the object 11 to be evaluated with the camera 110 and wants to evaluate it while viewing the image data taken later, the evaluator activates the program 114 and activates the image. Data is transmitted to the search server 18. The specific operation in the case of 3) is, for example, an operation on a soft key or a touch panel formed by the program 114. However, it is also possible to transmit by gesture operation. For example, if one image data is transmitted by one gesture operation (down), the evaluator can transmit a plurality of image data by performing the gesture operation several times.

<Search server search>
A search by the search server 18 will be described. The search server 18 searches for image data by two methods.
A. Pattern matching Visual search (when searching text image data)
A. Pattern Matching As shown in FIG. 20A, the search server 18 has a matching unit 41 and an image data DB 42. The image data DB 42 stores IDs and standard image data in association with each other. The standard image data is image data of various evaluation targets 11 or data obtained by converting it into feature data. There is no need for one standard image data for one evaluation target 11, and a plurality of standard image data may be associated with one evaluation target 11. For example, a plurality of image data obtained by photographing a specific coffee cup from different angles can be used as the standard image data. The standard image data may be taken in either color or grace case.

  FIG. 21 is an example of a diagram schematically illustrating the image data DB 42. In the image data DB 42, one or more standard image data is associated with one ID. The ID may be the same as the ID of the first embodiment, but may not be an IC stored in the wireless communication chip 15. Since the ID is identification information provided by the search server 18, it is guaranteed that the ID is unique within a range assumed by the evaluation system 500 (for example, the whole world, a certain country or region). All IDs registered in the image data DB 42 of the search server 18 are registered in the evaluation information management DB 20 of the server 13.

  The matching unit 41 identifies standard image data that is highly correlated with the image data received from the evaluation device 12, and transmits the ID of the standard image data to the evaluation device 12.

  The matching unit 41 performs preprocessing on the image data and then compares it with the standard image data. Preprocessing includes processing for enlarging and reducing the size of the image data so as to match the standard image data, processing for matching the color space, processing for matching the gradation of luminance, edge processing, and the like. The matching unit 41 uses known pattern matching such as SAD (Sum of Absolute Difference), SSD (Sum of Squared Difference), or NCC (Normalized Cross Correlation) for each pixel or each pixel block. The value of SAD and SSD decreases as the correlation increases, and the value of NCC approaches 1 as the correlation increases.

  The matching unit 41 identifies standard image data having the highest correlation, and reads the ID of the standard image data when the correlation is equal to or greater than a threshold value. Further, when there are a plurality of standard image data having a correlation greater than or equal to the threshold, all IDs may be read out.

  When there is no standard image data having a correlation greater than or equal to the threshold value, the matching unit 41 newly assigns an ID to the image data received from the evaluation device 12 and registers it as standard image data in the image data DB 42. Thereby, the standard image data can be automatically increased.

  If there is no standard image data having a correlation greater than or equal to the threshold, the matching unit 41 can also search for image data on the Internet. List some highly correlated image data on the Internet and collect the target information. Names, providers, prices, etc. are often described in image data on the Internet, and target information can be collected. This process may be performed by the server 13.

  The search server 18 that has specified the standard image data transmits the ID to the evaluation device 12. The evaluation device 12 preferably adds related information to the ID and transmits it to the server 13. Thereby, the server 13 can count up the number of evaluations similarly to Example 1, and can register relevant information.

  Instead of communication as “evaluation device 12 → (image data) → search server 18 → (ID) → evaluation device 12 → (ID) → server 13”, “evaluation device 12 → (image data) → search Communication may be performed in the order of “server 18 → (ID) → server 13”. In this case, the evaluation device 12 can complete the evaluation only by transmitting the image data to the search server 18. This is the same as when the server 13 and the search server 18 are mounted on the same information processing apparatus.

・ B. Visual Search As shown in FIG. 20B, the search server 18 includes a feature extraction unit 43, a classification unit 44, and a feature database 45.
FIG. 22 is an example of a diagram for schematically explaining the outline of the visual search. Visual search is a technique for extracting feature amounts of document images and comparing the feature amounts of two document images. The registered document image in the figure is a document image in which the feature amount is registered in advance, and the search image is an image taken by the evaluation device 12. The feature amount is obtained by quantifying the characteristic arrangement of the text, and an index is assigned to the registered document image. This index corresponds to the ID.

  For example, when a part of a newspaper or magazine article is photographed with the camera of the evaluation device 12 and transmitted to the search server 18, the feature amount is extracted in the same manner from the photographed document image, and the registered document image of the feature database 45 is stored. Compared with feature quantity. The search server 18 can specify not only the registered document image but also the position in the page.

  The feature amount will be described. FIG. 23 shows an example of a word bounding box determination algorithm. Word boundary box determination is to determine the boundary of one word in English. In a language that is not “split language” that does not have a clear break (blank) between words such as Japanese, “,” “.”, Etc. This is to determine the blank generated by.

  The document image is skew corrected. The text lines are aligned horizontally by deskewing. The feature extraction unit 43 calculates a horizontal projection profile (plan view characteristic) as shown in FIG. That is, a histogram of pixels is calculated in the horizontal direction, and the range in the vertical direction where the value exceeds the threshold value is determined as one line (one row).

  When each line is extracted in this way, the search server 18 specifies a word area for each line. The feature extraction unit 43 calculates a vertical projection profile (plan view characteristic) as shown in FIG. That is, a histogram of pixels is calculated in the vertical direction, and a horizontal range whose value exceeds the threshold is determined as a word (one word).

  FIG. 24 is an example of a diagram schematically illustrating grouping based on word boundaries. A circumscribed rectangle of each word detected in FIG. 23 is a word boundary. Once word boundaries are extracted, multiple groups can be formed from them. A group is, for example, a word whose word boundaries overlap each other, and the total number of words is at least three. For example, the first feature point (second word box in the second row with a length of 6; indicated by a black circle) is the first word box in the first row with the front word boundary Overlap, the back word boundary overlaps the second word box in the first row (they are 5 and 7 in length). Also, the front word boundary overlaps with the second word box in the third row (its length is 5).

  The second feature point (the fourth word box in the third row, which has a length of 5 and is indicated by a white circle) is the front word boundary of the third word box in the second row. Overlap, the back word boundary overlaps with the fourth word box in the third row (they are 4 and 5 in length). Also, the front word boundary overlaps with the second word box in the fourth row, and the rear word boundary overlaps with the third word box in the fourth row (the lengths are 8 and 7). ).

Accordingly, as shown in FIG. 24, each feature point is expressed as the length of the lower word box following the length of the upper word box. In this manner, the upper left vertex (or another vertex) of the word boundary can be used as the feature point.
First feature: 6 57 5
Second characteristic point: 5 45 87
It should be noted that the length of the word box may be based on any metric (unit).

  Next, the feature amount can be extracted so that the space is expressed by 0 and the word region is expressed by 1.

  FIG. 25 is an example of a diagram for explaining a feature quantity having 0 and 1 as feature quantities. The block representation on the right corresponds to the word / space area of the left document image (patch). That is, the word area is indicated by black pixels and the space is indicated by zero (0).

  In this case, the distance between 0 and 0 can be used as the feature amount. The extracted feature amount may be compared with various distance indexes (for example, including norm and Hamming distance). Alternatively, a hash table may be used to identify a document patch having the same feature amount as the query image (query image).

Next, an angle from each feature point to another feature point can be calculated.
FIG. 26 is a diagram illustrating an example of calculating an angle formed by a word boundary. In FIG. 26, inner angles θ1 to θ3 when three word boundaries are connected are calculated. Any three or more word boxes may be extracted, or an angle when the word boundaries of one group described in FIG. 24 are connected may be calculated. The method of determining the word of interest is arbitrary.

  The calculated angle is compared with the angle from each feature point to another feature point in the query image. If some angle of feature points to be matched is similar, the similarity score may be increased. Alternatively, if a group of angles is used, and the series of angles between the groups in the two images are numerically similar, the similarity score may be increased. Once the score between the query image and each extracted document patch is calculated, the document patch that yields the highest score is selected and compared to an adaptive threshold to determine if the degree of match meets certain predetermined criteria. Confirm whether or not. If it meets the criteria, it is notified that a matching document patch has been found.

Further, the word length can be used as a feature amount.
FIG. 27 is an example of a diagram for explaining the feature amount based on the word length. As shown in the figure, the feature extraction unit 43 divides each word into estimated characters (plural) based on the height and width of the word. The word is divided into estimated characters. This feature amount is described together with (i) the length of the focused word, (ii) the text array in the line above the word, and (iii) the text array in the line below the word. The text arrangement information is represented by 1 or 0 as to whether or not each character of the focused word is a space.

  When the number of characters in the focused word is 6, 6-bit binary numbers are obtained in (ii) and (iii), respectively. In the case of the illustrated word, there are words above the first estimated character, and spaces above the second and third estimated characters. The upper side of the fourth to sixth estimated characters is a word. In addition, there are words below the first to fifth estimated characters, and spaces below the sixth estimated character. Therefore, the feature amount of the focused word is (6,100111,111110). When rewritten in integer form, the word is encoded as (6,39,62).

  An example of collation of documents in registered document image units by the classification unit 44 will be described. The classification unit 44 extracts the lengths of word pairs adjacent in the horizontal and vertical directions, and calculates the ranking of the patches in the feature database 45 individually. This focuses on the fact that an image of text contains two independent sources for its identity, and the word layout alongside the word, in addition to the word, identifies the document. In the following, collation is described using the length of a word pair as a feature amount, but collation can be performed using the feature amounts described in FIGS.

FIG. 28 is an example of a diagram illustrating a specific example of how a vertical layout is integrated with a horizontal layout. FIG. 28A shows a document image (patch) 601 and an example of division into words. From the document image 601, horizontal and vertical “n-grams” are determined. “N-gram” is a description method that describes the amount of features in a sequence of n numbers. For example, a horizontal trigram specifies the number of characters in each word in a horizontal sequence of three (= tri) words. For example, in the case of the image data in FIG. 28A, the horizontal and vertical trigrams are as follows.
·horizontal direction
5-8-7 ("upper", "division" and "courses")
7-3-5 ("Project", "has" and "begun")
3-5-3 ("has", "begun" and "The")
3-3-6 ("461", "and" and "permit")
3-6-8 ("and", "permit" and "projects")
·Longitudinal direction
5-7-3 ("upper", "Project" and "461")
8-7-3 ("division", "Project" and "461")
8-3-3 ("division", "has" and "and")
8-3-6 ("division", "has" and "permit")
8-5-6 "division", "begun" and "permit")
8-5-8 ("division", "begun" and "projects")
7-5-6 ("courses", "begun" and "permit")
7-5-8 ("courses", "begun" and "projects")
7-3-8 ("courses", "The" and "projects")
7-3-7 ("Project", "461" and "student")
3-3-7 ("has", "and" and "student")
The classification unit 44 searches the feature database 45 for documents including the horizontal and vertical trigrams determined as described above. FIG. 28D shows the search result of the horizontal trigram, and FIG. 28E shows the search result of the vertical trigram. That is, the horizontal trigram 7-3-5 appears in the book registration document images of the indexes 15, 22, 134. Also, for example, the vertical trigram 7-5-6 appears in the registered document images with indexes 15 and 17.

  FIG. 28F shows a list in which the list of registered document images in which horizontal trigrams appear is ranked in descending order, and FIG. 28G shows a list in which the list of registered document images in which vertical trigrams appear is ranked in descending order. . For example, in FIG. 28F, a registered document image with an index of 15 is referred to by five horizontal trigrams, but a registered document image with an index of 9 is referenced only by one horizontal trigram. Further, for example, in the case of FIG. 28 (g), the registered document image with the index of 15 is referred to by 11 vertical trigrams, but the registered document image of the index of 18 is referred to by only one vertical trigram. .

  FIG. 29 is an example of a diagram illustrating a method of combining the horizontal and vertical trigram information obtained in FIG. The classifier 44 uses information about the known physical location of the trigram in the registered document image to combine the list of votes from the horizontal and vertical feature extraction. For all registered document images that are common among the top M choices output by each of the horizontal and vertical classifiers, the location of all the horizontal trigrams that were supposed to exist in the registered document image are assumed to exist in the registered document image. Compared to all vertical trigram locations. Registered document images that overlap in any vertical trigram receive a vote count equal to the number of horizontal trigrams, where “overlap” occurs when the bounding boxes of the two trigrams overlap. That is, overlapping means that some words of the horizontal trigram and the vertical trigram overlap.

  For example, from the list of FIGS. 29 (a) and 29 (b) (the same as the list of FIGS. 28 (f) and (g)), the classification unit 44 can display a list of registered document images (see FIG. 29 (c)).

  FIG. 29 (d) shows only the list included in the horizontal trigram of FIG. 28 (d) extracted from the list of FIG. 29 (c), and FIG. 29 (e) shows the list of FIG. 29 (c). Of these, only those included in the vertical trigram of FIG. 28 (e) are extracted.

  The classification unit 44 uses the lists shown in FIGS. 29C, 29D, and 29E and the feature database 45 to check the overlap of documents. For example, the registered document image at index 6 is referenced by the horizontal trigram 3-5-3 and by the vertical trigram 8-3-6, and these two trigrams overlap with respect to the word “has” in the document image 601. Therefore, the registered document image of index 6 obtains one vote for each overlap.

  FIG. 29F shows an example of the number of votes of registered document images with indexes 15, 6, and 4. In the case of the document image 601, since the registered document image of the index 15 has acquired the maximum number of votes, it is confirmed as a document including the document image 601. (x1, y1) is confirmed as the location of the input image in the registered document image of index 15.

  28 and 29, trigrams are used, but any n-gram may be used for one or both of horizontal and vertical feature extraction / classification. For example, vertical and horizontal n-grams (n = 4, 5) may be used for feature extraction.

  Further, classification may be made based on adjacency relationships that are not strictly vertical or horizontal. For example, the adjacent relationship of NW (North West), SW (South West), NE (North East), and SE (South East) may be used for extraction / classification.

  As described above, when the evaluator evaluates the text, the text can be identified with high accuracy by photographing the text and using the visual search technology. For example, if an ID is assigned to each article of a magazine or each magazine, the evaluation can be performed when the evaluator thinks that the article should be on the spot in the magazine. Since the server 13 counts up magazine articles and magazine evaluation numbers, it is possible to rank articles and magazines with high evaluation numbers.

[Operation procedure]
FIG. 30 is an example of a flowchart illustrating a procedure until the evaluation device 12 acquires an ID based on image data. A program 114 is running on the evaluation device 12. The procedure of FIG. 30 is mainly the procedure of 1) above.

  First, the motion sensing unit 35 senses a specific motion (S410). The program 114 may be activated by this specific operation.

  When the evaluator operates the camera to photograph the evaluation target 11 (Yes in S420), the Internet communication unit 32 transmits the image data of the evaluation target 11 to the search server 18 (S430).

  The search server 18 receives the image data (S510). The matching unit 41 of the search server 18 specifies standard image data having a high correlation with the image data (S520). The search server 18 transmits the ID of standard image data having high correlation to the evaluation device 12 (S530).

  When the Internet communication unit 32 of the evaluation device 12 receives the ID (S440), the control unit 33 stores the ID in the storage unit 34 (S450).

  The control unit 33 acquires wireless base station information by performing communication with the wireless communication station 16 and stores the wireless base station information in the storage unit (S460).

  The control unit 33 causes the Internet communication unit 32 to transmit the ID and wireless base station information stored in the storage unit 34 to the server 13 (S470). The acquisition of radio base station information may be performed up to step S470 including before step S410. The subsequent processing is the same as in the first embodiment.

  In the case of the procedure 2), the processes of S410 and S420 are integrated. In the case of the procedure 3), S410 and S420 are reversed.

  As described above, the evaluation system of the present embodiment can evaluate the evaluation target 11 by taking an image even if the evaluation target does not have an ID. In particular, since a text such as a magazine can be searched with high accuracy including its position, books and the like can be evaluated with high accuracy. In addition, Examples 1 and 2 can be used in combination.

DESCRIPTION OF SYMBOLS 11 Evaluation object 12 Evaluation device 13 Server 14 Browsing client 15 Wireless communication chip 16 Wireless communication station 17 Current position estimation service system 18 Search server 31 Communication unit 32 Internet communication unit 33 Control unit 34 Storage unit 35 Motion detection unit 36 Imaging unit 41 Matching unit 42 Image data DB
43 Feature Extractor 44 Classification Unit 45 Feature Database 500 Evaluation System

JP 2011-96259 A Japanese Patent No. 4753616

Claims (9)

On the computer,
A specific operation detection step for detecting a predetermined specific operation;
An identification information acquisition step for acquiring identification information to be evaluated ;
A position information acquisition step of acquiring position information of the current position or position estimation information for estimating the current position;
An identification information storage step of storing the previous SL identification information in the storage unit,
The identification information stored in the storage unit, and, the position information or the position estimation information, a transmission step of transmitting to the external device,
A program for executing the steps of: receiving location-related information associated with the position information estimated from the position information or the position estimate information from said external device,
Holding the first information in which the position information or the position estimation information of each computer is associated with the identification information received from the computer ;
And evaluation information updating means for updating the evaluation information of the target of the evaluation associated with the identification information received from the computer,
Associated with the position information estimated from the position information or the position estimation information, and location-related information generation means for generating position-related information including the result of aggregating the number of position information in the predetermined region,
A transmission means for transmitting the position related information to a computer;
An evaluation system characterized by comprising: Before Symbol location-related information generation means aggregates a number of position information in the same area as position information estimated from the position information or the position estimation information received from the computer, include the counting result to the location-related information The evaluation system according to claim 1, wherein: The position related information creating means specifies the identification information received from a computer among the plurality of identification information registered in the first information ,
Of the position information of each computer associated with the identified identification information, the number of the identification information in the same region as the position information received from the computer or the position information estimated from the position estimation information is tabulated. , Including the counting results in the position related information,
The evaluation system according to claim 2, wherein: Said location-related information generating means, the number of position information in the same area as position information estimated from the position information or the position estimation information received from the computer, and aggregated by the identification information, the count results Include in location related information,
The evaluation system according to claim 2, wherein: The external device holds second information in which useful information registered in each region is registered,
Said location-related information generating means, including the useful information region position information estimated from the position information or the position estimation information received from the computer corresponding to the second information to read the position-related information, it The evaluation system according to claim 1. The program is
When causing the computer to execute the position information acquisition step,
The base station identification information of the base station acquired from the base station for communicating with the external device, and the received signal strength of the radio wave received from the base station is acquired as the position estimation information,
The external device is
Estimating the current position of the computer based on the position of the base station specified based on the base station identification information and the received signal strength with each base station;
The evaluation system according to any one of claims 1 to 5, wherein: In the identification information acquisition step,
The evaluation system according to claim 1, wherein the program controls wireless communication means to wirelessly communicate with the evaluation target and receives the identification information from the evaluation target. In the identification information acquisition step,
The program controls the photographing means to photograph the evaluation target,
Controlling the wireless communication means to transmit the image data to a second external device that stores the image data to be evaluated or the feature amount of the image data in association with the identification information;
Receiving the identification information of the object of evaluation taken from the second external device;
The evaluation system according to claim 1. On the computer,
A specific operation detection step for detecting a predetermined specific operation;
An identification information acquiring step of acquiring evaluation of the target identification information,
A position information acquisition step of acquiring position information of the current position or position estimation information for estimating the current position;
An identification information storage step of storing the previous SL identification information in the storage unit,
The identification information stored in the storage unit, and, the position information or the position estimation information, and transmit steps that sends to an external device,
Evaluation information update means for updating the evaluation information of the evaluation target associated with the identification information received from the computer;
The external device comprising: position-related information creating means for creating position-related information associated with the position information or the position information estimated from the position estimation information and including a result of counting the number of position information in a predetermined region Receiving the position-related information from the program.