JP6165422B2 - Information processing system, information processing device, server, terminal device, information processing method, and program - Google Patents

Description

  Embodiments described herein relate generally to an information processing system, an information processing device, a server, a terminal device, an information processing method, and a program.

  In recent years, positioning techniques such as GPS (Global Positioning System) are known. For example, in GPS, positioning signals transmitted from a plurality of GPS satellites are received, and a position in a three-dimensional space is calculated based on a time difference in arrival times of positioning signals.

  However, in the conventional positioning technique, the positioning position may be different from the actual position due to positioning error caused by multipath or the like. In this case, there is a problem that a positioning position different from the actual position is displayed in a device (for example, a navigation device) that uses the positioning position.

  On the other hand, a technique for correcting the position and orientation using an image taken by an in-vehicle camera is known (see, for example, Patent Document 1). The in-vehicle navigation device of Patent Document 1 captures an image of a road, identifies the type of road (hereinafter referred to as “image road”) included in the captured image, and determines the road being guided (hereinafter referred to as “guide road”). It is determined whether or not the type matches the type of the image road. If the two types do not match, the position and direction are corrected.

JP 2006-317286 A

  However, in an environment where a plurality of roads of the same type run side by side, the in-vehicle navigation device of Patent Document 1 cannot accurately determine whether or not the two types match. As a result, there is a problem in that the position and orientation correction accuracy is lowered.

  For example, in an environment where two expressways run side by side, if the expressway on which the mobile body actually travels is different from the expressway corresponding to the guide road (that is, the expressway where the mobile body is different from the guide road) The vehicle-mounted navigation device of Patent Document 1 determines whether the type of the image of the expressway that is actually running matches the type of the expressway that corresponds to the guide road. To do. In this case, since the two types are both highways (that is, they match), the correction of the position and direction is performed even though the actual highway and the guide road are different. Not done.

  The present invention has been made in view of the above problems. An object of the present invention is to provide positioning information corrected with high accuracy by a simpler method.

  An information processing system according to an embodiment of the present invention acquires positioning information acquisition means for acquiring positioning information, information acquisition means for acquiring reference object information including position information of a reference object, and image data including a plurality of reference objects Correction that corrects the positioning information based on the image data acquisition means, the reference specifying means for specifying the positional relationship of a plurality of reference objects in the image data, the positional information of the reference object, and the positional relationship Means.

  According to the present invention, it is possible to provide positioning information corrected with high accuracy by a simpler method.

The block diagram which shows the structure of the information processing system 1 of this embodiment. The sequence diagram of the information processing of this embodiment. Schematic of the guide image data of this embodiment. The flowchart of S2-30 of FIG. 2 of this embodiment. Explanatory drawing of S2-300 of FIG. 4 of this embodiment. Explanatory drawing of S2-302 of FIG. 4 of this embodiment. Explanatory drawing of S2-302 of FIG. 4 of this embodiment. The flowchart of positioning information correction | amendment (S2-10) of this embodiment. Explanatory drawing of S2-102 of FIG. 8 of this embodiment. Explanatory drawing of S2-104 of FIG. 8 of this embodiment. Explanatory drawing of S2-106 of FIG. 8 of this embodiment. Explanatory drawing of S2-108 of FIG. 8 of this embodiment. Explanatory drawing of S2-110 of FIG. 8 of this embodiment. Schematic of the correction map image of this embodiment. Schematic of the image data for a correction | amendment of the modification of this embodiment.

  The present embodiment will be described with reference to the drawings.

  A configuration of the information processing system 1 according to the present embodiment will be described. FIG. 1 is a block diagram illustrating a configuration of an information processing system 1 according to the present embodiment.

  The information processing system 1 includes a server 10, a terminal device 30, and a network 50. The server 10 and the terminal device 30 can communicate with each other via the network 50. The number of servers 10 and terminal devices 30 may be one or more, respectively. The network 50 may be a wired network or a wireless network. Communication between the server 10 and the terminal device 30 is performed via a medium other than the network 50 (for example, a data bus cable such as USB (Universal Serial Bus) or a removable medium such as SD (Secure Digital) card). May be.

  The server 10 includes a server control unit 12, a server storage unit 14, and a server communication unit 16.

  The server control unit 12 includes a server communication control unit 120, a server information acquisition unit 122, a reference specifying unit 125, a correction unit 126, and a server output control unit 128. Each unit of the server control unit 12 will be described later.

  The server storage unit 14 stores data handled by the server control unit 12. For example, the server storage unit 14 stores map information, reference object information including reference object position information, and an application executable by the server control unit 12. For example, the reference object information includes POI information that defines POI (Point Of Interest). The POI information includes POI identification information that identifies the POI, POI name information that defines the name of the POI, and POI position information that defines the position of the POI.

  Further, the reference object information may further include road information that defines a road. The road information is information including position information of the start point and end point of each road. For example, the road information may be road network information indicating a road network. The road network information includes a plurality of nodes and links connecting the plurality of nodes. The node includes position information of the node, and the link includes information of a start point node and an end point node of the link.

  The server storage unit 14 may be provided outside the server 10 and connected to the server 10 via the network 50.

  The server communication unit 16 is a communication interface between the server 10 and the network 50.

  The terminal device 30 includes a terminal control unit 32, a terminal storage unit 34, a terminal communication unit 36, an operation unit 38, a positioning information acquisition unit 40, a display unit 42, and an image data acquisition unit 44. For example, the terminal device 30 is a desktop computer, a notebook computer, a mobile phone, a smartphone, a tablet terminal, or a car navigation device.

  The terminal control unit 32 includes a terminal communication control unit 320 and a terminal output control unit 322. Each unit of the terminal control unit 32 will be described later.

  The terminal storage unit 34 stores data handled by the terminal control unit 32. For example, the terminal storage unit 34 stores user information and an application that can be executed by the terminal control unit 32.

  The terminal communication unit 36 is a communication interface between the terminal device 30 and the network 50.

  The operation unit 38 receives a user instruction. For example, the operation unit 38 is a touch panel. In this case, the user gives a user instruction to the terminal device 30 by performing a predetermined operation (for example, touch or swipe) using the touch panel. The operation unit 38 receives a user instruction in accordance with an operation performed by the user.

  The positioning information acquisition unit 40 acquires positioning information. The positioning information includes positioning position information indicating the positioning position of the terminal device 30 and positioning direction information indicating the positioning direction of the terminal device 30. For example, the positioning information acquisition unit 40 is a GPS (Global Positioning System) receiver and an electronic compass.

  The display unit 42 outputs various information. For example, the display unit 42 is a touch panel type liquid crystal display.

  The image data acquisition unit 44 captures an image and acquires image data corresponding to the captured image. For example, the image data acquisition unit 44 is a digital still camera that acquires still image data corresponding to a still image.

  Information processing according to the present embodiment will be described. FIG. 2 is a sequence diagram of information processing according to the present embodiment. The information processing in FIG. 2 is started when the terminal control unit 32 starts an information processing application. An information processing application is a computer program for causing a computer to execute information processing.

  <S2-30> The terminal device 30 issues a correction request. For example, when the user wants to correct the current position display C and the direction display Dc in the map image (see FIG. 3) displayed on the display unit 42, the user issues a correction instruction to the information processing application via the operation unit 38. give. The terminal device 30 issues a correction request in response to the correction instruction.

  FIG. 4 is a flowchart of S2-30 in FIG. 2 of the present embodiment.

  <S2-300> The image data acquisition unit 44 acquires the correction image data. The correction image data is image data including a plurality of reference objects. The reference object is an object that serves as a reference for correcting the positioning information and provides information that can be used to specify the position where the image indicated by the correction image data is captured. The reference objects include a reference object corresponding to POI (hereinafter referred to as “POI-compatible reference object”) and a reference road. For example, the POI-compliant reference objects are a signboard, a sign, and a building.

  FIG. 5 is an explanatory diagram of S2-300 in FIG. 4 of the present embodiment.

  For example, when the user activates a camera application and captures a landscape, the image data acquisition unit 44 acquires correction image data. Here, an image acquisition screen as shown in FIG. 5 may be displayed on the display unit 42 in order to reliably acquire correction image data including a road. On the image acquisition screen, the frame lines AL and AR, which are the areas including the reference object, and the frame line AC, which is the area including the road, “Please photograph the signboard and the road according to the frame line” And messages. Note that the shapes of the frame lines AL, AC, and AR are not limited to the shape shown in FIG. 5 (ie, a rectangle), and a plurality of patterns may be prepared. For example, the road display position may be a pattern centered on the center, right edge, or left edge of the screen, and the road shape may be a pattern that is vertical, horizontal, or diagonal, or A pattern including a plurality of roads may be used. A pattern to be displayed may be selected from the plurality of patterns according to the shooting location, or the user may be caused to select an appropriate pattern from the plurality of patterns.

  Next, when the user includes the signboard “A bank” in the frame line AL, the national road R1 is included in the frame line AC, and the signboard “B shop” is included in the frame line AR, the shooting button When 42a is pressed, the digital still camera (that is, the image data acquisition unit 44) acquires image data for correction (that is, image data including a plurality of signboards and at least one road). The acquired correction image data only needs to include a road in the frame AC indicating the road, and include at least one signboard in the frame that is an area including the reference object. There may be a frame line that does not include a signboard in any of the frame lines that should include objects.

  <S2-302> The positioning information acquisition unit 40 acquires positioning information. The positioning information acquired in S2-302 includes positioning position information indicating the positioning position when the correction image data is acquired in S2-300.

  In addition to the positioning position information, the positioning information may further include positioning direction information indicating the positioning direction when the correction image data is acquired in S2-300.

  For example, in S2-300, when the user presses the shooting button 42a, the positioning information acquisition unit 40 acquires positioning information when the user presses the shooting button 42a. The acquired positioning information includes positioning position information indicating the positioning position. When the positioning information includes both positioning position information and positioning direction information, the acquired positioning information includes the positioning direction indicating the positioning direction when the user presses the shooting button 42a in addition to the positioning position information. Information may be further included.

  <S2-304> The terminal control unit 32 issues a correction request. This is data for requesting correction of positioning information. The correction request includes the correction image data acquired in S2-300 and the positioning information acquired in S2-302.

  When S2-304 in FIG. 4 ends, the terminal communication control unit 320 transmits a correction request to the server 10 via the terminal communication unit 36 and the network 50, as shown in FIG.

  <S2-10> The server 10 performs positioning information correction. FIG. 8 is a flowchart of positioning information correction (S2-10) of the present embodiment.

  <S2-100> The server communication control unit 120 receives the correction request via the network 50 and the server communication unit 16.

  <S2-102> The reference specifying unit 125 specifies the positional relationship of a plurality of reference objects in the correction image data included in the correction request.

  FIG. 9 is an explanatory diagram of S2-102 of FIG. 8 of the present embodiment.

  First, the reference specifying unit 125 extracts POI-compliant reference objects (for example, signs “A bank” and “B shop”) and a reference road (for example, the national road R1) from the correction image data.

  As an example, in S2-300 of FIG. 4, according to the image acquisition screen of FIG. 5 (that is, the signboard “A bank” is included in the frame line AL, the national road R1 is included in the frame line AC, and the frame line AR is included. When the correction image data is acquired, the reference specifying unit 125 calls “A bank” and “B store” included in the frame lines AL and AR. The signboard is extracted as a POI-compliant reference object, and the national road R1 included in the frame line AC is extracted as a reference road. Hereinafter, when considering the positional relationship between the reference object and the reference road, the reference object included in one area of the reference road (specifically, the frame line AL in FIG. 5) is referred to as a “first POI-compliant reference object”. The reference objects included in the other area of the reference road (similarly, the frame line AR in FIG. 5) are distinguished as “second POI-compatible reference objects”.

  As another example, the case where the correction image data is acquired in S2-300 of FIG. 4 according to the image acquisition screen not including the frame line of FIG. 5 will be described with reference to FIG. The reference specifying unit 125 specifies a road portion from the correction image data, and extracts a reference road based on the specification result. The method for specifying the road portion from the correction image data uses a known technique, and thus the description thereof is omitted. When a plurality of roads are included in the correction image data, a plurality of reference roads may be extracted, or one reference road may be extracted in consideration of road specifications (for example, road width). May be.

  Next, as illustrated in FIG. 9, the reference specifying unit 125 sets a reference line V along the reference road in the correction image data. And the reference | standard specific | specification part 125 respond | corresponds to the reference object (signboard "A bank") arrange | positioned in the 1st area | region L among the area | regions (1st area | region L and 2nd area | region R) of the both sides of the reference line V to 1st POI. The reference object is extracted as the reference object, and the reference object (signboard “B shop”) arranged in the second region R is extracted as the second POI-compatible reference object.

  <S2-104> The reference specifying unit 125 specifies a reference object corresponding to POI (POI search).

  FIG. 10 is an explanatory diagram of S2-104 in FIG. 8 of the present embodiment.

  The reference specifying unit 125 specifies the POI indicated by the POI-compliant reference object included in the correction image data. For example, the corresponding POI may be specified by recognizing characters included in a signboard using an OCR (Optical Character Reader). The recognized character may be, for example, a POI name, an address, or a telephone number. Further, even if a logo for a signboard (for example, a mark or the like) is recognized as a POI-compliant reference object and the recognized logo is matched with logo data stored in the server storage unit 16 in advance, the corresponding POI can be specified. Good. Further, the corresponding POI may be specified from the shape and appearance of the building, or the corresponding POI may be specified using position information of a reference object that can specify the installation position, such as a sign. In the case of FIG. 9, the letters “A bank” and the letters “B shop” are recognized from the two signboards that are POI target standards, and the corresponding POI is “A bank”, which is a bank. And it is specified that it is restaurant “B shop”.

  Next, as shown in FIG. 10A, the reference specifying unit 125 searches the POI around the positioning position (hereinafter referred to as “reference POI”) corresponding to the specified POI from the POI information. Hereinafter, in order to consider the positional relationship between the reference object and the reference road, the reference POI corresponding to the first POI corresponding reference object is referred to as “first reference POI”, and the reference POI corresponding to the second POI corresponding reference object is “second POI”. It may be distinguished from “reference POI”.

  In the case of FIG. 9, the POI corresponding to the POI identification information “Pa” is searched as the first reference POI, and the POI corresponding to the POI identification information “Pb” is searched as the second reference POI.

  As another example, when there are a plurality of reference POIs corresponding to the specified POI around the positioning position and one reference POI cannot be specified (that is, there are a plurality of reference POI candidates), the other specified reference One reference POI may be specified based on the POI. More specifically, when the restaurant “B store” is a chain store and there are a plurality of stores around the positioning position, information on “A bank”, which is another specified reference POI ( For example, on the condition that it is included in a predetermined range from “A bank”, the reference POI corresponding to “B store” may be specified.

  <S2-106> The reference specifying unit 125 performs reference road specification (link search).

  FIG. 11 is an explanatory diagram of S2-106 in FIG. 8 of the present embodiment.

  The reference specifying unit 125 extracts links around the positioning position from the links included in the road network information. Then, the reference specifying unit 125 specifies a link corresponding to the reference road from the extracted links based on the position information (latitude and longitude) of the reference POI.

  More specifically, as shown in FIG. 11, the reference specifying unit 125 includes the position coordinates of the first reference POI and the second reference POI from among the links around the positioning position among the links included in the road network information. A line segment connecting the position coordinates is set, and a link that intersects the line segment is specified as a reference link. In the case of FIG. 9, a line connecting the position coordinates of two reference POIs (ie, the position coordinates Npa and the position coordinates Npb) from the links L1a, L1b, L2a, L3a, L3b, and L4a that are links around the positioning position. The link L1b that intersects the minute is specified as the reference link. When a plurality of first reference POIs or second reference POIs are specified, a reference link may be specified after setting a plurality of line segments.

  Note that when at least one of the first reference POI and the second reference POI cannot be specified (that is, when all the specified reference POIs are included in a specific region), it intersects with a line segment connecting a plurality of reference POIs. The link may not exist. In such a case, the reference link may be specified on the condition that it does not cross a line segment connecting a plurality of reference POIs.

  <S2-108> The correction unit 126 calculates the shooting direction of the correction image data based on the positional relationship between the first POI-compatible reference object, the second POI-compatible reference object, and the reference road in the correction image data.

  FIG. 12 is an explanatory diagram of S2-108 in FIG. 8 of the present embodiment.

  As illustrated in FIG. 12, the correction unit 126 includes a position coordinate Npa corresponding to the first POI corresponding reference object, a position coordinate Npb corresponding to the second POI corresponding reference object, and a reference link (link L1b) corresponding to the reference road. (That is, as shown in FIG. 9, in the correction image data, the first reference POI is located on the first region L side, the second reference POI is located on the second region R side, and the national road R1 Is based on the relationship between the first reference POI and the second reference POI).

  As an example of a specific method, for the link L1b, it is calculated which of the shooting direction from the node N1b side and the shooting direction from the node N1c side is the correction image data shot in the shooting direction. May be. For example, the positional relationship on the coordinate plane between the reference link and the first POI corresponding reference object when the image is taken from one direction is calculated, and the positional relationship on the coordinate plane matches the positional relationship in the correction data. It may be determined whether or not. If the two match, the shooting direction Dc ′ may be calculated as if shooting was taken from that direction. If the two do not match, the shooting direction Dc ′ may be calculated on the assumption that the image is taken from the opposite direction.

  <S2-110> The correction unit 126 calculates a correction position based on the positioning position, the reference link, and the correction direction.

  FIG. 13 is an explanatory diagram of S2-110 of FIG. 8 of the present embodiment.

  As illustrated in FIG. 13, the correction unit 126 is opposite to the correction direction Dc ′ with respect to the reference link (link L1b) from the links L1a, L3a, L3b, and L4a connected to the reference link (link L1b). The link L1a located in the direction is selected as the correction link.

  Next, the correction unit 126 sets a point on the correction link (link L1a) closest to the positioning position C (that is, a point perpendicular to the correction link (link L1a) from the positioning position C) to the correction position. Calculate as In FIG. 13, C ′ indicates a correction position. Thus, conventionally, the correction position is calculated on the link L2a that is the link closest to the positioning position C, whereas in the present invention, a more appropriate correction position can be calculated.

  In selecting the correction link, the position of the reference road in the correction image data may be taken into consideration. For example, when the reference road is photographed vertically in the center as shown in FIG. 9, the correction link is calculated so as to weight the link (link L1a) connected to form a straight line with the reference link L1b. May be. Similarly, when the reference road is photographed obliquely from the upper left to the lower right, in addition to a straight link (link L1a), links (links L2a and L3a) located on the left side toward the reference link L1b May be weighted.

  <S2-112> The correction unit 126 generates corrected positioning information. The corrected positioning information is information including the corrected azimuth calculated in S2-108 and the corrected position calculated in S2-110.

  When S2-112 in FIG. 8 ends, the server communication control unit 120 transmits the corrected positioning information to the terminal device 30 via the server communication unit 16 and the network 50 as illustrated in FIG.

  <S2-32> The terminal device 30 corrects the positioning information based on the corrected positioning information.

  For example, the terminal communication control unit 320 receives the corrected positioning information via the network 50 and the terminal communication unit 36.

  Next, the terminal output control unit 322 corrects the positioning information. For example, the terminal output control unit 322 may correct the positioning position information to the correction position, or may correct the positioning direction information to the correction direction.

  As another example, the terminal output control unit 322 may generate corrected map information based on the corrected positioning information. For example, the correction map information is a correction map image including correction positioning information (correction position and correction direction).

  FIG. 14 is a schematic diagram of a corrected map image of the present embodiment.

  According to the present embodiment, when the positioning accuracy of the current position or the positioning azimuth obtained by the azimuth sensor is low, the positioning position or the positioning azimuth can be corrected with high accuracy by a simpler method. Further, instead of the map information corresponding to the positioning position and the positioning direction (that is, positioning information different from the actual position and direction), the correction position and the correction direction (that is, positioning information corresponding to the actual position and direction) are used. Corresponding correction map information (for example, the correction map image of FIG. 14) is obtained. In other words, according to the present embodiment, positioning information corrected with high accuracy can be provided by a simpler method.

  In the present embodiment, a signboard (in particular, a character included in the signboard) is exemplified as the recognized POI-compliant reference material, but the scope of the present invention is not limited to this. For example, the recognized POI-compliant reference may be in the form of a POI-compliant reference (eg, at least one of building size (width, depth, and height), shape, and color).

  In the present embodiment, generation of corrected positioning information including both the correction direction and the correction position is exemplified, but the scope of the present invention is not limited to this. For example, the correction unit 126 compares the positioning azimuth and the positioning position with the correction azimuth and the correction position, respectively, and determines the positioning information (at least one of the positioning azimuth and the positioning position) and the corrected positioning information (at least one of the correction azimuth and the correction position). When the difference between the two is equal to or less than a predetermined value (that is, when the positioning accuracy is high), the correction azimuth is calculated (S2-108 in FIG. 8) and the correction position is calculated (S2-110 in FIG. 8). One of them (that is, calculation of the difference between the positioning information and the corrected positioning information being a predetermined value or less) may be omitted.

  In the present embodiment, it is exemplified that all the POI-compliant reference objects (“A bank” and “B store” in FIG. 9) included in the correction image data are recognized and the reference POI is specified. The scope of the present invention is not limited to this. For example, the reference POI may be specified by selecting a reference object used for specifying the positional relationship from among the reference objects included in the correction image data and recognizing only the selected reference object. That is, an arbitrary road may be selected from the reference objects included in the image data to specify the reference road, or an arbitrary POI-compatible reference object may be selected to specify the reference POI.

  Specifically, the reference specifying unit 125 includes the POI-compliant reference objects (for example, four POI-compliant reference objects “A bank”, “B shop”, “C hall” in FIG. 15A) included in the correction image data. ”And“ D D ”), at least two POI compatible standards (for example, the three POI compatible standards“ A bank ”,“ B shop ”, and“ C D ”in FIG. 15B)) The reference POI may be specified by selecting and recognizing the selected POI-compatible reference object. As the number of reference objects corresponding to POI increases, the accuracy of position correction of this embodiment can be improved.

  As another example, the reference specifying unit 125 excludes a POI-compatible reference material whose reference POI is not searchable from the POI information, or a corresponding reference material whose relevance to the POI information is low, among the POI-compatible reference materials. The reference POI may select a POI-compatible reference material that can be searched from the POI information, and only the selected POI-compatible reference material may be recognized and selected.

  For example, for a POI-compatible reference object having a plurality of corresponding POIs around the positioning position, it is difficult to specify the reference POI corresponding to the POI, and it is difficult to calculate correction information by specifying the positional relationship. In some cases, the corresponding POI information does not include the corresponding POI information data in the POI information storage means. Furthermore, depending on the resolution and size of the acquired correction image data, the POI-compatible reference object may be unclear or the recognition accuracy (reading accuracy) may be low. Accordingly, such a POI-compatible reference material may be excluded in advance, and a POI-compatible reference material that can easily specify the reference POI may be selected.

  The reference specifying unit 125 may select a reference object based on a predetermined reference from the reference objects included in the correction image data. Alternatively, the reference object used for specifying the position may be selected by the user, and the reference object corresponding to the selection instruction given by the user using the operation unit 38 may be recognized and selected.

  Furthermore, in this embodiment, although the example which produces | generates correction | amendment positioning information based on one reference | standard road and several POI corresponding | compatible reference thing was illustrated, the scope of the present invention is not limited to this. In other words, the reference object to be specified is not limited to the POI-compliant reference object or the reference road, and the above-mentioned reference object included in the image data may be specified, and the correction information is obtained based on the positional relationship of the plurality of specified reference objects. It may be calculated. For example, the reference specifying unit 125 recognizes one POI-compatible reference object (for example, “A bank” in FIG. 15A), and the correction unit 126 includes one POI-compatible reference object and one reference road (for example, The correction azimuth and the correction position may be calculated using the national road R1) in FIG. Alternatively, a plurality of reference roads may be specified, and correction information may be calculated based on the positional relationship between the plurality of reference roads and one POI-compatible reference object. Furthermore, the correction information may be calculated based on the positional relationship among a plurality of POI-compliant reference objects without specifying the reference road.

  Moreover, although this embodiment illustrated calculating a correction position based on a positioning position, a reference link, and a correction direction, the scope of the present invention is not limited to this.

  As an example, the POI information further includes reference object size information indicating the size (width, height, and depth) of the reference object, and the correction unit 126 includes the size (width and height) of the reference object in the correction image data. And the ratio of the reference object size (width and height) in the reference object size information, and based on the calculated ratio, calculate the distance between the position where the correction image data was acquired and the reference object, and calculate The correction position may be calculated based on the distance.

  As another example, the image data acquisition unit 44 is a camera (for example, a stereo camera) that can acquire not only the correction image data but also the distance between the position at which the correction image data is acquired and the reference object. The correction unit 126 may correct the positioning information based on the distance acquired by the image data acquisition unit 44.

  In the present embodiment, an example in which the image data acquisition unit 44 is a digital still camera is illustrated, but the scope of the present invention is not limited to this.

  As an example, the image data acquisition unit 44 may be a digital video camera. In this case, the image data acquisition unit 44 acquires moving image data composed of a plurality of frame data (that is, still image data), and acquires correction image data from the moving image data according to a predetermined sample rate. May be. When moving image data is acquired, the correction information may be calculated in consideration of the relative position of the reference POI included in the moving image data, the change in the shooting position, and the shooting direction.

  As another example, the image data acquisition unit 44 may acquire, as correction image data, removable media that can be attached to and detached from the terminal device 30 or image data stored in the terminal storage unit 34.

  As yet another example, the image data acquisition unit 44 may acquire image data acquired by a camera provided outside the terminal device 30 as correction image data. For example, when the terminal device 30 is a car navigation device, the image data acquisition unit 44 acquires image data acquired by a camera mounted on the vehicle to which the terminal device 30 is attached (for example, the periphery of the traveling vehicle). The image data indicating the image of the image may be acquired as the correction image data.

  At least a part of the information processing system 1 according to the present embodiment may be configured by hardware or software. When configured by software, a program for realizing at least a part of the functions of the information processing system 1 may be stored in a recording medium such as a flexible disk or a CD-ROM, and read and executed by a computer. The recording medium is not limited to a removable medium such as a magnetic disk or an optical disk, but may be a fixed recording medium such as a hard disk device or a memory.

  Further, a program that realizes at least a part of functions of the information processing system 1 according to the present embodiment may be distributed via a communication line (including wireless communication) such as the Internet. Further, the program may be distributed in a state where the program is encrypted, modulated or compressed, and stored in a recording medium via a wired line such as the Internet or a wireless line.

  In addition, this invention is not limited to embodiment mentioned above, It deform | transforms and implements a component in the range which does not deviate from the summary. That is, the specific form of the distribution / integration of the devices is not limited to that shown in the drawings, and all or a part thereof may be mechanically or physically in arbitrary units according to various additions or according to functional loads. Can be distributed and integrated. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above-described embodiments. For example, you may delete a some component from all the components shown by embodiment mentioned above. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 Information processing system 10 Server 12 Server control part 120 Server communication control part 122 Server information acquisition part 125 Reference | standard identification part 126 Correction | amendment part 128 Server output control part 14 Server memory | storage part 16 Server communication part 30 Terminal device 32 Terminal control part 320 Terminal communication Control unit 322 Terminal output control unit 34 Terminal storage unit 36 Terminal communication unit 38 Operation unit 40 Positioning information acquisition unit 42 Display unit 44 Image data acquisition unit

Claims (9)

A specifying means for specifying a road and a plurality of different POI-compliant reference objects from the captured image data;
Correction means for correcting the positioning information measured based on the positional relationship between the identified road and the plurality of POI-compliant reference objects;
An information processing system comprising: The specifying means is:
The signboard included in the image data is specified as the POI-compliant reference object,
The information processing system according to claim 1, wherein a positional relationship between the signboard and the road is specified.   The specifying means selects the plurality of POI-compatible reference objects whose positional relationship is to be specified from a plurality of reference objects included in the image data, and specifies the positional relationship of the selected POI-compatible reference objects. The information processing system according to claim 1 or 2.   The specifying unit receives a selection instruction from the user for the plurality of POI-compatible reference objects whose positional relationship should be specified from a plurality of reference objects included in the image data, and based on the selection instruction, the plurality of POI-compatible objects The information processing system according to claim 3, wherein a reference object is selected and a positional relationship between the selected POI-compatible reference objects is specified. The positioning information includes positioning direction information and / or positioning position information,
The information processing system according to claim 1, wherein the correction unit corrects at least one of the positioning direction information and the positioning position information.   The information processing system according to claim 1, wherein the correction unit corrects the positioning information based on a size of the POI-compliant reference object in the image data. Computer
A specifying means for specifying a road and a plurality of different POI-compatible reference objects from captured image data, or an acquisition means for acquiring information for specifying the road and the plurality of POI-compatible reference objects from a server;
Correction means for correcting the positioning information measured based on the positional relationship between the identified road and the plurality of POI-compliant reference objects;
An information processing program that functions as a computer program. Computer
A specifying means for specifying a road and a plurality of different POI-compliant reference objects from the captured image data;
Based on the positional relationship between the identified road and the plurality of POI-compliant reference objects, correction means for correcting the positioning information measured, or the specified road and the above-mentioned to enable the correction by a terminal device Transmitting means for transmitting information based on the positional relationship with a plurality of POI-compliant reference objects to the terminal device;
An information processing program that functions as a computer program. A step of specifying a road and a plurality of different POI-compatible reference objects from the captured image data by the specifying means;
A step of correcting the positioning information measured based on the positional relationship between the identified road and the plurality of POI-compliant reference objects;
An information processing method comprising:

Images