JP7598900B2 - Management device, program, system, and management method - Google Patents

Description

The present invention relates to a management device, a program, a system, and a management method.

Patent Document 1 describes a Visual Positioning System (VPS).
[Prior Art Literature]
[Patent Documents]
[Patent Document 1] JP 2021-174285 A

According to one embodiment of the present invention, a management device is provided. The management device may include a map storage unit that stores a plurality of 3D maps, each of which corresponds to a three-dimensional area in real space, in association with range information indicating the range of the corresponding three-dimensional area in the real space. The management device may include a map selection unit that selects one of the plurality of 3D maps based on the plurality of range information stored in the map storage unit and terminal location information indicating the location of the communication terminal. The management device may include a map transmission unit that transmits the 3D map selected by the map selection unit to the communication terminal.

The map selection unit may select the 3D map corresponding to the range information including the position indicated by the terminal position information. In response to the communication terminal entering the three-dimensional area in the real space, the map selection unit may select the 3D map corresponding to the three-dimensional area into which the communication terminal has entered.

In the management device, the map selection unit may select the 3D map corresponding to the range information including the position indicated by the terminal location information and an adjacent 3D map corresponding to an adjacent area, which is a three-dimensional area adjacent to a current area, which is the three-dimensional area corresponding to the 3D map, and the map transmission unit may transmit the 3D map and the adjacent 3D map selected by the map selection unit to the communication terminal.

In any of the management devices, the map selection unit may select the 3D map corresponding to the range information including the position indicated by the terminal location information and a destination 3D map corresponding to a destination area, which is the three-dimensional area to which the communication terminal may move from the current area, which is the three-dimensional area corresponding to the 3D map, and the map transmission unit may transmit the 3D map selected by the map selection unit and the destination 3D map to the communication terminal. The map selection unit may select the destination 3D map by setting the three-dimensional area located within a predetermined distance from the current area as the destination area. The map storage unit may previously store destination map information indicating the destination 3D map in association with each of the multiple 3D maps, and the map selection unit may select the destination 3D map indicated by the destination map information of the 3D map corresponding to the range information including the position indicated by the terminal location information. The management device may further include a terminal-related information acquisition unit that acquires terminal-related information related to the communication terminal, and the map selection unit may identify the destination area based on the terminal-related information. The terminal-related information acquisition unit may acquire movement direction information indicating a movement direction of the communication terminal, and the map selection unit may select the destination 3D map by using the current area as a reference and the three-dimensional area existing in the movement direction indicated by the movement direction information as the destination area. The terminal-related information acquisition unit may acquire user direction information indicating a direction in which a user of the communication terminal is facing, and the map selection unit may select the destination 3D map by using the current area as a reference and the three-dimensional area existing in the direction indicated by the user direction information as the destination area. The terminal-related information acquisition unit may acquire behavior history information indicating a behavior history of a user of the communication terminal, and the map selection unit may select the destination 3D map corresponding to the destination area determined based on the user's destination estimated based on the behavior history information. The terminal-related information acquisition unit may acquire destination information indicating a destination in a navigation service being executed on the communication terminal, and the map selection unit may select the destination 3D map corresponding to the destination area determined based on the destination indicated by the destination information. The terminal-related information acquisition unit may acquire movement speed information indicating a movement speed of the communication terminal, and the map selection unit may select more of the destination 3D maps as the movement speed indicated by the movement speed information increases.

Any of the management devices may further include a deletion instruction transmission unit that transmits a deletion instruction to the communication terminal to delete the 3D map corresponding to the one three-dimensional area when the communication terminal moves outside the one three-dimensional area after the communication terminal is located within the one three-dimensional area and the map transmission unit transmits the 3D map corresponding to the one three-dimensional area to the communication terminal, in response to a predetermined condition being satisfied.

In any of the management devices, the range information may include the minimum and maximum values of the X-axis, the minimum and maximum values of the Y-axis, and the minimum and maximum values of the Z-axis of the three-dimensional area in a coordinate space in the real space.

According to one embodiment of the present invention, a program is provided for causing a computer to function as the management device.

According to one embodiment of the present invention, a system is provided that includes the management device and the communication terminal. The communication terminal may transmit terminal location information indicating the location of the communication terminal to the management device, receive the 3D map selected by the map selection unit using the transmitted terminal location information and transmitted by the map transmission unit, and execute a VPS using the received 3D map.

According to one embodiment of the present invention, there is provided a management method executed by a computer. The management method may include a storage step of storing in a map storage unit a plurality of 3D maps, each of which corresponds to a three-dimensional area in real space, range information indicating the range of the corresponding three-dimensional area in the real space. The management method may include a map selection step of selecting one of the plurality of 3D maps based on the plurality of range information stored in the map storage unit and terminal location information indicating the location of the communication terminal. The management method may include a map transmission step of transmitting the 3D map selected in the map selection step to the communication terminal.

Note that the above summary of the invention does not list all of the necessary features of the present invention. Also, subcombinations of these features may also be inventions.

1 illustrates a schematic diagram of an example of a system 10. 4 shows a schematic diagram of an example of range information 400. An example of an area group 300 is shown in schematic form. 10 is an explanatory diagram for explaining an example of a 3D map transmission process performed by the management device 100; FIG. 10 is an explanatory diagram for explaining an example of a 3D map transmission process performed by the management device 100; FIG. 2 illustrates an example of a functional configuration of a management device 100. 13 shows an example of a flow of processing by the management device 100. 1 illustrates an example of a hardware configuration of a computer 1200 that functions as the management device 100.

In recent years, in the fields of AR (Augmented Reality) and autonomous driving, a self-location estimation method called VPS has been developed and put into practical use. VPS is a technology that aligns virtual and real spaces by matching camera images with scanned spatial information (3D maps containing 3D point cloud information).

In conventional VPS technology, detailed location information that can uniquely identify the 3D map to be used is not stored together with the 3D map. In addition, there is no mechanism for automatically selecting the 3D map to be used based on location information. As a result, the efficiency of selecting a 3D map in a VPS is poor. For example, when targeting a relatively large space, a single 3D map would result in an enormous amount of data, so the 3D map needs to be divided. If location information is not attached to the 3D map, map selection occurs every time the user moves from one location to another, resulting in a decrease in UX (User Experience). In addition, for example, when targeting an environment with multiple rooms of the same design, matching only with camera images may result in the wrong 3D map being selected because the characteristics are similar.

In the system 10 according to the present embodiment, for example, detailed location information data is added to the 3D map. In conventional VPS technology, GPS (latitude, longitude, altitude) information is stored together with the map, but if only one piece of coordinate information is used, all maps that fit the vicinity of the coordinates will be selected as selection candidates. In the system 10, the range in real space of the three-dimensional area that the 3D map corresponds to is stored together with the 3D map. As a specific example, in the system 10, the eight vertex coordinates of the 3D map are applied to the real space and stored. This makes it possible to select a specific point cloud map that fits the location information of the terminal. In addition, in the system 10, a mechanism for selecting a 3D map that utilizes location information is introduced. For example, in the system 10, the location information of the terminal is obtained using GPS, a beacon ID, PDR (pedestrian dead reckoning), etc., and a 3D map that fits the obtained location information is selected. In addition, 3D maps adjacent to the 3D map are also selected. When using VPS, you are likely to be constantly moving, so you can increase the efficiency of VPS by selecting adjacent 3D maps as well.

The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

FIG. 1 shows an example of a system 10. The system 10 includes a management device 100 and a communication terminal 200. Although FIG. 1 shows an example of one communication terminal 200, the system 10 may include multiple communication terminals 200.

The system 10 may realize a VPS. The management device 100 may manage a 3D map used in the VPS. The management device 100 may manage a 3D map registered from outside. The management device 100 may generate a 3D map. The management device 100 may generate a 3D map based on multiple images whose positions are identified.

The communication terminal 200 uses the 3D map received from the management device 100 and an image captured by a camera provided in the communication terminal 200 to determine the position and orientation of the user 202 of the communication terminal 200. The communication terminal 200 may further determine the positional relationship between the communication terminal 200 and surrounding objects.

The management device 100 and the communication terminal 200 may communicate via a network 20. The network 20 may include a mobile communication network. The mobile communication network may conform to any of the following communication methods: LTE (Long Term Evolution), 5G (5th Generation), 3G (3rd Generation), and 6G (6th Generation) or later. The network 20 may include the Internet. The network 20 may include a cloud.

The management device 100 may be connected to the network 20 by wire. The management device 100 may be connected to the network 20 by wireless. The management device 100 is connected to the network 20, for example, via a wireless base station. The management device 100 is connected to the network 20, for example, via a Wi-Fi (registered trademark) (Wireless Fidelity) access point.

The communication terminal 200 may be wirelessly connected to the network 20. The communication terminal 200 is connected to the network 20, for example, via a wireless base station. The communication terminal 200 is connected to the network 20, for example, via a Wi-Fi access point.

The management device 100 may be configured as one physical device or multiple physical devices. The management device 100 is, for example, disposed in a mobile communication network. The management device 100 is, for example, disposed in a core network in a mobile communication network. The management device 100 may be disposed in MEC (Multi access Edge Computing, Mobile Edge Computing). The management device 100 is, for example, disposed in a cloud. The management device 100 is, for example, disposed on the Internet.

The communication terminal 200 may be any terminal that has a camera and can execute the VPS. The camera of the communication terminal 200 may be an internal or external type. For example, the communication terminal 200 is a smartphone. For example, the communication terminal 200 is a wearable terminal. For example, the communication terminal 200 is AR (Augmented Reality) glasses.

The communication terminal 200 may have a positioning function. The communication terminal 200 performs, for example, GNSS (Global Navigation Satellite System) positioning such as GPS (Global Positioning System) positioning. The communication terminal 200 performs, for example, NW (Network) positioning. Examples of NW positioning include cell positioning and Wi-Fi (registered trademark) positioning. The communication terminal 200 performs, for example, PDR (Pedestrian Dead Reckoning). The communication terminal 200 grasps its own position by, for example, appropriately performing GNSS positioning, and when it becomes impossible to perform GNSS positioning due to moving inside a building or underground, it continues to grasp its own position by PDR.

The management device 100 according to this embodiment stores a plurality of 3D maps, each of which corresponds to a three-dimensional area 310 in real space, in association with range information indicating the range of the corresponding three-dimensional area 310 in real space. Real space is an actual space, not a virtual space. Then, the management device 100 selects one of the plurality of 3D maps based on the plurality of range information and terminal position information indicating the position of the communication terminal, and transmits it to the communication terminal 200.

In conventional VPS technology, one location (latitude, longitude, altitude) is associated with each 3D map, but in that case, it is difficult to accurately identify the 3D map that corresponds to the location of the communication terminal 200, and, for example, multiple 3D maps whose associated locations are close to the location of the communication terminal 200 end up being selected as candidates. In contrast, with the management device 100 according to this embodiment, it becomes possible to select a specific 3D map that matches the location of the communication terminal 200 using range information.

The communication terminal 200 transmits terminal location information indicating the location of the communication terminal 200 to the management device 100, receives a 3D map selected and transmitted by the management device 100 using the transmitted terminal location information, and executes the VPS using the received 3D map.

For example, in response to receiving an instruction from user 202, communication terminal 200 transmits to management device 100 terminal position information of communication terminal 200 and request information for a 3D map. In response to the request information received from communication terminal 200, management device 100 transmits to communication terminal 200 a 3D map corresponding to range information including the position indicated by the terminal position information received from communication terminal 200. In this way, management device 100 can instantly transmit a 3D map that fits the position of communication terminal 200 to communication terminal 200.

Furthermore, communication terminal 200 transitions to a VPS execution state in response to, for example, receiving an instruction from user 202. In the VPS execution state, communication terminal 200 periodically transmits terminal position information of communication terminal 200 to management device 100. When range information including a position indicated by the received terminal position information exists, management device 100 transmits a 3D map corresponding to the range information to communication terminal 200. In this way, according to management device 100, when communication terminal 200 moving enters three-dimensional area 310 in which a 3D map is registered, the 3D map can be transmitted to communication terminal 200.

In addition to the 3D map corresponding to the 3D area 310 in which the communication terminal 200 is located, the management device 100 may transmit to the communication terminal 200 a 3D map corresponding to a 3D area 310 adjacent to the 3D area 310. When using a VPS, the user 202 is likely to be constantly on the move, and it is highly likely that the user 202 will move from the 3D area 310 in which the user 202 is currently located to the adjacent 3D area 310. When the 3D map is transmitted to the communication terminal 200 after the user 202 moves to the adjacent 3D area 310, a time lag may occur before the VPS can be executed in the 3D area 310. However, by transmitting the 3D map to the communication terminal 200 in advance, the time lag can be eliminated and the efficiency of the VPS can be improved.

The selection of the 3D map may be initiated by the user 202. For example, the user 202 accesses the management device 100 via the communication terminal 200, selects a 3D map corresponding to the three-dimensional area 310 in which the user 202 is located from among a plurality of 3D maps, and requests the 3D map from the management device 100. The management device 100 transmits the requested 3D map to the communication terminal 200. At this time, the management device 100 may transmit to the communication terminal 200, in addition to the requested 3D map, 3D maps corresponding to three-dimensional areas 310 adjacent to the three-dimensional area 310 to which the 3D map corresponds.

Figure 2 shows a schematic diagram of an example of range information 400. Range information 400 may be any information that indicates the range of the corresponding three-dimensional area 310 in real space.

2 illustrates an example in which the three-dimensional area 310 has a rectangular shape. When the three-dimensional area 310 has a rectangular shape, the range information 400 includes, for example, the minimum and maximum values of the X-axis, the minimum and maximum values of the Y-axis, and the minimum and maximum values of the Z-axis of the three-dimensional area 310 in the coordinate space in real space. In the example shown in FIG. 2, the range information 400 includes the coordinates of eight vertices of the rectangular-shaped range information 400. This allows the range information 400 to indicate the range of the three-dimensional area 310 in real space with a very small amount of data, and reduces the calculation load for detecting whether the communication terminal 200 has entered or exited the three-dimensional area 310.

The shape of the three-dimensional area 310 is not limited to a rectangular shape and may be any shape. If the shape of the three-dimensional area 310 is a shape other than a rectangular shape, the range information may be information capable of identifying the range of the three-dimensional area 310 according to the shape of the three-dimensional area 310. For example, if the shape of the three-dimensional area 310 is a sphere, the range information may include information on the center point and radius of the three-dimensional area 310.

Figure 3 shows an example of an area group 300 of three-dimensional areas 310. Here, an example is shown in which multiple three-dimensional areas 310 are arranged contiguously. The management device 100 stores 3D maps corresponding to each of the multiple three-dimensional areas 310.

Figure 4 is an explanatory diagram for explaining an example of a 3D map transmission process by the management device 100. Here, the area group 300 illustrated in Figure 3 is shown as viewed from above, and an example is given of a case in which terminal location information and 3D map request information are received from a communication terminal 200 currently located in area 312.

The management device 100 identifies a current area 312 that corresponds to range information that includes the location indicated by the terminal location information among the multiple range information. The management device 100 also identifies an associated area 314 that is related to the current area 312.

For example, the management device 100 identifies the related area 314 based on the positional relationship with the current area 312. In the example shown in FIG. 4, the management device 100 identifies four three-dimensional areas 310 adjacent to the current area 312 as related areas 314. The management device 100 then transmits a 3D map corresponding to the current area 312 and four 3D maps corresponding to the four related areas 314 to the communication terminal 200. Note that, here, an example has been described in which the management device 100 identifies the three-dimensional areas 310 adjacent to the current area 312 in the horizontal direction as related areas 314, but this is not limiting. The management device 100 may further identify four three-dimensional areas 310 adjacent to the current area 312 in the diagonal direction as related areas 314. The management device 100 may also identify three-dimensional areas 310 located within a predetermined distance from the current area 312 as related areas 314.

The management device 100 may identify the related area 314 using terminal-related information related to the communication terminal 200 in addition to the positional relationship with the current area 312. For example, the management device 100 identifies, as the related area 314, the three-dimensional area 310 located ahead in the direction of movement of the communication terminal 200 among the three-dimensional areas 310 adjacent to the current area 312. For example, the management device 100 identifies, as the related area 314, the three-dimensional area 310 located ahead in the direction in which the user 202 of the communication terminal 200 is facing among the three-dimensional areas 310 adjacent to the current area 312.

The management device 100 may pre-register and store associated 3D maps for each of a plurality of 3D maps. In this case, after identifying the current area 312, the management device 100 identifies an associated 3D map registered in association with the current area 312, and transmits the associated 3D map and the 3D map corresponding to the current area 312 to the communication terminal 200.

Registration of related 3D maps for a 3D map may be performed by an administrator of the system 10 or the like. For example, for each of a plurality of 3D areas 310, the administrator of the system 10 registers in the management device 100 3D areas 310 to which there is a possibility of movement from the 3D area 310 as related areas. The management device 100 registers the 3D map corresponding to the 3D area 310 and the 3D map corresponding to the related area in association with each other.

The administrator of the system 10, for example, checks whether it is physically possible to move from one three-dimensional area 310 to another three-dimensional area 310, and if it is possible, determines that it is a related area. The administrator of the system 10, for example, determines that one three-dimensional area 310 is a related area when the degree of association between the one three-dimensional area 310 and the other three-dimensional area 310 is high. Note that such a determination may be performed mainly by the management device 100. The management device 100, for example, determines whether the one three-dimensional area 310 is related to the other three-dimensional area 310 by analyzing the position of the one three-dimensional area 310, multiple images of the one three-dimensional area 310, the position of the other three-dimensional area 310, and multiple images of the other three-dimensional area 310. The management device 100 may make a determination, for example, by analyzing whether it is possible to move from the one three-dimensional area 310 to the other three-dimensional area 310, and the association between the one three-dimensional area 310 and the other three-dimensional area 310.

Figure 5 is an explanatory diagram for explaining an example of a 3D map transmission process by the management device 100. Here, a case where multiple three-dimensional areas 310 are not contiguous is explained.

The management device 100 identifies a current area 312 that corresponds to range information that includes the position indicated by the terminal position information among the multiple range information. The management device 100 also identifies a related area 314 that is related to the current area 312. In the example shown in FIG. 5, the management device 100 identifies two three-dimensional areas 310 located within a predetermined distance range from the current area 312 as related areas 314. The management device 100 transmits a 3D map corresponding to the current area 312 and two 3D maps corresponding to the two related areas 314 to the communication terminal 200.

3 to 5 show an example in which multiple three-dimensional areas 310 are arranged horizontally. For example, if the target is a multi-story building or the like, multiple three-dimensional areas 310 are arranged on each floor. The three-dimensional areas 310 may be arranged vertically in addition to horizontally. For example, in an open space such as a city center, multiple three-dimensional areas 310 may be arranged horizontally and stacked vertically. In this case, the management device 100 may transmit to the communication terminal 200 a 3D map corresponding to the current area 312 in which the communication terminal 200 is located and a 3D map corresponding to the three-dimensional area 310 located above the current area 312. In addition, when transmitting a 3D map corresponding to the related area 314 to the communication terminal 200, the management device 100 may also transmit to the communication terminal 200 a 3D map corresponding to the three-dimensional area 310 located above the related area 314.

Figure 6 shows an example of the functional configuration of the management device 100. The management device 100 includes a memory unit 110, a registration unit 120, a map generation unit 122, a terminal-related information acquisition unit 130, a map selection unit 140, a map transmission unit 142, and a deletion instruction transmission unit 144. Note that it is not essential that the management device 100 includes all of these units.

The storage unit 110 stores various types of information. The storage unit 110 may include a map storage unit 112 and a terminal-related information storage unit 114. Note that it is not essential that the storage unit 110 includes all of these.

The registration unit 120 executes the registration of various information. For example, the registration unit 120 registers a number of 3D maps, each of which corresponds to a number of three-dimensional areas 310 in real space. The registration unit 120 registers range information indicating the range in real space of the corresponding three-dimensional area 310 for each of the multiple 3D maps. The registration unit 120 receives and registers the 3D map and range information, for example, from an external device. The registration unit 120 stores the registered 3D map and range information in the map storage unit 112.

The registration unit 120 may register AR content to be displayed on the communication terminal 200. The registration unit 120 may store the AR content to be displayed on the communication terminal 200 in the three-dimensional area 310 in the map storage unit 112 in association with a 3D map corresponding to the three-dimensional area 310.

The map generating unit 122 generates a 3D map. For example, the map generating unit 122 generates the 3D map based on a plurality of images whose positions are identified and stored in the storage unit 110.

The map generating unit 122 may acquire three-dimensional area information of a target real-world three-dimensional area and generate a 3D map corresponding to the target three-dimensional area based on the three-dimensional area information. For example, the map generating unit 122 may generate one 3D map covering the entire target real-world three-dimensional area, or may divide the target real-world three-dimensional area into multiple three-dimensional areas and generate multiple 3D maps covering the multiple divided three-dimensional areas. For example, when one 3D map is generated for the target real-world three-dimensional area, if the data size of the 3D map exceeds a predetermined threshold, the map generating unit 122 may divide the target three-dimensional area into multiple three-dimensional areas and generate multiple 3D maps covering the multiple divided three-dimensional areas. When dividing one three-dimensional area into multiple three-dimensional areas, the map generating unit 122 may divide the area according to divisions in real space. For example, the map generating unit 122 may divide the area by category, such as roads and buildings, or by floors of a building. The map generation unit 122 may generate range information for each of the multiple 3D maps that have been generated, and store the information in association with the multiple 3D maps in the map storage unit 112.

The terminal-related information acquisition unit 130 acquires terminal-related information related to the communication terminal 200. The terminal-related information acquisition unit 130 may receive the terminal-related information from the communication terminal 200. The terminal-related information acquisition unit 130 stores the acquired terminal-related information in the terminal-related information storage unit 114.

The terminal-related information acquisition unit 130 acquires, for example, terminal position information of the communication terminal 200. The terminal-related information acquisition unit 130 acquires, for example, movement direction information indicating the movement direction of the communication terminal 200. The communication terminal 200 generates the movement direction information using the detection results of the acceleration sensor and gyro sensor provided in the communication terminal 200, the results of the time-series positioning process, etc.

The terminal-related information acquisition unit 130 acquires, for example, user direction information indicating the direction in which the user 202 of the communication terminal 200 is facing. The communication terminal 200 generates the user direction information based on, for example, the attitude information of the communication terminal 200 and the positional relationship between the communication terminal 200 and the user 202.

The terminal-related information acquisition unit 130 acquires, for example, behavior history information indicating the behavior history of the user 202 of the communication terminal 200. The behavior history information may include the movement history of the user 202. The behavior history information may include the payment history of the user 202.

The terminal-related information acquisition unit 130 acquires, for example, navigation-related information related to a navigation service being executed in the communication terminal 200. The navigation-related information may include destination information indicating the destination.

The terminal-related information acquisition unit 130 acquires, for example, moving speed information indicating the moving speed of the communication terminal 200. The communication terminal 200 generates the moving speed information using, for example, the detection results of an acceleration sensor or a speed sensor provided in the communication terminal 200, the results of a time-series positioning process, etc.

The map selection unit 140 selects one of the multiple 3D maps stored in the map storage unit 112 based on the terminal position information of the communication terminal 200 acquired by the terminal-related information acquisition unit 130 and the multiple pieces of range information stored in the map storage unit 112. The map transmission unit 142 transmits the 3D map selected by the map selection unit 140 to the communication terminal 200.

The map selection unit 140 selects, for example, a 3D map corresponding to range information including the position indicated by the terminal position information. This makes it possible to transmit a 3D map corresponding to the three-dimensional area 310 in which the communication terminal 200 is located to the communication terminal 200, and to cause the communication terminal 200 to appropriately execute the VPS. When another three-dimensional area 310 is located on the three-dimensional area 310 corresponding to range information including the position indicated by the terminal position information, the map selection unit 140 may further select a 3D map corresponding to the other three-dimensional area 310.

The map selection unit 140 may detect when the communication terminal 200 enters any of the three-dimensional areas 310 in which a 3D map is registered by monitoring the terminal position information of the communication terminal 200 received by the terminal-related information acquisition unit 130 from the communication terminal 200. Then, the map selection unit 140 may select a 3D map corresponding to the three-dimensional area 310 into which the communication terminal 200 has entered in response to the communication terminal 200's entry into the three-dimensional area 310. This makes it possible to transmit an appropriate 3D map to the communication terminal 200 at an appropriate time without the user 202 of the communication terminal 200 being aware of it. The map selection unit 140 may accept a 3D map designated by the user 202 of the communication terminal 200. For example, the map selection unit 140 selects the 3D map designated by the user 202 of the communication terminal 200 from among a plurality of 3D maps.

The map selection unit 140 may select a 3D map (sometimes referred to as an adjacent 3D map) corresponding to a 3D area 310 (sometimes referred to as a current area) adjacent to the 3D area 310 (sometimes referred to as an adjacent area) corresponding to the 3D map, in addition to the 3D map corresponding to the range information including the position indicated by the terminal position information. In this case, the map transmission unit 142 may transmit the 3D map selected by the map selection unit 140 and the adjacent 3D map to the communication terminal 200. The map selection unit 140 may specify an adjacent area adjacent to the current area using the positional relationship of multiple 3D areas 310 that can be specified by multiple range information stored in the map storage unit 112. For example, the map selection unit 140 specifies a 3D area 310 that is continuous horizontally with respect to the current area as an adjacent area. For example, the map selection unit 140 specifies a 3D area 310 that is continuous horizontally with respect to the current area and a 3D area 310 that is continuous diagonally with respect to the current area as adjacent areas. The map storage unit 112 may register adjacent three-dimensional areas 310 in advance for each of the multiple three-dimensional areas 310. The map selection unit 140 may specify the adjacent areas by referring to information on the three-dimensional areas 310 adjacent to the current area that are registered in advance for the current area. The map storage unit 112 may also register adjacent 3D maps in advance for each of the multiple 3D maps. After specifying the 3D map corresponding to the current area, the map selection unit 140 may select the adjacent 3D map that is registered in advance for the 3D map. There is a relatively high possibility that the user 202 located in the current area will move to an adjacent area, and by transmitting the 3D map in advance to the communication terminal 200, the execution of the VPS can be started immediately after the user 202 moves to the adjacent area.

The map selection unit 140 may select a 3D map (sometimes referred to as a destination 3D map) corresponding to a three-dimensional area 310 (sometimes referred to as a destination area) to which the communication terminal 200 may move from the current area, in addition to the 3D map corresponding to the range information including the position indicated by the terminal position information. In this case, the map transmission unit 142 may transmit to the communication terminal 200 the 3D map selected by the map selection unit 140 and the destination 3D map. By transmitting to the communication terminal 200 a 3D map corresponding to a three-dimensional area 310 to which the communication terminal 200 may move, in addition to the 3D map corresponding to the three-dimensional area 310 in which the communication terminal 200 is currently located, it is possible to eliminate a time lag compared to a case in which the communication terminal 200 transmits a 3D map after entering the three-dimensional area 310, and it is possible to make the VPS executable immediately after the movement.

The map selection unit 140 selects a destination 3D map, for example, from a three-dimensional area 310 located within a predetermined distance from the current area as the destination area. This allows a 3D map corresponding to the three-dimensional area 310 to be transmitted to the communication terminal 200 in advance when a three-dimensional area 310 with a registered 3D map is present near the current area, eliminating a time lag compared to when the communication terminal 200 transmits the 3D map after moving from the current area to the three-dimensional area 310.

The map storage unit 112 may store destination map information indicating a destination 3D map in association with each of the multiple 3D maps. In this case, the map selection unit 140 may select a destination 3D map indicated by the destination map information of the 3D map corresponding to the range information including the position indicated by the terminal position information. By storing destination map information indicating a destination 3D map determined by a person or identified by image analysis results for each of the multiple 3D maps, the map storage unit 112 can transmit a 3D map corresponding to a three-dimensional area 310 to which a communication terminal 200 currently located in a current area is likely to move in advance to the communication terminal 200.

The map selection unit 140 may identify the destination area based on the terminal-related information stored in the terminal-related information storage unit 114.

For example, the map selection unit 140 selects a destination 3D map by using the current area as a reference and a three-dimensional area 310 that exists in the movement direction indicated by the movement direction information as a destination area. Since the movement direction indicated by the movement direction information is more likely to be the direction in which the user 202 will move than other directions, a 3D map of the three-dimensional area 310 in which the user 202 is more likely to move can be transmitted in advance to the communication terminal 200.

For example, the map selection unit 140 selects a destination 3D map by using the current area as a reference and a three-dimensional area 310 that exists in the direction indicated by the user direction information as a destination area. Since the user 202 is likely to move in the direction in which the user 202 is facing, a 3D map of the three-dimensional area 310 to which the user 202 is likely to move can be transmitted in advance to the communication terminal 200.

For example, the map selection unit 140 selects a destination 3D map corresponding to a destination area determined based on the destination of the user 202 estimated based on the behavior history information. The map selection unit 140 determines the destination area based on the destination of the user 202 estimated from the movement history of the user 202, for example. The map selection unit 140 may estimate the destination from the movement history using existing technology. For example, the map selection unit 140 identifies the life pattern of the user 202, such as commuting to work or school, from the long-term movement history of the user 202, and identifies the destination of the user 202 according to the life pattern. For example, the map selection unit 140 may estimate the destination of the user 202 from the short-term movement history of the user 202. Since the destination of the user 202 is correlated with the behavior history of the user 202, a 3D map of the three-dimensional area 310 to which the user 202 is likely to move can be transmitted to the communication terminal 200 in advance.

For example, the map selection unit 140 selects a destination 3D map corresponding to a destination area determined based on the destination indicated by the destination information. The map selection unit 140 selects, for example, a 3D map corresponding to range information including the destination indicated by the destination information as the destination 3D map. This makes it possible to make the VPS executable at the destination before the user 202 arrives at the destination. In addition, the map selection unit 140 selects, for example, a 3D map corresponding to a three-dimensional area 310 that exists on the route from the current location of the user 202 to the destination indicated by the destination information as the destination 3D map. This makes it possible to execute the VPS without any time lag occurring until the user 202 moves to the destination.

The map selection unit 140 may adjust the number of selected destination 3D maps based on the movement speed information. For example, the map selection unit 140 selects more destination 3D maps as the movement speed indicated by the movement speed information increases. As a specific example, when the movement speed indicated by the movement speed information is slower than a first threshold, the map selection unit 140 selects one 3D map of the three-dimensional area 310 closest to the current area, and when the movement speed is faster than the first threshold, the map selection unit 140 selects the 3D map of the three-dimensional area 310 closest to the current area and the 3D map of the next closest three-dimensional area 310. In addition, the map selection unit 140 selects one 3D map of the three-dimensional area 310 closest to the current area when the moving speed indicated by the moving speed information is slower than the first threshold, selects the 3D map of the three-dimensional area 310 closest to the current area and the 3D map of the next closest three-dimensional area 310 when the moving speed is faster than the first threshold and slower than a second threshold indicating a value faster than the first threshold, and selects the 3D map of the three-dimensional area 310 closest to the current area, the 3D map of the next closest three-dimensional area 310, and the 3D map of the next closest three-dimensional area 310 when the moving speed is faster than the second threshold. If the user 202 is riding a vehicle such as a bicycle and moving at a high speed, there is a possibility that the user will pass the three-dimensional area 310 closest to the current area in a short time and reach the next closest three-dimensional area 310. According to the map selection unit 140, even in such a case, it is possible to execute the VPS without a time lag.

The map selection unit 140 may select a 3D map further based on the category of the three-dimensional area 310. Examples of categories of the three-dimensional area 310 include roads and buildings. For example, when the current area of the communication terminal 200 is a road, the map selection unit 140 identifies an adjacent area along the road and selects an adjacent 3D map. For example, when the current area of the communication terminal 200 is a road, the map selection unit 140 identifies a destination area along the road and selects a destination 3D map. For example, when the current area of the communication terminal 200 is a road and a three-dimensional area 310 with a category of buildings exists in the direction indicated by the user direction information from the position of the communication terminal 200, the map selection unit 140 selects a 3D map of the three-dimensional area 310.

After the map transmission unit 142 transmits a 3D map to the communication terminal 200, the deletion instruction transmission unit 144 transmits a deletion instruction for the 3D map to the communication terminal 200 in response to the communication terminal 200 satisfying a predetermined condition. For example, when the communication terminal 200 is located within one three-dimensional area 310 and the map transmission unit 142 transmits a 3D map corresponding to the one three-dimensional area 310 to the communication terminal 200, and the communication terminal 200 moves outside the one three-dimensional area 310, the deletion instruction transmission unit 144 transmits a deletion instruction to the communication terminal 200 to delete the 3D map corresponding to the one three-dimensional area 310 in response to the communication terminal 200 moving outside the one three-dimensional area 310 in response to the predetermined condition being satisfied.

For example, when the communication terminal 200 moves outside the one three-dimensional area and then moves away from the one three-dimensional area 310 by a predetermined distance or more, the deletion instruction sending unit 144 sends a deletion instruction to the communication terminal 200 to delete the 3D map corresponding to the one three-dimensional area 310. This makes it possible to cause the communication terminal 200 to delete the 3D map when it becomes highly likely that the user 202 of the communication terminal 200 will not return to the one three-dimensional area 310.

For example, when a plurality of other three-dimensional areas 310 are adjacent to the one three-dimensional area 310, the deletion instruction transmission unit 144 transmits to the communication terminal 200 a deletion instruction to delete the 3D map corresponding to the one three-dimensional area 310 when the communication terminal 200 moves out of the one three-dimensional area and then leaves the three-dimensional area 310 adjacent to the one three-dimensional area 310. Also, for example, when a plurality of other three-dimensional areas 310 are adjacent to the one three-dimensional area 310, the deletion instruction transmission unit 144 transmits to the communication terminal 200 a deletion instruction to delete the 3D map corresponding to the one three-dimensional area 310 when the communication terminal 200 moves out of the one three-dimensional area and then enters a three-dimensional area 310 that is two or more areas away from the one three-dimensional area 310. This allows the communication terminal 200 to delete the 3D map when the user 202 of the communication terminal 200 is in a situation where there is a high probability that he or she will not return to one three-dimensional area 310.

For example, when the deletion instruction sending unit 144 detects that the user 202 of the communication terminal 200 has boarded a vehicle after the communication terminal 200 has moved outside the one three-dimensional area 310, the deletion instruction sending unit 144 sends a deletion instruction to the communication terminal 200 to delete the 3D map corresponding to the one three-dimensional area 310. For example, when the deletion instruction sending unit 144 detects that the user 202 of the communication terminal 200 has boarded a bus, a taxi, or the like after the communication terminal 200 has moved outside the one three-dimensional area 310, the deletion instruction sending unit 144 sends a deletion instruction to the communication terminal 200 to delete the 3D map corresponding to the one three-dimensional area 310. For example, the deletion instruction sending unit 144 may detect that the user 202 has boarded a bus or a taxi based on the payment history of the user 202 included in the behavior history information acquired by the terminal-related information acquisition unit 130.

Figure 7 shows an example of the flow of processing by the management device 100. Here, the flow of processing is described in which the management device 100 periodically acquires terminal location information of one communication terminal 200 from the communication terminal 200, and transmits the 3D map to the communication terminal 200 when the communication terminal 200 enters a three-dimensional area 310 in which a 3D map is registered.

In step (sometimes abbreviated to S) 102, the terminal-related information acquisition unit 130 receives terminal location information from the communication terminal 200. In S104, the map selection unit 140 determines whether the location indicated by the terminal location information received by the terminal-related information acquisition unit 130 in S102 is included in any of the multiple range information stored in the map storage unit 112, thereby determining whether the communication terminal 200 is located within the three-dimensional area 310 in which the 3D map is registered. If it is determined that the communication terminal 200 is located, the process proceeds to S106, and if it is determined that the communication terminal 200 is not located, the process returns to S102.

In S106, the map selection unit 140 reads out a 3D map corresponding to the current area of the communication terminal 200 from the map storage unit 112. In S108, the map selection unit 140 determines whether or not there is an additional 3D map to transmit to the communication terminal 200. If there is an adjacent 3D map or a destination 3D map to transmit to the communication terminal 200, the map selection unit 140 may determine that there is an additional map, and if there is not, it may determine that there is no additional map. If it is determined that there is an additional map, the process proceeds to S110.

In S110, the map selection unit 140 reads an additional 3D map from the map storage unit 112. In S112, the map transmission unit 142 transmits the 3D map read in S106 and, if a 3D map was read in S110, the 3D map to the communication terminal 200.

8 shows an example of a hardware configuration of a computer 1200 functioning as the management device 100. A program installed on the computer 1200 can cause the computer 1200 to function as one or more "parts" of the device according to the present embodiment, or to execute operations or one or more "parts" associated with the device according to the present embodiment, and/or to execute a process or steps of the process according to the present embodiment. Such a program can be executed by the CPU 1212 to cause the computer 1200 to execute specific operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphics controller 1216, which are connected to each other by a host controller 1210. The computer 1200 also includes input/output units such as a communication interface 1222, a storage device 1224, a DVD drive, and an IC card drive, which are connected to the host controller 1210 via an input/output controller 1220. The DVD drive may be a DVD-ROM drive, a DVD-RAM drive, etc. The storage device 1224 may be a hard disk drive, a solid state drive, etc. The computer 1200 also includes a ROM 1230 and a legacy input/output unit such as a keyboard, which are connected to the input/output controller 1220 via an input/output chip 1240.

The CPU 1212 operates according to the programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphics controller 1216 acquires image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into itself, and causes the image data to be displayed on the display device 1218.

The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive reads programs or data from a DVD-ROM or the like and provides them to the storage device 1224. The IC card drive reads programs and data from an IC card and/or writes programs and data to an IC card.

ROM 1230 stores therein a boot program or the like executed by computer 1200 upon activation, and/or a program that depends on the hardware of computer 1200. I/O chip 1240 may also connect various I/O units to I/O controller 1220 via USB ports, parallel ports, serial ports, keyboard ports, mouse ports, etc.

The programs are provided by a computer-readable storage medium such as a DVD-ROM or an IC card. The programs are read from the computer-readable storage medium, installed in storage device 1224, RAM 1214, or ROM 1230, which are also examples of computer-readable storage media, and executed by CPU 1212. The information processing described in these programs is read by computer 1200, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be constructed by realizing the operation or processing of information according to the use of computer 1200.

For example, when communication is performed between computer 1200 and an external device, CPU 1212 may execute a communication program loaded into RAM 1214 and instruct communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of CPU 1212, communication interface 1222 reads transmission data stored in a transmission buffer area provided in RAM 1214, storage device 1224, a DVD-ROM, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes received data received from the network to a reception buffer area or the like provided on the recording medium.

The CPU 1212 may also cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, a DVD drive (DVD-ROM), an IC card, etc. to be read into the RAM 1214, and perform various types of processing on the data on the RAM 1214. The CPU 1212 may then write back the processed data to the external recording medium.

Various types of information, such as various types of programs, data, tables, and databases, may be stored in the recording medium and may undergo information processing. The CPU 1212 may perform various types of processing on the data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search/replacement, etc., as described throughout this disclosure and specified by the instruction sequence of the program, and writes back the results to the RAM 1214. The CPU 1212 may also search for information in a file, database, etc. in the recording medium. For example, when multiple entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 may search for an entry whose attribute value of the first attribute matches a specified condition from among the multiple entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

The above-described programs or software modules may be stored in a computer-readable storage medium on or near the computer 1200. In addition, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the programs to the computer 1200 via the network.

The blocks in the flowcharts and block diagrams in this embodiment may represent stages of a process in which an operation is performed or "parts" of a device responsible for performing the operation. Particular stages and "parts" may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable storage medium, and/or a processor provided with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuitry may include digital and/or analog hardware circuits and may include integrated circuits (ICs) and/or discrete circuits. The programmable circuitry may include reconfigurable hardware circuits including AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, and memory elements, such as, for example, field programmable gate arrays (FPGAs) and programmable logic arrays (PLAs).

A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon comprises an article of manufacture that includes instructions that can be executed to create means for performing the operations specified in the flowchart or block diagram. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disk read-only memories (CD-ROMs), digital versatile disks (DVDs), Blu-ray disks, memory sticks, integrated circuit cards, and the like.

The computer readable instructions may include either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk (registered trademark), JAVA (registered trademark), C++, etc., and conventional procedural programming languages such as the "C" programming language or similar programming languages.

The computer-readable instructions may be provided to a processor of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, or a programmable circuit, either locally or over a local area network (LAN), a wide area network (WAN), such as the Internet, so that the processor of the general-purpose computer, special-purpose computer, or other programmable data processing apparatus, or the programmable circuit, executes the computer-readable instructions to generate means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

The present invention has been described above using an embodiment, but the technical scope of the present invention is not limited to the scope described in the above embodiment. It is clear to those skilled in the art that various modifications and improvements can be made to the above embodiment. It is clear from the claims that forms with such modifications or improvements can also be included in the technical scope of the present invention.

The order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before" or "prior to," and it should be noted that the processes may be performed in any order, unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is explained using "first," "next," etc. for convenience, it does not mean that it is necessary to perform the processes in that order.

10 System, 20 Network, 100 Management device, 110 Storage unit, 112 Map storage unit, 114 Terminal-related information storage unit, 120 Registration unit, 122 Map generation unit, 130 Terminal-related information acquisition unit, 140 Map selection unit, 142 Map transmission unit, 144 Delete instruction transmission unit, 200 Communication terminal, 202 User, 300 Area group, 310 Three-dimensional area, 312 Current area, 314 Related area, 400 Range information, 1200 Computer, 1210 Host controller, 1212 CPU, 1214 RAM, 1216 Graphic controller, 1218 Display device, 1220 Input/output controller, 1222 Communication interface, 1224 Storage device, 1230 ROM, 1240 Input/output chip

Claims (7)

A management device,
a map storage unit that stores a plurality of 3D maps, each of which corresponds to a three-dimensional area in real space, in association with range information indicating a range of the corresponding three-dimensional area in the real space;
a map selection unit that selects one of the plurality of 3D maps based on the plurality of pieces of range information stored in the map storage unit and terminal location information indicating a location of a communication terminal;
a map transmission unit that transmits the 3D map selected by the map selection unit to the communication terminal,
the management device performs a process of analyzing whether or not movement from one three-dimensional area to another three-dimensional area is possible by analyzing a position of the one three-dimensional area, a plurality of images captured of the one three-dimensional area, and a position of another three-dimensional area, a plurality of images captured of the other three-dimensional area, thereby causing the map storage unit to store, in association with each of the plurality of 3D maps, a destination 3D map corresponding to a destination area, which is a three-dimensional area to which a communication terminal may move from the three-dimensional area corresponding to the 3D map;
the map selection unit selects the 3D map corresponding to the range information including the position indicated by the terminal position information and the destination 3D map stored in association with the 3D map;
The map transmission unit transmits the 3D map and the destination 3D map selected by the map selection unit to the communication terminal. The management device according to claim 1, wherein the map selection unit selects the 3D map corresponding to the three-dimensional area into which the communication terminal has entered in response to the communication terminal entering the three-dimensional area in the real space. a map storage unit that stores a plurality of 3D maps, each of which corresponds to a three-dimensional area in real space, in association with range information indicating a range of the corresponding three-dimensional area in the real space;
a map selection unit that selects one of the plurality of 3D maps based on the plurality of pieces of range information stored in the map storage unit and terminal position information indicating a position of a communication terminal, the map selection unit selecting the 3D map corresponding to the range information including a position indicated by the terminal position information;
a map transmission unit that transmits the 3D map selected by the map selection unit to the communication terminal;
and a deletion instruction sending unit that, when the communication terminal is located within a certain three-dimensional area and the map sending unit sends the 3D map corresponding to the certain three-dimensional area to the communication terminal, and then , when the communication terminal moves outside the certain three-dimensional area and detects that a user of the communication terminal has boarded a vehicle , sends to the communication terminal a deletion instruction to delete the 3D map corresponding to the certain three-dimensional area. A program for causing a computer to function as a management device according to any one of claims 1 to 3. A management device according to any one of claims 1 to 3;
a communication terminal that transmits terminal location information indicating the location of the communication terminal to the management device, is selected by the map selection unit using the transmitted terminal location information, receives the 3D map transmitted by the map transmission unit, and executes a VPS using the received 3D map. 1. A computer-implemented management method, comprising:
a storage step of storing, in a map storage unit, a plurality of 3D maps each corresponding to a three-dimensional area in a real space, in association with range information indicating a range of the corresponding three-dimensional area in the real space;
a storage step of storing in the map storage unit, in association with each of the plurality of 3D maps, a destination 3D map corresponding to a destination area, which is a three-dimensional area to which a communication terminal may move from the three-dimensional area corresponding to the 3D map, by performing a process of analyzing whether or not movement from the one three-dimensional area to the other three-dimensional area is possible by analyzing a position of the one three-dimensional area, a plurality of images captured of the one three-dimensional area, and a position of the other three-dimensional area, a plurality of images captured of the other three-dimensional area;
a map selection stage for selecting one of the plurality of 3D maps based on the plurality of pieces of range information stored in the map storage unit and terminal position information indicating a position of a communication terminal, the map selection stage selecting the 3D map corresponding to the range information including the position indicated by the terminal position information and the destination 3D map stored in association with the 3D map;
a map transmission step of transmitting the 3D map and the destination 3D map selected in the map selection step to the communication terminal. 1. A computer-implemented management method, comprising:
a storage step of storing, in a map storage unit, a plurality of 3D maps each corresponding to a three-dimensional area in a real space, in association with range information indicating a range of the corresponding three-dimensional area in the real space;
a map selection stage for selecting one of the plurality of 3D maps based on the plurality of pieces of range information stored in the map storage unit and terminal position information indicating a position of a communication terminal, the map selection stage selecting the 3D map corresponding to the range information including a position indicated by the terminal position information;
a map transmission step of transmitting the 3D map selected in the map selection step to the communication terminal;
and a deletion instruction sending step of sending to the communications terminal a deletion instruction to delete the 3D map corresponding to the one three-dimensional area when the communications terminal is located within a one three-dimensional area and the map sending step sends the 3D map corresponding to the one three-dimensional area to the communications terminal, and then when the communications terminal moves outside the one three-dimensional area and detects that the user of the communications terminal has boarded a vehicle.

Images