Creating Immersive Virtual Environments Based on Open Geospatial Data and Game Engines

Cartography and Geographic Information Science have frequently gained benefit from technological advancements. For example, the spreading of affordable computers and displays enabled the introduction of dynamic and interactive digital maps (Brainerd and Pang 2001). The introduction of the Global Positioning System (GPS) and the massive improvements of its accuracy levels available to civil and commercial users, due to the termination of selective availability in the year 2000 (Zumberge and Gendt 2001), laid the foundation for map matching and navigation systems. The availability of personal computers with powerful graphic cards supported the creation of rendered pseudo-3D images and 3D models representing geographic space more realistically and immersive than 2D spatial representations (cf. Buchroithner and Knust 2013).

This paper carves out modern methods of geospatial data processing that could be used to create complex 3D-landscapes in virtual reality (VR) environments. Two methodological approaches will be demonstrated showing how digital elevation data as well as city models can be implemented into game engine-based VR environments. Workflows are compared between official geospatial data and volunteered geographic information (VGI). In addition, required steps for the transformation of 3D environments based on geospatial data into an immersive VR-capable application are explained.

By implementing VR capabilities into these 3D spatial representations, the level of immersion can be significantly increased (Hruby et al. 2020b). Consequently, it is much easier for a user to obtain a feeling of being present in the spatial representation. Creating such a feeling of spatial presence can support many geographic application scenarios, such as urban planning or studies on spatial perception, because the experience created by the virtual environment is more similar to the experience created by a real environment. However, the level of immersion of a VR-capable application does not only depend on general VR characteristics, such as a stereoscopic perspective and the tracking on real-world movements. It also depends on the quality of the used geospatial data and technical characteristics of the used HMD (Slater et al. 1996). Therefore, parameters of geospatial data quality are compared between an official and non-official data sources. In addition, relevant technical specifications of VR-capable HMDs are presented and compared between market-leading HMDs. This comparison is intended to support the selection of the ideal HMD for a given geospatial application scenario based on its requirements.

3D representation of space in VR allows a synthesizing approach to geographic work (Dickmann and Schmitz 2009). Concepts of different geographic sub-disciplines, such as urban planning and the effects on spatial perception can be combined. For example, construction planning of buildings or wind turbines can be combined with the investigation of shadowing and visual axes, areas at the risk of flooding during heavy rainfall events can be identified, or heat demand for the development of urban districts can be measured. Thus, the synthesis of different geographic approaches and perspectives in VR-based 3D spatial representations can support the development of urban development concepts towards more smart, green and resilient cities (Jamei et al. 2017; Ma et al. 2020).

Moreover, besides the basic ability to visualize space in 3D, VR is characterized by the component of immersion, which considerably intensifies the communication of spatial information (Hruby et al. 2020b). Immersion describes the potential of a technology to create a feeling of presence in a virtual environment (Baños et al. 2004; Waterworth and Riva 2014). Thus, immersive spatial representations allow people to perceive virtual space in a way that is more similar to the perception of real-world space. Visual and auditory spatial information can be perceived from a ‘close-to-natural perspective’.

The advantages of the explicitly immersive character of VR become particularly clear in questions of spatial perception. For example, within an urban context, immersion can support the identification of (potential) spaces of fear in cities by simulating different nightly illumination situations. Even changed soundscapes, which accompany urban-planning measures to traffic flows, can be communicated and evaluated in VR in a more realistic manner. The integration of different geospatial data formats and geospatial datasets, such as building information (height, building fabric), urban climatological data, elevation data, vegetation data, noise data from different digital sources, is a decisive prerequisite for the development of such immersive VR environments and especially for the evaluation of geographic work.

In terms of new software, cartographers are invited to explore and use game engines to create modern examples of 3D visualizations. These visualizations could include 3D models, such as modeled and textured buildings web users share online. First approaches already exist (e.g., Edler et al. 2018a, b; Hruby et al. 2017; Lütjens et al. 2019) that implement spatial data offered by official surveying departments or spatial data communities, such as the VGI initiative OpenStreetMap (OSM).

3.1 The Capabilities of Game Engines

Since the emergence of free game engines such as Unity, Unreal Engine or CryEngine, 3D spatial representations can be created with previously inconceivable levels of immersion. The implementation of a player-controlled avatar (a virtual character) enables users to perceive a constructed virtual environment from an egocentric camera perspective imitating a natural real-world perspective (cf. Hruby et al. 2020a, b; Vetter 2019). Users can freely move through the virtual space via key, mouse or button input. Thus, opposed to ‘traditional’ 2D visualization techniques or pre-rendered pseudo-3D visualization techniques, game engine-based environments can be perceived from almost unlimited varieties of different perspectives (Indraprastha and Shinozaki 2009, see Fig. 1).

Evolution of spatial representations. 2D maps (top image) are traditional kinds of spatial representation. Pseudo-3D spatial representations (center image) aim to visualize space from a more realistic but fixed spatial perspective. Modern VR-compatible 3D spatial representations (bottom image) allow users to perceive the represented space from a dynamic egocentric perspective and to interact with the virtual environment in a natural way (e.g., pointing at objects). All representations are based on spatial data of the Ruhr University Bochum retrieved from OpenStreetMap (OSM)

Full size image

In the last years, market-leading game engines, like Unity and Unreal Engine, facilitated implementation of VR head-mounted display (HMD) compatibility into virtual 3D environments. By implementing VR capability, these environments can be perceived from an immersive stereoscopic perspective and real-world movements can be transferred to the virtual environment (Edler et al. 2018a, b). Such VR perspectives enable depth perception and are totally decoupled from distracting stimuli from the real world, making the spatial experience even more immersive.

In addition to new ways of displaying spatial information that is either created manually or based on geospatial data, game engines introduce numerous possibilities of interactivity, animation and simulation that are not available in 2D, pseudo-3D, or previous 3D representations of space (Ferworn et al. 2013; Vetter 2019). Possible types of interactions are, for example, picking up, moving, adding or removing objects, and triggering visual or auditory actions via key presses or avatar movements (Keil et al. 2019). Modern game engines also apply physics models that enable realistic simulation of dynamic 3D sounds, lighting, gravity, or object collisions based on object shapes, speed and weight (Edler et al. 2019a, b; González et al. 2017). These capabilities suggest game engines as suitable solutions for the development of a multitude of geographic visualization and simulation scenarios as well as for spatial research design. Virtual 3D environments allow to experience environments which are otherwise inaccessible due to financial costs, time constraints, environmental hazards or nonexistence.

Numerous examples show advantages of game engine capabilities for geographical applications. They make it possible to bring together different perspectives of geography and related disciplines, based on the technical application of modern spatial data sets. For example, the virtual recreation of a historical town in VR developed by Kersten et al. (2018) or the TimeRide VR experience in Cologne,^{Footnote 1} Germany demonstrate how historical sites and former urban structures can be made tangible nowadays. Such recreations are especially appealing for educational purposes; applications in the field of experimental archaeology are also conceivable. In contrast to no longer existing environments, Edler et al. (2019a, b) show how virtual 3D environments and VR technology can be used to support urban planning and site marketing (see also Ma et al. 2020). Game engine technologies are shown to be helpful for urban planners, architects and stakeholders, as they enable quick prototyping of building designs and spatial arrangements. Different (future) building scenarios can be compared and shadow casts as well as visual axes can be experienced from an immersive egocentric perspective (visibility analyses). Another example for the use of game engines for planning scenarios is the attempt to assess and visualize the solar energy potential for buildings (Buyuksalih et al. 2017). Virtual exploration of hazardous environments in game engine-based 3D models has been demonstrated by Ferworn et al. (2013) and Liang et al. (2019). Ferworn et al. (2013) built a traversable virtual reconstruction of a partially collapsed building. Liang et al. (2019) created a VR-capable and interactive model of an underground mine that is used to communicate mining hazards. Such virtual environments can be used to inform or train (rescue-) workers and to reduce potential personal risks. In addition to the already presented geographic applications, game engine-based 3D environments comprise great potential for spatial user studies (cf. Edler et al. 2018a, b; Lokka et al. 2018; Lokka and Çöltekin 2020). The high level of control over the visual stimuli presented in the virtual environment is an immense advantage compared to spatial studies carried out in the real world (Minderer and Harvey 2016). All distractor stimuli can be eliminated and arbitrary visual and auditory stimuli can be presented at any desired location.

3.2 Using Open 3D Geodata for VR Construction

Several of the VR application examples mentioned in the previous section use geospatial data as digital elevation models or 3D city models to shape virtual 3D environments. The use of geospatial data has multiple advantages. First, if the spatial resolution of the used geospatial data is high enough, virtual representations of real-world environments can achieve high degrees of realism. Second, massive amounts of geospatial data have already been gathered and many (usually official) sources provide free access to this data. Therefore, using available geospatial data is time and cost efficient, as geographers do not have to acquire these data personally. Third, using geospatial data provides authenticity to the virtual environment that is required for geographic applications, such as urban planning or simulation scenarios.

A limitation of the use of free geospatial data in game engine-based 3D environments is that the data comes in numerous file types (Edler et al. 2020, in print) because there are no globally accepted standards for geospatial data file formats. Therefore, although modern game engines support a great variety of file types, transformation of geospatial data into a supported file format is usually required (cf. Petridis et al. 2012). This section demonstrates multiple examples how free geospatial data can be transformed for use in game engines, such as the Unity game engine.

Geospatial data often delivers semantic information linked to a defined geographic location, represented by point, linear or polygonal geometries (Kraak and Ormeling 2020; Stock and Guesgen 2016). The linked location or area does not need to be fixed, but non-fixed geospatial data requires additional temporal information that can be used to track movements over time. Geospatial data includes, but is not limited to, information on vegetation, land use, state boundaries, terrain elevation, residential properties, such as income or health, and human-built objects, such as buildings, roads or bridges (Biljecki et al. 2015; Haithcoat et al. 2019; Ribarsky 2005). As theoretically every semantic element can be geospatial information if it is linked to a specific location or area, it is impossible to present a complete list of all types of geospatial data. In the following sections, we will focus on two of the most common types of geospatial data: terrain elevation data in the form of digital elevation models (DEM) and human-made object data in the form of 3D city models. Both types of data can be obtained with multiple methods, can be stored in different file types, and are freely available at multiple sources. In this paper, DEMs and 3D city models from an official source and non-official open databases will be used to demonstrate basic workflows. The official data are obtained from Open.NRW, an open data portal provided by the state of North Rhine-Westphalia (NRW) in Germany. The non-official data are obtained from OSM. In our comparison, we investigate how easily the data can be imported into a Unity project. In addition, differences in the gathering of the data and their effects on data quality and the immersion of the resulting 3D model are compared.

3.2.1 Digital Elevation Models

A DEM contains structured information about the variation of terrain heights in a specified area. Common measures used to create DEMs include airplane and satellite-based aerial photography and remote sensors, barometers or tachymeters (Frolind and Ulander 2002; Korsgaard et al. 2016; Liu et al. 2014; Pichon et al. 2016). The quality of a DEM is reflected in three parameters: the reliability of the measures used to assess the terrain height and the associated location, the spatial data resolution, and the variation of distance between the data points. If the used measure has a low reliability, e.g., if the measurements of a barometer have a low reproducibility, a virtual terrain built in Unity based on the generated DEM will be less representative of the measured terrain. The spatial data resolution represents the number of measurements per unit of length. Terrain representations based on a DEM with a low spatial resolution are less representative of the measured terrain as the original topography is smoothened (see example in Fig. 2). We argue that the lack of topographic detail also makes these terrain representations less immersive, because extremely smooth terrains appear unnatural, especially if more topographic detail is expected (e.g., in extremely mountainous terrains). The variation of distance between data points describes how evenly the measured data points are distributed across the measured terrain. In the ideal case, the distance of a data point to the adjacent data points is the same for each data point, e.g., 1 m. If measured data points are not evenly distributed across the measured terrain, problems arise when these data are applied to a virtual terrain in Unity. As Unity cannot account for unevenly distributed terrain data, such data are forced into an even spatial distribution. Thus, the resulting virtual terrain is less representative of the real-world terrain. Whereas resolution of DEMs is usually specified, information about the reliability of the used measure and the variation of distance between data points is usually difficult to find, if available at all. In addition, as the latter two threats for data quality are usually non-systematic (the error can be different for each measurement), it is virtually impossible to eliminate inaccuracies. In other words, when DEM data are applied to a terrain in Unity, errors based on the reliability of the measure and the distribution of data points will affect the quality of the resulting virtual terrain representation.

Effect of the spatial resolution of a DEM on the resulting terrain representation in Unity. The figure shows two terrain representations of the former central landfill in Bochum, Germany. The left representation has a spatial resolution of 1 m. The right representation has a spatial resolution of 8 m. The loss of topographic information makes the right terrain representation appear much smoother

Full size image

DEMs can be created based on the data gathered from various measures. However, not all measures are equally appropriate to create DEMs covering large areas with a high spatial resolution. Theoretically, it is possible to create a DEM only with a smartphone that has GPS receiver and a barometer (Liu et al. 2014). However, this would require a time-consuming systematic and fine-meshed traversing across the complete selected area. In addition, some locations might not be able to be measured because they are private property, impassable or otherwise inaccessible. Airplane and satellite-based aerial photography and remote sensing on the other hand are highly cost intensive, but can cover immense areas, can penetrate vegetation and water (Frolind and Ulander 2002; Hruby et al. 2017), and can achieve high spatial resolutions of down to 1 m (Yu et al. 2014). Taken together, low-cost options to create DEMs usually cannot compete with the cost intensive options available to official institutions in terms of size, coverage and spatial resolution. As large portions of the earth surface are freely available as DEMs at official sources, VGI-based initiatives for DEM creation are usually not reasonable. Therefore, the shaping of Unity terrains based on DEM data will only be demonstrated based on an example of official data sources: Open.NRW.

The Open.NRW portal provides free DEM data of the state of NRW with a spatial resolution of 1 m. The data can be downloaded per municipality or as separate tiles with a size of 2 × 2 km.^{Footnote 2} For implementation of the DEM data into a Unity project, using the separate tile data is recommended, because the Unity terrain element is rectangular and applying non-rectangular data to the terrain element leads to undesired height artifacts. In addition, as the maximum resolution for a Unity terrain element is 4097 × 4097, applying terrains larger than 4097 × 4097 m at a spatial resolution of 1 m leads to data point losses. Therefore, DEM data with more than 4097 × 4097 data points should be subdivided into multiple datasets and applied to multiple separate terrain elements in Unity.

The DEM tiles provided by Open.NRW are formatted as space-separated .xyz files. To apply this DEM data to a terrain in Unity, it must be transformed into a heatmap image and stored as a .raw file. The transformation into a heatmap image can be achieved with QGIS, a free and open-source geographic information system.^{Footnote 3} After importing the .xyz file via the Data Source Manager, the created layer is supposed to be saved in the GeoPackage format before it is rasterized in a next step. The rasterized layer can then be exported as a .tif file. After importing the generated .tif file into GIMP, a free and open-source image manipulation program,^{Footnote 4} the Image Mode can be changed to Greyscale and afterwards the image can be exported into a .raw file, as required by Unity. However, before exporting the image, it is recommended to scale it from 2000 × 2000 px to 2049 × 2049 px. Unity terrains only accept resolutions of 2^x + 1 (e.g., 129 × 129 px, 257 × 257 px, and 513 × 513 px). Similar to non-rectangular DEM data, applying DEM data that deviates from these resolution values results in height artifacts, in this case at two terrain borders. Upscaling the image leads to interpolation of some pixels (GIMP 2020) that may not reflect actual terrain heights. However, scaling the image down to 1025 × 1025 px would discard almost half of the available data points, making the virtual terrain even much less representative of the original terrain. After transforming the DEM data into a .raw file, it can be applied to a terrain in Unity. To apply a 1:1 scale to the terrain, the X and Z values of the Terrain Size must be set to the original terrain size in meters (e.g., 2000 for Open.NRW DEM tiles). The Y value of the Terrain Size represents the height difference between the highest and the lowest elevation value in the DEM, which can be obtained from the layer view in QGIS. Finally, before the .raw data can be imported, the Depth must be set to Bit 8 and the Flip Vertically option must be activated, as Unity and GIMP apply coordinate systems in different directions. The result of the workflow described above is an untextured terrain excluding additional spatial elements.

3.2.2 3D City Models

3D city models are 3D spatial representations of natural and artificial spatial elements as buildings, roads, and vegetation (Vosselman 2003; Yao et al. 2018). The most relevant quality criteria of a 3D city model are the completeness of the model, the spatial accuracy of object locations and the level of detail (LOD). The LOD reflects how accurately representations of 3D objects display complex visual details of the represented spatial objects (Biljecki et al. 2014). For example, the CityGML format used to generate 3D city models differentiates between five LOD levels ranging from textured terrains and simplistic cube-based building models to highly detailed and textured building models including interior structures and furniture (Kolbe et al. 2005).

Two major categories of approaches for generating 3D city models that affect the resulting LOD can be differentiated: automated approaches and manual approaches. Official 3D city models are usually based on automated approaches that use aerial photography, laser scanning and cadastral information (cf. Köln 2020; City of New York 2020; Haag 2020). Automated approaches make it possible to create 3D city models of huge areas, because the algorithms used to deduce 3D representations from spatial information can be applied to arbitrary spatial data sizes without much effort. The LOD of 3D city models based on automated approaches is usually relatively consistent, because the same automation algorithms are applied to all spatial objects. However, the LOD of these models is usually relatively low (Döllner and Buchholz 2005), because it is difficult and cost intensive to gather spatial data of huge areas from a sufficient number of perspectives to create models with higher LODs. Manual approaches to create 3D city models on the other hand, e.g., by a VGI community, are partially based on modelling and placement of 3D elements by hand. These approaches can lead to extremely inconsistent LODs. Based on the number of active contributors in a specific region, their engagement and their personal priorities, such 3D city models can be incomplete, minimalistic, or highly detailed (cf. Barrington-Leigh and Millard-Ball 2017). The following paragraphs exemplarily illustrate the steps required to import 3D city model data from an official source (Open.NRW) and a VGI-based source (OSM). In addition, distribution of LOD across the 3D city models is compared between the two sources.

Open.NRW provides official 3D city models of the state of NRW as CityGML files. CityGML is an established format for 3D city model data that is especially used by official geospatial data sources (e.g., Berlin 2020; City of New York 2020; Den Haag 2020). The LOD is relatively evenly distributed across the models with a complexity of LOD2 (see Fig. 3). This LOD includes cubic building models with standardized roof shapes (Köln 2020). Similar to the DEMs, 3D city model data from Open.NRW can be downloaded either per municipality or as separate tiles with a size of 2 × 2 km.^{Footnote 5} As Unity does not support the CityGML format, the data must be transformed first. In the first step, the command line utility citygml-tools^{Footnote 6} is used to transform the CityGML data to the CityJSON file format. This format can be imported into Blender, a free and open-source 3D creation software^{Footnote 7} using the Blender CityJSON Plugin.^{Footnote 8} From Blender, the 3D city model can then be exported as a .blend file that can be imported into Unity.

Distribution of LOD in an Open.NRW-based 3D city model of the city of Bochum, Germany. The LOD in 3D city models from official sources is usually relatively evenly distributed, as the based models are usually on automated approaches

Full size image

Recently, VGI is gaining increasing practical importance as an alternative to official geospatial data. At least in urban areas, detailed spatial information is available that goes far beyond the spectrum of official data, e.g., locations of ATMs, and the type of business use of buildings. VGI-based 3D city models of all world regions can be acquired from OSM with the export function. The desired area can be selected manually and the data can be downloaded as .osm files. However, as this file format is not compatible with Unity, transformation into another file format would be required. An easier approach is to import selected data from OSM directly into Blender using the blender-osm plugin.^{Footnote 9} The geographic coordinates and the extent of the desired data can be specified directly within Blender. Then, the data can be exported in a format supported by Unity as .blend, .dae, .fbx or.obj, and subsequently the new file can be imported into a Unity project. As 3D city model data from OSM is based on a manual approach, great differences of LOD exist between single spatial objects (see Fig. 4). Therefore, OSM-based 3D city model data cannot be classified in a specific LOD as specified in the CityGML format (cf. Kolbe et al. 2005).

Distribution of LOD in an OSM-based 3D city model. The LOD of 3D city models obtained from OSM varies greatly between spatial objects. For example, the “Große Stern” in Berlin has much more visual complexity than the surrounding buildings, as someone took the effort to manually rebuild it

Full size image

As demonstrated by the two examples above, different workflows can be required for the implementation of 3D city models from different sources into a Unity project. The CityGML format that is used by many official sources requires two plugin-based transformation steps to be compatible with Unity (see Fig. 5) OSM data on the other hand requires only one transformation step and the selection of data from a desired region is easier and more flexible, as arbitrary geographic coordinates can be specified directly within Blender. In addition, opposed to official data sources, OSM 3D city model data are not limited to a specified region but covers the whole world. However, as OSM data depend on the number of active contributors in a specific region and their personal priorities, the LOD of OSM-based 3D city models is much less evenly distributed than data gathered by official institutions. In other words, some spatial objects can be represented with much more detail than other objects and 3D city models from regions with less active contributors are more likely to be incomplete. On the other hand, VGI-based 3D city models from regions with many active contributors may achieve much higher LODs than official 3D city models.

Transformations required to apply 3D city model data to a Unity-based VR environment. CityGML data require two transformation steps to be compatible with Unity. OSM data only require one transformation step

Full size image

Adding VR capabilities to a virtual 3D environment helps to create a sense of presence within this environment (Kersten et al. 2018; Mütterlein 2018; Noor 2016). For VR-based geographic applications, whether focused on education, training, other types of information transfer or experimental research, such a sense of presence is desirable, because it gives users the feeling of ‘being there’, thus makes VR experiences more similar to real-world experiences (Slater et al. 1996). In addition, immersive hardware and the sense of presence have been found to improve procedural memory, interpretation of volumetric data and performance on visual search tasks and spatial tasks as mental rotation, navigation and the formation of cognitive maps (Laha et al. 2012; Ragan et al. 2010; Tan et al. 2006). A simple way to implement VR capabilities into a Unity-based virtual environment is to use the SteamVR plugin provided by Valve Corporation. This plugin supports most modern VR HMDs and hand controllers and can be added to a Unity Project via the Unity Asset Store.^{Footnote 10} After importing the plugin, switching from a screen-based to a VR HMD-based content display is as easy as deleting the main camera in the scene and adding the Player prefab included in the plugin.

However, the sense of presence stimulated by implementing VR capabilities is not similar for all VR applications. In interaction with the displayed media content and user characteristics, the immersion of the technology used to create a VR experience affects the ability of the user to develop a sense of presence (Baños et al. 2004; Waterworth and Riva 2014). Two main immersive characteristics are shared by all modern VR HMDs. First, the use of binocular displays presents the virtual environment in a stereoscopic perspective and thereby imitates a parameter of natural depth perception. Second, head movements of the user are tracked and mirrored within the virtual environment. However, additional characteristics of VR HMDs as display resolution, field of view (FOV), frame rate and spatial tracking methods can also affect the immersion and the usefulness of an HMD for specific geographic VR application scenarios (Ragan et al. 2010; Slater 2018; Wloka 1995). Therefore, effects of these characteristics are discussed below.

The resolution defines how many pixels are presented by the displays of the used HMD. It affects how much visual detail of the virtual environment is presented to the user. If the display resolution is low, thus pixels are large, users can perceive single pixels. In addition, low resolutions make it difficult to identify characteristics of distant objects, as they consist of only a few pixels. VR HMDs with low resolution displays are generally less immersive, because they present much less visual detail than the human eye can naturally perceive (cf. Baxter and Corriveau 2005; Slater 2018). VR HMDs with high-resolution displays on the other hand present more visual detail and thereby support the perception and interpretation of distant elements. Therefore, they are especially beneficial if large geographic environments with many (possibly photorealistic) details are supposed to be presented. However, high-resolution displays also require more hardware (especially graphics card) resources to display a virtual environment at high and stable frame rates.

The FOV of a VR HMD, usually specified in degrees, describes the angle of virtual space visible to the users without moving the head. Wide FOVs are argued to be an important factor for the immersion of a VR HMD (Slater 2018) and Lin et al. (2002) found that spatial presence is higher when the FOV is wider. Narrow FOVs are not only less immersive, they also reduce the amount of visual detail that the user can perceive simultaneously. Thus, they increase the likelihood that important peripheral visual details are missed (see Fig. 6). Therefore, if spatial awareness or a close-to-natural spatial perception is relevant (e.g., for spatial studies), an HMD with a wide field of view should be selected. The tradeoff of wide FOVs is that larger pixel resolutions and consequentially more hardware resources are required to achieve a high image quality, because the available pixels are distributed across a larger display area. FOV values specified by HMD manufacturers must be treated with caution, because these values are affected by use characteristics as the distance of the eye to the HMD lenses and setting the HMD to the correct interpupillary distance of the user. Therefore, some manufacturers (e.g., Oculus and Valve) avoid specifying exact FOV values. Other manufacturers usually specify the diagonal FOV values to be able to present higher values.

Effects of FOV on immersion and spatial awareness. VR HMDs with a larger FOV are more immersive, because the tube-like perspective of HMDs with a low FOV deviates from the natural spatial perception. In addition, a low FOV increases the likelihood that important visual stimuli are missed (3D city model retrieved from OSM)

Full size image

The frame rate defines how often the images are refreshed on the displays of a VR HMD. It determines to what extent users experience visual lag, for example stutter of virtual object movements, or in the transfer of the user’s head movement onto the controlled avatar within the virtual environment (Ware and Balakrishnan 1994; Wloka 1995). High lag can cause VR sickness and is a serious threat for immersion, because it can dissociate the user’s movements from the reflected avatar movements in the virtual environment (Golding 2006; Held et al. 1966; Minderer and Harvey 2016). Therefore, high frame rates are important for immersive VR applications, especially if the user or virtual objects move very fast. The maximum frame rate is defined by the refresh rate of the used VR HMD (usually around 90 Hz). However, the actual frame rate is often lower, because it is affected by the available hardware capacities and the hardware requirements of the VR application. Sophisticated and photorealistic VR applications with a lot of visual detail and many spatial elements require more hardware capacities to achieve high and stable frame rates. If the required hardware capacities are not available, using an HMD with a lower display resolution (and thus less hardware requirements) should be considered.

The type of tracking system used by a specific VR HMD can also affect its immersion and its usefulness for specific geographic VR applications. Two tracking types can be distinguished: inside-out and outside-in tracking. Inside-out systems use cameras to record the environment around the HMD and calculate HMD movements based on the location of objects in the environment identified by the cameras and object recognition algorithms. The advantage of inside-out tracking is that no base stations are required (cf. outside-in tracking). However, image-based tracking accuracy can be affected by lighting conditions and the availability of sufficient spatial elements used to update the position and rotation of the HMD within 3D space (Eger Passos and Jung 2020). In addition, tracking lags can occur if the available hardware capacities cannot evaluate visual changes in the camera recordings fast enough. Similar to frame rate-based lags, these lags can cause VR sickness and can affect the immersion because real-world movements can be dissociated from the mirrored movements of the virtual avatar (cf. Golding 2006; Held et al. 1966). Outside-in systems record the tracked space from fixed locations or use base stations that emit information to sensors located on the HMD. The Valve base stations used by many current VR HMDs from HTC, Valve and Pimax use rotating infrared emitters. Multiple sensors on the HMDs register the infrared light and based on the time differences of sensor registrations, the location of the HMD within 3D space can be calculated. Using these base stations, a high-tracking accuracy and low latencies can be achieved (Caserman et al. 2019). Opposed to inside-out systems, the tracking accuracy of outside-in systems does not depend on the availability of sufficient spatial elements. However, to use outside-in tracking, the base stations need to be mounted in fixed locations and the tracked space needs to be calibrated. This makes outside-in solutions spatially less flexible than inside-out solutions.

Additional characteristics of VR HMDs, such as the availability of headphones, microphones, eye-tracking capabilities and external hardware requirements can affect their appropriateness for specific geographic VR applications. Table 1 gives an overview of some of the most popular recent VR HMDs and their hardware specifications. When the development of a geographic VR application is planned, identifying technical requirements, defining priorities and selecting the most appropriate VR HMD accordingly is highly important, because these decisions will affect the immersion of the final VR experience.

Virtual Reality (VR) has been identified as a promising approach to representing interactive geographic applications. The visualization of geographic space benefits from several developments related to software advancements and rising geospatial data availability. In addition, web technologies support a worldwide communication and exchange of data. The rising availability of spatial data resources allows cartographers to create advanced and detailed models of spatial reality. It also supports a multiple perspective view on 3D environments. Open geospatial data from various official and VGI-based sources can be visualized and perceived from an immersive egocentric perspective. However, many file formats used for geospatial data are not supported by game engines such as Unity. Therefore, we provided some examples of how public and VGI-based geospatial data can be transferred to file formats compatible with current game engines. Data quality differences that affect the immersion of the resulting 3D spatial representation have been identified and discussed. However, immersion of a geographic VR application does not only depend on the quality of the used geospatial data, but also on hardware characteristics. Therefore, important criteria for the immersion of a VR HMD have been discussed and compared between popular VR HMDs. Considering these criteria, characteristics of geospatial data sources and their compatibility with a game engine can help geographers and planners to create immersive VR applications aimed at geographic visualization, simulation and spatial research.