DE102020113485A1 - Method and control device for operating a display device carried on the head of a user in a vehicle - Google Patents

Abstract

The invention relates to a method for operating a display device (3) carried on the head of a user (2) in a vehicle (1), with the following steps: controlling the display device (3) to display virtual content on a screen (8) serving as a virtual screen Display area of the display device (3); Providing a control routine for minimizing kinetosis symptoms for the display device (3); Providing data that characterize or influence current and / or future vehicle movements of the vehicle (1) and / or a strength of the kinetosis symptoms occurring in the user (2); Adaptation of the routine based on the provided data and activation of the display device (3) according to the adapted routine while the virtual content is displayed on the virtual screen (8) in order to minimize kinetosis symptoms for the user (2). The invention also relates to a control device (4) for operating a display device (3) carried on the head of a user (2) in a vehicle (1).

Description

The present invention relates to a method and a control device for operating a display device carried on the head of a user in a vehicle.

The use of data glasses, for example so-called augmented reality glasses, in motor vehicles is known per se. For example, the DE 10 2013 005 342 A1 a method in which information is displayed in data glasses as a function of a detected driver gaze direction during autonomous driving. While driving a motor vehicle, vehicle occupants generally have the option of displaying a wide variety of content, be it information and / or entertainment, using visual output devices that can be worn on their heads, such as augmented reality glasses or virtual reality glasses .

Virtual reality is the representation and simultaneous perception of reality and its physical properties in a real-time, computer-generated, interactive virtual environment. A mixture of virtual reality and pure reality becomes mixed reality or augmented reality. Mixed Reality, also called Augmented Reality. Augmented reality is understood to be the computer-aided expansion of the perception of reality. This information can appeal to all human sensory modalities. Often, however, augmented reality is only understood to mean the visual representation of information, i.e. the addition of images or videos with computer-generated additional information or virtual objects by means of fading in / overlay.

Special output devices, often so-called head-mounted displays, are used to represent virtual realities and extended realities. A head-mounted display is a visual output device that can be worn on or on the head. It either presents images on a screen close to the eye or projects them directly onto the retina. Such head-mounted displays are also offered as more or less glasses-like portable devices. Depending on whether such visual output devices that can be worn on the head are designed to display virtual reality or augmented reality, these are also referred to as virtual reality glasses or augmented reality glasses.

Virtual reality glasses usually optically completely isolate the wearer of the virtual reality glasses from their surroundings, so that the wearer can only see the content displayed by means of the virtual reality glasses, but not his real environment. Augmented reality glasses, on the other hand, are designed in such a way that the wearer can still see their surroundings. In the case of an autonomously driving motor vehicle, for example, the driver could also have put on virtual reality glasses, whereas in the case of non-autonomous vehicles the driver should only have put on augmented reality glasses so that he can still see his surroundings.

Particularly when using virtual reality glasses, it can happen that vehicle occupants who have put on such virtual reality glasses feel nauseous. This often happens when the displayed virtual content deviates from the information provided by the sensory organs of the wearer of the virtual reality glasses on the spatial position and movement of their body. The greater this deviation, the more likely it is usually that a wearer of such virtual reality glasses will feel sick. The respective individual sensitivities also play a role. In principle, the same thing can happen, albeit in a weakened form, when wearing augmented reality glasses.

The object of the invention is to provide a solution which can reduce the occurrence of kinetosis symptoms in a user as much as possible while the user is being displayed virtual content in a vehicle by means of a display device worn on the head.

This object is achieved by a method and by a control device for operating a display device carried on the head of a user in a vehicle having the features of the independent claims. Further possible embodiments of the invention are specified in the subclaims, the description and the figures.

In the method according to the invention for operating a display device carried on the head of a user in a vehicle, the display device is activated to display virtual content on a display area of the display device serving as a virtual screen. The virtual content can be, for example, a film, a computer game and, in principle, any content that is reproduced on the virtual screen of the display device worn on the head. The virtual screen acts like a kind of free-floating screen that the user sitting in the vehicle can see when he has put on the display device that can be worn on his head. The display device that can be worn on the head can, for example, be a so-called head-mounted display in the form of virtual reality glasses or also in the form of an augmented reality Trade glasses. The display device worn on the head can also be, for example, correspondingly suitable contact lenses which are designed to display virtual content on respective displays.

In the course of the method according to the invention, a control routine serving to minimize kinetosis symptoms is also provided for the display device. This control routine can in particular be a computer program or procedural instructions on how the display device worn on the user's head is to be controlled in order to reduce kinetosis symptoms. Furthermore, data is provided which characterize or influence the current and / or future vehicle movements of the vehicle and / or a strength of the kinetosis symptoms occurring in the user.

While the virtual content is displayed on the virtual screen, in order to minimize symptoms of kinetosis for the user, provision is made for the routine provided to be continuously adapted based on the data provided and for the display device to be controlled in accordance with the continuously adapted routine. In particular, in the course of the method according to the invention, provision can be made according to the routine to synchronize as good as possible between the movements perceived by the vestibular system of the user and the movements visually recorded on the basis of the reproduction of the virtual content.

While the virtual content is displayed on the virtual screen, current and / or future vehicle movements of the vehicle and / or a strength of the kinetosis symptoms occurring in the user are continuously evaluated. As a function of this, the routine provided is continuously adapted and the display device is activated in accordance with the adapted routine in order to minimize the occurrence of kinetosis or the occurrence of kinetosis symptoms in the user. By means of the method according to the invention, it is therefore possible for the user in question to wear the display device on his head and to reproduce a wide variety of virtual content on the display area of the display unit serving as a virtual screen without the user feeling sick.

One possible embodiment of the invention provides that, according to the routine, a virtual environment with virtual elements is displayed in a second display area adjoining the virtual screen, the virtual elements moving synchronously with the current or future vehicle movements. This virtual environment can be understood as a kind of ambi-environment. In particular, it can be provided that this virtual environment surrounds the virtual canvas, that is to say frames it. In particular, it can be provided that the virtual elements move within the virtual environment in the same way as real objects in the vehicle environment would move past the vehicle when looking out of a vehicle window.

For example, the user can perceive the virtual elements in a peripheral field of vision and thereby receives visual cues or stimuli that are more or less as if they were actually looking out of a window of the moving car. The movement of the virtual elements can take place synchronously with current vehicle movements. Alternatively, it is also possible to adapt the movement of the virtual elements to future vehicle movements. For example, if the vehicle is traveling at constant speed on a straight stretch of motorway and it is clear that the vehicle will soon take a motorway exit and then drive a very winding route, it can be provided, for example, from a certain point in time that the virtual elements are still in use while the vehicle is in motion Driving along the motorway is already gradually being adapted to future vehicle movements. The user who wears the display device on his head can already guess how the vehicle will soon be moving. This can help to minimize symptoms of kinetosis in the user.

Another possible embodiment of the invention provides that the data characterize a route lying ahead of the vehicle, the future vehicle movements being estimated based on the data. The data can be provided, for example, in the form of digital map data, for example by means of a navigation device of the vehicle concerned. Knowing the route ahead of the vehicle makes it possible to estimate what future vehicle movements will look like. If the example of driving on the motorway is taken up again, it could be known in connection with route guidance, for example, which motorway exit the vehicle will soon take and what the route will look like afterwards. If, for example, a very winding route follows after leaving the motorway, it is possible, based on route data, to estimate which vehicle movements will take place along this winding route section. Based on this, it is in turn possible, from a certain point in time when approaching the winding route, to synchronize the virtual elements within the virtual environment with the move future and thus estimated vehicle movements. This can help ensure that the user feels less or not at all sick when the change follows, for example, from the rather quiet motorway drive to the winding stretch of road. The user is thus visually prepared for the future vehicle movements that will take place.

Another possible embodiment of the invention provides that the virtual screen is set smaller in relation to the virtual environment, the more dynamic the current or future vehicle movements are and / or the greater the kinetosis symptoms are for the user. In this context, the invention is based on the knowledge that usually every person has a different trigger point or can tolerate a differently sized virtual screen in relation to the displayed virtual environment, within which, in particular, the virtual elements are displayed that are synchronized with the current or future vehicle movements move. If the vehicle drives a very winding route, for example, the virtual screen is set smaller in relation to the virtual environment than if the vehicle drives along a motorway that has hardly any bends, and the vehicle is hardly accelerated or braked. The setting of the size ratio between the virtual screen and the virtual environment can be adapted to the current vehicle movements. It is also possible to anticipate or estimate future vehicle movements in the manner described and, from a certain approach, for example to a curved route, to adapt the size ratio between the virtual screen and the virtual environment in advance and successively so that there is no abrupt change in the size ratio between the virtual screen and virtual environment. On the one hand, this does not disturb the user when consuming the displayed virtual content on the virtual screen and, on the other hand, this can also help to ensure that the user is prepared in advance for the changing driving movements even before they occur, as a result of which the occurrence of kinetosis- Symptoms can be reduced significantly. Furthermore, it is also possible to determine how great the current kinetosis symptoms are for the user. If, for example, very strong kinetosis symptoms occur in the user, provision can be made to set the size ratio between the virtual screen and the virtual environment to be relatively small, whereas the ratio between the virtual screen and the virtual environment can be set to be larger if it is determined that no or hardly any kinetosis symptoms occur in the user. It is therefore possible to react to how bad the user is at the moment by adjusting the size ratio between the virtual canvas and the virtual environment appropriately. In particular, it can be provided that at least some of the kinetosis symptoms of the user are recorded by means of sensors on the vehicle. A wide variety of sensors can be used for this, for example camera systems, heart rate monitors and the like. It is therefore possible to use vehicle-mounted sensors to record a wide variety of kinetosis symptoms and then evaluate them in order to adapt the size ratio between the virtual screen and the virtual environment to the respective user in the manner described and thus to adapt particularly well to any existing kinetosis symptoms and their severity to be able to enter.

According to a further possible embodiment of the invention, it is provided that the virtual screen is reduced or enlarged in relation to the virtual environment as a function of a detected gesture by the user. In addition to automatically adjusting the size of the virtual screen, the user can also change the size of the virtual screen manually. For example, this can be done using a pinch-zoom-unzoom gesture with the index finger-thumb. The display device itself or the vehicle in question can have a correspondingly configured gesture detection device for this purpose.

In a further possible embodiment of the invention, it is provided that the virtual screen is set smaller in relation to the virtual environment, the more dynamic the virtual content displayed on the virtual screen. If, for example, an opera is currently being played on the virtual screen, the virtual screen can be selected to be relatively large in relation to the virtual environment, whereas when a very dynamic action film is being played on the virtual screen, the virtual screen can be set relatively small in relation to the virtual environment . This makes it possible to reduce symptoms of kinetosis in the user. In addition, it can also be provided, for example, that a check is carried out to determine how dynamic the content currently displayed on the virtual screen is in relation to the vehicle movements. In particular, it can also be checked in this context how synchronous the actual vehicle movements are with the virtually perceptible movements based on the virtual content shown on the virtual screen. For example, the more synchronous the virtual content on the virtual screen is with the vehicle movements, the more synchronous the virtual screen is in relation to the virtual environment all the greater to set and vice versa. This can also help to reduce the occurrence of kinetosis symptoms in the user.

In a further possible embodiment of the invention, it is provided that the number of virtual elements is set to be greater, the more dynamic the current or future vehicle movements are and / or the greater the kinetosis symptoms are for the user. If the vehicle is accelerated and braked strongly, for example, and drives along a serpentine road that has a large number of curves, for example, a relatively large number of virtual elements can be selected within the virtual environment. As a result, the user receives a large number of visual cues in the form of the virtual elements moving synchronously with the vehicle movements within the virtual environment, so that the occurrence of kinetosis symptoms can be significantly reduced. If, on the other hand, the vehicle is not moved very dynamically, for example because it is traveling at a constant speed along a straight route, the number of virtual elements can be selected to be correspondingly lower. If the risk of the occurrence of kinetosis symptoms is currently rather low due to the relatively undynamic movements of the vehicle, the number of virtual elements can be reduced accordingly so that they impair the perception of the virtual content on the virtual screen as little as possible. It is also possible to adapt the number of virtual elements to future vehicle movements. If the vehicle approaches a very winding route section after a rather undynamic straight-ahead drive, it can be provided to gradually increase the number of virtual elements before reaching this route section, i.e. from a predetermined distance or a predetermined duration before reaching this route section, and in such a way that the number of displayed virtual elements within the virtual environment has reached the appropriate number as soon as, for example, the relevant curved route section has been reached. By gradually increasing the number of virtual elements that move synchronously with the vehicle movements, the user is visually prepared for the fact that he will soon have to reckon with stronger vehicle movements. This can also help to significantly minimize the occurrence of kinetosis symptoms. In addition, it is also possible to adapt the number of virtual elements to the severity of the kinetosis symptoms of the user that is currently occurring. If it is detected that the user is already relatively nauseous, the number of virtual elements can be increased accordingly until it is determined that the kinetosis symptoms in the user subside. In line with the severity of the kinetosis symptoms occurring in the user, it is therefore possible to adapt the visual cues to the actually occurring or expected vehicle movements by means of the virtual elements by varying their number.

Another possible embodiment of the invention provides that the virtual environment includes an image of at least part of the real vehicle environment of the vehicle, which is recorded in particular with a 360 ° camera system and displayed as a component of the virtual environment. In this case, the virtual elements already mentioned can relate to virtual images of real elements in the vehicle environment. If the vehicle drives along an avenue, for example, the virtual elements can be trees that, in particular in the peripheral field of vision of the user, when the display device is on, move past the vehicle like the real trees when driving through the avenue. This not only makes it possible to significantly reduce the occurrence of kinetosis symptoms in the user, but also to provide the user with an orientation option at any time, despite the display device being attached, as to where he is in reality with the vehicle. In particular, by means of a 360 ° camera system, it is possible to capture the entire vehicle environment all around. For example, when the user's head movements are detected, a virtual image of the vehicle environment is displayed in the peripheral field of vision in the form of the virtual environment from the appropriate perspective.

In a further possible embodiment of the invention, it is provided that distinctive points from the vehicle environment, which are recorded by means of sensors of the vehicle and / or are present in digital map material, are displayed as part of the virtual environment. For example, if the vehicle passes a place-name sign from a place in which the destination of the journey in question is located, it is possible, for example, for a virtual image of this place-name sign to be displayed in the peripheral field of vision in the form of the virtual environment when the place-name sign is actually passed. The user therefore not only receives visual stimuli or hints that give him an idea of the real vehicle movements, but also receives additional information about the fact that, for example, he will soon have reached his destination. The distinctive points can in principle be any points or objects in the real vehicle environment that can be displayed in the form of virtual images or images in the peripheral field of vision of the user, that is, within the virtual environment. Between this virtual environment related to Real environment and, for example, a virtual environment with reference to the virtual content that can be seen on the virtual screen, for example, a type of cross-fading can also be provided, for example when a menu structure is exited or, for example, a film starts on the virtual screen, or for example in the event of certain journey or route-related events. An image of the real vehicle environment does not have to be displayed permanently in the form of the virtual environment. This can be triggered, for example, by a wide variety of events or actions by the user.

It is also possible that the entire vehicle environment is generated from environment data available for the vehicle (e.g. from the navigation system) and displayed in the form of the virtual environment. The user thus drives through a digital image of the real environment, which can already be stored in modern navigation systems, for example. In addition, it is possible for the displayed vehicle environment to be adapted in terms of color, atmosphere and / or any further properties to a respective virtual content that is displayed on the virtual screen. In a horror film, for example, you drive through a gloomy, monster-riddled Halloween image of the real environment. An advantage here would be that a look at the virtual environment always enables orientation and is still atmospheric.

According to a further possible embodiment of the invention, it is provided that the virtual environment forms an optical extension of the virtual canvas, with brightness, coloring and / or contrasts of the virtual environment being adapted to the contents of the virtual canvas. It is therefore possible that the virtual environment - in particular without any visual reference to the real vehicle environment - forms said optical extension of the virtual screen. If, for example, a change between day and night is currently taking place within a film displayed on the virtual screen, this change can also be displayed by means of the virtual environment as a kind of optical extension. For example, if a film has a very specific color tone, the virtual environment can accordingly have the same color tone, so that the impression arises that the virtual environment is simply an optical extension of the virtual screen or the virtual content displayed. A wide variety of image parameters, such as brightness, coloring, contrasts and the like, can therefore be adapted in the virtual environment to the contents of the virtual canvas that are currently being displayed. If, for example, a specific film is to be displayed on the virtual screen, it is possible that corresponding data for a suitable virtual environment can also be downloaded from a server, for example, together with the film data. The virtual environment thus automatically forms a kind of virtual ambience in the form of the said optical extension of the virtual screen while the film is being displayed on the virtual screen. Said virtual elements can, for example, continue to be displayed within the virtual environment, for example to match the current driving situation, to expected future vehicle movements and / or adapted to a degree of the kinetosis symptoms of the user that is currently occurring. The virtual environment is perceived as particularly less disruptive and distracting, since it forms an optical extension of the virtual screen, whereas the elements displayed within the virtual environment can help, in the manner already described, to considerably reduce the occurrence of kinetosis symptoms.

In a further possible embodiment of the invention, it is provided that the display area of the display device serving as a virtual screen is framed by the virtual surroundings from the side and / or from above and below. For example, black bars can be automatically hidden in a cinemascope display, these black bars then being able to be replaced by the said virtual environment. A correspondingly large display area of the display device can thus be used to display said elements that move synchronously with the current or future vehicle movements. If, for example, a film is displayed on the virtual screen and the film is just beginning, it can also be provided, for example, that a kind of virtual curtain is slowly opened, as is known from cinemas, this virtual curtain forming the said virtual environment can. This makes the film experience particularly realistic and at the same time the virtual curtain is also used to reduce the kinetosis symptoms, for example by fading in the said synchronously moving elements.

Another possible embodiment of the invention provides that, according to the routine, at least part of the display device to minimize kinetosis symptoms is partially switched so transparently that the user can see his real environment through the display device, the higher the degree of transparency being set , the more dynamic the current or future vehicle movements and / or the greater the kinetosis symptoms for the user. For example, the display area that serves as the virtual screen can be switched partially transparent so that the user is behind the virtual screen can recognize the real environment. Alternatively or additionally, it is also possible, for example, to switch said virtual environment, which for example frames the virtual screen, so transparently that the user can recognize real objects lying behind the virtual environment. It is also possible, for example, to use the entire display area of the display device exclusively for the representation of the virtual screen, whereby the degree of transparency of the virtual screen can be increased and decreased as required to reduce kinetosis symptoms. The more dynamically the vehicle is currently moving or moving in the future and / or the greater the kinetosis symptoms are for the user, the greater the current degree of transparency can be set. It is thus possible to take measures as required to reduce the occurrence of kinetosis symptoms in the user.

Another possible embodiment of the invention provides that, according to the routine, at least the virtual screen is inclined in part to minimize kinetosis symptoms, following the current or future vehicle movements. For example, if the vehicle is currently driving through a left curve, provision can be made for the virtual screen to be tilted accordingly to the left, similar to how a motorcyclist would, for example, tilt to the left when driving through the relevant left curve.

In principle, it is possible to incline the virtual screen around a wide variety of axes to minimize symptoms of kinetosis in order to provide the user with appropriate visual cues or stimuli, on the basis of which he can recognize current or future vehicle movements based on the respective inclination of the virtual screen. For example, if the vehicle is currently still driving straight ahead, but is approaching a left curve, it can also be provided that, from a certain distance from the left curve, the virtual screen is already tilted slightly to the left according to the left curve soon to be driven through, similar to a motorcyclist, for example will actually do when driving through such a left curve. Even before reaching the left curve, the user receives a visual indication of how the vehicle will soon move when it drives through the left curve. It is also possible, for example, to incline the virtual screen during or even before driving through curves in such a way that corresponding rolling movements of the vehicle in question are to be expected. This can also help to reduce the occurrence of kinetosis symptoms, since the actual rolling movements are displayed or already anticipated as visual cues by a corresponding inclination of the virtual screen. It is also possible for the virtual screen to be inclined about a vertical axis, for example, so that the virtual screen visually rotates slightly away from you or towards you.

The control device according to the invention for operating the display device carried on the head of the user in a vehicle is designed to carry out the method according to the invention or possible embodiments of the method according to the invention. Possible configurations of the method are to be viewed in particular as possible configurations of the control device and vice versa, the control device in particular having means for performing the method steps.

Further features of the invention can emerge from the following description of the figures and with reference to the drawing. The features and feature combinations mentioned above in the description as well as the features and feature combinations shown below in the description of the figures and / or in the figures alone can be used not only in the respectively specified combination, but also in other combinations or alone, without the scope of the invention to leave.

• 1 eine schematische Darstellung eines Fahrzeugs, in dem ein Nutzer mit einer aufgesetzten Virtual-Reality-Brille sitzt, wobei ein aktuell mit dem Fahrzeug befahrener gerader Streckenverlauf und ein noch vor dem Fahrzeug liegender kurviger Streckenverlauf schematisch angedeutet sind;
• 2 eine schematische Darstellung von unterschiedlichen Anzeigebereichen der Virtual-Reality-Brille.

The drawing shows in:

• 1 a schematic representation of a vehicle in which a user is sitting with virtual reality glasses on, a straight route currently being traveled by the vehicle and a curvy route still ahead of the vehicle being indicated schematically;
• 2 a schematic representation of different display areas of the virtual reality glasses.

Identical or functionally identical elements are provided with the same reference symbols in the figures.

A vehicle 1 in which a user 2 with virtual reality glasses on 3 is highly schematized in 1 shown. Instead of virtual reality glasses 3 can the user 2 also carry any other display devices that can be worn on the head, such as, for example, augmented reality glasses, contact-analog contact lenses and the like. A control device is also shown schematically 4th indicated which is designed for the virtual reality glasses 3 to control. A detection device is also shown schematically 5 indicated, which can have a wide variety of sensors to detect kinetosis symptoms of the user 2 capture. In the vehicle shown here 1 is it Although it is a motor vehicle, for example a passenger car, the following explanations apply to any type of vehicle, be it land vehicles, aircraft, rail-bound vehicles, aircraft and the like.

The vehicle is currently driving 1 a straight route 6th and get closer to you in front of the vehicle 1 lying curvy route 7th . The following is a method for operating the virtual reality glasses 3 explained in more detail.

In 2 is the virtual reality glasses 3 indicated schematically, one being used as a virtual canvas 8th serving as a display area and another as a virtual environment 9 serving display area are indicated schematically.

While driving the vehicle 1 becomes the virtual reality glasses 3 by means of the control device 4th for displaying virtual content on the virtual screen 8th controlled. The virtual content can be, for example, a film, a computer game and the like. Furthermore, by means of the control device 4th a control routine for the virtual reality glasses that serves to minimize symptoms of kinetosis 3 provided. This control routine can, for example, be stored in a memory of the control device 4th be saved. In addition, data is provided which shows the current and / or future vehicle movements of the vehicle 1 characterize or influence. In addition, data can also be provided, which is a strength of the user 2 Characterize or influence the kinetosis symptoms that occur. The detection device 5 can have a wide variety of sensors that can record data on current vehicle movements, for example. This can in particular accelerate the vehicle 1 can be detected in translational directions and in rotational directions. For example, navigation data, digital road data and the like can also be provided, which can be used to estimate how the vehicle is moving 1 will move in the future. The detection device 5 can also have a wide variety of optical sensors and other sensors that detect kinetosis symptoms in the user 2 recognize or detect.

The routine provided is continuously adapted based on the data provided, with the virtual reality glasses 3 according to the adapted routine while displaying the virtual contents on the virtual screen 8th to minimize kinetosis symptoms for the user 2 is controlled.

According to the routine, it can be provided, for example, that within the virtual environment 9 virtual elements 10 are displayed, with the virtual elements 10 move synchronously with current or future vehicle movements. Drives the vehicle 1 , as in 1 indicated schematically, currently still on the straight route 6th at constant speed, it can for example be provided that the virtual elements 10 move in the same way as real objects in the vehicle environment, for example 1 pass by. Has the vehicle 1 the winding route 7th for example approximated to within a few meters or seconds, it can also be provided that the virtual elements 10 already start to move like the vehicle 1 when driving through the curves of the winding route 7th will move. The user 2 is thus due to the movement of the virtual elements 10 Already optically adjusted to how the vehicle looks 1 soon when driving through the winding route 7th will move.

In addition, it can also be provided that the virtual screen 8th in relation to the virtual environment 9 the smaller the setting, the more dynamic the current or future vehicle movements are and / or the greater the kinetosis symptoms for the user 2 are. With the straight route currently being driven on 6th it can be provided, for example, that the virtual screen 8th in relation to the virtual environment 9 is displayed much larger than when the vehicle 1 the winding route 7th drives through. It is found that the user 2 If the motion sickness becomes worse, it can be reacted to by using the virtual screen 8th in relation to the virtual environment 9 is reduced. The virtual elements that move synchronously with the current vehicle movements, for example 10 thus move more into the focus of the user 2 which may help reduce the symptoms of kinetosis.

It can also be provided that the virtual screen 8th in relation to the virtual environment 9 the smaller the setting, the more dynamic the virtual content displayed on the virtual screen 8th are. Will be on the virtual screen 8th For example, an opera is currently being displayed, the displayed virtual content is relatively calm or not very dynamic. In that case, the virtual screen can 8th relatively large in relation to the virtual environment 9 can be set. On the other hand, it is on the virtual screen 8th for example, an action movie chase is being displayed, the displayed virtual contents are on the virtual screen 8th so very dynamic right now. In that case it can be provided that, compared to the reproduction of the opera, the virtual canvas 8th much smaller in relation to the virtual environment 9 is shown.

It can also be provided, for example, that the number of virtual elements 10 The greater the setting, the more dynamic the current or future vehicle movements are and / or the greater the kinetosis symptoms for the user 2 are. Are the vehicle movements currently relatively dynamic, for example because the vehicle 1 especially the winding route 7th passes through, the number of virtual elements 10 can be chosen relatively large, so that the user 2 receives as many and clear visual cues as possible about how the vehicle is moving 1 just moved. It can also be provided that when approaching the curvy route 7th already successively the number of virtual elements 10 is increased so that the user 2 already when approaching the winding route 7th It is visually prepared for how the vehicle will look 1 will move soon. For example, it is determined that the user 2 For example, if the symptoms of kinetosis are just getting worse, provision can also be made for the number of virtual elements 10 to give more visual information about the current vehicle movements and thus the kinetosis symptoms for the user 2 turn to reduce.

In the virtual environment 9 For example, it can also be an image of at least part of the real vehicle environment of the vehicle 1 Act. This vehicle environment can be captured, for example, with a 360 ° camera system and as part of the virtual environment 9 are displayed. With the virtual elements 10 it can be, for example, virtual images of real elements in the vehicle environment. It can also be the case with the virtual elements 10 For example, it can be about prominent points from the vehicle's surroundings, which are determined by means of the vehicle's sensors 1 recorded and / or available in digital map material. The real vehicle environment or parts of it can therefore be in the form of the virtual environment 9 are displayed. However, this does not have to be permanent. This can be done on an event basis, for example. The vehicle approaches 1 for example a specific destination, from a certain distance to the destination it can be provided that the virtual environment 9 is displayed as an image of the real vehicle environment. The user 2 receives about the virtual environment 9 So on the one hand, in the manner described, visual indications of how the vehicle is, for example 1 just moved, on the other hand he also receives information about where he is in reality and that he is, for example, approaching his desired destination.

The virtual environment 9 can for example also be an optical extension of the virtual screen 8th form, in particular brightness, coloring and / or contrasts of the virtual environment 9 on the content of the virtual screen 8th be adjusted. For example, it can be provided if a film is on the virtual screen 8th that the mapping of the real vehicle environment starts in the optical extension of the virtual screen 8th is faded. The user 2 it is thus attuned to the fact that the film will be shown on the virtual screen 8th just starting. Even if the virtual environment 9 an optical extension of the virtual canvas 8th forms can continue to display the virtual elements in a wide variety of ways 10 be provided in order to display current or future vehicle movements in a synchronized manner. It also forms the virtual environment 9 a kind of ambience or optical extension of the virtual screen 8th . For example, if there is a change from day to night within a film scene, this is also due to the virtual environment in terms of brightness and / or color 9 pictured.

As in 2 indicated, the virtual screen can 8th completely from the virtual environment 9 be framed. But it is just as possible that the virtual environment 9 the virtual canvas 8th is not completely framed and is provided, for example, only above, below or to the side.

According to the aforementioned routine for controlling the virtual reality glasses 3 it can also be provided that at least some of the virtual reality glasses 3 is switched so transparently that the user 2 his real environment through the virtual reality glasses 3 can see through. The degree of transparency can be set higher, the more dynamic the current or future vehicle movements are and / or the greater the kinetosis symptoms for the user 2 are. Because the user 2 through transparency switching of at least part of the virtual reality glasses 3 can see his real vehicle environment, he automatically receives visual stimuli or information on how the vehicle is actually moving. The degree of transparency can be increased or decreased in accordance with the current vehicle movements or future vehicle movements. It is also possible to increase the degree of transparency if the user has symptoms of kinetosis 2 increase and decrease the degree of transparency in turn, if the kinetosis symptoms in the user 2 should be less strong again.

According to the routine, it can alternatively or additionally also be provided that the virtual screen 8th to minimize kinetosis symptoms, for example, partially the current or is inclined following future vehicle movements. The vehicle drives through 1 for example a left turn, it can be provided that the virtual screen 8th a respective roll movement of the vehicle 1 following is inclined to the right. Alternatively it would also be possible that the canvas 8th for example, when driving through the left-hand bend, it is inclined to the left, just as a motorcyclist would lean into the left-hand bend. Due to the inclination of the virtual screen 8th the user receives 2 visual cues of how the vehicle is moving 1 Moved when driving through the curve or he gets a visual indication of the curve to be driven through. It is also possible to use the canvas 8th to incline accordingly before reaching a curve. In that case, the user receives 2 a visual indication of the inclination of the screen before driving through the curve in question 8th that he will soon have to reckon with cornering. This can also reduce the occurrence of kinetosis symptoms.

It is true that the procedure for reducing kinetosis symptoms was based on the virtual reality glasses 3 explained, but these statements also apply to any other display devices that can be worn on the head, be it augmented reality glasses, contact-analog contact lenses or the like.

List of reference symbols

1

vehicle

2

Users

3

Virtual reality glasses

4th

Control device

5

Detection device

6th

straight route

7th

curvy route

8th

virtual canvas

9

virtual environment

10

virtual elements

QUOTES INCLUDED IN THE DESCRIPTION

This list of the documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• DE 102013005342 A1 [0002]

Claims (15)

Method for operating a display device (3) carried on the head of a user (2) in a vehicle (1), comprising the steps: - controlling the display device (3) for displaying virtual content on a display area of the display device (3) serving as a virtual screen (8); - Providing a control routine for minimizing kinetosis symptoms for the display device (3); - Provision of data that characterize or influence current and / or future vehicle movements of the vehicle (1) and / or a strength of the kinetosis symptoms occurring in the user (2); - Adaptation of the routine based on the provided data and control of the display device (3) according to the adapted routine while the virtual content is displayed on the virtual screen (8) in order to minimize kinetosis symptoms for the user (2). Procedure according to Claim 1 characterized in that, according to the routine, a virtual environment (9) with virtual elements (10) is displayed in a second display area adjoining the virtual screen (8), the virtual elements (10) being synchronized with the current or future ones Move vehicle movements. Procedure according to Claim 2 , characterized in that the data characterize a route lying in front of the vehicle (1), the future vehicle movements being estimated based on the data. Procedure according to Claim 2 or 3 , characterized in that the virtual screen (8) is set smaller in relation to the virtual environment (9), the more dynamic the current or future vehicle movements are and / or the greater the kinetosis symptoms for the user (2). Method according to one of the Claims 2 until 4th , characterized in that the virtual screen (8) is reduced or enlarged in relation to the virtual environment (9) as a function of a detected gesture of the user (2). Method according to one of the Claims 2 until 5 , characterized in that the virtual screen (8) is set smaller in relation to the virtual environment (9), the more dynamic the displayed virtual content on the virtual screen (8). Method according to one of the Claims 2 until 6th , characterized in that the number of virtual elements (10) is set to be greater, the more dynamic the current or future vehicle movements are and / or the greater the kinetosis symptoms for the user (2). Method according to one of the Claims 2 until 7th , characterized in that the virtual environment (9) comprises an image of at least part of the real vehicle environment of the vehicle (1), which is recorded in particular with a 360 ° camera system and displayed as part of the virtual environment (9). Method according to one of the Claims 2 until 8th , characterized in that distinctive points from the vehicle environment, which are detected by sensors of the vehicle (1) and / or are present in digital map material, are displayed as part of the virtual environment (9). Method according to one of the Claims 2 until 9 , characterized in that the virtual environment (9) forms an optical extension of the virtual canvas (8), the brightness, coloring and / or contrasts of the virtual environment (9) being adapted to the contents of the virtual canvas (8). Method according to one of the Claims 2 until 10 , characterized in that the display area of the display device (3) serving as a virtual screen (8) is framed by the virtual environment (9) to the side and / or from above and below. Method according to one of the preceding claims, characterized in that, according to the routine, at least part of the display device (3) to minimize kinetosis symptoms is partially switched so transparently that the user (2) can see his real environment through the display device (3) can see, with a degree of transparency being set higher the more dynamic the current or future vehicle movements and / or the greater the kinetosis symptoms for the user (2). Method according to one of the preceding claims, characterized in that, according to the routine, at least the virtual screen (8) is inclined in part following the current or future vehicle movements in order to minimize kinetosis symptoms. Method according to one of the preceding claims, characterized in that at least some of the kinetosis symptoms of the benefit (2) are recorded by means of sensors on the vehicle. Control device (4) for operating a device worn on the head of a user (2) Display device (3) in a vehicle (1), which is designed to carry out a method according to one of the preceding claims.

Images