CN114454718B

CN114454718B - Information display method and device, electronic equipment and storage medium

Info

Publication number: CN114454718B
Application number: CN202210077333.9A
Authority: CN
Inventors: 拉玛图洛耶夫·唿斯拉夫绍
Original assignee: Beijing Horizon Robotics Technology Research and Development Co Ltd
Current assignee: Beijing Horizon Robotics Technology Research and Development Co Ltd
Priority date: 2022-01-21
Filing date: 2022-01-21
Publication date: 2024-09-13
Anticipated expiration: 2042-01-21
Also published as: CN114454718A

Abstract

The embodiment of the disclosure discloses an information display method and device, an electronic device and a storage medium, wherein the method comprises the following steps: when the vehicle is detected to be in a running state, if the vehicle is determined to be in a dangerous state based on the current driving environment information of the vehicle, acquiring a target dangerous type and a corresponding target dangerous level of the vehicle; determining corresponding target information display content and target display control parameters according to the target hazard type and the corresponding target hazard level; transmitting the target information display content and the target display control parameters to the display equipment so that the display equipment displays the target information display content on the display screen according to the target display control parameters; the display screen of the display device is mounted on a front windshield on the vehicle. According to the method and the device for reminding the driver of the dangerous situations, accurate and effective reminding aiming at different dangerous situations under the condition that the attention of the driver is not affected can be achieved, so that the driver can timely and accurately take corresponding avoidance measures, and safety is improved.

Description

Information display method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to computer vision technology, and more particularly, to an information display method and apparatus, an electronic device, and a storage medium.

Background

During driving, the vehicle may encounter various emergency conditions, such as obstacles, or dangerous vehicles such as large trucks around the vehicle during driving, etc., and the driver is required to keep high attention, in the related art, reminding information is usually displayed through a vehicle central control screen, reminding a driver to pay attention to related conditions, but reminding the driver to transfer the attention from a road in front to a central control screen through the central control screen, so that the driver can not timely find reminding information or look at the reminding information to cause the driver to pay attention to be dispersed, and potential safety hazards are brought to vehicle driving; in order to solve the problem, a HUD (Head Up Display) screen is gradually applied to a vehicle, but the HUD screen mainly adopts a projection mode to present images on a windshield, is sensitive to ambient light and the like, has relatively fixed Display content, and is difficult to provide accurate and effective reminding for users aiming at various dangerous situations.

Disclosure of Invention

The disclosure is provided for solving the technical problem that the accurate and effective reminding is difficult to provide for users aiming at various dangerous situations. The embodiment of the disclosure provides an information display method and device, electronic equipment and a storage medium.

According to an aspect of the embodiments of the present disclosure, there is provided an information display method including: when detecting that a vehicle is in a running state, acquiring current driving environment information of the vehicle; if the vehicle is in a dangerous state based on the current driving environment information, acquiring a target dangerous type and a corresponding target dangerous level of the vehicle; determining corresponding target information display content and target display control parameters according to the target hazard type and the corresponding target hazard level; the target information display content and the target display control parameters are sent to display equipment, so that the display equipment displays the target information display content on a display screen according to the target display control parameters; the display screen of the display device is mounted on a front windshield on the vehicle.

According to another aspect of the embodiments of the present disclosure, there is provided an information display apparatus including: the first acquisition module is used for acquiring current driving environment information of the vehicle when the vehicle is detected to be in a driving state; the first processing module is used for acquiring a target danger type and a corresponding target danger level of the vehicle if the vehicle is determined to be in a dangerous state based on the current driving environment information; the second processing module is used for determining corresponding target information display content and target display control parameters according to the target hazard type and the corresponding target hazard level; the first sending module is used for sending the target information display content and the target display control parameters to display equipment so that the display equipment displays the target information display content on a display screen according to the target display control parameters; the display screen of the display device is mounted on a front windshield on the vehicle.

According to still another aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium storing a computer program for executing the information display method according to any one of the above embodiments of the present disclosure.

According to still another aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including: a processor; a memory for storing the processor-executable instructions; the processor is configured to read the executable instructions from the memory and execute the instructions to implement the information display method according to any one of the foregoing embodiments of the present disclosure.

According to still another aspect of the embodiments of the present disclosure, there is provided an in-vehicle display system including: the vehicle-mounted computing platform is connected with the at least one camera and is used for acquiring current driving environment information of the vehicle based on the at least one camera so as to realize the information display method according to any embodiment; the display device is connected with the vehicle-mounted computing platform and used for receiving and displaying display contents sent by the vehicle-mounted computing platform; the display device at least comprises a control module and a display screen, wherein the display screen is arranged on a front windshield of the vehicle.

Based on the information display method and device, the electronic device and the storage medium provided by the embodiments of the present disclosure, the current danger type and the corresponding danger level of the vehicle are determined based on the current driving environment information of the vehicle, the target information display content and the corresponding display control parameters for reminding the driver are further determined according to the current danger type and the corresponding danger level and are sent to the display device, and the display device displays the target information display content on a rear-mounted display screen mounted on the front windshield of the vehicle according to the display control parameters, so that accurate and effective reminding for different danger conditions is realized without influencing the attention of the driver, the driver can timely and accurately learn what danger exists at present, and timely take corresponding avoidance measures to improve the safety.

The technical scheme of the present disclosure is described in further detail below through the accompanying drawings and examples.

Drawings

The above and other objects, features and advantages of the present disclosure will become more apparent by describing embodiments thereof in more detail with reference to the accompanying drawings. The accompanying drawings are included to provide a further understanding of embodiments of the disclosure, and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure, without limitation to the disclosure. In the drawings, like reference numerals generally refer to like parts or steps.

Fig. 1 is an exemplary application scenario of an information display method provided by the present disclosure;

FIG. 2 is a flow chart of an information display method according to an exemplary embodiment of the present disclosure;

Fig. 3 is a flowchart illustrating an information display method according to another exemplary embodiment of the present disclosure;

fig. 4 is a flowchart illustrating an information display method according to still another exemplary embodiment of the present disclosure;

fig. 5 is a flowchart illustrating an information display method according to still another exemplary embodiment of the present disclosure;

Fig. 6 is a flowchart illustrating an information display method according to still another exemplary embodiment of the present disclosure;

FIG. 7 is a flow chart of step 203 provided by an exemplary embodiment of the present disclosure;

FIG. 8 is a schematic diagram of a display provided by an exemplary embodiment of the present disclosure;

FIG. 9 is a schematic diagram of another display provided by an exemplary embodiment of the present disclosure;

fig. 10 is a schematic structural view of an information display device provided in an exemplary embodiment of the present disclosure;

FIG. 11 is a schematic diagram of a first processing module 502 provided in an exemplary embodiment of the present disclosure;

fig. 12 is a schematic structural view of an information display device provided in another exemplary embodiment of the present disclosure;

fig. 13 is a schematic structural diagram of a second processing module 503 provided in an exemplary embodiment of the present disclosure;

FIG. 14 is a schematic diagram of an in-vehicle display system provided in an exemplary embodiment of the present disclosure;

Fig. 15 is a schematic structural view of an application embodiment of the electronic device of the present disclosure.

Detailed Description

Hereinafter, example embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present disclosure and not all of the embodiments of the present disclosure, and that the present disclosure is not limited by the example embodiments described herein.

It should be noted that: the relative arrangement of the components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless it is specifically stated otherwise.

It will be appreciated by those of skill in the art that the terms "first," "second," etc. in embodiments of the present disclosure are used merely to distinguish between different steps, devices or modules, etc., and do not represent any particular technical meaning nor necessarily logical order between them.

It should also be understood that in embodiments of the present disclosure, "plurality" may refer to two or more, and "at least one" may refer to one, two or more.

It should also be appreciated that any component, data, or structure referred to in the presently disclosed embodiments may be generally understood as one or more without explicit limitation or the contrary in the context.

In addition, the term "and/or" in this disclosure is merely an association relationship describing an association object, and indicates that three relationships may exist, for example, a and/or B may indicate: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" in the present disclosure generally indicates that the front and rear association objects are an or relationship.

It should also be understood that the description of the various embodiments of the present disclosure emphasizes the differences between the various embodiments, and that the same or similar features may be referred to each other, and for brevity, will not be described in detail.

Meanwhile, it should be understood that the sizes of the respective parts shown in the drawings are not drawn in actual scale for convenience of description.

The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.

Techniques, methods, and apparatus known to one of ordinary skill in the relevant art may not be discussed in detail, but are intended to be part of the specification where appropriate.

It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further discussion thereof is necessary in subsequent figures.

Embodiments of the present disclosure may be applicable to electronic devices such as terminal devices, computer systems, servers, etc., which may operate with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known terminal devices, computing systems, environments, and/or configurations that may be suitable for use with the terminal device, computer system, server, or other electronic device include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, hand-held or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network personal computers, small computer systems, mainframe computer systems, and distributed cloud computing technology environments that include any of the foregoing, and the like.

Electronic devices such as terminal devices, computer systems, servers, etc. may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, etc., that perform particular tasks or implement particular abstract data types. The computer system/server may be implemented in a distributed cloud computing environment in which tasks are performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computing system storage media including memory storage devices.

Summary of the disclosure

In the process of realizing the present disclosure, the inventor finds that, during driving, a vehicle may encounter various emergency conditions, such as encountering an obstacle, or a dangerous vehicle such as a large truck around the vehicle during driving, and so on, and needs to keep high attention of a driver, in the related art, display through a HUD screen is sensitive to ambient light and so on, display content is relatively fixed, and it is difficult to provide accurate and effective reminding for users for various dangerous conditions.

Exemplary overview

Fig. 1 is an exemplary application scenario of an information display method provided by the present disclosure.

In a running state of the vehicle, the surrounding environment information and the in-vehicle environment information of the vehicle can be collected as current driving environment information of the vehicle by various sensors mounted on the vehicle. The sensor can comprise one or more cameras, can also comprise other types of sensors such as a laser radar, a millimeter wave radar and the like, and can be specifically arranged according to actual requirements. In fig. 1, taking 6 cameras as an example, by using the information display method provided by the embodiment of the disclosure, classification and grading can be performed in advance according to dangers possibly encountered by a vehicle, when the vehicle is in a driving state, a target dangerous type and a corresponding target dangerous level when the vehicle is in a dangerous state can be determined based on the current driving environment information of the vehicle, further, according to the target dangerous type and the corresponding target dangerous level, the corresponding target information display content and target display control parameters are determined, and are sent to the safety display device, so that the corresponding target information display content is displayed on a display screen arranged on a front windshield, and different reminding contents can be displayed according to dangers of different types and different levels because of dangers are classified and graded according to dangers, so that the accuracy and effectiveness of dangerous reminding are improved, a driver can timely and accurately understand the dangerous situation currently located, and timely take corresponding risk avoidance measures, so that driving safety is effectively improved, and on the other hand, the cost is effectively reduced relative to a rear mounted screen arranged on the front windshield, the display screen is not easily affected by the environmental light, and the quality of reminding information is further improved.

Exemplary method

Fig. 2 is a flowchart illustrating an information display method according to an exemplary embodiment of the present disclosure. The embodiment can be applied to an electronic device, specifically, for example, a vehicle-mounted computing platform, as shown in fig. 2, and includes the following steps:

step 201, when detecting that the vehicle is in a driving state, acquiring current driving environment information of the vehicle.

The running state of the vehicle may be detected and obtained according to any implementation manner, for example, speed information detected by a speed sensor, vehicle speed information determined by a vision sensor, acceleration information detected by an acceleration sensor, and the like, and may specifically be set according to actual requirements, which is not limited in the present disclosure. The current driving environment information may be acquired by a vision sensor, which may include a camera. The current driving environment information can also be obtained by data fusion of data acquired by a visual sensor and other types of sensors, and the current driving environment information can be specifically set according to actual requirements, and the current driving environment information is not limited by the disclosure.

Alternatively, the current driving environment information may include at least one of vehicle exterior driving environment information and vehicle interior driving environment information. The external driving environment information comprises surrounding environment information such as front, back, left, right and the like of the vehicle, and the internal driving environment information comprises driving state information and other related information of a driver in the vehicle.

Step 202, if it is determined that the vehicle is in a dangerous state based on the current driving environment information, a target dangerous type and a corresponding target dangerous level of the vehicle are obtained.

Optionally, the method of judging whether the vehicle is in a dangerous state based on the current driving environment information is to analyze and identify the obtained current driving environment information, and judge whether the vehicle is in a dangerous state according to an identification result, for example, the current driving state information is an environment image collected by a camera, then, based on a recognition model obtained by training in advance, target identification is performed on the collected environment image, and the target identification result may include various recognized obstacle objects and a position area of the obstacle objects in the image, wherein the obstacle objects may include road edges, surrounding vehicles, pedestrians, buildings, roadblocks and other objects that may affect the running of the vehicle, and the specific identifiable content may be set according to actual requirements. Whether the vehicle is in a dangerous state is determined based on the positional relationship of the identified obstacle object and the vehicle. For example, for an identified surrounding vehicle, the distance between the surrounding vehicle and the host vehicle itself may be calculated from the image, and when the surrounding vehicle is less than a certain distance from the host vehicle, it may be determined that the vehicle is in a dangerous state. After the dangerous state of the vehicle is determined, the current target dangerous type and the corresponding target dangerous level of the vehicle can be determined according to the preset dangerous type and dangerous level dividing rules.

Alternatively, for the hazard types, for example, it may be classified into surrounding vehicles (may be further classified into a left rear vehicle, a left side vehicle, a left front vehicle, a right rear vehicle, a right side vehicle, a right front vehicle, etc., which may be specifically set according to actual demands), front obstacles, hazard vehicles, blind area pedestrians, etc., and specific types may be set according to actual demands, wherein the surrounding vehicles may refer to general vehicles approaching themselves, the hazard vehicles may refer to vehicles having a certain hazard such as detecting a large truck, etc., the blind area pedestrians may refer to the detection of the existence of pedestrians in the blind area region, and the front obstacles refer to obstacles within a certain distance in front of the traveling need to be noted.

Alternatively, for each hazard type, a plurality of hazard levels may be classified according to actual requirements, for example, classification may be performed according to distances, a first distance threshold > a second distance threshold > a third distance threshold may be set, and the distance may be classified into a range, and when the distance between the obstacle object and the vehicle is smaller than the first distance threshold and larger than the second distance threshold, a hazard state may be entered, and may be set as a primary hazard, and when the distance between the obstacle object and the vehicle is smaller than the second distance threshold and larger than the third distance threshold, a medium-level hazard may be entered, and when the distance between the obstacle object and the vehicle is smaller than the third distance threshold, a high-level hazard may be entered.

Alternatively, different distance threshold levels may be set for different obstacle objects, in particular according to actual requirements.

Alternatively, the division of the hazard classes is not limited to the division based on the distance, and may be set to any possible division manner according to the actual demand, and the number of stages of the hazard classes may be set to 2 classes, 3 classes, 4 classes, and so on according to the actual demand.

And 203, determining corresponding target information display content and target display control parameters according to the target risk type and the corresponding target risk level.

The target information display content is a reminding content to be displayed according to the current target danger type and the target danger level, the target display control parameter is a display screen control parameter required for displaying the target information display content, and the target display control parameter is used for generating a display control instruction of a display screen according to the target display control parameter by display equipment, so that the display screen is controlled to display the target information display content, and a specific control principle of the display screen is not repeated here.

Optionally, corresponding information display content can be set for each danger level of each danger type, and information display content corresponding to different danger levels of different danger types is different, so that accurate danger reminding information is provided for a driver.

Step 204, the target information display content and the target display control parameters are sent to the display equipment, so that the display equipment displays the target information display content on the display screen according to the target display control parameters; the display screen of the display device is mounted on a front windshield on the vehicle.

The display screen of the display device is a rear-mounted screen and is arranged on the front windshield, the display screen can be any practicable display screen as long as the front sight of a driver is not affected, for example, the display screen is a flexible transparent display screen, particularly, for example, a flexible transparent OLED display screen, and the display screen can be particularly arranged according to actual requirements. After the target information display content and the target display control parameters are determined, the target information display content and the target display control parameters are sent to the display equipment, and the display equipment generates a display control instruction of the display screen according to the target display control parameters, so that the display screen is controlled to display the target information display content.

Optionally, the display device including the flexible transparent OLED display is connected to the vehicle computing platform, and the flexible transparent OLED display array substrate and the substrate of the package substrate are made of flexible materials, and may be applied to a front windshield of a vehicle using an adhesive. The specific installation mode is not limited.

Optionally, the size of the flexible transparent display screen may be set according to actual requirements, for example, a user may perform personalized selection according to his own budget, preference, etc., and may be a size covering the entire front windshield, or may be a small size, a medium size, etc.

According to the information display method, the dangers are classified and graded, and different reminding contents can be displayed for different types of dangers with different grades, so that the accuracy and effectiveness of dangerous reminding are improved, a driver can timely and accurately know the current dangerous situation, corresponding risk avoidance measures are timely taken, driving safety is effectively improved, on the other hand, the information is displayed through the rear mounting screen arranged on the front windshield, cost is effectively reduced relative to the HUD screen, the influence of ambient light is not easy, and the reminding information display quality is further improved under the condition that the attention of the driver is ensured.

Fig. 3 is a flowchart illustrating an information display method according to another exemplary embodiment of the present disclosure.

In an alternative example, the current driving environment information includes at least one of external driving environment information and internal driving environment information of the vehicle, the internal driving environment information includes driving state information of the driver, and accordingly, step 202 may specifically include the steps of:

If it is determined that the vehicle is in a dangerous state based on the current driving environment information, a target dangerous type and a corresponding target dangerous level of the vehicle are determined based on at least one of the external driving environment information and the internal driving environment information, step 2021.

The driver state information may include information related to a sight line state, a hand state, and the like of the driver.

In an alternative example, the step 2021 may specifically include: if it is determined that at least one risk factor of a dangerous vehicle, an illegally driven vehicle and other obstacles affecting driving exists outside the vehicle based on the external driving environment information, acquiring state information of the at least one risk factor based on the external driving environment information; determining a target risk type and a corresponding target risk level of the vehicle according to the state information of at least one risk factor; if the dangerous action of the driver is determined based on the internal driving environment information, the target dangerous type and the corresponding target dangerous level of the vehicle are determined according to the dangerous action of the driver.

The illegally driven vehicle refers to a vehicle that does not run according to traffic laws and regulations, such as a right front vehicle that does not run according to lane lines, a rear vehicle that runs over speed, and so on. Dangerous actions of the driver may include the driver's hands leaving the steering wheel, the driver's vision leaving the front, the driver getting fooled, the driver closing his eyes, etc., which may be specifically set according to actual needs. The driving state information of the driver can be obtained by shooting an in-vehicle driving environment image of the driver based on a camera installed in the vehicle, and the driving state of the driver can be perceived by identifying the in-vehicle driving environment image, so that whether dangerous actions exist in the driver can be analyzed. The method specifically can acquire various recognition models through training to recognize, the specific recognition models can adopt any practical model, the method is not limited, for example, eye images of a driver are acquired through semantic segmentation, and then the sight direction of the driver is determined based on the trained sight direction recognition model or other sight direction determining modes, so that whether the sight of the driver looks at the road conditions ahead can be determined. For another example, it is determined whether the driver's hand is away from the steering wheel by recognizing the positional relationship between the driver's hand and the steering wheel. The driver can also judge whether the driver is in a foolproof state or not by analyzing the driver behavior images including the face and the arms of the driver in a certain period of time and acquiring the eye-opening duration proportion.

The danger type and the danger level of the driver state can be set according to actual requirements, for example, the danger type can comprise a hand-off steering wheel, a foolproof, a sight abnormality and the like, and the danger level can be determined according to the duration of dangerous actions, for example, when the driver is initially judged to be in the hand-off steering wheel state, the primary danger is entered, timing is started, when the duration of the hand-off steering wheel state exceeds a first time threshold, the medium-level danger is entered, and when the duration of the hand-off steering wheel state exceeds a second time threshold, the high-level danger is entered.

The system and the method can remind dangerous situations outside the vehicle and also remind dangerous actions of a driver in the vehicle, so that richer and comprehensive dangerous reminding can be provided for the driver, the driver can take safety measures in time, and driving safety is further improved.

According to the detected target danger type and target danger level, the danger reminding content starts reminding from the primary stage, if the danger is not eliminated, but enters the middle-stage danger, the corresponding reminding content is upgraded to the middle-stage danger reminding, and the like, the danger is gradually reminded from the low-stage danger to the high-stage danger until the danger is eliminated, so that the situation of danger caused by suddenly carrying out high-danger reminding and frightening on a driver can be avoided, and the driving safety is further improved.

Fig. 4 is a flowchart illustrating an information display method according to still another exemplary embodiment of the present disclosure.

In an alternative example, before sending the target information display content and the target display control parameters to the display device in step 204, the method of the present disclosure further includes:

step 3011, obtaining sight line height information of the driver.

Step 3012, determining target display area information corresponding to the driver according to the sight line height information.

The sight line height information of the driver can be determined through the driver image acquired by the camera in the vehicle. For example, after the camera mounting position is determined, the corresponding relation between the area in the image shot by the camera and the actual space height can be determined according to the camera mounting position, so that the sight height of the driver can be determined according to the eye height of the driver in the image. The driver's eye level may also be obtained by other embodiments, not specifically limited. After the sight line height information of the driver is determined, the target display area information corresponding to the driver can be determined according to the sight line height information, and the target display area information corresponds to part or all of the display areas on the display screen and is used for providing a viewing area more suitable for the driver and more convenient for the driver to view information display contents. For example, when the display screen is larger in size, such as covering the whole front windshield, a larger area is covered, the display areas which are convenient to view by different sight heights of the driver are different, namely the size of the display areas is related to the sight coverage range of the driver, but the road sight cannot be blocked, so that for different drivers, the appropriate personalized target display areas of the drivers can be determined according to the sight heights of the drivers, information display contents are displayed for the drivers, and the experience of the drivers is effectively improved.

Correspondingly, step 204 specifically includes:

Step 2041, transmitting the target information display content, the target display control parameter and the target display area information to the display device, so that the display device displays the target information display content in the target display area corresponding to the target display area information according to the target display control parameter.

According to the method and the device, the proper personalized target display areas of different drivers are determined according to the sight heights of the drivers, so that information display contents are displayed for the drivers in the target display areas, and other areas are completely transparent and do not display contents, so that the experience of the drivers is effectively improved.

Fig. 5 is a flowchart illustrating an information display method according to still another exemplary embodiment of the present disclosure.

In one optional example, the method of the present disclosure further comprises:

step 401, detecting a current posture of a driver when the vehicle is detected to be in a non-running state.

The detection of whether the vehicle is in a driving state refers to the foregoing embodiment, and the current posture of the driver may include the state, the action, etc. of each part of the body of the driver, for example, the driver views the mobile phone, the fool, etc., the detection of the fool state refers to the foregoing, and the state of viewing the mobile phone may be determined by image recognition.

Step 402, if it is determined that the driver is in a leisure state according to the current gesture of the driver, the first entertainment content, the corresponding first display control parameter and the first display area information are acquired and sent to the display device, so that the display device displays the first entertainment content in the first display area corresponding to the first display area information according to the first display control parameter.

The judging of the leisure state is that the driver is in a state of wear-out time if the current posture of the driver is that the driver views a mobile phone or is in a fool, for example, and the driver is determined to be in the leisure state. The first entertainment content may be preset entertainment content, and may specifically be set according to actual requirements. The function and determination principle of the first display control parameter are similar to those of the target display control parameter described above, and will not be described again here. The first display area information is a display area for displaying first entertainment content determined for the driver according to the driver's line-of-sight height.

It should be noted that steps 401-402 and steps 201-204 are not sequential.

According to the method and the device, when the driver is detected to be in a leisure state, entertainment content is automatically played for the driver, and the experience of the driver is further improved.

In an alternative example, the acquiring the first entertainment content in step 402 specifically includes: acquiring first entertainment content according to the viewing history of a driver; or acquiring the first entertainment content according to the entertainment program list preset by the driver.

Optionally, the viewing history of the driver may be obtained according to the authorization of the driver, and further, the first entertainment content may be obtained for the driver according to the viewing history, and played for the driver on the display screen.

Optionally, a setting entry may be provided for the driver, and the entertainment program list is preset by the driver, so that when the driver is detected to be in a leisure state, the first entertainment content may be acquired according to the entertainment program list preset by the driver, and displayed and played for the driver on the display screen.

The present disclosure further improves driver experience by automatically playing entertainment for the driver based on the driver viewing history or the driver's customized entertainment program.

In step 3021, when navigation is required in response to a navigation request of a user or based on current driving environment information, navigation information, corresponding second display control parameters and second display area information are acquired and sent to the display device, so that the display device displays the navigation information in a second display area corresponding to the second display area information according to the second display control parameters.

The user may refer to a driver user or a co-driver user, and is not specifically limited. The method and the device can automatically start the dangerous reminding function when detecting that the vehicle is in a dangerous state, display reminding contents on the display screen on the front windshield, and display navigation information in response to a navigation request of a user when the user has navigation requirements. Optionally, the navigation information display function may be automatically started when it is determined that navigation is required according to the current driving environment information, and may be specifically set according to actual requirements. The second display control parameter corresponding to the navigation information is used for controlling the display of the navigation information on the display screen, and the specific principle is not repeated. The second display area information is similar to the first display area information, and may be determined according to the sight line height of the user, or alternatively, the second display area information may be obtained according to a preset, for example, which types of information contents may be preset to be displayed in which area, which is not particularly limited.

Alternatively, the user may issue the navigation request through a voice command or other possible manners, which is not particularly limited.

Optionally, step 3021 is not sequential to steps 201-204.

According to the method and the device, the navigation information is displayed on the display screen of the front windshield when needed, so that a user can conveniently check the route condition, and the user experience is further improved. And the navigation information, namely the non-emergency reminding information, is displayed only when needed, so that lower energy consumption and less interference are ensured.

Alternatively, the warning may not be displayed when there is no danger warning, to reduce power consumption and interference with the driver.

Fig. 6 is a flowchart illustrating an information display method according to still another exemplary embodiment of the present disclosure.

Step 3031, detecting the current state and sight line height information of the secondary driving user.

Specifically, the image information of the secondary driving user can be acquired through user authorization, the current state and the sight line height information of the secondary driving user are detected according to the image information of the secondary driving user, and the specific detection mode is similar to the detection of the driver and is not repeated here.

Step 3032, if the secondary driving user is determined to be in a leisure state according to the current state of the secondary driving user, the second entertainment content, the corresponding third display control parameter and the third display area information are obtained and sent to the display device, so that the display device displays the second entertainment content in the third display area corresponding to the third display area information according to the third display control parameter.

The determination of the leisure state of the secondary driver is similar to that of the driver, and will not be described here again. The second entertainment content may be identical to the first entertainment content, or may be different from the first entertainment content, and may be specifically set according to actual requirements. The third display control parameter is similar to the foregoing various display control parameters, and will not be described herein again, and the third display area information may be a display area suitable for the secondary driving user determined according to the line of sight height of the secondary driving user, so that the display device controls to display the second entertainment content in the display area corresponding to the third display area information of the display screen.

According to the method and the device, when the secondary driving user is detected to be in a leisure state, corresponding entertainment content is played in the display area corresponding to the secondary driving user, and user experience is further improved.

In an optional example, when the driver or the assistant driving user is detected to be in a leisure state, the driver or the assistant driving user can be inquired whether the entertainment content needs to be played through voice interaction, and the name of the entertainment content input by the voice of the driver or the assistant driving user can be received, so that the corresponding entertainment content is obtained to be displayed and played in a corresponding display area, and user experience is further improved.

In an alternative example, fig. 7 is a flow chart of step 203 provided by an exemplary embodiment of the present disclosure. In this example, step 203 specifically includes:

Step 2031, determining target information display content according to the target risk type, the target risk level and the first preset corresponding relation; the first preset corresponding relation comprises corresponding relations of different danger types, different danger levels and information display contents.

Step 2032, determining a target display control parameter according to the target information display content and the second preset corresponding relation; the second preset corresponding relation comprises a corresponding relation between information display content and display control parameters.

The corresponding relation between different danger types, different danger levels and information display contents in the first preset corresponding relation can be set according to actual requirements, for example, when the danger types are that vehicles approach on the right side and the danger levels are primary, vehicle icons are displayed on corresponding level lines on the right side of a display area, or vehicle icons are displayed on the right side, indicator lamps of the corresponding danger levels flash, and specific display modes can be set according to the actual requirements. For another example, when the danger type is that a pedestrian is present in the blind area, the character icon may be displayed in a corresponding orientation of the blind area in which the pedestrian is present in the display area.

Illustratively, fig. 8 is a schematic diagram of a display provided in an exemplary embodiment of the present disclosure. In this example, there is a current speed of the vehicle, a current temperature, hazard level indicator lights (left and right groups), a vehicle icon for the vehicle approaching on the right side, and a vehicle approaching level on the right side as a medium level (the right indicator light blinks or lights up).

Illustratively, fig. 9 is a schematic diagram of another display provided in an exemplary embodiment of the present disclosure. In this example, the left and right curves are used to represent a left lane line and a right lane line, respectively, and the vehicle icon on the lower right lane line indicates that the rear right vehicle is not traveling along the lane line.

Optionally, specific information display contents and display modes corresponding to different hazard types and different hazard levels can be set according to actual requirements, and the method is not limited to the illustrated contents.

According to the information display method provided by the embodiment of the disclosure, based on the flexible transparent display screen capable of being configured flexibly, a user can select the size of the display screen in a personalized manner, display convenience is improved, various types of risks in various grades can be perceived based on various sensors capable of being set on a vehicle, accurate and effective danger reminding can be provided for the user in a self-adaptive manner, different services can be provided for various states of driving and copilot in a self-adaptive manner, and user experience is improved.

Any of the information display methods provided by the embodiments of the present disclosure may be performed by any suitable device having data processing capabilities, including, but not limited to: terminal equipment, servers, etc. Or any of the information display methods provided by the embodiments of the present disclosure may be executed by a processor, such as the processor executing any of the information display methods mentioned by the embodiments of the present disclosure by invoking corresponding instructions stored in a memory. And will not be described in detail below.

Exemplary apparatus

Fig. 10 is a schematic structural view of an information display device provided in an exemplary embodiment of the present disclosure. The apparatus of this embodiment may be used to implement a corresponding method embodiment of the present disclosure, where the apparatus shown in fig. 10 includes: a first acquisition module 501, a first processing module 502, a second processing module 503, and a first sending module 504.

The first obtaining module 501 is configured to obtain current driving environment information of a vehicle when it is detected that the vehicle is in a driving state.

The first processing module 502 is configured to acquire a target hazard type and a corresponding target hazard level of the vehicle if it is determined that the vehicle is in a hazard state based on the current driving environment information acquired by the first acquiring module 501.

The second processing module 503 is configured to determine the corresponding target information display content and the target display control parameter according to the target risk type and the corresponding target risk level obtained by the first processing module 502.

A first sending module 504, configured to send the target information display content and the target display control parameter obtained by the second processing module 503 to a display device, so that the display device displays the target information display content on a display screen according to the target display control parameter; the display screen of the display device is mounted on a front windshield on the vehicle.

In one optional example, the current driving environment information includes at least one of external driving environment information and internal driving environment information of the vehicle, the internal driving environment information including driving state information of the driver; the first processing module 502 is specifically configured to: if the vehicle is determined to be in a dangerous state based on the current driving environment information, determining a target dangerous type and a corresponding target dangerous level of the vehicle based on at least one of the external driving environment information and the internal driving environment information.

In an alternative example, fig. 11 is a schematic structural diagram of a first processing module 502 provided in an exemplary embodiment of the present disclosure. In this example, the first processing module 502 includes: a first processing unit 5021 and a second processing unit 5022. The first processing unit 5021 is configured to obtain status information of at least one risk factor based on external driving environment information if it is determined that at least one risk factor of a dangerous vehicle, an illegally driven vehicle and other obstacles affecting driving exists outside the vehicle based on the external driving environment information; and determining the target danger type and the corresponding target danger level of the vehicle according to the state information of at least one danger factor. The second processing unit 5022 is configured to determine a target hazard type and a corresponding target hazard level of the vehicle according to the hazard motion of the driver if it is determined that the driver has the hazard motion based on the internal driving environment information.

Fig. 12 is a schematic structural view of an information display device provided in another exemplary embodiment of the present disclosure.

In an alternative example, the apparatus of the present disclosure further comprises: a second acquisition module 505 and a first determination module 506. A second obtaining module 505, configured to obtain sight line height information of a driver; the first determining module 506 is configured to determine target display area information corresponding to the driver according to the sight line height information acquired by the second acquiring module 505.

Correspondingly, the first sending module 504 is further configured to send the target information display content, the target display control parameter, and the target display area information to the display device, so that the display device displays the target information display content in the target display area corresponding to the target display area information according to the target display control parameter.

In an alternative example, the apparatus of the present disclosure further comprises: a first detection module 507 and a third acquisition module 508. A first detection module 507, configured to detect a current posture of a driver when it is detected that the vehicle is in an undriven state; a third obtaining module 508, configured to obtain the first entertainment content and the corresponding first display control parameter and first display area information if it is determined that the driver is in a leisure state according to the current gesture of the driver obtained by the first detecting module 507; the corresponding first sending module 504 is further configured to send the first entertainment content, the corresponding first display control parameter and the first display area information acquired by the third acquiring module 508 to a display device, so that the display device displays the first entertainment content in the first display area corresponding to the first display area information according to the first display control parameter.

In an alternative example, the third acquisition module 508 is specifically configured to: acquiring first entertainment content according to the viewing history of a driver; or acquiring the first entertainment content according to the entertainment program list preset by the driver.

In an alternative example, the apparatus of the present disclosure further comprises: a fourth obtaining module 509, configured to obtain navigation information and corresponding second display control parameters and second display area information when it is determined that navigation is required in response to a navigation request of a user or based on current driving environment information; the first sending module 504 is further configured to send the navigation information acquired by the fourth acquiring module 509 and the corresponding second display control parameter and second display area information to the display device, so that the display device displays the navigation information in the second display area corresponding to the second display area information according to the second display control parameter.

In an alternative example, the apparatus of the present disclosure further includes a second detection module 510 and a fifth acquisition module 511. The second detection module 510 is configured to detect a current state and sight line height information of the secondary driving user; a fifth obtaining module 511, configured to obtain the second entertainment content and the corresponding third display control parameter and third display area information if it is determined that the secondary driving user is in a leisure state according to the current state of the secondary driving user detected by the second detecting module 510; the first sending module 504 is further configured to send the second entertainment content, the corresponding third display control parameter, and the third display area information to the display device, so that the display device displays the second entertainment content in the third display area corresponding to the third display area information according to the third display control parameter.

In an alternative example, fig. 13 is a schematic structural diagram of a second processing module 503 provided in an exemplary embodiment of the present disclosure, where the second processing module 503 includes: a first determination unit 5031 and a second determination unit 5032. A first determining unit 5031, configured to determine, according to the target risk type, the target risk level, and the first preset correspondence, a target information display content; the first preset corresponding relation comprises corresponding relations between different danger types, different danger levels and information display contents; a second determining unit 5032, configured to determine a target display control parameter according to the target information display content and a second preset correspondence; the second preset corresponding relation comprises a corresponding relation between information display content and display control parameters.

Exemplary System

The embodiment of the disclosure also provides a vehicle-mounted display system, and fig. 14 is a schematic structural diagram of the vehicle-mounted display system provided in an exemplary embodiment of the disclosure. The in-vehicle display system of the present disclosure includes: an in-vehicle computing platform 601 and a display device 602. The vehicle-mounted computing platform 601 is connected with at least one camera and is used for acquiring current driving environment information of a vehicle based on the at least one camera so as to realize the information display method according to any embodiment or example; the display device 602 is connected with the vehicle-mounted computing platform 601 and is used for receiving and displaying display content sent by the vehicle-mounted computing platform 601; the display device 602 includes at least a control module and a display screen mounted on a front windshield of the vehicle.

Optionally, the vehicle-mounted display system may further include at least one camera, which is used for acquiring current driving environment information of the vehicle.

By way of example, the in-vehicle display system may include at least one of the following cameras:

The camera comprises a first camera for shooting the left front environment of the vehicle, a second camera for shooting the left rear environment of the vehicle, a third camera for shooting the right front environment of the vehicle, a fourth camera for shooting the right rear environment of the vehicle, a fifth camera for shooting the front environment of the vehicle, a sixth camera for shooting the in-vehicle environment and a seventh camera for shooting the rear environment of the vehicle.

Optionally, the vehicle-mounted display system may further include other types of sensors besides the camera for use in combination with the camera to obtain current driving environment information of the vehicle, or to detect the vehicle state and other related information.

Alternatively, the display of the display device 602 may be a flexible transparent OLED display or other flexible transparent display that may be implemented.

Exemplary electronic device

The embodiment of the disclosure also provides an electronic device, including: a memory for storing a computer program;

and a processor, configured to execute the computer program stored in the memory, and when the computer program is executed, implement the method according to any one of the embodiments of the disclosure.

Fig. 15 is a schematic structural view of an application embodiment of the electronic device of the present disclosure. In this embodiment, the electronic device 10 includes one or more processors 11 and a memory 12.

The processor 11 may be a Central Processing Unit (CPU) or other form of processing unit having data processing and/or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.

Memory 12 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random Access Memory (RAM) and/or cache memory (cache), and the like. The non-volatile memory may include, for example, read Only Memory (ROM), hard disk, flash memory, and the like. One or more computer program instructions may be stored on the computer readable storage medium that can be executed by the processor 11 to implement the methods of the various embodiments of the present disclosure described above and/or other desired functions. Various contents such as an input signal, a signal component, a noise component, and the like may also be stored in the computer-readable storage medium.

In one example, the electronic device 10 may further include: an input device 13 and an output device 14, which are interconnected by a bus system and/or other forms of connection mechanisms (not shown).

For example, the input device 13 may be a microphone or a microphone array as described above for capturing an input signal of a sound source.

In addition, the input device 13 may also include, for example, a keyboard, a mouse, and the like.

The output device 14 may output various information to the outside, including the determined distance information, direction information, and the like. The output means 14 may include, for example, a display, speakers, a printer, and a communication network and remote output devices connected thereto, etc.

Of course, only some of the components of the electronic device 10 relevant to the present disclosure are shown in fig. 15 for simplicity, components such as buses, input/output interfaces, etc. being omitted. In addition, the electronic device 10 may include any other suitable components depending on the particular application.

Exemplary computer program product and computer readable storage Medium

In addition to the methods and apparatus described above, embodiments of the present disclosure may also be a computer program product comprising computer program instructions which, when executed by a processor, cause the processor to perform steps in a method according to various embodiments of the present disclosure described in the "exemplary methods" section of the present description.

The computer program product may write program code for performing the operations of embodiments of the present disclosure in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server.

Furthermore, embodiments of the present disclosure may also be a computer-readable storage medium, having stored thereon computer program instructions, which when executed by a processor, cause the processor to perform steps in a method according to various embodiments of the present disclosure described in the above section "exemplary method" of the present disclosure.

The computer readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The basic principles of the present disclosure have been described above in connection with specific embodiments, but it should be noted that the advantages, benefits, effects, etc. mentioned in the present disclosure are merely examples and not limiting, and these advantages, benefits, effects, etc. are not to be considered as necessarily possessed by the various embodiments of the present disclosure. Furthermore, the specific details disclosed herein are for purposes of illustration and understanding only, and are not intended to be limiting, since the disclosure is not necessarily limited to practice with the specific details described.

In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different manner from other embodiments, so that the same or similar parts between the embodiments are mutually referred to. For system embodiments, the description is relatively simple as it essentially corresponds to method embodiments, and reference should be made to the description of method embodiments for relevant points.

The block diagrams of the devices, apparatuses, devices, systems referred to in this disclosure are merely illustrative examples and are not intended to require or imply that the connections, arrangements, configurations must be made in the manner shown in the block diagrams. As will be appreciated by one of skill in the art, the devices, apparatuses, devices, systems may be connected, arranged, configured in any manner. Words such as "including," "comprising," "having," and the like are words of openness and mean "including but not limited to," and are used interchangeably therewith. The terms "or" and "as used herein refer to and are used interchangeably with the term" and/or "unless the context clearly indicates otherwise. The term "such as" as used herein refers to, and is used interchangeably with, the phrase "such as, but not limited to.

The methods and apparatus of the present disclosure may be implemented in a number of ways. For example, the methods and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, firmware. The above-described sequence of steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the sequence specifically described above unless specifically stated otherwise. Furthermore, in some embodiments, the present disclosure may also be implemented as programs recorded in a recording medium, the programs including machine-readable instructions for implementing the methods according to the present disclosure. Thus, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.

It is also noted that in the apparatus, devices and methods of the present disclosure, components or steps may be disassembled and/or assembled. Such decomposition and/or recombination should be considered equivalent to the present disclosure.

The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of the disclosure to the form disclosed herein. Although a number of example aspects and embodiments have been discussed above, a person of ordinary skill in the art will recognize certain variations, modifications, alterations, additions, and subcombinations thereof.

Claims

1. An information display method, comprising:

when detecting that a vehicle is in a running state, acquiring current driving environment information of the vehicle;

if the vehicle is in a dangerous state based on the current driving environment information, acquiring a target dangerous type and a corresponding target dangerous level of the vehicle;

determining corresponding target information display content and target display control parameters according to the target hazard type and the corresponding target hazard level;

The target information display content and the target display control parameters are sent to display equipment, so that the display equipment displays the target information display content on a display screen according to the target display control parameters; the display screen of the display device is arranged on a front windshield of the vehicle, the display screen is a rear-mounted screen, and the display screen is a flexible transparent display screen;

The method further comprises the steps of: detecting the current state and sight height information of a secondary driving user; and if the secondary driving user is in a leisure state according to the current state of the secondary driving user, acquiring second entertainment content, corresponding third display control parameters and third display area information, and sending the second entertainment content to the display equipment so that the display equipment displays the second entertainment content in a third display area corresponding to the third display area information according to the third display control parameters.

2. The method according to claim 1, wherein the current driving environment information includes at least one of external driving environment information and internal driving environment information of the vehicle, the internal driving environment information including driving state information of a driver;

if the vehicle is determined to be in a dangerous state based on the current driving environment information, the method for acquiring the target dangerous type and the corresponding target dangerous level of the vehicle comprises the following steps:

and if the vehicle is in a dangerous state based on the current driving environment information, determining a target dangerous type and a corresponding target dangerous level of the vehicle based on at least one of the external driving environment information and the internal driving environment information.

3. The method of claim 1, prior to sending the target information display content and the target display control parameters to a display device, the method further comprising:

Acquiring sight line height information of a driver, and determining target display area information corresponding to the driver according to the sight line height information;

the sending the target information display content and the target display control parameter to a display device includes:

And sending the target information display content, the target display control parameters and the target display area information to the display equipment so that the display equipment displays the target information display content in a target display area corresponding to the target display area information according to the target display control parameters.

4. The method of claim 1, further comprising:

detecting the current posture of a driver when the vehicle is detected to be in a non-driving state;

If the driver is in a leisure state according to the current gesture of the driver, acquiring first entertainment content, corresponding first display control parameters and first display area information, and sending the first entertainment content and the corresponding first display control parameters and the first display area information to the display equipment, so that the display equipment displays the first entertainment content in a first display area corresponding to the first display area information according to the first display control parameters.

5. The method of claim 1, further comprising:

And when the navigation request of the user is responded or the navigation is required to be determined based on the current driving environment information, acquiring navigation information, corresponding second display control parameters and second display area information, and sending the navigation information to the display equipment so that the display equipment displays the navigation information in a second display area corresponding to the second display area information according to the second display control parameters.

6. The method according to any one of claims 1-5, wherein determining the corresponding target information display content and target display control parameters according to the target hazard type and the corresponding target hazard level comprises:

Determining the target information display content according to the target risk type, the target risk level and a first preset corresponding relation; the first preset corresponding relation comprises corresponding relations of different danger types, different danger levels and information display contents;

Determining the target display control parameters according to the target information display content and a second preset corresponding relation; the second preset corresponding relation comprises a corresponding relation between information display content and display control parameters.

7. An information display device, comprising:

The first acquisition module is used for acquiring current driving environment information of the vehicle when the vehicle is detected to be in a driving state;

The first processing module is used for acquiring a target danger type and a corresponding target danger level of the vehicle if the vehicle is determined to be in a dangerous state based on the current driving environment information;

The second processing module is used for determining corresponding target information display content and target display control parameters according to the target hazard type and the corresponding target hazard level;

The first sending module is used for sending the target information display content and the target display control parameters to display equipment so that the display equipment displays the target information display content on a display screen according to the target display control parameters; the display screen of the display device is arranged on a front windshield of the vehicle, the display screen is a rear-mounted screen, and the display screen is a flexible transparent display screen;

the apparatus further comprises: the second detection module is used for detecting the current state and sight line height information of the secondary driving user; a fifth obtaining module, configured to obtain a second entertainment content and a corresponding third display control parameter and third display area information if it is determined that the secondary driving user is in a leisure state according to the current state of the secondary driving user; the first sending module is further configured to send the second entertainment content, the corresponding third display control parameter and the third display area information to the display device, so that the display device displays the second entertainment content in a third display area corresponding to the third display area information according to the third display control parameter.

8. A computer-readable storage medium storing a computer program for executing the information display method according to any one of the preceding claims 1 to 6.

9. An electronic device, the electronic device comprising:

A processor;

a memory for storing the processor-executable instructions;

the processor is configured to read the executable instructions from the memory and execute the instructions to implement the information display method according to any one of the preceding claims 1-6.

10. An in-vehicle display system, comprising:

the vehicle-mounted computing platform is connected with at least one camera and is used for acquiring current driving environment information of the vehicle based on the at least one camera so as to realize the information display method according to any one of claims 1-6;

The display device is connected with the vehicle-mounted computing platform and used for receiving and displaying display contents sent by the vehicle-mounted computing platform; the display device at least comprises a control module and a display screen, wherein the display screen is arranged on a front windshield of the vehicle.