CN109819160A - Based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving and device - Google Patents
Based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving and device Download PDFInfo
- Publication number
- CN109819160A CN109819160A CN201910006505.1A CN201910006505A CN109819160A CN 109819160 A CN109819160 A CN 109819160A CN 201910006505 A CN201910006505 A CN 201910006505A CN 109819160 A CN109819160 A CN 109819160A
- Authority
- CN
- China
- Prior art keywords
- video
- panoramas
- auxiliary system
- visual auxiliary
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Traffic Control Systems (AREA)
Abstract
The invention discloses a kind of based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving, step are as follows: pre-established the traffic mark database based on location information；Obtain 360 panoramas drive a vehicle visual auxiliary system location information and what system generated original look around video；By it is described it is original look around the traffic beacon that occurs in video and know be compared with the traffic mark database, the traffic beacon knowledge image superposition of missing is looked around in video to original, final output is obtained and looks around video.In addition, the present invention also provides the device for realizing the above method, including the visual auxiliary system of 360 panoramas driving, locating module, AI analysis module, video processing module, wireless communication module, navigation module and primary processor.The present invention has the beneficial effect that, can show that lane intrusion early warning is known and prompted in panorama video to the traffic beacon blocked by nearby vehicle by panorama video.
Description
Technical field
The present invention relates to car steering field of auxiliary, visual auxiliary more particularly, to a kind of 360 panoramas driving based on AI
Auxiliary system video generation method and device.
Background technique
Automobile has become a kind of main transport facility of modern society, and people propose the safety of driving with comfort
Higher requirement is gone out.The invention of automobile rearview mirror is it is originally envisaged that be exactly that driver is facilitated to watch automobile two sides and subsequent shape
Condition prevents from colliding with the external world in the process of backing up, improves the safety of itself driving and the third party outside vehicle, extends vapour
The service life of vehicle.But in fact, only relying on driving vision and information provided by rearview mirror, it is difficult to meet driver for driving
The demand of safety, especially when reversing, there is very big blind areas behind vehicle.Connect, it is this it is inaccurate electronically
Figure or navigation system to client bring inconvenience, also send the employee of express delivery to cause temporal waste to food delivery.
For this purpose, the visual auxiliary system of 360 panoramas driving is produced, the basic principle is that acquiring the shadow of vehicle's surroundings simultaneously
Picture forms 360 degree of panorama top views of a width vehicle's surroundings after image processing unit is corrected and is spliced, and real-time transmission arrives
In the display equipment of console, the case where relatively understanding to see automobile surrounding clearly is enabled a driver to, convenient for keeping to the side to drive, fall
The driving behaviors such as vehicle, left-hand bend.
But current 360 panorama drives a vehicle video that visual auxiliary system generates there are following defect information, greatly reduces 360
Panorama is driven a vehicle the effect of visual auxiliary system: 1, cannot show that the traffic beacon blocked by nearby vehicle is known, influence normal row
Vehicle.2, it cannot predict that lane invades information.
Summary of the invention
It is the video that visual auxiliary system generates of solving the problems, such as above-mentioned 360 panorama to drive a vehicle there are following defect information, this
Invention proposes the visual auxiliary system video generation method of the driving of 360 panoramas based on AI and and device.
In order to achieve the object of the present invention, it adopts the following technical scheme that:
Based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving, step are as follows:
The traffic mark database based on location information is pre-established；
Obtain 360 panoramas drive a vehicle visual auxiliary system location information and what system generated original look around video；
By it is described it is original look around the traffic beacon that occurs in video and know be compared with the traffic mark database, general
The traffic beacon of missing is known image superposition and is looked around in video to original, obtains final output and looks around video.
Setting up the traffic mark database based on location information may include:
360 panoramas first are updated from cloud to drive a vehicle the traffic mark database of visual auxiliary system, original look around view for described
The traffic beacon knowledge occurred in frequency is compared with the traffic mark database；Or
The results for video for analyzing vehicle different location in real time by AI, therefrom extracts traffic mark data.
Further, it the present invention is based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving, also wraps
Include following steps:
Obtain lane invade information, and by lane invade with text or pictorial manner be added to it is original look around in video, obtain
Video is looked around to final output.
The lane mode of infection can obtain in the following way: the path actively issued by real-time nearby vehicle
Mobile message obtains；Or
It is obtained by real-time AI analysis.
The present invention also provides the visual auxiliary system video-generating devices of 360 panoramas driving based on AI and Internet of Things, comprising:
360 panoramas are driven a vehicle visual auxiliary system module, original look around video and information is shown for generating；
Locating module, the geographical location information where generating means；
AI analysis module is analyzed for video AI, generates traffic mark information, lane intrusion information etc.；
Video processing module is used to synthesize overlapped information and original video of looking around according to primary processor；
Wireless communication module is communicated for system and cloud server, the external world；
Navigation module provides vehicle movement planning information；
Primary processor is responsible for coordinating the work of above-mentioned each module.
The visual auxiliary system module of 360 panoramas driving is electrically connected with video processing module, and primary processor is respectively and at video
Manage module, AI analysis module, wireless communication module, navigation module electrical connection.
Compared with the prior art, the present invention is based on AI and 360 panorama of Internet of Things driving visual auxiliary system video generation side
Method and device have following the utility model has the advantages that overcoming the problem of 360 panoramas drive a vehicle visual auxiliary system presently, there are defect informations, this
Invention panorama video can show that the traffic beacon blocked by nearby vehicle is known and prompts lane intrusion pre- in panorama video
It is alert.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for
For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is shown in the present invention based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving
A kind of embodiment flow diagram；
The one of visual auxiliary system video-unit is driven a vehicle Fig. 2 shows 360 panoramas based on AI and Internet of Things in the present invention
The structural schematic diagram of kind embodiment.
Specific embodiment
In order to enable those skilled in the art to better understand the solution of the present invention, below to the technology in the embodiment of the present invention
Scheme is clearly and completely described.
The present invention's is driven a vehicle visual auxiliary system video generation method based on 360 panoramas of AI and Internet of Things, comprising:
The traffic mark database based on location information is pre-established, this database may exist cloud server
On, the visual auxiliary system of 360 panorama of system driving establishes connection by wireless communication, can also can locally produce.
By GPS or wireless communication positioning service, obtains 360 panoramas and drive a vehicle the location information and system of visual auxiliary system
The original of generation looks around video, i.e., has recorded location information in video.
On the basis of location information, the original traffic beacon occurred in video of looking around is known and the traffic mark
Database is compared, should be as it can be seen that but in the original traffic beacon for looking around video missing of system by position driver's vision
Know image superposition to look around in video to original, obtains final output and look around video.
For guarantee traffic mark database be it is newest, first can update 360 panoramas from cloud and drive a vehicle visual auxiliary system
Traffic mark database, by it is described it is original look around the traffic beacon that occurs in video know with the traffic mark database into
Row compares.
For guarantee traffic mark database be it is newest, the video knot of vehicle different location can also be analyzed in real time by AI
Fruit therefrom extracts traffic mark data.
The present invention is based on the visual auxiliary system video generation methods of 360 panoramas of AI and Internet of Things driving, further include superposition
Lane invades warning information, and method is:
Calculating the estimated lane space occupied predetermined instant in future Nei Benche, (this lane can be the vehicle of roadmarking
Road is also possible to the space of vehicle periphery certain distance)；
If by artificial intelligence to look around video analysis, discovery video in have object that may invade above-mentioned lane space
When, attack early warning information in lane is superimposed in looking around video, lane attack early warning information can be text, be also possible to image.
Lane invasion can receive the fortune of motion path information and vehicle itself that other vehicles actively issue by other
Dynamic path, which is compared, to obtain, method can be, the movement routine information of nearby vehicle active transmission next step self, and 360 is complete
Scape is driven a vehicle after visual auxiliary system receives parsing, compared with the movement routine of Vehicular navigation system pair.
Lane invasion can also analyze real-time video by AI and be calculated, specifically, analysis moving objects in video
The direction of motion and speed, the possibility in the interior intrusion lane of prediction certain time.
In addition, the present invention also provides the visual auxiliary system video-generating device of 360 panoramas driving based on AI and Internet of Things,
Include:
360 panoramas are driven a vehicle visual auxiliary system module, original look around video and information is shown for generating；
Locating module, the geographical location information where generating means；
AI analysis module is analyzed for video AI, generates traffic mark information, lane intrusion information etc.；
Video processing module is used to synthesize overlapped information and original video of looking around according to primary processor；
Wireless communication module is communicated for system and cloud server, the external world；
Navigation module provides vehicle movement planning information；
Primary processor is responsible for coordinating the work of above-mentioned each module.
The visual auxiliary system module of 360 panoramas driving is electrically connected with video processing module, and primary processor is respectively and at video
Manage module, AI analysis module, wireless communication module, navigation module electrical connection.
Above to provided by the present invention based on AI and the visual auxiliary system video generation method of 360 panorama of Internet of Things driving
And the embodiment of device is described in detail, and for those of ordinary skill in the art, thought according to an embodiment of the present invention,
There will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not be construed as to this
The limitation of invention.
Claims (7)
1. based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving characterized by comprising
S1, the traffic mark database based on location information has been pre-established；
S2, obtain 360 panoramas drive a vehicle visual auxiliary system location information and what system generated original look around video；
S3, by it is described it is original look around the traffic beacon that occurs in video and know be compared with the traffic mark database, general
The traffic beacon of missing is known image superposition and is looked around in video to original, obtains final output and looks around video.
2. it is driven a vehicle visual auxiliary system video generation method based on 360 panoramas of A I and Internet of Things according to claim 1,
It is characterized in that, the S3 includes:
S31,360 panoramas first are updated from cloud drive a vehicle the traffic mark database of visual auxiliary system, original look around view for described
The traffic beacon knowledge occurred in frequency is compared with the traffic mark database.
3. it is driven a vehicle visual auxiliary system video generation method based on 360 panoramas of AI and Internet of Things according to claim 1,
It is characterized in that, the S3 includes:
S31 ', the results for video for analyzing vehicle different location in real time by AI, therefrom extract traffic mark data.
4. it is driven a vehicle visual auxiliary system video generation method based on 360 panoramas of AI and Internet of Things according to claim 1,
It is characterized in that, further includes:
S4, obtain lane invade information, and by lane invade with text or pictorial manner be added to it is original look around in video, obtain
Final output looks around video.
5. it is driven a vehicle visual auxiliary system video generation method based on 360 panoramas of AI and Internet of Things according to claim 4,
It is characterized in that:
S41, the lane mode of infection obtain in the following way: the path actively issued by real-time nearby vehicle is mobile
Information obtains.
6. it is driven a vehicle visual auxiliary system video generation method based on 360 panoramas of AI and Internet of Things according to claim 4,
It is characterized in that:
S41 ', the lane mode of infection obtain in the following way: being obtained by real-time A I analysis.
7. the present invention also provides the visual auxiliary system video-generating devices of 360 panoramas driving based on AI and Internet of Things, comprising:
360 panoramas are driven a vehicle visual auxiliary system module, original look around video and information is shown for generating；
Locating module, the geographical location information where generating means；
AI analysis module is analyzed for video AI, generates traffic mark information, lane intrusion information etc.；
Video processing module is used to synthesize overlapped information and original video of looking around according to primary processor；
Wireless communication module is communicated for system and cloud server, the external world；
Navigation module provides vehicle movement planning information；
Primary processor is responsible for coordinating the work of above-mentioned each module；
The visual auxiliary system module of 360 panoramas driving is electrically connected with video processing module, and primary processor handles mould with video respectively
Block, AI analysis module, wireless communication module, navigation module electrical connection.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910006505.1A CN109819160A (en) | 2019-01-04 | 2019-01-04 | Based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910006505.1A CN109819160A (en) | 2019-01-04 | 2019-01-04 | Based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109819160A true CN109819160A (en) | 2019-05-28 |
Family
ID=66603892
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910006505.1A Pending CN109819160A (en) | 2019-01-04 | 2019-01-04 | Based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109819160A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112820130A (en) * | 2019-12-27 | 2021-05-18 | 李华 | Mode conversion platform based on content analysis |
| CN116229765A (en) * | 2023-05-06 | 2023-06-06 | 贵州鹰驾交通科技有限公司 | Vehicle-road cooperation method based on digital data processing |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104063884A (en) * | 2014-07-11 | 2014-09-24 | 昆明联诚科技股份有限公司 | Image target recognition method based on combination of motion prediction and multi-template matching |
| US20150022426A1 (en) * | 2013-03-15 | 2015-01-22 | Honda Motor Co., Ltd | System and method for warning a driver of a potential rear end collision |
| CN104835339A (en) * | 2015-04-13 | 2015-08-12 | 苏州天趣信息科技有限公司 | Method and system for prompting special traffic violation behavior based on geographic position |
| CN106097383A (en) * | 2016-05-30 | 2016-11-09 | 海信集团有限公司 | A kind of method for tracking target for occlusion issue and equipment |
| CN106926779A (en) * | 2017-03-09 | 2017-07-07 | 吉利汽车研究院（宁波）有限公司 | A kind of vehicle lane change accessory system |
| CN108257418A (en) * | 2016-12-28 | 2018-07-06 | 上海汽车集团股份有限公司 | Vehicle collision prewarning method and device |
| CN108960566A (en) * | 2018-05-29 | 2018-12-07 | 高新兴科技集团股份有限公司 | A kind of traffic Visualized Monitoring System |
| CN109050401A (en) * | 2018-07-09 | 2018-12-21 | 三星电子（中国）研发中心 | A kind of the driving display methods and device of augmented reality |
-
2019
- 2019-01-04 CN CN201910006505.1A patent/CN109819160A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150022426A1 (en) * | 2013-03-15 | 2015-01-22 | Honda Motor Co., Ltd | System and method for warning a driver of a potential rear end collision |
| CN104063884A (en) * | 2014-07-11 | 2014-09-24 | 昆明联诚科技股份有限公司 | Image target recognition method based on combination of motion prediction and multi-template matching |
| CN104835339A (en) * | 2015-04-13 | 2015-08-12 | 苏州天趣信息科技有限公司 | Method and system for prompting special traffic violation behavior based on geographic position |
| CN106097383A (en) * | 2016-05-30 | 2016-11-09 | 海信集团有限公司 | A kind of method for tracking target for occlusion issue and equipment |
| CN108257418A (en) * | 2016-12-28 | 2018-07-06 | 上海汽车集团股份有限公司 | Vehicle collision prewarning method and device |
| CN106926779A (en) * | 2017-03-09 | 2017-07-07 | 吉利汽车研究院（宁波）有限公司 | A kind of vehicle lane change accessory system |
| CN108960566A (en) * | 2018-05-29 | 2018-12-07 | 高新兴科技集团股份有限公司 | A kind of traffic Visualized Monitoring System |
| CN109050401A (en) * | 2018-07-09 | 2018-12-21 | 三星电子（中国）研发中心 | A kind of the driving display methods and device of augmented reality |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112820130A (en) * | 2019-12-27 | 2021-05-18 | 李华 | Mode conversion platform based on content analysis |
| CN112820130B (en) * | 2019-12-27 | 2022-03-29 | 四川九洲视讯科技有限责任公司 | Mode conversion platform based on content analysis |
| CN116229765A (en) * | 2023-05-06 | 2023-06-06 | 贵州鹰驾交通科技有限公司 | Vehicle-road cooperation method based on digital data processing |
| CN116229765B (en) * | 2023-05-06 | 2023-07-21 | 贵州鹰驾交通科技有限公司 | Vehicle-road cooperation method based on digital data processing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12128901B2 (en) | Virtualized driver assistance | |
| US10417911B2 (en) | Inter-vehicle cooperation for physical exterior damage detection | |
| US10552695B1 (en) | Driver monitoring system and method of operating the same | |
| US10586118B2 (en) | Localizing traffic situation using multi-vehicle collaboration | |
| US10867510B2 (en) | Real-time traffic monitoring with connected cars | |
| US10628690B2 (en) | Systems and methods for automated detection of trailer properties | |
| US10580296B2 (en) | Advanced threat warning for autonomous vehicles | |
| US10970916B2 (en) | Image processing apparatus and image processing method | |
| US20180081357A1 (en) | Geocoded information aided vehicle warning | |
| US20200189459A1 (en) | Method and system for assessing errant threat detection | |
| JPWO2020116195A1 (en) | Information processing device, information processing method, program, mobile control device, and mobile | |
| US10369995B2 (en) | Information processing device, information processing method, control device for vehicle, and control method for vehicle | |
| US10748012B2 (en) | Methods and apparatus to facilitate environmental visibility determination | |
| JP7020434B2 (en) | Image processing equipment, image processing method, and program | |
| JPWO2019039282A1 (en) | Image processing device and image processing method | |
| US11328379B2 (en) | Image processing apparatus and image processing method | |
| TW201333896A (en) | Remote traffic management system using video radar | |
| US20220165066A1 (en) | Information processing apparatus, information processing method, and program | |
| CN109819160A (en) | Based on the visual auxiliary system video generation method of 360 panoramas of AI and Internet of Things driving and device | |
| US11375137B2 (en) | Image processor, image processing method, and imaging device | |
| US20200349367A1 (en) | Image processing device, image processing method, and program | |
| US11563905B2 (en) | Information processing device, information processing method, and program | |
| DE102022124517A1 (en) | METHOD AND SYSTEM FOR INTELLIGENT TRAFFIC WARNING AND NAVIGATION ASSISTANCE IN POOR WEATHER AND POOR VISIBILITY | |
| EP3751512A1 (en) | Recognition device, recognition method, and program | |
| WO2023113676A1 (en) | High fidelity anchor points for real-time mapping with mobile devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190528 |
|
| RJ01 | Rejection of invention patent application after publication |