CN107380064A - A kind of vehicle-mounted Eye-controlling focus device based on augmented reality - Google Patents
A kind of vehicle-mounted Eye-controlling focus device based on augmented reality Download PDFInfo
- Publication number
- CN107380064A CN107380064A CN201710539990.XA CN201710539990A CN107380064A CN 107380064 A CN107380064 A CN 107380064A CN 201710539990 A CN201710539990 A CN 201710539990A CN 107380064 A CN107380064 A CN 107380064A
- Authority
- CN
- China
- Prior art keywords
- controlling focus
- eye
- autoist
- vehicle
- augmented reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/804—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for lane monitoring
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Mechanical Engineering (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a kind of vehicle-mounted Eye-controlling focus device based on augmented reality, including image collecting device, people's car mutual display device, Eye-controlling focus module and control module, control module includes controller, data processor and data storage, Eye-controlling focus module includes light source assembly and imaging sensor, Eye-controlling focus module follows the trail of autoist sight fixation object, catch visual line characteristics, controller control instruction according to corresponding to generating visual line characteristics, image collecting device gathers automobile external image according to control instruction and extracts characteristics of image, characteristics of image after data processor processes via forming data message, data message is matched with the data storage in data storage, visualization procedure corresponding to the data storage that the match is successful is shown in people's car mutual display device by controller.The above-mentioned vehicle-mounted Eye-controlling focus device based on augmented reality, can help autoist to understand the information data of targets of interest within sweep of the eye in real time.
Description
Technical field
The invention belongs to the vehicle-mounted Eye-controlling focus device of auto parts field, more particularly to a kind of augmented reality.
Background technology
With the popularization and development of automobile, people propose higher requirement for automobile, and intellectuality has become now
The direction of development of automobile, the popularization of augmented reality also provide new path for vehicle intellectualized development.
Augmented reality by video and Internet technology, can obtain the information of peripheral object, and it is included
On specific display interface, user is carried out interactive by display interface and periphery real-world objects.
Augmented reality is applied into automotive field can allow autoist to be realized more with environment surrounding automobile
Good interaction, brand-new riding experience is brought to autoist.
The content of the invention
Technical scheme can help autoist to understand the Information Number of targets of interest within sweep of the eye in real time
According to.
The present invention concrete technical scheme be：A kind of vehicle-mounted Eye-controlling focus device based on augmented reality, including with
In the image collecting device for shooting automobile external image, the people's car mutual display device being arranged in front of autoist, set
In the Eye-controlling focus module and control module of automotive interior, control module includes controller, data processor and data storage,
Eye-controlling focus module includes light source assembly and imaging sensor.Eye-controlling focus module follows the trail of autoist sight, according to automobile
User's sight and the corresponding relation of the outer Target space position of car determine autoist fixation object；Eye-controlling focus module is caught
Visual line characteristics, controller control instruction according to corresponding to generating visual line characteristics, image collecting device gather vapour according to control instruction
Car external image simultaneously extracts characteristics of image, characteristics of image via forming data message after data processor processes, data message with
Data storage in data storage is matched, and controller shows the visualization procedure corresponding to the data storage that the match is successful
It is shown in people's car mutual display device.
As the further optimization of the present invention, the visual line characteristics of autoist are that user's sight is watched position attentively and set
Time cycle in reside in the same space scope.
As the further optimization of the present invention, the visual line characteristics of autoist are that user's sight watched position attentively at 2 seconds
Inside reside in the same space scope.When being less than 2 seconds the time cycle of setting, the noise of device identification is excessive, and increase device misses
Sentence rate；When being more than 2 seconds the time cycle of setting, because automobile is in transport condition, the situation that object departs from the visual field increases, entered
And recognition failures are caused, moreover, this setting can allow autoist sensory device to react slowly, easily cause visual fatigue.
Summarized and drawn by substantial amounts of experimental data, the time cycle is set as that good experience can be obtained in 2 seconds.
As the further optimization of the present invention, the data storage in data storage is streetscape data, and autoist can
To understand the various information of its place block by vehicle-mounted Eye-controlling focus device, information includes street traffic condition information, building
Historical information of merchant information and building etc. in thing.This technical scheme can make autoist not have to go down automobile i.e.
Various information at one's side can be understood in real time.
As the further optimization of the present invention, the vehicle-mounted Eye-controlling focus device based on augmented reality is arranged on and driven automatically
Sail on automobile.Watching road conditions and information of road surface, autoist without autoist due to autonomous driving vehicle can concentrate
Notice appreciates targets of interest, therefore can more preferably be experienced.
As the further optimization of the present invention, Eye-controlling focus module, which is arranged on, to be connected on the glasses of automobile report control platform,
The connected mode of glasses and automobile report control platform is wired or wireless connection.Such a scheme can realize the amount of Eye-controlling focus module
Body customizes, and improves the recognition accuracy of device.
As the further optimization of the present invention, image collecting device is arranged on the front portion of automobile, it is possible to achieve to garage
The target object for sailing direction carries out better image collection.
As the further optimization of the present invention, Eye-controlling focus module tracking autoist sight watches position attentively, and sight is special
Levy and blinked more than twice for autoist is continuous in 1 second, control instruction is to be controlled in people's car mutual display device
Cursor, autoist by sight realize to control cursor manipulation, and then realize in people's car mutual display device can
Manipulation depending on changing program.
As the further optimization of the present invention, Eye-controlling focus module tracking autoist sight watches position attentively, and sight is special
Levy and blinked more than twice for autoist is continuous in 1 second, control instruction is to be controlled in people's car mutual display device
Cursor, autoist by sight realize to control cursor manipulation, and then realize in people's car mutual display device can
Manipulation depending on changing program, when data storage is map datum, autoist can be selected by vehicle-mounted Eye-controlling focus device
Travel direction or traveling destination.
The vehicle-mounted Eye-controlling focus device based on augmented reality of present disclosure, can help autoist real-time
Understand the information data of targets of interest within sweep of the eye.
Brief description of the drawings
Fig. 1 is the structured flowchart of the vehicle-mounted Eye-controlling focus device of the invention based on augmented reality；
Fig. 2 is the schematic layout pattern of vehicle-mounted Eye-controlling focus device in the car of the invention based on augmented reality；
Fig. 3 is the operational process block diagram of the vehicle-mounted Eye-controlling focus device of the invention based on augmented reality.
Embodiment
To describe technical scheme in detail, in conjunction with the brief description of the drawings preferred embodiment of the invention.
A kind of preferred embodiment of the vehicle-mounted Eye-controlling focus device based on augmented reality, as depicted in figs. 1 and 2, bag
The image collecting device 300 for shooting automobile external image is included, image collecting device 300 is arranged at the front portion of automobile；People's car
Interactive display unit 400 is arranged in front of autoist, and Eye-controlling focus module 100 and control module 200 are arranged in automobile
Portion, control module 200 include controller, data processor and data storage, Eye-controlling focus module 100 include light source assembly and
Imaging sensor.
As shown in figure 3, when autoist watches jobbie outside automobile attentively, Eye-controlling focus module 100 is followed the trail of automobile and used
Person's sight, autoist fixation object is determined according to the corresponding relation of Target space position outside autoist sight and car,
Specifically, Eye-controlling focus module 100 light source assembly transmitting light outside the eyes of autoist on cornea reflect after shape
Into Purkinje image, image capture sensor Purkinje image simultaneously determines autoist according to the position of Purkinje image and pupil center
The direction that sight is watched attentively, and then the target object that autoist is watched attentively is determined, when the sight of autoist rests on target
When object was more than 2 seconds, controller sends the control instruction for gathering the target object image.
As shown in figure 3, image collecting device 300 gathers automobile external image according to the control instruction and extracts image spy
Sign, characteristics of image is via forming data message after data processor processes, data message and the data storage in data storage
Matched, the visualization procedure corresponding to the data storage that the match is successful is shown in people's car mutual display device by controller
400.For example, the data storage in the present embodiment is streetscape data, autoist can pass through people's car mutual display device 400
The various information of block where understanding it, information include merchant information and building in street traffic condition information, building
Historical information etc..
In another preferred embodiment of the invention, as depicted in figs. 1 and 2, a kind of car based on augmented reality
Carrying Eye-controlling focus device includes being used for the image collecting device 300 for shooting automobile external image, and image collecting device 300 is arranged at
The front portion of automobile；People's car mutual display device 400 is arranged in front of autoist, Eye-controlling focus module 100 and control module
200 are arranged at automotive interior, and control module 200 includes controller, data processor and data storage, Eye-controlling focus module
100 include light source assembly and imaging sensor.
As shown in figure 3, when autoist watches jobbie outside automobile attentively, Eye-controlling focus module 100 is followed the trail of automobile and used
Person's sight watches position attentively, specifically, the light of the light source assembly transmitting of Eye-controlling focus module 100 is outside the eyes of autoist
Purkinje image is formed after being reflected on cornea, image capture sensor Purkinje image and according to Purkinje image and the position of pupil center
The direction that autoist sight is watched attentively is determined, and then determines the target object that autoist is watched attentively, when autoist
When sight rested on target object more than 2 seconds, controller sends the control instruction for gathering the target object image.Image collector
300 are put to gather automobile external image according to the control instruction and extract characteristics of image, characteristics of image via data processor at
Data message is formed after reason, data message matched with the data storage in data storage, and controller is by the match is successful
Visualization procedure corresponding to data storage is shown in people's car mutual display device 400.Eye-controlling focus module 100, which follows the trail of automobile, to be made
User's sight watches position attentively, when autoist was continuously blinked more than twice in 1 second, in people's car mutual display device 400
There is control cursor, autoist realizes the manipulation to controlling cursor by sight, and then realization shows to people's car mutual and filled
Put the control of the visualization procedure on 400.For example, data storage is map datum in the present embodiment, there is row in visualization procedure
Sail direction and travel the visualization option of destination, autoist can be by controlling in people's car mutual display device 400
Control cursor selection travel direction or traveling destination.
In another preferred embodiment of the invention, the vehicle-mounted Eye-controlling focus device based on augmented reality is arranged on
On autonomous driving vehicle.
In another preferred embodiment of the invention, Eye-controlling focus module is arranged on the eye for being connected to automobile report control platform
On mirror, the connected mode of glasses and automobile report control platform is wired connection.
In another preferred embodiment of the invention, Eye-controlling focus module is arranged on the eye for being connected to automobile report control platform
On mirror, the connected mode of glasses and automobile report control platform is wireless connection.
Although present disclosure is discussed in detail by above preferred embodiment, but it should be appreciated that above-mentioned
Description is not considered as limitation of the present invention.After those skilled in the art have read the above, for the present invention's
A variety of modifications and substitutions all will be apparent.Therefore, protection scope of the present invention should be limited to the appended claims.
Claims (9)
1. a kind of vehicle-mounted Eye-controlling focus device based on augmented reality, including：
For shooting the image collecting device of automobile external image；
The people's car mutual display device being arranged in front of autoist；
The Eye-controlling focus module and control module of automotive interior are arranged at, control module includes controller, data processor sum
According to memory, Eye-controlling focus module includes light source assembly and imaging sensor；
Characterized in that, the Eye-controlling focus module tracking autoist sight, according to mesh outside autoist sight and car
The corresponding relation of mark locus determines autoist fixation object；
The Eye-controlling focus module catches visual line characteristics, controller control instruction according to corresponding to generating visual line characteristics, figure
As harvester according to the control instruction gather autoist fixation object image and extract characteristics of image, characteristics of image
Via data message is formed after data processor processes, data message is matched with the data storage in data storage, control
Visualization procedure corresponding to the data storage that the match is successful is shown in people's car mutual display device by device processed.
2. the vehicle-mounted Eye-controlling focus device according to claim 1 based on augmented reality, it is characterised in that described to regard
Line is characterized in that user's sight watches position attentively and the same space scope is resided within the time cycle of setting.
3. the vehicle-mounted Eye-controlling focus device according to claim 2 based on augmented reality, it is characterised in that described to set
The cycle fixed time as 2 seconds.
4. the vehicle-mounted Eye-controlling focus device according to claim 1 based on augmented reality, it is characterised in that described to deposit
Storage data are streetscape data, the various information of block where autoist can understand it by vehicle-mounted Eye-controlling focus device,
Described information includes historical information of merchant information and building in street traffic condition information, building etc..
5. the vehicle-mounted Eye-controlling focus device according to claim 1 based on augmented reality, it is characterised in that the base
It is arranged in the vehicle-mounted Eye-controlling focus device of augmented reality on autonomous driving vehicle.
6. the vehicle-mounted Eye-controlling focus device according to claim 1 based on augmented reality, it is characterised in that described to regard
Line tracing module, which is arranged on, to be connected on the glasses of automobile report control platform, and the connected mode of the glasses and automobile report control platform is
Wired or wireless connection.
7. the vehicle-mounted Eye-controlling focus device according to claim 1 based on augmented reality, it is characterised in that the figure
As harvester is arranged on the front portion of automobile.
8. the vehicle-mounted Eye-controlling focus device according to claim 1 based on augmented reality, it is characterised in that described to regard
Line tracing module tracking autoist sight watches position attentively, and the visual line characteristics are that autoist was continuously blinked in 1 second
More than twice, the control instruction is to occur control cursor in people's car mutual display device, and autoist is real by sight
Now to controlling the manipulation of cursor, and then realize the manipulation to the visualization procedure in people's car mutual display device.
9. the vehicle-mounted Eye-controlling focus device according to claim 8 based on augmented reality, it is characterised in that described to deposit
Storage data are map datum, and autoist can select travel direction or traveling destination.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710539990.XA CN107380064B (en) | 2017-07-04 | 2017-07-04 | Vehicle-mounted sight tracking device based on augmented reality technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710539990.XA CN107380064B (en) | 2017-07-04 | 2017-07-04 | Vehicle-mounted sight tracking device based on augmented reality technology |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107380064A true CN107380064A (en) | 2017-11-24 |
| CN107380064B CN107380064B (en) | 2022-08-19 |
Family
ID=60335071
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710539990.XA Active CN107380064B (en) | 2017-07-04 | 2017-07-04 | Vehicle-mounted sight tracking device based on augmented reality technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107380064B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109191587A (en) * | 2018-08-23 | 2019-01-11 | 百度在线网络技术（北京）有限公司 | Color identification method, device, electronic equipment and storage medium |
| CN109739352A (en) * | 2018-12-27 | 2019-05-10 | 斑马网络技术有限公司 | The methods of exhibiting and equipment of Land-scape picture |
| CN111951454A (en) * | 2020-10-16 | 2020-11-17 | 兰和科技（深圳）有限公司 | Fingerprint biological identification unlocking device of intelligent access control and judgment method thereof |
| CN112455327A (en) * | 2020-12-03 | 2021-03-09 | 上海汽车集团股份有限公司 | Vehicle lamp control method and device and computer readable storage medium |
| CN113492756A (en) * | 2021-07-01 | 2021-10-12 | 中汽创智科技有限公司 | Method, device, equipment and storage medium for displaying vehicle external information |
| WO2023206590A1 (en) * | 2022-04-30 | 2023-11-02 | 华为技术有限公司 | Interaction method and electronic device |
| EP4421614A1 (en) * | 2023-02-27 | 2024-08-28 | Bayerische Motoren Werke Aktiengesellschaft | Data processing device and method for providing a video to a passenger of a vehicle |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB0914174D0 (en) * | 2009-08-13 | 2009-09-16 | Light Blue Optics Ltd | Head up displays |
| CN103838378A (en) * | 2014-03-13 | 2014-06-04 | 广东石油化工学院 | Head wearing type eye control system based on pupil recognition positioning |
| US20140267402A1 (en) * | 2013-03-15 | 2014-09-18 | Honda Motor Co., Ltd. | Volumetric heads-up display with dynamic focal plane |
| CN104260669A (en) * | 2014-09-17 | 2015-01-07 | 北京理工大学 | Intelligent vehicle head-up display |
| CN205049814U (en) * | 2015-10-10 | 2016-02-24 | 青岛歌尔声学科技有限公司 | On -vehicle new line display terminal |
| CN105425967A (en) * | 2015-12-16 | 2016-03-23 | 中国科学院西安光学精密机械研究所 | Sight tracking and human eye region-of-interest positioning system |
| CN105739705A (en) * | 2016-02-04 | 2016-07-06 | 重庆邮电大学 | Human-eye control method and apparatus for vehicle-mounted system |
| CN105829938A (en) * | 2013-12-05 | 2016-08-03 | 罗伯特·博世有限公司 | Arrangement For Creating An Image Of A Scene |
| CN106155290A (en) * | 2014-11-06 | 2016-11-23 | 现代自动车株式会社 | Utilize the menu setecting equipment of Eye-controlling focus |
-
2017
- 2017-07-04 CN CN201710539990.XA patent/CN107380064B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB0914174D0 (en) * | 2009-08-13 | 2009-09-16 | Light Blue Optics Ltd | Head up displays |
| US20140267402A1 (en) * | 2013-03-15 | 2014-09-18 | Honda Motor Co., Ltd. | Volumetric heads-up display with dynamic focal plane |
| CN105829938A (en) * | 2013-12-05 | 2016-08-03 | 罗伯特·博世有限公司 | Arrangement For Creating An Image Of A Scene |
| CN103838378A (en) * | 2014-03-13 | 2014-06-04 | 广东石油化工学院 | Head wearing type eye control system based on pupil recognition positioning |
| CN104260669A (en) * | 2014-09-17 | 2015-01-07 | 北京理工大学 | Intelligent vehicle head-up display |
| CN106155290A (en) * | 2014-11-06 | 2016-11-23 | 现代自动车株式会社 | Utilize the menu setecting equipment of Eye-controlling focus |
| CN205049814U (en) * | 2015-10-10 | 2016-02-24 | 青岛歌尔声学科技有限公司 | On -vehicle new line display terminal |
| CN105425967A (en) * | 2015-12-16 | 2016-03-23 | 中国科学院西安光学精密机械研究所 | Sight tracking and human eye region-of-interest positioning system |
| CN105739705A (en) * | 2016-02-04 | 2016-07-06 | 重庆邮电大学 | Human-eye control method and apparatus for vehicle-mounted system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109191587A (en) * | 2018-08-23 | 2019-01-11 | 百度在线网络技术（北京）有限公司 | Color identification method, device, electronic equipment and storage medium |
| CN109191587B (en) * | 2018-08-23 | 2019-12-31 | 百度在线网络技术（北京）有限公司 | Color recognition method and device, electronic equipment and storage medium |
| CN109739352A (en) * | 2018-12-27 | 2019-05-10 | 斑马网络技术有限公司 | The methods of exhibiting and equipment of Land-scape picture |
| CN111951454A (en) * | 2020-10-16 | 2020-11-17 | 兰和科技（深圳）有限公司 | Fingerprint biological identification unlocking device of intelligent access control and judgment method thereof |
| CN111951454B (en) * | 2020-10-16 | 2021-01-05 | 兰和科技（深圳）有限公司 | Fingerprint biological identification unlocking device of intelligent access control and judgment method thereof |
| CN112455327A (en) * | 2020-12-03 | 2021-03-09 | 上海汽车集团股份有限公司 | Vehicle lamp control method and device and computer readable storage medium |
| CN113492756A (en) * | 2021-07-01 | 2021-10-12 | 中汽创智科技有限公司 | Method, device, equipment and storage medium for displaying vehicle external information |
| WO2023206590A1 (en) * | 2022-04-30 | 2023-11-02 | 华为技术有限公司 | Interaction method and electronic device |
| EP4421614A1 (en) * | 2023-02-27 | 2024-08-28 | Bayerische Motoren Werke Aktiengesellschaft | Data processing device and method for providing a video to a passenger of a vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107380064B (en) | 2022-08-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107380064A (en) | A kind of vehicle-mounted Eye-controlling focus device based on augmented reality | |
| US20210357670A1 (en) | Driver Attention Detection Method | |
| US10528837B1 (en) | Training of vehicles to improve autonomous capabilities | |
| US10926773B2 (en) | Systems and methods for mitigating motion sickness in a vehicle | |
| US10037699B1 (en) | Systems and methods for motivating a driver according to behaviors of nearby vehicles | |
| CN103010099B (en) | Multidate information display on full blast gear head-up display | |
| JP2019533209A (en) | System and method for driver monitoring | |
| CN110703904B (en) | Visual line tracking-based augmented virtual reality projection method and system | |
| AU2024202759A1 (en) | Autonomous Vehicles and Advanced Driver Assistance | |
| KR20220004754A (en) | Neural Networks for Head Pose and Gaze Estimation Using Photorealistic Synthetic Data | |
| CN110826369A (en) | Driver attention detection method and system during driving | |
| WO2015134840A2 (en) | Vehicular visual information system and method | |
| JP2019195377A (en) | Data processing device, monitoring system, awakening system, data processing method, and data processing program | |
| Tayibnapis et al. | Driver's gaze zone estimation by transfer learning | |
| CN112789020B (en) | Visualization method and system for intelligent wheelchair | |
| AU2018267541A1 (en) | Systems and methods of training vehicles | |
| AU2018267553B2 (en) | Systems and methods to train vehicles | |
| CN110825216A (en) | Method and system for man-machine interaction of driver during driving | |
| JP7099036B2 (en) | Data processing equipment, monitoring system, awakening system, data processing method, and data processing program | |
| JP4345526B2 (en) | Object monitoring device | |
| JP2021162542A (en) | Driving support device and data collection system | |
| JP2019066191A (en) | Information processing device | |
| JP2022142553A (en) | Image display control device, image display control method and program | |
| CN114419721A (en) | Interest point information feedback method, medium, device and system based on eyeball identification | |
| CN115767249A (en) | Photographing method, electronic equipment and vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |