CN112918337A - Intelligent cabin adjusting system and method for identifying eye position - Google Patents
Intelligent cabin adjusting system and method for identifying eye position Download PDFInfo
- Publication number
- CN112918337A CN112918337A CN202110362380.3A CN202110362380A CN112918337A CN 112918337 A CN112918337 A CN 112918337A CN 202110362380 A CN202110362380 A CN 202110362380A CN 112918337 A CN112918337 A CN 112918337A
- Authority
- CN
- China
- Prior art keywords
- driver
- rearview mirror
- eye
- human
- human body
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 17
- 210000001508 eye Anatomy 0.000 claims abstract description 84
- 210000005252 bulbus oculi Anatomy 0.000 claims abstract description 20
- 230000035945 sensitivity Effects 0.000 claims description 6
- 238000013473 artificial intelligence Methods 0.000 claims description 5
- 238000011217 control strategy Methods 0.000 claims description 2
- 230000006835 compression Effects 0.000 claims 1
- 238000007906 compression Methods 0.000 claims 1
- 230000008569 process Effects 0.000 abstract description 7
- 230000008859 change Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 3
- 238000005265 energy consumption Methods 0.000 description 2
- 230000003750 conditioning effect Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006386 memory function Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60N2/00—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
- B60N2/02—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles the seat or part thereof being movable, e.g. adjustable
- B60N2/0224—Non-manual adjustments, e.g. with electrical operation
- B60N2/0244—Non-manual adjustments, e.g. with electrical operation with logic circuits
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60N2/00—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
- B60N2/02—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles the seat or part thereof being movable, e.g. adjustable
- B60N2/0224—Non-manual adjustments, e.g. with electrical operation
- B60N2/0244—Non-manual adjustments, e.g. with electrical operation with logic circuits
- B60N2/0268—Non-manual adjustments, e.g. with electrical operation with logic circuits using sensors or detectors for adapting the seat or seat part, e.g. to the position of an occupant
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/02—Rear-view mirror arrangements
- B60R1/04—Rear-view mirror arrangements mounted inside vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/02—Rear-view mirror arrangements
- B60R1/06—Rear-view mirror arrangements mounted on vehicle exterior
- B60R1/062—Rear-view mirror arrangements mounted on vehicle exterior with remote control for adjusting position
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Mechanical Engineering (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Aviation & Aerospace Engineering (AREA)
- Transportation (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Ophthalmology & Optometry (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
- Rear-View Mirror Devices That Are Mounted On The Exterior Of The Vehicle (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses an intelligent cockpit adjusting system and method for identifying eye positions, wherein the system comprises the following steps: human feature recognition camera: the system is arranged outside the vehicle and used for acquiring the whole body image of the driver; a DMS camera: the system is arranged in the vehicle and is used for acquiring a face image of a driver; an image processing module: the human body structure model recognition system is used for recognizing a whole body image and a face image of a driver and outputting human body structure model data and eyeball position data of the driver; a storage module: the human body characteristic identification camera and the DMS camera are used for acquiring data and preset human-machine engineering model data; a system controller: the human body structure model data and the eyeball position data of the driver are respectively input into the human-machine engineering model to obtain a seat control instruction and a rearview mirror adjusting instruction, and the seat, the outer rearview mirror and the inner rearview mirror are respectively controlled to be automatically adjusted according to the instructions. The invention ensures that the driver is always in the position with optimal ergonomics and optimal view during the driving process.
Description
Technical Field
The invention relates to the technical field of vehicle cabin regulation and control, in particular to an intelligent cabin regulation system and method for recognizing eye positions.
Background
Many drivers 'seats, left and right rear-view mirrors and interior rear-view mirrors are not adjusted completely to the best position for the driver's comfort and the field of vision. Meanwhile, in the driving process or different driving scenes, the sitting posture of the driver can be changed, and at the moment, because the rearview mirrors are not adjusted correspondingly in time, the blind area appears in the visual field of the driver, and then the vehicle or the pedestrian can be possibly damaged. Meanwhile, different drivers need to reset the positions of the seat and the rearview mirror, and the operation is complicated.
In the prior art, chinese patent "automatic adjustment method for a vehicle rearview mirror, automatic adjustment system for a rearview mirror, and vehicle" (application number: CN 103507718A) discloses an automatic adjustment method for a vehicle rearview mirror, which includes photographing a self-image of a driver's face and determining a position of a driver's eyes in a vehicle body coordinate system, determining observation positions of a left side rearview mirror and a right side rearview mirror to be adjusted according to the positions of the driver's eyes in the vehicle body coordinate system, and further adjusting the left side rearview mirror and the right side rearview mirror to the observation positions to be adjusted; however, the large change of the eye position of the driver in a short time causes interference to the system.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides an intelligent cockpit adjusting system and method for recognizing the eye position, so that a driver is always in the position with optimal ergonomics and optimal visual field in the driving process.
In order to achieve the above object, the present invention provides an intelligent cockpit regulating system for identifying eye position, which is characterized in that the system comprises:
human feature recognition camera: the system is arranged outside the vehicle and used for acquiring the whole body image of the driver;
a DMS camera: the system is arranged in the vehicle and is used for acquiring a face image of a driver;
an image processing module: the human body structure model recognition system is used for recognizing a whole body image and a face image of a driver and outputting human body structure model data and eyeball position data of the driver;
a storage module: the human body characteristic identification camera and the DMS camera are used for acquiring data and preset human-machine engineering model data;
a system controller: the human body structure model data and the eyeball position data of the driver are respectively input into the human-machine engineering model to obtain a seat control instruction and a rearview mirror adjusting instruction, and the seat, the outer rearview mirror and the inner rearview mirror are respectively controlled to be automatically adjusted according to the instructions.
Further, the image processing module performs distortion correction on the whole-body image of the driver by stretching, compressing and cutting pixel points, restores human body image data, obtains the positions of the legs and the arms of the driver in the image by adopting an AI (artificial intelligence) recognition algorithm, and calculates the height, the leg length and the arm length of the driver.
Further, it is characterized in that: the human body feature recognition camera is installed above a B column outside the vehicle, and the DMS camera is installed on the inner side of an A column of the vehicle.
Still further, the ergonomic model data of the storage module includes a seat ergonomic model and a rearview mirror ergonomic model.
Further, the seat ergonomic model is used to output the matched spatial position coordinates of the driver's seat based on the driver's height, leg length, and arm length.
Further, the rear view mirror ergonomic model is used to output the best position coordinates of the matched rear view mirror according to the eyeball position.
Furthermore, in the rearview mirror ergonomic model, a human eye enveloping space is calculated according to the eyeball position of a driver, the human eye enveloping space is divided into N parts of areas, the center of each part of area is selected as a reference point, and the optimal position coordinate of the rearview mirror is set for each reference point.
Furthermore, the system controller calls a rearview mirror ergonomic model, inputs the eyeball position of the driver to obtain the position of the eye of the driver in the sub-area of the human eye envelope space, and outputs a corresponding control instruction to adjust the outer rearview mirror and the inner rearview mirror to the corresponding positions; if the position information of the eyes of the driver monitored next time is in the same sub-area as the position information of the eyes monitored last time, the system controller does not output any instruction, and the external rearview mirror and the internal rearview mirror do not respond.
Furthermore, the human eye envelope space is divided into N, 2N and 3N sub-regions, N is a natural number which is not zero, and the three regions respectively correspond to control strategies of which the sensitivity of the system controller is from high to low.
The invention also provides an intelligent cockpit adjusting method for identifying the eye position, which is based on the intelligent cockpit adjusting system for identifying the eye position, and is characterized by comprising the following specific steps:
1) the human body feature recognition camera collects a whole-body image of the driver, and the image processing module recognizes the whole-body image of the driver and outputs human body structure model data of the driver;
2) inputting human body structure model data of a driver of the system controller into an ergonomic model to obtain a seat control instruction rearview mirror adjusting instruction, and controlling the seat to automatically adjust according to the instruction;
3) the DMS camera collects a face image of a driver, identifies the face image of the driver and outputs eyeball position data of the driver;
4) the system controller respectively inputs eyeball position data of a driver into the human-machine engineering model to obtain a rearview mirror adjusting instruction, and controls the outer rearview mirror and the inner rearview mirror to automatically adjust according to the instruction.
The invention has the advantages that:
1. the invention can automatically adjust the seat by identifying the human body structure characteristics and the eye position of the driver, efficiently and energy-saving adjusts the angle of the rearview mirror in real time, ensures that the driver is always in the position with optimal ergonomics and optimal visual field in the driving process, and avoids the possibility of accidents to the maximum extent.
2. As the eye position of the same driver can also change in the driving process, the invention identifies the eye position of the driver by the DMS camera 6, thereby automatically adjusting the outer rearview mirror and the inner rearview mirror. This system carries out the secondary optimization through seat and rear-view mirror position, and furthest guarantees driver's comfort level and driving safety nature.
3. The invention adjusts the seat position through the human-computer engineering example, is suitable for any temporary user, and can call the stored specific user data by identifying the ID of the driver.
4. According to the invention, the human eye envelope space is subjected to partition management, and rearview mirror information corresponding to each sub-area is stored in the storage module; the rearview mirror can be adjusted by directly calling data through monitoring the positions of human eyes, so that the calculated amount of the system in operation is greatly reduced.
5. The invention does not need to adjust the rearview mirror in real time by tracking the eye position, and can avoid the practical problems of uncomfortable feeling of the driver, high energy consumption of the system, high failure risk rate under high-strength working load of the adjusting mechanism and the like caused by continuous adjustment of the rearview mirror along with the change of the spatial position of the eyes of the driver.
6. The invention divides the sub-areas of the human eye enveloping space differently, can realize different adjusting precision of the rearview mirror, and meets the individual requirements of different drivers.
7. The invention carries out time delay processing on the system, can further reduce the workload of the system, and more importantly can shield the common interference problem and enhance the practicability of the system.
Drawings
FIG. 1 is a block diagram of a system flow.
Fig. 2 is a schematic diagram of automatic seat adjustment.
Fig. 3 is a schematic diagram of automatic adjustment of the rearview mirror.
Fig. 4 is a schematic diagram of the human eye enveloping the subareas.
In the figure: the system comprises a driver eye 1, a human body feature recognition camera 2, a system controller 3, an image processing module 4, a seat 5, a DMS camera 6, a storage module 7, an external rear view mirror 8, an internal rear view mirror 9, a human eye enveloping space 10 and a vehicle B column 12.
Detailed Description
The invention is described in further detail below with reference to the figures and specific embodiments.
Example 1
The invention provides an intelligent cabin adjusting system for identifying eye positions, which mainly comprises two subsystems, namely a seat automatic adjusting module and a rearview mirror automatic adjusting module, and the functional block diagram of the system is shown in figure 1. The system comprises a human body feature recognition camera 2, a system controller 3, an image processing module 4, a seat 5, a DMS camera 6, a storage module 7, an external rear view mirror 8 and an internal rear view mirror 9. The operation of the system is briefly described below with reference to fig. 1.
Human body feature recognition camera 2: the system is arranged outside the vehicle and used for acquiring the whole body image of the driver;
DMS camera 6: the system is arranged in the vehicle and is used for acquiring a face image of a driver;
the image processing module 4: the human body structure model recognition system is used for recognizing a whole body image and a face image of a driver and outputting human body structure model data and eyeball position data of the driver;
the storage module 7: the human body characteristic identification camera 2 is used for acquiring human body characteristic identification data and human body characteristic identification data acquired by the DMS camera 6;
the system controller 3: the human body structure model data and the eyeball position data of the driver are respectively input into the human-machine engineering model to obtain a seat control instruction and a rearview mirror adjusting instruction, and the seat 5, the outer rearview mirror 8 and the inner rearview mirror 9 are respectively controlled to automatically adjust according to the instructions.
As shown in fig. 2, the system continuously records the whole image of the driver through the human body feature recognition camera 2 installed on the outer side of the vehicle B-pillar 12, and in order to ensure that the driver can acquire the whole body image information of the driver both in the range of approaching the vehicle door and in the range of 3m away from the vehicle door, the human body feature recognition camera 2 is required to be a fish-eye camera with an ultra-wide angle (the vertical field angle is larger than 180 degrees); because the input image has serious distortion, the image processing module performs distortion correction on the image in modes of stretching, compressing, cutting and the like on pixel points to restore human body image data; important human body characteristic parameters such as legs, arms and the like in the image can be identified through an AI identification technology, so that the actual skeleton data such as the height, the leg length and the like of the driver are obtained; according to different vehicle types, different seat ergonomic models can be output by a host factory, and corresponding seat ergonomic models can be obtained by inputting human body structure model data of a driver to the system controller 3, so that the spatial position coordinates of the seat 5 can be obtained according to ergonomic example results. And outputting a control command to the seat 5, the outside rear view mirror 8 and the inside rear view mirror 9 according to the spatial position coordinate of the seat 5, and adjusting the seat 5, the outside rear view mirror 8 and the inside rear view mirror 9 to the position where the ergonomics of the driver is optimal.
After a driver is in a driving position, the positions of eyes are monitored through the DMS camera 6 on the inner side of the A column, and according to the rearview mirror ergonomic model, in an eyeball enveloping range, each eyeball position corresponds to the optimal position of one rearview mirror in order to achieve the optimal view of the driver. This corresponding position data is stored in the memory module. After monitoring the human eye position data, the system controller 3 will call the data in the storage module 7 to obtain the corresponding spatial coordinate positions of the exterior mirror 8 and the interior mirror 9, thereby outputting a control instruction to the exterior mirror 8 and the interior mirror 9 to adjust the exterior mirror 8 and the interior mirror 9 to the state of the best view of the driver. And in the driving process, real-time automatic adjustment can be realized.
Example 2:
the present embodiment is different from embodiment 1 in that the automatic adjustment function of the seat 5 in the present system is applicable to any temporary user without the need of a memory function of the seat 5, without the need of identifying the driver's ID, and by the driver's entire image, the stored seat ergonomic model data corresponding to the driver can be called up to be adjusted to the optimal position of the seat of the driver.
Example 3:
according to the ergonomic model, in order to achieve the optimal field of view for the driver, each eye position point in the human eye envelope space 10 corresponds to a spatial position coordinate of the exterior mirror 8 and the interior mirror 9. In the actual driving process, the spatial position of the eyes 1 of the driver is changed in real time, for example, in the early stage of driving, the driver keeps straight with both backs and holds the steering wheel with both hands, and after a period of time, the driver leans against the backrest and holds the steering wheel with one hand, and at the moment, the spatial position of the eyes of the driver is greatly changed. But most of the time the driver's body is slightly shaken and the eye position actually changes within a small range. The rearview mirror adjusting device aims to avoid the practical problems that the rearview mirror is continuously adjusted along with the change of the spatial position of the eyes 1 of the driver, so that the driver feels uncomfortable, the system is high in energy consumption, the mechanism is high in failure risk rate under high-strength working load, and the like.
In this embodiment, the human eye envelope space 10 is partitioned.
The human eye envelope space 10 is divided into N sub-regions, the central point of each sub-region is taken and input into the human-machine engineering example, and the position information of the outer rearview mirror 8 and the inner rearview mirror 9 matched with the central point can be obtained. The N pieces of position information are all stored in the storage module B7.
The image information of the eye 1 of the driver is collected by a DMS camera installed at the a-pillar inner panel, the image information is transferred into the system controller 3, and the relative positions of the eye 1 and the DMS camera 6 are calculated. It can be found which sub-region of the human eye envelope space 10 the driver's eye 1 is in, the corresponding information in the storage module B7 is called, and the corresponding control instruction is output to the exterior mirror 8 and the interior mirror 9, so that the driver's eye 1 is adjusted to the corresponding position. If the position information of the eye 1 of the driver is monitored next time and the position information is in the same sub-area as the position information of the eye 1 of the driver is monitored last time, the system controller 3 does not output any instruction, and the external rear view mirror 8 and the internal rear view mirror 9 do not respond.
Example 4:
in order to increase the practicability of the system, the technical scheme of the implementation carries out time delay processing on the system. For example, when the driver looks outside the window for a short time, the eye position changes greatly for a short time and then returns, and the adjustment of the rearview mirror is not necessary. The system is delayed for such cases. The time interval for the system to normally monitor the positions of the human eyes is 30S, as shown in fig. 4, if the human eyes are monitored in the area a at the last moment and in the area b at the next moment, at this time, the MCU3 will not immediately send a control command to the exterior mirror 8 and the interior mirror 9, but will monitor the positions of the human eyes again after 5S. If the human eyes are in the area a at the moment, the MCU3 does not send a control instruction, and the monitoring time interval returns to 30S again; if the eyes are in the b area at this time, control commands are sent to the outside rear view mirror 8 and the inside rear view mirror 9. So that it is adjusted to the corresponding position.
Example 5:
the technical scheme of the embodiment can set the automatic adjustment precision of the outer rearview mirror 8 and the inner rearview mirror 9 on the premise that the visual field can meet the driving safety in order to pursue personalized setting and meet different driving habits of a driver.
The human eye envelope space 10 is divided into N sub-regions of a, b, c, … and N equally, the central point coordinate of each sub-region is input into an ergonomic model, the position information of the external rearview mirror 8 and the internal rearview mirror 9 matched with the sub-regions can be obtained, and the corresponding information is stored in the storage module 7 a; dividing the human eye envelope space 10 into N/2 sub-regions (a, b), (c, …), (N), and storing the position information of the outer mirror 8 and the inner mirror 9 corresponding to the center point coordinate of each sub-region in the storage module 7 b; the human eye envelope space 10 is divided equally into N/3 sub-regions of (a, b, c), …, (, N), and the position information of the exterior mirror 8 and the interior mirror 9 corresponding to the coordinates of the center point of each sub-region is stored in the storage module 7 c.
When the driver sets the adjustment accuracy to be high, the DMS camera 6 sends the face image to the system controller 3, the system controller 3 reads the characteristics of the human eye 1 and inputs the characteristics into the human-computer engineering model to obtain the space coordinate position of the human eye 1. At this time, the system controller 3 automatically retrieves the data in the memory module B7a, for example, as shown in fig. 3, the system starts the pre-conditioning mechanism when the eye 1 is located in the area a at the previous time and the eye 1 is located outside the area a at the next time. The sensitivity of the exterior mirror 8 and the interior mirror 9 is then the highest with respect to the change in the range of positions of the human eye 1. When the driver sets the accuracy of the adjustment to medium, the system controller 3 automatically retrieves the data in the memory module B7B, for example, as shown in fig. 3, and the system starts the pre-adjustment mechanism when the eye 1 position is in the (a, B) region at the previous time and the eye 1 position is out of the (a, B) region at the next time. The sensitivity of the outer rearview mirror 8 and the inner rearview mirror 9 along with the change of the position range of the human eyes 1 is moderate; when the driver sets the accuracy of the adjustment to be low, the system controller 3 automatically retrieves the data in the memory module B7c, for example, as shown in fig. 3, and the system starts the preconditioning mechanism when the eye 1 position is in the (a, B, c) region at the previous time and the eye 1 position is out of the (a, B, c) region at the next time. The sensitivity of the exterior mirror 8 and the interior mirror 9 to changes in the range of positions of the human eye 1 is now at its lowest.
Finally, it should be noted that the above detailed description is only for illustrating the technical solution of the patent and not for limiting, although the patent is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that the technical solution of the patent can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the patent, which should be covered by the claims of the patent.
Claims (10)
1. The utility model provides an intelligence passenger cabin governing system of discernment eye position which characterized in that: the system comprises:
human body characteristic identification camera (2): the system is arranged outside the vehicle and used for acquiring the whole body image of the driver;
DMS camera (6): the system is arranged in the vehicle and is used for acquiring a face image of a driver;
image processing module (4): the human body structure model recognition system is used for recognizing a whole body image and a face image of a driver and outputting human body structure model data and eyeball position data of the driver;
storage module (7): the human body characteristic identification camera (2) and the DMS camera (6) are used for collecting data and preset human-machine engineering model data;
system controller (3): the human body structure model data and the eyeball position data of the driver are respectively input into the human-machine engineering model to obtain a seat control instruction and a rearview mirror adjusting instruction, and the seat (5), the outer rearview mirror (8) and the inner rearview mirror (9) are respectively controlled to automatically adjust according to the instructions.
2. The intelligent cockpit modulation system of identifying an eye location of claim 1 wherein: the image processing module is used for carrying out distortion correction on the whole-body image of the driver by carrying out stretching, compression and cutting on pixel points, restoring human body image data, obtaining the positions of legs and arms of the driver in the image by adopting an AI (artificial intelligence) recognition algorithm, and calculating the height, the length of the legs and the length of the arms of the driver.
3. The intelligent cockpit modulation system of identifying an eye location of claim 1 wherein: the human body feature recognition camera (2) is installed above a vehicle B column (12), and the DMS camera (6) is installed on the inner side of a vehicle A column.
4. The intelligent cockpit modulation system of identifying an eye location of claim 1 wherein: the ergonomic model data of the storage module (7) comprises a seat ergonomic model and a rear view mirror ergonomic model.
5. The intelligent cockpit modulation system of identifying an eye location of claim 4 wherein: the seat ergonomic model is used for outputting the matched spatial position coordinates of the driver seat (5) according to the height, the leg length and the arm length of the driver.
6. The intelligent cockpit modulation system of identifying an eye location of claim 4 wherein: the rearview mirror ergonomic model is used for outputting the matched optimal position coordinates of the rearview mirror according to the eyeball position.
7. The intelligent cockpit modulation system of identifying an eye location of claim 6 wherein: in the rearview mirror ergonomic model, a human eye enveloping space (10) is calculated according to the eyeball position of a driver, the human eye enveloping space (10) is divided into N parts of areas, the center of each part of area is selected as a reference point, and the optimal position coordinate of a rearview mirror is set for each reference point.
8. The intelligent cockpit modulation system of identifying an eye location of claim 1 wherein: the system controller (3) calls a rearview mirror ergonomic model, inputs the eyeball position of the driver to obtain the position of the eye part (1) of the driver in a subregion of the human eye envelope space (10), and outputs a corresponding control instruction to the outer rearview mirror (8) and the inner rearview mirror (9) to adjust to the corresponding positions; if the position information of the eye (1) of the driver monitored next time is in the same sub-area as the position information of the eye monitored last time, the system controller (3) does not output any instruction, and the external rearview mirror (8) and the internal rearview mirror (9) do not respond.
9. The intelligent cockpit modulation system of claim 8 where the eye location is identified by: the human eye enveloping space (10) is divided into N, 2N and 3N sub-regions, N is a natural number which is not zero, and the three regions respectively correspond to control strategies of the system controller (3) from high sensitivity to low sensitivity.
10. An intelligent cabin adjusting method for identifying eye positions is characterized in that: the method is realized based on the intelligent cabin adjusting system for identifying the eye position according to any one of claims 1-9, and comprises the following specific steps:
1) the human body feature recognition camera (2) collects a whole-body image of the driver, the image processing module (4) recognizes the whole-body image of the driver and outputs human body structure model data of the driver;
2) the system controller (3) inputs the human body structure model data of a driver into an ergonomic model to obtain a seat control instruction rearview mirror adjusting instruction, and controls the seat (5) to automatically adjust according to the instruction;
3) the DMS camera (6) collects a face image of a driver, identifies the face image of the driver and outputs eyeball position data of the driver;
4) the system controller (3) respectively inputs eyeball position data of a driver into the human-machine engineering model to obtain a rearview mirror adjusting instruction, and controls the outer rearview mirror (8) and the inner rearview mirror (9) to automatically adjust according to the instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110362380.3A CN112918337A (en) | 2021-04-02 | 2021-04-02 | Intelligent cabin adjusting system and method for identifying eye position |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110362380.3A CN112918337A (en) | 2021-04-02 | 2021-04-02 | Intelligent cabin adjusting system and method for identifying eye position |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112918337A true CN112918337A (en) | 2021-06-08 |
Family
ID=76174013
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110362380.3A Pending CN112918337A (en) | 2021-04-02 | 2021-04-02 | Intelligent cabin adjusting system and method for identifying eye position |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112918337A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113525390A (en) * | 2021-09-13 | 2021-10-22 | 深圳市同进视讯技术有限公司 | Linkage control method and system for vehicle-mounted equipment of new energy automobile |
| CN113547985A (en) * | 2021-07-13 | 2021-10-26 | 一汽奔腾轿车有限公司 | Control method for adaptively adjusting position of external rearview mirror based on human body model memory |
| CN113602196A (en) * | 2021-08-25 | 2021-11-05 | 东风汽车集团股份有限公司 | Display system and method for perspective A column and peripheral area |
| CN113602198A (en) * | 2021-08-03 | 2021-11-05 | 深圳市智慧联芯科技有限公司 | Vehicle rearview mirror adjusting method and device, storage medium and computer equipment |
| CN113665440A (en) * | 2021-08-31 | 2021-11-19 | 东风汽车集团股份有限公司 | Self-adaptive riding space adjusting system and method |
| CN113665487A (en) * | 2021-07-21 | 2021-11-19 | 云度新能源汽车有限公司 | Method and system for adjusting rearview mirror |
| CN115195548A (en) * | 2022-07-04 | 2022-10-18 | 上海中联重科桩工机械有限公司 | Seat adjusting method and seat adjusting device |
| CN115352386A (en) * | 2022-08-31 | 2022-11-18 | 中国第一汽车股份有限公司 | Seat position matching system, method and device, terminal and storage medium |
| GB2609052A (en) * | 2021-07-19 | 2023-01-25 | Motional Ad Llc | Automatically adjusting a vehicle seating area based on the characteristics of a passenger |
| CN118144711A (en) * | 2024-05-10 | 2024-06-07 | 安徽博微智能电气有限公司 | Following type cockpit adjusting method and device |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102582473A (en) * | 2012-03-06 | 2012-07-18 | 浙江吉利汽车研究院有限公司 | Automatic driving sitting position adjusting device and method |
| CN104670382A (en) * | 2013-11-27 | 2015-06-03 | 纬创资通股份有限公司 | rearview mirror control system and method |
| CN105128773A (en) * | 2015-08-07 | 2015-12-09 | 浙江工业职业技术学院 | Driving visual field automatic regulating system |
| CN105835779A (en) * | 2016-04-26 | 2016-08-10 | 乐视控股（北京）有限公司 | Automobile rearview mirror adjusting device and method as well as automobile |
| CN108657029A (en) * | 2018-05-17 | 2018-10-16 | 华南理工大学 | A kind of driver's seat seat intelligent regulating system and method based on limbs length prediction |
| CN208149176U (en) * | 2018-03-02 | 2018-11-27 | 安徽江淮汽车集团股份有限公司 | Rearview mirror adjustment system based on Ins location |
| CN109421599A (en) * | 2017-08-24 | 2019-03-05 | 长城汽车股份有限公司 | A kind of the inside rear-view mirror adjusting method and device of vehicle |
| CN208774693U (en) * | 2018-06-06 | 2019-04-23 | 威马智慧出行科技（上海）有限公司 | Vehicle driving posture adjusting device and automobile including it |
| CN110466457A (en) * | 2019-08-26 | 2019-11-19 | 戴姆勒股份公司 | Vehicle Automatic adjustment method |
| CN110588551A (en) * | 2019-09-26 | 2019-12-20 | 上海赫千电子科技有限公司 | Automatic adjustment method and automatic adjustment device for vehicle-mounted personalization of user based on feature recognition |
| CN112046428A (en) * | 2020-09-14 | 2020-12-08 | 上海博泰悦臻网络技术服务有限公司 | Vehicle, control method and device for adjusting driving seat and rearview mirror |
| CN112572296A (en) * | 2020-12-17 | 2021-03-30 | 的卢技术有限公司 | Auxiliary system of AR-HUD intelligent rearview system and use method thereof |
-
2021
- 2021-04-02 CN CN202110362380.3A patent/CN112918337A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102582473A (en) * | 2012-03-06 | 2012-07-18 | 浙江吉利汽车研究院有限公司 | Automatic driving sitting position adjusting device and method |
| CN104670382A (en) * | 2013-11-27 | 2015-06-03 | 纬创资通股份有限公司 | rearview mirror control system and method |
| CN105128773A (en) * | 2015-08-07 | 2015-12-09 | 浙江工业职业技术学院 | Driving visual field automatic regulating system |
| CN105835779A (en) * | 2016-04-26 | 2016-08-10 | 乐视控股（北京）有限公司 | Automobile rearview mirror adjusting device and method as well as automobile |
| CN109421599A (en) * | 2017-08-24 | 2019-03-05 | 长城汽车股份有限公司 | A kind of the inside rear-view mirror adjusting method and device of vehicle |
| CN208149176U (en) * | 2018-03-02 | 2018-11-27 | 安徽江淮汽车集团股份有限公司 | Rearview mirror adjustment system based on Ins location |
| CN108657029A (en) * | 2018-05-17 | 2018-10-16 | 华南理工大学 | A kind of driver's seat seat intelligent regulating system and method based on limbs length prediction |
| CN208774693U (en) * | 2018-06-06 | 2019-04-23 | 威马智慧出行科技（上海）有限公司 | Vehicle driving posture adjusting device and automobile including it |
| CN110466457A (en) * | 2019-08-26 | 2019-11-19 | 戴姆勒股份公司 | Vehicle Automatic adjustment method |
| CN110588551A (en) * | 2019-09-26 | 2019-12-20 | 上海赫千电子科技有限公司 | Automatic adjustment method and automatic adjustment device for vehicle-mounted personalization of user based on feature recognition |
| CN112046428A (en) * | 2020-09-14 | 2020-12-08 | 上海博泰悦臻网络技术服务有限公司 | Vehicle, control method and device for adjusting driving seat and rearview mirror |
| CN112572296A (en) * | 2020-12-17 | 2021-03-30 | 的卢技术有限公司 | Auxiliary system of AR-HUD intelligent rearview system and use method thereof |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113547985A (en) * | 2021-07-13 | 2021-10-26 | 一汽奔腾轿车有限公司 | Control method for adaptively adjusting position of external rearview mirror based on human body model memory |
| GB2609052B (en) * | 2021-07-19 | 2023-10-11 | Motional Ad Llc | Automatically adjusting a vehicle seating area based on the characteristics of a passenger |
| GB2609052A (en) * | 2021-07-19 | 2023-01-25 | Motional Ad Llc | Automatically adjusting a vehicle seating area based on the characteristics of a passenger |
| CN113665487A (en) * | 2021-07-21 | 2021-11-19 | 云度新能源汽车有限公司 | Method and system for adjusting rearview mirror |
| CN113665487B (en) * | 2021-07-21 | 2024-03-01 | 云度新能源汽车有限公司 | Method and system for adjusting rearview mirror |
| CN113602198A (en) * | 2021-08-03 | 2021-11-05 | 深圳市智慧联芯科技有限公司 | Vehicle rearview mirror adjusting method and device, storage medium and computer equipment |
| CN113602198B (en) * | 2021-08-03 | 2023-09-29 | 深圳市智慧联芯科技有限公司 | Vehicle rearview mirror adjusting method and device, storage medium and computer equipment |
| CN113602196B (en) * | 2021-08-25 | 2023-10-17 | 东风汽车集团股份有限公司 | Display system and method for perspective A column and peripheral area |
| CN113602196A (en) * | 2021-08-25 | 2021-11-05 | 东风汽车集团股份有限公司 | Display system and method for perspective A column and peripheral area |
| CN113665440A (en) * | 2021-08-31 | 2021-11-19 | 东风汽车集团股份有限公司 | Self-adaptive riding space adjusting system and method |
| CN113525390B (en) * | 2021-09-13 | 2022-01-25 | 深圳市同进视讯技术有限公司 | Linkage control method and system for vehicle-mounted equipment of new energy automobile |
| CN113525390A (en) * | 2021-09-13 | 2021-10-22 | 深圳市同进视讯技术有限公司 | Linkage control method and system for vehicle-mounted equipment of new energy automobile |
| CN115195548A (en) * | 2022-07-04 | 2022-10-18 | 上海中联重科桩工机械有限公司 | Seat adjusting method and seat adjusting device |
| CN115352386A (en) * | 2022-08-31 | 2022-11-18 | 中国第一汽车股份有限公司 | Seat position matching system, method and device, terminal and storage medium |
| CN118144711A (en) * | 2024-05-10 | 2024-06-07 | 安徽博微智能电气有限公司 | Following type cockpit adjusting method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112918337A (en) | Intelligent cabin adjusting system and method for identifying eye position | |
| CN108657029B (en) | Intelligent automobile driver seat adjusting system and method based on limb length prediction | |
| CN109515361B (en) | Cabin adjustment system and vehicle | |
| CN103612632B (en) | The control method of driver behavior system and device | |
| EP4245609A1 (en) | Rear-view mirror control method and related device | |
| JP3228086B2 (en) | Driving operation assist device | |
| CN110239441A (en) | A kind of visual field automatic adjusting method and device of rearview mirror | |
| US20210380021A1 (en) | Seat Adjustment and Sensing System | |
| CN109334573A (en) | Adjusting method, device and the automobile of automobile outer rear-view mirror | |
| CN114506273B (en) | Method and system for adjusting field of view of electronic side rearview mirror | |
| CN111572308A (en) | Automobile cabin and temperature control method, system, equipment and storage medium thereof | |
| US20200348751A1 (en) | Display method | |
| CN106056094A (en) | Vehicle driving habit memory control system and method | |
| CN115649094B (en) | Intelligent control method for driving position, domain controller and related device | |
| CN115195540B (en) | Self-adaptive adjusting system and method for automobile seat | |
| CN116749881A (en) | Visual field blind area compensation method and system and storage medium | |
| CN115782794A (en) | Self-adaptive adjusting method and device for vehicle | |
| CN116039548A (en) | Automatic adjusting method and device for main driving seat and outer rearview mirror | |
| CN113085490A (en) | Intelligent air outlet system and method and vehicle | |
| CN117246199A (en) | Vehicle seat control method, device, electronic equipment and storage medium | |
| CN115891830A (en) | Self-adaptive adjusting method and system for inner rearview mirror | |
| CN114771434B (en) | Linkage control method and device for ceiling screen and seat and controller | |
| CN117360335A (en) | Vehicle adjusting method, system, device and storage medium | |
| CN115571051A (en) | Method and system for adjusting intelligent rearview mirror in vehicle | |
| CN118578838A (en) | In-vehicle environment adjustment method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210608 |