CN104679225B - Screen adjustment method, screen adjustment device and the mobile terminal of mobile terminal - Google Patents
Screen adjustment method, screen adjustment device and the mobile terminal of mobile terminal Download PDFInfo
- Publication number
- CN104679225B CN104679225B CN201310625751.8A CN201310625751A CN104679225B CN 104679225 B CN104679225 B CN 104679225B CN 201310625751 A CN201310625751 A CN 201310625751A CN 104679225 B CN104679225 B CN 104679225B
- Authority
- CN
- China
- Prior art keywords
- eyes
- user
- screen
- angle
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- User Interface Of Digital Computer (AREA)
- Eye Examination Apparatus (AREA)
Abstract
A kind of screen adjustment method of mobile terminal, screen adjustment device and mobile terminal.The screen adjustment method of the mobile terminal includes：Obtain the positional information of two eyes of user；The positive sight being projected to according to the horizontal line of positional information acquisition left eye to the right eye of two eyes on the screen of mobile terminal；Calculate the second angle between the first angle and the positive sight and the vertical coordinate axle of the mobile terminal between the positive sight and the horizontal axis of mobile terminal；The direction of rotation of screen is determined according to second angle, and the preset range according to residing for first angle determines the anglec of rotation of screen.Technical solution of the present invention can effectively adjust the display picture of screen according to the positional information of human eye, so that display picture is under the optimum visual state of human eye all the time, avoid the injury to eyes.
Description
Technical field
The present invention relates to mobile communication technology field, the screen adjustment method of more particularly to a kind of mobile terminal, screen are adjusted
Regulating device and mobile terminal.
Background technology
With the development and progress of technology, mobile terminal is increasingly favored by user, and people use mobile terminal
Time is increasingly longer, in some instances it may even be possible to can lie upon its side and be used, in order to preferably protect the eyes of user, existing mobile terminal
The rotation adjustment of most support screen.
Hand-held mobile terminal only has point of transverse screen (landscape) and portrait layout (portrait) mostly at present, and some should
The switching of horizontal/vertical screen is not supported even with program.Existing horizontal/vertical screen switching is realized using gravity sensor mostly, that is, is passed through
Monitor the coordinate data of gravity sensor and then the direction of Rotation screen.
However, not all situation is suitable for solving with gravity sensor, that is to say, that on-screen displays
Not necessarily there is absolute relation in direction with centrifugal force direction, such as when user side lies down viewing mobile terminal screen,
May find that the visual direction of at this moment human eye with the font image direction on screen into an angle of 90 degrees, this is not meeting people's vision just
Chang Fangxiang, larger injury can be caused to human eye.In this case, the display direction for being best suitable for the picture of user's viewing should
It is consistent with the positive apparent direction of people.
Therefore, the display picture of screen is maintained at the positive apparent direction of people just turns into those skilled in the art
One of urgent problem to be solved.
The content of the invention
What the present invention solved be screen in the prior art display picture can not all the time with the positive apparent direction of people is consistent asks
Topic.
To solve the above problems, the present invention provides a kind of screen adjustment method of mobile terminal, including：
Obtain the positional information of two eyes of user；
The horizontal line that left eye to right eye are obtained according to the positional information of two eyes is projected on the screen of mobile terminal
Positive sight；
Calculate the first angle between the positive sight and the horizontal axis of mobile terminal and the positive sight and institute
State the second angle between the vertical coordinate axle of mobile terminal；
The direction of rotation of screen is determined according to second angle, and the preset range according to residing for first angle is true
Determine the anglec of rotation of screen.
Optionally, the positional information of two eyes for obtaining user includes：
Obtain the image of the user of viewing screen；
The human eye area of user is obtained from the image of the user and determines multiple candidate's eyes pair；
The multiple candidate's eyes pair determined are matched to obtain with the template photo of the user prestored
The positional information of two eyes of user.
Optionally, the human eye area of user is obtained from the image of the user based on integral projection method and is determined multiple
Candidate's eyes pair.
Optionally, the template photo by the user of the multiple candidate's eyes pair determined with prestoring is carried out
The step of matching, includes：
The full face of the user is obtained in advance and is stored using the template photo as the user；
The similarity between each candidate's eyes pair and the template photo of the user is calculated respectively；
Similarity highest candidate's eyes are believed as the position of two eyes of the user corresponding positional information
Breath.
Optionally, the template photo by the user of the multiple candidate's eyes pair determined with prestoring is carried out
The step of matching, includes：
The full face of the user is obtained in advance and is stored using the template photo as the user；
Obtained according to the template photo of the user and store the two intraocular lateral extents of user and the mark of two outer lateral extents
Quasi- ratio；
The similarity between each candidate's eyes pair and the template photo of the user is calculated respectively；
Whether the similarity for judging to calculate meets preparatory condition；
When at least one similarity meets preparatory condition, by similarity highest candidate's eyes to corresponding positional information
Positional information as two eyes of the user；
When the similarity of whole is unsatisfactory for preparatory condition, each intraocular lateral extent of candidate's eyes centering two and two are calculated
The ratio of the outer lateral extent of eye；The ratio of two intraocular lateral extents and two outer lateral extents is equal to the candidate's eyes of typical ratio to making
For the positional information of two eyes of the user.
Optionally, it is described to determine that the direction of rotation step of screen includes according to second angle：When second angle
During less than 90 degree, the direction of rotation for determining screen is to turn clockwise；When second angle is more than 90 degree, screen is determined
Direction of rotation is rotate counterclockwise.
Optionally, the step of preset range according to residing for first angle determines the anglec of rotation of screen is wrapped
Include：
Judge the current preset scope residing for first angle；
The anglec of rotation of corresponding screen is determined based on the current preset scope；
When first angle is in the range of current preset, the screen remains stationary.
Optionally, when first angle exceeds current preset scope, rejudge pre- residing for first angle
If scope, and the anglec of rotation is rotated screen according to corresponding to the preset range redefined.
Present invention also offers a kind of screen adjustment device, including：
Location information acquiring unit, the positional information of two eyes suitable for obtaining user；
Positive sight acquiring unit, the horizontal line suitable for obtaining left eye to right eye according to the positional information of two eyes project
Positive sight on to the screen of mobile terminal；
Angle acquiring unit, suitable for calculate the first angle between the positive sight and the horizontal axis of mobile terminal with
And the second angle between the positive sight and the vertical coordinate axle of the mobile terminal；
Screen rotation unit, suitable for determining the direction of rotation of screen according to second angle, and according to the described first folder
Preset range residing for angle determines the anglec of rotation of screen.
Optionally, the location information acquiring unit includes：
Image acquisition units, the image of the user suitable for obtaining viewing screen；
Eyes are to determining unit, suitable for obtaining the human eye area of user from the image of the user and determining multiple times
Select eyes pair；
First memory cell, suitable for storing the template photo of user；
Matching unit, the eyes is connected to determining unit and the first memory cell, suitable for the multiple candidates that will be determined
Eyes pair are matched with the template photo of the user prestored to obtain the positional information of the two of user eyes.
Optionally, the matching unit includes：
Call unit, first memory cell is connected, suitable for calling the template of user from first memory cell
Photo；
Computing unit, the eyes is connected to determining unit and the call unit, suitable for calculating each candidate's eye respectively
Similarity between eyeball pair and the template photo of the user；
Determining unit, using two eyes of the similarity highest candidate's eyes to corresponding positional information as the user
Positional information.
Optionally, the location information acquiring unit also includes：Typical ratio acquiring unit, connection first storage are single
Member, suitable for according to the template photo of the user obtain user two intraocular lateral extents and two outer lateral extents typical ratio simultaneously
The typical ratio is stored to first memory cell；
The matching unit includes：
Call unit, first memory cell is connected, suitable for calling the template of user from first memory cell
Photo；
Computing unit, the eyes is connected to determining unit and the call unit, suitable for calculating each candidate's eye respectively
Similarity between eyeball pair and the template photo of the user, and calculate each intraocular lateral extent of candidate's eyes centering two and two
The ratio of the outer lateral extent of eye；
Judging unit, the computing unit is connected, whether the similarity suitable for judging to calculate meets preparatory condition；
Determining unit, the judging unit, computing unit and typical ratio acquiring unit are connected, suitable for when at least one phase
When meeting preparatory condition like degree, using two eyes of the similarity highest candidate's eyes to corresponding positional information as the user
The positional information of eyeball；Or when whole similarity be unsatisfactory for preparatory condition when, by two intraocular lateral extents with two on the outside of away from
From ratio be equal to the candidate's eyes of typical ratio to the positional informations of two eyes as the user.
Optionally, the screen rotation unit includes：First comparing unit, the angle acquiring unit is connected, suitable for working as
When second angle is less than 90 degree, the direction of rotation for determining screen is to turn clockwise；When second angle is more than 90 degree
When, the direction of rotation for determining screen is rotate counterclockwise.
Optionally, the screen rotation unit also includes：
Second memory cell, the corresponding relation suitable for storage preset range and the anglec of rotation；
Second comparing unit, the angle acquiring unit and the second memory cell are connected, suitable for judging first angle
Residing current preset scope, to determine the anglec of rotation of corresponding screen；
Adjustment unit is shown, first comparing unit and the second comparing unit are connected, suitable for the screen according to determination
Screen is carried out display adjustment by the anglec of rotation of direction of rotation and screen.
The present invention also provides a kind of mobile terminal, including the screen adjustment device described in any of the above-described.
Compared with prior art, technical scheme has advantages below：
In technical solution of the present invention, determine to join in mobile terminal by obtaining the positional information of two eyes of user
Positive sight, and determine the direction of rotation of screen and screen by calculating the angle between positive sight and the reference axis of mobile terminal
The anglec of rotation of curtain.The screen adjustment method of the present invention can effectively adjust the display of screen according to the positional information of human eye
Picture, so that display picture is under the optimum visual state of human eye all the time, avoid the injury to eyes.
Further, in technical solution of the present invention, use that can be by the multiple candidate's eyes pair determined with prestoring
The template photo at family is matched to obtain real candidate's eyes pair, so as to improve the degree of accuracy positioned to human eye.
Further, in technical solution of the present invention, it can keep the anglec of rotation of screen constant within the specific limits, that is, exist
When the eye position change of user is little, the display picture remains stationary of screen is excessively frequent so as to avoid the rotation of screen
Caused by human eye injure.
Brief description of the drawings
Fig. 1 is the schematic flow sheet of the screen adjustment method of mobile terminal of the present invention；
Fig. 2 is a kind of schematic flow sheet of implementation of step S1 in Fig. 1；
Fig. 3 is a kind of schematic flow sheet of implementation of step S13 in Fig. 2；
Fig. 4 is a kind of use state diagram of mobile terminal of the present invention；
Fig. 5 is the structural representation of screen adjustment device of the present invention；
Fig. 6 is a kind of structural representation of implementation of positional information acquisition device in Fig. 5；
Fig. 7 be Fig. 5 be positional information acquisition device another implementation structural representation.
Embodiment
As described in the background art, existing mobile terminal is at the direction of display picture in adjusting screen most
Switching between horizontal/vertical screen can be provided, and the rotation of screen can not be realized by gravity sensor in most cases, so as to
Human eye is damaged.
In technical solution of the present invention, joined in by obtaining the positional information of human eye, and according to human eye on screen just
Angle between sight and mobile terminal reference axis realizes the positioning and tracking to human eye, so as to realize the position according to human eye
Information adjusts the function of the display picture of screen in real time.
It is understandable to enable the above objects, features and advantages of the present invention to become apparent, below in conjunction with the accompanying drawings to the present invention
Specific embodiment be described in detail.
Fig. 1 is the schematic flow sheet of the screen adjustment method of mobile terminal of the present invention.With reference to figure 1, the mobile terminal
Screen adjustment method, including：
Step S1, obtain the positional information of two eyes of user；
Step S2, the horizontal line that left eye to right eye are obtained according to the positional information of two eyes are projected to mobile terminal
Positive sight on screen；
Step S3, calculate the first angle between the positive sight and the horizontal axis of mobile terminal and described face
The second angle between the vertical coordinate axle of line and the mobile terminal；
Step S4, the direction of rotation of screen is determined according to second angle, and it is pre- according to residing for first angle
If scope determines the anglec of rotation of screen.
Specifically, with reference to figure 2, the positional information of two eyes of user is obtained described in step S1 to be included：
Step S11, obtain the image of the user of viewing screen；
In a particular embodiment, the image that the user of currently viewing screen can be obtained by imaging first-class device.For example,
User can be taken pictures by the camera in mobile terminal, so as to get the head portrait of user, this is art technology
Known to personnel, it will not be repeated here.
Step S12, the human eye area of user is obtained from the image of the user and determines multiple candidate's eyes pair；
In concrete application, due to the gray feature of human eye area and other regions of face exist it is significantly different, therefore, can
So that the human eye area of user is obtained from the image of the user based on integral projection method (Gray Projection method) and is determined multiple
Candidate's eyes pair.
After the human eye area of user is drawn, the intensity variation around the gray scale and eyes of comprehensive eyes can be with
Obtain some eyes pair to candidate；And as candidate's eyes to following two condition need to be met：
The distance between (1) two point suitable；That is, the distance between 2 points can not be excessive；Obtained according to analysis
The image of the user arrived, it can estimate at the distance between 2 points and not should be greater than the 1/2 of human eye area picture traverse；Correspondingly, two
The distance between eye can not be too small, for example, typically no less than the 1/4 of picture traverse.
The angle of line and horizontal direction between (2) two points is typically not greater than 30 degree.
Only meet two above condition simultaneously can just be confirmed as real candidate's eyes pair.Certainly, this area skill
Art personnel are above-mentioned to meet that condition be according to actual conditions on candidate's eyes pair it should be appreciated that due to individual difference
Carry out accommodation, however it is not limited to described above.
It should be noted that denoising and adjustment gray scale can also be first carried out to image after the image of user is got
The processing such as spacing, so as to reduce the harmful effect of grass to greatest extent, while ensures the gray scale quality of image.Specifically
Processing method can realize that the present invention is without limitation using existing technology.
Step S13, by the multiple candidate's eyes pair determined and the template photo progress of the user prestored
It is equipped with the positional information for obtaining two eyes of user.
Specifically, the step of above-mentioned matching, can be realized by the following method：
First, the full face of the user is obtained in advance and is stored using the template photo as the user；
For example, shooting the full face of user beforehand through the filming apparatus of mobile terminal, and full face is deposited
Store up using the template photo as the user.It is of course also possible to use other manner obtains the full face of user, such as may be used also
With by bluetooth, WIFI or other method by the full face of the user prestored transmit into mobile terminal using as with
The template photo at family.
Secondly, the similarity between each candidate's eyes pair and the template photo of the user is calculated respectively.That is,
Using the template photo of the user prestored as sample, the candidate's eyes pair got in above-mentioned steps S12 are entered with sample
Row Similarity Measure.Method on Similarity Measure can be realized using prior art, will not be repeated here.
Finally, the similarity calculated is ranked up, by similarity highest candidate's eyes to corresponding positional information
Positional information as two eyes of the user.
Inventor is by research：The candidate's eyes that draw of similarity are directly calculated in actual applications may be simultaneously
It is not most accurate position of human eye, because in actual use, user there may be the inclined possibility of eyes, also may be used
Can there can be the possibility that eyes are opened and closed, if it is not exactly accurate directly to calculate similarity.To solve these problems, this
The inventor of invention provides a kind of method of more accurate eyes positioning, referring particularly to Fig. 3：
Step S131 is performed, the full face of the user is obtained in advance and stores using the template photograph as the user
Piece.The step can be realized by any one foregoing mode, will not be repeated here.
Perform step S132, obtained according to the template photo of the user and store user two intraocular lateral extents and two
The typical ratio of outer lateral extent.
Specifically, can be by existing processing method calculation template photo after the template photo of user is got
The two intraocular lateral extents (width of the wing of nose i.e. between two) and two outer lateral extent (i.e. width between on the outside of two canthus of user
Degree) between ratio, ratio will be calculated and stored as typical ratio.
Step S133 is performed, calculates the similarity between each candidate's eyes pair and the template photo of the user respectively.
That is, using the template photo of the user prestored as sample, the time got in above-mentioned steps S12
Eyes pair are selected to carry out Similarity Measure with sample.Method on Similarity Measure can be realized using prior art, herein
Repeat no more.
Then step S134 is performed, whether the similarity for judging to calculate meets preparatory condition.
When at least one similarity meets preparatory condition, step S135 is performed, by similarity highest candidate's eyes pair
Positional information of the corresponding positional information as two eyes of the user；
When the similarity of whole is unsatisfactory for preparatory condition, step S136 is performed, calculates each candidate's eyes centering two
The ratio of intraocular lateral extent and two outer lateral extents；Step S137 is finally performed, by two intraocular lateral extents and two outer lateral extents
Ratio be equal to the candidate's eyes of typical ratio to the positional informations of two eyes as the user.
The step shown in Fig. 3 is described in detail in conjunction with a specific example below.
First, the full face of user is obtained by the front camera of mobile terminal and stored, the user is just
Template photo of the face photo as user；
Then, the template photo of the user to getting is handled, and be calculated the two intraocular lateral extents of user with
Typical ratio between two outer lateral extents is simultaneously preserved.For convenience of description, the typical ratio is designated as D0, for example, institute
Typical ratio D0 is stated as 0.3.
Then, get the image of the user of currently viewing screen and getting multiple candidate's eyes to rear, perform step
Rapid S133.It is assumed that the candidate's eyes got are to for 3, and respectively the first candidate's eyes pair, the second candidate's eyes pair and the 3rd
Candidate's eyes pair.It is calculated by performing step S133, between first candidate's eyes pair and the template photo of user
Similarity is 80%；Similarity between second candidate's eyes pair and the template photo of user is 98%；3rd candidate's eyes pair
Similarity between the template photo of user is 90%.
So, when performing step S134, if preparatory condition is：Candidate's eyes pair are similar to before the template photo of user
Degree is more than 95%, then the similarity between the second candidate's eyes pair and the template photo of user meets advance condition, therefore performs
Step S135, using positional information of second candidate's eyes to corresponding positional information as two eyes of the user.
It should be understood that：If exist it is multiple meet preparatory condition in the case of, then then by similarity highest candidate
Eyes are to positional information of the corresponding positional information as two eyes of user.
In another scenario, if the preparatory condition in step S134 is：The template photo of candidate's eyes pair and user it
Preceding similarity is more than 99%, then, all similarities are unsatisfactory for preparatory condition, at this moment will perform step S136, i.e., again
The ratio of each intraocular lateral extent of candidate's eyes centering two and two outer lateral extents is calculated respectively.Assume again that, the first candidate's eyes
The ratio D1 of the intraocular lateral extent of centering two and two outer lateral extents is 0.2；The intraocular lateral extent of second candidate's eyes centering two and two
The ratio D2 of the outer lateral extent of eye is 0.4；The ratio D3 of the intraocular lateral extent of 3rd candidate's eyes centering two and two outer lateral extents is
0.3。
Due to the ratio D3 and typical ratio D0 phases of the intraocular lateral extent of the 3rd candidate's eyes centering two and two outer lateral extents
Deng, therefore after execution step S137, using position of the 3rd candidate's eyes to corresponding positional information as two eyes of user
Information.
When calculating candidate's eyes pair and the similarity of the template photo of user accurately can not position eyes, Ke Yitong
Cross the ratio of the inner distance and the outer lateral extent that calculate two, will with typical ratio identical candidate's eyes to determining, with
More accurate eyes positioning is realized, so as to substantially increase the degree of accuracy of eyes positioning.
With continued reference to Fig. 1, after the positional information of two eyes of user (performing step S1) is got, step is performed
S2 can get human eye and join in the positive sight to the screen of mobile terminal.In the present invention, by the left eye of user to right eye
Line has direction as positive sight, the just sight, i.e., from left eye to the direction of right eye to be positive, the direction of right eye to left eye
To be reverse.
After positive sight is obtained, step S3 is performed, is calculated between the positive sight and the horizontal axis of mobile terminal
The second angle between first angle and the positive sight and the vertical coordinate axle of the mobile terminal.Fig. 4 shows this hair
A kind of use situation schematic diagram of bright mobile terminal, with reference to figure 4, the horizontal axis X and vertical coordinate axle Y of mobile terminal with
The inclination of mobile terminal and there occurs corresponding change.What L was represented is the left eye position information of user in Fig. 4, and what R was represented is to use
The right eye position information at family, the first angle between the line of vector LR and horizontal axis X of left eye to right eye is α；Left eye is to the right side
The second angle between the line of vector LR and vertical coordinate axle Y of eye is β.
After the first angle α and the second angle β is calculated, step S4 is performed, i.e., screen is determined according to the second angle β
Direction of rotation, and the preset range according to residing for first angle α determines the anglec of rotation of screen.
Specifically, described determine that the direction of rotation step of screen can include according to the second angle β：When described second
When angle β is less than 90 degree, the direction of rotation for determining screen is to turn clockwise；When the second angle β is more than 90 degree, it is determined that
The direction of rotation of screen is rotate counterclockwise.
The step of preset range according to residing for first angle α determines the anglec of rotation of screen can include：
Judge the current preset scope residing for first angle α；
The anglec of rotation of corresponding screen is determined based on the current preset scope；
When first angle α is in the range of current preset, the screen remains stationary.
Optionally, when first angle α exceeds current preset scope, rejudge residing for first angle α
Preset range, and the anglec of rotation is rotated screen according to corresponding to the preset range redefined.
With reference to Fig. 4, the preset range and the corresponding anglec of rotation of first angle α can do following setting：
When the first angle α, which is more than 0 degree, is less than 20 degree, the anglec of rotation is 0 degree (i.e. state of portrait layout)；
When the first angle α is more than or equal to 20 degree and is less than 40 degree, the anglec of rotation is 30 degree；
When the first angle α is more than or equal to 40 degree and is less than 60 degree, the anglec of rotation is 50 degree；
When the first angle α is more than or equal to 60 degree and is less than 80 degree, the anglec of rotation is 70 degree；
When the first angle α is more than or equal to 80 degree and is less than or equal to 90 degree, the anglec of rotation is 90 degree of (i.e. transverse screens
State)；
When the first angle α is more than 90 degree (mobile terminal is in the state of falling screen), the anglec of rotation maintains Last status
It is constant.
Based on above-mentioned setting, when the second angle β is calculated as 60 degree, and the first angle α for 30 degree when, mobile terminal
Screen will rotate 30 degree in clockwise direction；And when between the positive sight of eyes and the horizontal axis of mobile terminal
More than or equal to 20 degree and when being less than 40 degree (i.e. current preset scope), the screen of mobile terminal will be kept first angle α
It is constant in 30 degree of state of rotation, until the first angle α between the positive sight of eyes and the horizontal axis of mobile terminal surpasses
Go out current preset scope, and fall into other preset ranges, then, then need to redefine preset range and according to determination
The anglec of rotation is rotated.For example, when the first angle α between the positive sight of eyes and the horizontal axis of mobile terminal is changed into 65
When spending, then, then the anglec of rotation for redefining screen is 70 degree, and therefore, screen is by 70 degree of rotation of progress.
Certainly, the setting of the above-mentioned preset range on the first angle is only one kind for example, invention technician
Other settings can also be done according to concrete application, this should not be limited the scope of the invention.
The screen adjustment method of the mobile terminal of the present invention, is positioned, then basis by two eyes to user
The positional information of the eyes of determination determines the anglec of rotation and the direction of rotation of screen, so that the display picture energy of mobile terminal
Enough positive apparent directions with user are consistent, so as to effectively protect the eyes of user.
Further, enter in the present invention by the ratio of the inner distance and the outer lateral extent that calculate two and with typical ratio
Row compares, and can more accurately determine the positional information of two eyes of user, improves the degree of accuracy of human eye positioning.
On the other hand, technical solution of the present invention is provided with the preset range of multiple first angles, so as to be effectively guaranteed
In certain scope, will not frequently Rotation screen, but keep the state of screen constant in the range of certain angle, so as to
Avoid because screen is not fixed and the huge injury to caused by human eye.
Accordingly, present invention also offers a kind of screen adjustment device, with reference to figure 5, the screen adjustment device includes：Position
Put information acquisition unit 10, positive sight acquiring unit 20, angle acquiring unit 30 and screen rotation unit 40.
The location information acquiring unit 10 is suitable to the positional information for obtaining two eyes of user；
The positive sight acquiring unit 20 connects the location information acquiring unit 10, suitable for the position according to two eyes
The horizontal line of acquisition of information left eye to right eye is projected to the positive sight on the screen of mobile terminal；
The angle acquiring unit 30 connects the positive sight acquiring unit 20, suitable for calculating the positive sight and movement eventually
The between the first angle between the horizontal axis at end and the positive sight and the vertical coordinate axle of the mobile terminal
Two angles；
The screen rotation unit 40 connects the angle acquiring unit 30, suitable for determining screen according to second angle
Direction of rotation, and the preset range according to residing for first angle determines the anglec of rotation of screen.
Fig. 6 shows a kind of structural representation of implementation of location information acquiring unit；With reference to figure 6, the position
Information acquisition unit includes：
Image acquisition units 101, the image of the user suitable for obtaining viewing screen；Described image collecting unit can be existing
Filming apparatus in some mobile terminals, such as front camera, naturally it is also possible to be other devices, the present invention is not done to this
Limitation.
Eyes are to determining unit 102, connection described image collecting unit 101, the eyes determining unit 102 is suitable to from
The human eye area of user is obtained in the image of the user and determines multiple candidate's eyes pair；
First memory cell 103, suitable for storing the template photo of user；First memory cell 103 can use existing
Some storage devices, such as FLASH memory are realized.
Matching unit 104, the eyes are connected to the memory cell 103 of determining unit 102 and first, the matching unit
104 are suitable to the template photo of the user prestored be matched the multiple candidate's eyes pair determined to obtain use
The positional information of two eyes at family.
With continued reference to Fig. 6, the matching unit 104 can include：
Call unit 1041, first memory cell 103 is connected, suitable for being called from first memory cell 103
The template photo of user；
Computing unit 1042, the eyes is connected to determining unit 102 and the call unit 1041, suitable for calculating respectively
Similarity between each candidate's eyes pair and the template photo of the user；
First determining unit 1043, connect the computing unit 1042, suitable for by similarity highest candidate's eyes to right
Positional information of the positional information answered as two eyes of the user.
Fig. 7 shows the structural representation of another implementation of location information acquiring unit；With reference to figure 7, institute's rheme
Putting information acquisition unit includes：Image acquisition units 101, eyes are to determining unit 102, the first memory cell 103, matching unit
104 and typical ratio acquiring unit 105.Described image collecting unit 101, eyes are to the memory cell of determining unit 102 and first
103 is similar with the corresponding unit shown in Fig. 6, will not be repeated here.
Specifically, the typical ratio acquiring unit 105 connects first memory cell 103, suitable for according to the use
The template photo at family obtains the two intraocular lateral extents of user and the typical ratio of two outer lateral extents and deposits the typical ratio
Store up to first memory cell 103.
In addition, the matching unit 104 includes：
Call unit 1041, first memory cell 103 is connected, suitable for calling user from first memory cell
Template photo；
Computing unit 1042, the eyes is connected to determining unit 102 and the call unit 1041, suitable for calculating respectively
Similarity between each candidate's eyes pair and the template photo of the user, and calculate each intraocular of candidate's eyes centering two
The ratio of lateral extent and two outer lateral extents；
Judging unit 1044, the computing unit 1042 is connected, whether the similarity suitable for judging to calculate meets to preset
Condition；
Second determining unit 1045, connect the judging unit 1044, computing unit 1042 and typical ratio acquiring unit
105, suitable for when at least one similarity meets preparatory condition, by similarity highest candidate's eyes to corresponding positional information
Positional information as two eyes of the user；Or when the similarity of whole is unsatisfactory for preparatory condition, by two
The ratio of inner distance and two outer lateral extents is equal to the candidate's eyes of typical ratio to two eyes as the user
Positional information.
With continued reference to Fig. 5, the screen rotation unit 40 can include：First comparing unit, connect the angle and obtain
Unit, suitable for when second angle is less than 90 degree, the direction of rotation for determining screen is to turn clockwise；When the described second folder
When angle is more than 90 degree, the direction of rotation for determining screen is rotate counterclockwise.
In addition, the screen rotation unit 40 can also include：
Second memory cell, the corresponding relation suitable for storage preset range and the anglec of rotation；
Second comparing unit, the angle acquiring unit and the second memory cell are connected, suitable for judging first angle
Residing current preset scope, to determine the anglec of rotation of corresponding screen；
Adjustment unit is shown, first comparing unit and the second comparing unit are connected, suitable for the screen according to determination
Screen is carried out display adjustment by the anglec of rotation of direction of rotation and screen.
Operation principle on above-mentioned screen adjustment device refers to the related description in preceding method with the course of work,
This is repeated no more.
The screen adjustment device of the present invention can timely adjust the anglec of rotation of screen according to the positional information of human eye,
So as to effectively reduce the injury to human eye；
In addition, the screen adjustment device of the present invention will be protected when detecting that the first angle is in certain preset range
It is constant to hold the anglec of rotation of screen, so as to reduce further because frequently human eye injures caused by rotation；
Further, screen adjustment device of the invention is when the eyes to user position, by calculating two
Ratio between inner distance and outer lateral extent, using the candidate's eyes equal with typical ratio to two eyes as user
Positional information, so as to solve the position letter due to can not accurately obtain eyes caused by the reasons such as eyes inclination or eye closing
The problem of breath, it is effectively improved the degree of accuracy of eyes positioning.
The present invention also provides a kind of mobile terminal, including the screen adjustment device described in any of the above-described.
Although present disclosure is as above, the present invention is not limited to this.Any those skilled in the art, this is not being departed from
In the spirit and scope of invention, it can make various changes or modifications, therefore protection scope of the present invention should be with claim institute
The scope of restriction is defined.
Claims (15)
1. a kind of screen adjustment method of mobile terminal, it is characterised in that including：
Obtain the positional information of two eyes of user；
The horizontal line that left eye to right eye are obtained according to the positional information of two eyes is projected on the screen of mobile terminal just
Sight；
Calculate the first angle between the positive sight and the horizontal axis of mobile terminal and the positive sight and the shifting
The second angle between the vertical coordinate axle of dynamic terminal；
The direction of rotation of screen is determined according to second angle, and the preset range according to residing for first angle determines screen
The anglec of rotation of curtain.
2. the screen adjustment method of mobile terminal as claimed in claim 1, it is characterised in that two eyes for obtaining user
The positional information of eyeball includes：
Obtain the image of the user of viewing screen；
The human eye area of user is obtained from the image of the user and determines multiple candidate's eyes pair；
The multiple candidate's eyes pair determined are matched to obtain user with the template photo of the user prestored
Two eyes positional information.
3. the screen adjustment method of mobile terminal as claimed in claim 2, it is characterised in that based on integral projection method from described
The human eye area of user is obtained in the image of user and determines multiple candidate's eyes pair.
4. the screen adjustment method of mobile terminal as claimed in claim 2, it is characterised in that the multiple times that will be determined
The step of selecting eyes pair to be matched with the template photo of the user prestored includes：
The full face of the user is obtained in advance and is stored using the template photo as the user；
The similarity between each candidate's eyes pair and the template photo of the user is calculated respectively；
Using positional information of the similarity highest candidate's eyes to corresponding positional information as two eyes of the user.
5. the screen adjustment method of mobile terminal as claimed in claim 2, it is characterised in that the multiple times that will be determined
The step of selecting eyes pair to be matched with the template photo of the user prestored includes：
The full face of the user is obtained in advance and is stored using the template photo as the user；
Obtained according to the template photo of the user and store the two intraocular lateral extents of user and the standard ratio of two outer lateral extents
Value；
The similarity between each candidate's eyes pair and the template photo of the user is calculated respectively；
Whether the similarity for judging to calculate meets preparatory condition；
When at least one similarity meets preparatory condition, using similarity highest candidate's eyes to corresponding positional information as
The positional information of two eyes of the user；
When the similarity of whole is unsatisfactory for preparatory condition, calculates each intraocular lateral extent of candidate's eyes centering two and two outer
The ratio of lateral extent；The ratio of two intraocular lateral extents and two outer lateral extents is equal to the candidate's eyes of typical ratio to as institute
State the positional information of two eyes of user.
6. the screen adjustment method of mobile terminal as claimed in claim 1, it is characterised in that described according to second angle
Determining the direction of rotation step of screen includes：When second angle is less than 90 degree, the direction of rotation for determining screen is up time
Pin rotates；When second angle is more than 90 degree, the direction of rotation for determining screen is rotate counterclockwise.
7. the screen adjustment method of mobile terminal as claimed in claim 1, it is characterised in that described according to first angle
Residing preset range determines that the step of anglec of rotation of screen includes：
Judge the current preset scope residing for first angle；
The anglec of rotation of corresponding screen is determined based on the current preset scope；
When first angle is in the range of current preset, the screen remains stationary.
8. the screen adjustment method of mobile terminal as claimed in claim 7, it is characterised in that work as when first angle exceeds
During preceding preset range, the preset range residing for first angle is rejudged, and it is corresponding according to the preset range redefined
The anglec of rotation screen is rotated.
A kind of 9. screen adjustment device, it is characterised in that including：
Location information acquiring unit, the positional information of two eyes suitable for obtaining user；
Positive sight acquiring unit, the horizontal line suitable for obtaining left eye to right eye according to the positional information of two eyes are projected to shifting
Positive sight on the screen of dynamic terminal；
Angle acquiring unit, suitable for calculating the first angle and institute between the positive sight and the horizontal axis of mobile terminal
State the second angle between positive sight and the vertical coordinate axle of the mobile terminal；
Screen rotation unit, suitable for determining the direction of rotation of screen according to second angle, and according to the first angle institute
The preset range at place determines the anglec of rotation of screen.
10. screen adjustment device as claimed in claim 9, it is characterised in that the location information acquiring unit includes：
Image acquisition units, the image of the user suitable for obtaining viewing screen；
Eyes are to determining unit, suitable for obtaining the human eye area of user from the image of the user and determining multiple candidate's eyes
Eyeball pair；
First memory cell, suitable for storing the template photo of user；
Matching unit, the eyes is connected to determining unit and the first memory cell, suitable for the multiple candidate's eyes that will be determined
Pair matched with the template photo of the user prestored to obtain the positional information of the two of user eyes.
11. screen adjustment device as claimed in claim 10, it is characterised in that the matching unit includes：
Call unit, first memory cell is connected, suitable for calling the template photo of user from first memory cell；
Computing unit, the eyes is connected to determining unit and the call unit, suitable for calculating each candidate's eyes pair respectively
Similarity between the template photo of the user；
Determining unit, using position of the similarity highest candidate's eyes to corresponding positional information as two eyes of the user
Confidence ceases.
12. screen adjustment device as claimed in claim 10, it is characterised in that the location information acquiring unit also includes：
Typical ratio acquiring unit, first memory cell is connected, suitable for obtaining the two of user according to the template photo of the user
The typical ratio of intraocular lateral extent and two outer lateral extents simultaneously stores the typical ratio to first memory cell；
The matching unit includes：
Call unit, first memory cell is connected, suitable for calling the template photo of user from first memory cell；
Computing unit, the eyes is connected to determining unit and the call unit, suitable for calculating each candidate's eyes pair respectively
Similarity between the template photo of the user, and calculate outside each intraocular lateral extent of candidate's eyes centering two and two
The ratio of lateral extent；
Judging unit, the computing unit is connected, whether the similarity suitable for judging to calculate meets preparatory condition；
Determining unit, the judging unit, computing unit and typical ratio acquiring unit are connected, suitable for when at least one similarity
When meeting preparatory condition, using similarity highest candidate's eyes to corresponding positional information as two eyes of the user
Positional information；Or when the similarity of whole is unsatisfactory for preparatory condition, by two intraocular lateral extents and two outer lateral extents
Ratio is equal to positional information of the candidate's eyes to two eyes as the user of typical ratio.
13. screen adjustment device as claimed in claim 9, it is characterised in that the screen rotation unit includes：First compares
Unit, the angle acquiring unit is connected, suitable for when second angle is less than 90 degree, the direction of rotation for determining screen is suitable
Hour hands rotate；When second angle is more than 90 degree, the direction of rotation for determining screen is rotate counterclockwise.
14. screen adjustment device as claimed in claim 13, it is characterised in that the screen rotation unit also includes：
Second memory cell, the corresponding relation suitable for storage preset range and the anglec of rotation；
Second comparing unit, the angle acquiring unit and the second memory cell are connected, suitable for judging residing for first angle
Current preset scope, to determine the anglec of rotation of corresponding screen；
Adjustment unit is shown, connects first comparing unit and the second comparing unit, the rotation suitable for the screen according to determination
Screen is carried out display adjustment by the anglec of rotation of direction and screen.
15. a kind of mobile terminal, it is characterised in that including the screen adjustment device as described in any one of claim 9~14.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310625751.8A CN104679225B (en) | 2013-11-28 | 2013-11-28 | Screen adjustment method, screen adjustment device and the mobile terminal of mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310625751.8A CN104679225B (en) | 2013-11-28 | 2013-11-28 | Screen adjustment method, screen adjustment device and the mobile terminal of mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104679225A CN104679225A (en) | 2015-06-03 |
| CN104679225B true CN104679225B (en) | 2018-02-02 |
Family
ID=53314424
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310625751.8A Expired - Fee Related CN104679225B (en) | 2013-11-28 | 2013-11-28 | Screen adjustment method, screen adjustment device and the mobile terminal of mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104679225B (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105045395A (en) * | 2015-08-28 | 2015-11-11 | 京东方科技集团股份有限公司 | Display device and image display method |
| CN106598209A (en) * | 2015-10-20 | 2017-04-26 | 中兴通讯股份有限公司 | Terminal screen display control method, device and terminal |
| CN105760795A (en) * | 2016-01-28 | 2016-07-13 | 宇龙计算机通信科技(深圳)有限公司 | Method and terminal for displaying information |
| CN105892647B (en) | 2016-03-23 | 2018-09-25 | 京东方科技集团股份有限公司 | A kind of display screen method of adjustment, its device and display device |
| CN108614634A (en) * | 2016-12-09 | 2018-10-02 | 北京视联动力国际信息技术有限公司 | A kind of mobile device shows the method and mobile device of screen rotation |
| CN107155099A (en) * | 2017-06-06 | 2017-09-12 | 苏州佳世达电通有限公司 | Display device and its control method |
| CN108388849B (en) * | 2018-02-07 | 2021-02-02 | Oppo广东移动通信有限公司 | Method and device for adjusting display image of terminal, electronic equipment and storage medium |
| CN109445735A (en) * | 2018-10-22 | 2019-03-08 | 奇酷互联网络科技（深圳）有限公司 | Control method, mobile terminal and the computer storage medium of display direction |
| CN109696201B (en) * | 2018-12-29 | 2022-01-18 | 维沃移动通信有限公司 | Terminal state determination method and terminal |
| CN111443772B (en) * | 2020-03-26 | 2022-08-12 | 合肥联宝信息技术有限公司 | Method for adjusting electronic equipment |
| CN111857910A (en) * | 2020-06-28 | 2020-10-30 | 维沃移动通信有限公司 | Information display method and device and electronic equipment |
| CN112445342B (en) * | 2020-11-26 | 2023-07-21 | 维沃移动通信有限公司 | Display screen control method and device and electronic equipment |
| CN114740966A (en) * | 2020-12-23 | 2022-07-12 | 上海联影医疗科技股份有限公司 | Multi-modal image display control method and system and computer equipment |
| CN113867535B (en) * | 2021-10-11 | 2023-09-05 | 展讯通信（深圳）有限公司 | Picture display method, device, terminal equipment and storage medium |
| CN114071231A (en) * | 2021-10-25 | 2022-02-18 | 中国航空无线电电子研究所 | Eye position self-adaptive display system and implementation method thereof |
| CN117555411A (en) * | 2022-08-03 | 2024-02-13 | 中兴通讯股份有限公司 | Adjustable human-computer interaction device, control method and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101465116A (en) * | 2009-01-07 | 2009-06-24 | 北京中星微电子有限公司 | Display equipment and control method thereof |
| CN101840509A (en) * | 2010-04-30 | 2010-09-22 | 深圳华昌视数字移动电视有限公司 | Measuring method for eye-observation visual angle and device thereof |
| CN101950550A (en) * | 2010-09-28 | 2011-01-19 | 冠捷显示科技（厦门）有限公司 | Display device for displaying pictures at different angles based on visual angle of viewer |
| CN101984453A (en) * | 2010-11-02 | 2011-03-09 | 中国科学技术大学 | Human eye recognition system and method |
| CN101989126A (en) * | 2009-08-07 | 2011-03-23 | 深圳富泰宏精密工业有限公司 | Handheld electronic device and automatic screen picture rotating method thereof |
| CN102662476A (en) * | 2012-04-20 | 2012-09-12 | 天津大学 | Gaze estimation method |
| CN102760024A (en) * | 2011-04-26 | 2012-10-31 | 鸿富锦精密工业（深圳）有限公司 | Screen picture rotating method and system |
| CN103024191A (en) * | 2012-12-21 | 2013-04-03 | 广东欧珀移动通信有限公司 | Screen rotating method, screen rotating device and mobile terminal |
| WO2013071826A1 (en) * | 2011-11-14 | 2013-05-23 | 华为技术有限公司 | Method and terminal for switching horizontal and vertical display modes of screen |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20090101733A (en) * | 2008-03-24 | 2009-09-29 | 삼성전자주식회사 | Mobile terminal and displaying method of display information using face recognition thereof |
-
2013
- 2013-11-28 CN CN201310625751.8A patent/CN104679225B/en not_active Expired - Fee Related
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101465116A (en) * | 2009-01-07 | 2009-06-24 | 北京中星微电子有限公司 | Display equipment and control method thereof |
| CN101989126A (en) * | 2009-08-07 | 2011-03-23 | 深圳富泰宏精密工业有限公司 | Handheld electronic device and automatic screen picture rotating method thereof |
| CN101840509A (en) * | 2010-04-30 | 2010-09-22 | 深圳华昌视数字移动电视有限公司 | Measuring method for eye-observation visual angle and device thereof |
| CN101950550A (en) * | 2010-09-28 | 2011-01-19 | 冠捷显示科技（厦门）有限公司 | Display device for displaying pictures at different angles based on visual angle of viewer |
| CN101984453A (en) * | 2010-11-02 | 2011-03-09 | 中国科学技术大学 | Human eye recognition system and method |
| CN102760024A (en) * | 2011-04-26 | 2012-10-31 | 鸿富锦精密工业（深圳）有限公司 | Screen picture rotating method and system |
| WO2013071826A1 (en) * | 2011-11-14 | 2013-05-23 | 华为技术有限公司 | Method and terminal for switching horizontal and vertical display modes of screen |
| CN102662476A (en) * | 2012-04-20 | 2012-09-12 | 天津大学 | Gaze estimation method |
| CN103024191A (en) * | 2012-12-21 | 2013-04-03 | 广东欧珀移动通信有限公司 | Screen rotating method, screen rotating device and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104679225A (en) | 2015-06-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104679225B (en) | Screen adjustment method, screen adjustment device and the mobile terminal of mobile terminal | |
| WO2023071884A1 (en) | Gaze detection method, control method for electronic device, and related devices | |
| US9373156B2 (en) | Method for controlling rotation of screen picture of terminal, and terminal | |
| US9262984B2 (en) | Device and method for controlling rotation of displayed image | |
| CN104331168B (en) | Display adjusting method and electronic equipment | |
| CN109960401B (en) | Dynamic projection method, device and system based on face tracking | |
| CN102880290B (en) | A kind of display control method, device and terminal | |
| US20060147192A1 (en) | Best shooting moment selectable digital camera apparatus | |
| EP3465085B1 (en) | Carrier-assisted tracking | |
| CN107167924B (en) | A kind of lens adjusting method of virtual reality device and virtual reality device | |
| WO2014042764A1 (en) | Automatic image orientation and straightening through image analysis | |
| US9959841B2 (en) | Image presentation control methods and image presentation control apparatuses | |
| EP3726836B1 (en) | Wearable device testing method and system | |
| WO2019128917A1 (en) | Object control method and apparatus, storage medium, and computer device | |
| KR20220054157A (en) | Method of providing photographing guide and system therefor | |
| US10950001B2 (en) | Determination program, determination method, and information processing apparatus | |
| CN102316260A (en) | Control system and method of PTZ (pan/tilt/zoom) camera and adjusting device of PTZ camera | |
| KR20240032107A (en) | Vision testing systems and methods and their uses | |
| CN105787435A (en) | Indication method and apparatus for iris acquisition | |
| US10917559B2 (en) | Method for achieving non-selfie-taking effect through selfie-taking and photographing device | |
| US20240013439A1 (en) | Automated calibration method of a system comprising an external eye-tracking device and a computing device | |
| JP2015064700A (en) | Spectacle wearing parameter measuring apparatus, spectacle wearing parameter measurement program and position designation method | |
| CN109756663A (en) | A kind of control method of AR equipment, device and AR equipment | |
| CN108628519A (en) | Control device, control method and the storage medium of network camera | |
| WO2020087317A1 (en) | Monitoring device adjustment method, monitoring device, and gimbal device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180202 Termination date: 20181128 |