CN110928407B - Information display method and device - Google Patents
Information display method and device Download PDFInfo
- Publication number
- CN110928407B CN110928407B CN201911044192.5A CN201911044192A CN110928407B CN 110928407 B CN110928407 B CN 110928407B CN 201911044192 A CN201911044192 A CN 201911044192A CN 110928407 B CN110928407 B CN 110928407B
- Authority
- CN
- China
- Prior art keywords
- information
- user
- display mode
- eye
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an information display method and device. The method comprises the following steps: under the condition that the current application interface is changed from a first display mode to a second display mode, acquiring a target application identifier of a target application to which the current application interface belongs; determining target user eye gaze information corresponding to a target application identifier based on the established correspondence between the application identifier and the user eye gaze information, wherein the target user eye gaze information is information of user eye gaze in a current application interface in a first display mode; displaying information matching the target user's eye-gaze information in a predetermined manner, or displaying information matching the target user's eye-gaze information at a position corresponding to the current gaze point of the user's eye; information that does not match the eye gaze information of the target user is displayed in a manner different from the predetermined manner. According to the embodiment of the invention, the efficiency of searching the last information read by the user before the display mode of the application interface is changed is improved.
Description
Technical Field
The embodiment of the invention relates to the field of data processing, in particular to an information display method and device.
Background
The user may adjust the screen state of the electronic device according to the requirement during the process of using the electronic device. For example, when the user adjusts the screen state of the electronic device, such as horizontal-vertical screen switching, split-screen switching and full-screen switching, during the process of reading the document or the webpage on the electronic device, the display mode of the document or the webpage can be readjusted.
When the display mode of the application interface is adjusted, if the user needs to find the reading position before the change of the application interface again, the user needs to browse from the beginning, and a great deal of time is spent on finding the reading interruption position, namely, finding the last information read by the user before the change of the display mode, which is more time-consuming.
Disclosure of Invention
The embodiment of the invention provides an information display method and device, which are used for solving the problem that the time for searching the last information read before the display mode is changed is more when the display mode of an application interface is changed.
In order to solve the technical problems, the invention is realized as follows: an information display method, comprising:
under the condition that the current application interface is changed from a first display mode to a second display mode, acquiring a target application identifier of a target application to which the current application interface belongs;
determining target user eye gaze information corresponding to a target application identifier based on the established correspondence between the application identifier and the user eye gaze information, wherein the target user eye gaze information is information of user eye gaze in a current application interface in a first display mode;
matching the eye gazing information of the target user with the information in the current application interface in the second display mode;
displaying information matched with the eye-gazing information of the target user in a preset mode in the current application interface in the second display mode, or displaying the information matched with the eye-gazing information of the target user at a position corresponding to the current gazing point of the eyes of the user in the current application interface in the second display mode;
wherein the information that does not match the eye gaze information of the target user is displayed in a manner different from the predetermined manner.
In a first aspect, an embodiment of the present invention provides an information display apparatus, including:
the first application identification acquisition module is used for acquiring a target application identification of a target application to which the current application interface belongs under the condition that the current application interface is changed from a first display mode to a second display mode;
the eye gaze information determining module is used for determining target user eye gaze information corresponding to the target application identifier based on the established correspondence between the application identifier and the user eye gaze information, wherein the target user eye gaze information is information of user eye gaze in a current application interface in a first display mode;
the information matching module is used for matching the eye gazing information of the target user with the information in the current application interface in the second display mode;
the display module is used for displaying information matched with the eye-gazing information of the target user in a preset mode in the current application interface in the second display mode, or displaying the information matched with the eye-gazing information of the target user at a position corresponding to the current gazing point of the eyes of the user in the current application interface in the second display mode;
wherein the information that does not match the eye gaze information of the target user is displayed in a manner different from the predetermined manner.
In a second aspect, an embodiment of the present invention provides an electronic device, including: a processor and a memory storing computer program instructions;
the processor executes the computer program instructions to implement the information display method provided in the embodiment of the invention.
In a third aspect, an embodiment of the present invention provides a computer storage medium, where computer program instructions are stored, where the computer program instructions, when executed by a processor, implement an information display method as provided in the embodiment of the present invention.
In the embodiment of the invention, the information matched with the eye-gaze information of the target user is highlighted in a preset mode different from the display mode of the information which is not matched with the eye-gaze information of the target user in the application interface in the second display mode by acquiring the latest information watched by the eyes of the user in the recorded first display mode. Or, in the application interface in the second display mode, the information matched with the eye gaze information of the target user is automatically adjusted to the current gaze point of the eyes of the user, so that the user can quickly find the last position read by the user before the display mode of the application interface changes, the time for the user to search the last information read by the user before the display mode of the application interface changes is reduced, and the searching efficiency is improved.
Drawings
The invention will be better understood from the following description of specific embodiments thereof taken in conjunction with the accompanying drawings in which like or similar reference characters designate like or similar features.
Fig. 1 is a flow chart of an information display method according to an embodiment of the present invention;
fig. 2 is an application interface in a horizontal screen display manner according to an embodiment of the present invention;
fig. 3 is an application interface in a vertical screen display manner provided in an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an information display device according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
Features and exemplary embodiments of various aspects of the present invention will be described in detail below, and in order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely configured to illustrate the invention and are not configured to limit the invention. It will be apparent to one skilled in the art that the present invention may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the invention by showing examples of the invention.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises the element.
Fig. 1 is a flow chart illustrating an information display method 100 according to an embodiment of the present invention. As shown in fig. 1, the information display method provided by the embodiment of the invention is applied to an electronic device, and includes the following steps:
s110, under the condition that the current application interface is changed from the first display mode to the second display mode, a target application identifier of a target application to which the current application interface belongs is obtained.
The application interface may be a display interface of a certain application program (for example, a WeChat display interface, a Taobao display interface, etc.), or may be a display interface of a system application of the electronic device (for example, a main interface of the electronic device).
S120, determining target user eye gaze information corresponding to the target application identifier based on the established correspondence between the application identifier and the user eye gaze information, wherein the target user eye gaze information is information of user eye gaze in a current application interface in a first display mode.
And S130, matching the eye gaze information of the target user with the information in the current application interface in the second display mode.
And S140, displaying information matched with the eye gaze information of the target user in a preset mode in the current application interface in the second display mode, or displaying the information matched with the eye gaze information of the target user at a position corresponding to the current gaze point of the user in the current application interface in the second display mode.
Wherein the information that does not match the eye gaze information of the target user is displayed in a manner different from the predetermined manner.
In the embodiment of the invention, under the condition that the display mode of the current application interface browsed by the user is changed, the latest information watched by the eyes of the user in the first pre-recorded display mode is obtained, namely, the last reading position of the user in the current application interface in the first display mode is recorded, namely, the reading interruption point is obtained. And then highlighting the information matched with the eye-gaze information of the target user in a preset mode different from the display mode of the information which is not matched with the eye-gaze information of the target user in the application interface with the changed display mode, prompting the user to read the interrupt position, and reducing the time for the user to search the interrupt position. Or, the information matched with the eye fixation information of the target user is automatically adjusted to the current fixation point of the eyes of the user in the application interface after the display mode is changed, so that the user can quickly find the last position read before the display mode is changed, the time for the user to search the last information read before the display mode is changed is reduced, and the searching efficiency is improved.
In an embodiment of the present invention, before step S110, the information display method further includes: acquiring a face image; determining position coordinates of a gaze point of eyes of a user in a face image on an application interface; acquiring user eye gazing information in a preset area taking position coordinates as a center in an application interface; acquiring an application identifier of an application to which an application interface belongs; and establishing a corresponding relation between the application identification and the eye gaze information of the user.
In the process of browsing the application interface by the user, the electronic equipment acquires face images of the user through the front-facing camera or the infrared equipment according to a preset time interval.
As an example, the position coordinates of the gaze point of the user's eyes in the face image on the application interface, i.e. the position of the gaze point of the user's eyes on the screen of the electronic device, may be determined by means of a pre-trained gaze point recognition model.
The pre-trained fixation point identification model can be a deep learning model such as a convolutional neural network model and a support vector machine model.
Before using the gaze point recognition model, the gaze point recognition model may be trained using a large number of human eye images that label the coordinates of the gaze point of the human eye on the screen of the electronic device. And obtaining the coordinates of the gaze point of the user eyes on the application interface in the preset coordinate system in the face image input into the model by utilizing the gaze point recognition model obtained after training. As one example, the preset coordinate system may be a coordinate system established based on the screen of the electronic device.
After the position coordinates of the gaze point of the user's eyes in the face image on the application interface are determined, the user's eye gaze information in a preset area centered on the position coordinates in the application interface may be acquired. As a specific example, the preset area may be information within a range in which the front-rear distances are d with the position coordinates of the gaze point of the user's eye on the application interface as the center. As one example, the user eye gaze information may be information such as picture information, text information, or the like.
And then the electronic equipment acquires the application identifier of the application to which the application interface browsed by the user belongs, for example, the package name of the application. And finally, establishing a corresponding relation between the user eye gaze information corresponding to the position coordinates in the obtained application interface and an application identifier of the application to which the application interface belongs.
In the embodiment of the invention, as the user continuously browses information in the same application interface, the gaze point of the user's eyes is continuously changed, and as the gaze point of the user's eyes is continuously updated, the user eye gaze information corresponding to the application identifier of the application to which the application interface belongs is correspondingly updated.
That is, in the process that the user uses the electronic device, the correspondence between the application identifier and the user eye gaze information is continuously updated according to the user eye gaze point. In the corresponding relation, for any application identifier, the eye gaze information of the user corresponding to the application identifier is the latest information of the eye gaze of the user in the application interface corresponding to the application identifier.
In the embodiment of the invention, if the user opens an application program interface which is never opened before, the application identifier of the application program is newly added in the corresponding relation, and the gazing information of eyes of the user in the application program interface is associated with the application identifier.
In an embodiment of the present invention, the case that the current application interface changes from the first display mode to the second display mode includes any one of the following cases: the screen state of the electronic device is switched between a first state and a second state, and the target application is switched from the background to the foreground.
As one example, the first state is a landscape state and the second state is a portrait state. When the screen state of the electronic equipment is switched from the horizontal screen state to the vertical screen state, the display mode of the current application interface is switched from the horizontal screen display mode to the vertical screen display mode, namely, the display mode of the current application interface is changed. Or when the screen state of the electronic equipment is switched from the vertical screen state to the horizontal screen state, the display mode of the current application interface is switched from the vertical screen display mode to the horizontal screen display mode, namely, the display mode of the current application interface is changed.
As another example, the first state is a split screen state and the second state is a full screen state. When the screen state of the electronic equipment is switched from the split screen state to the full screen state, the display mode of the current application interface is switched from the split screen display mode to the full screen display mode, so that the display mode of the current application interface is changed. Or when the screen state of the electronic equipment is switched from the vertical screen state to the full screen state, the display mode of the current application interface is switched from the vertical screen display mode to the full screen display mode, so that the display mode of the current application interface is changed.
In yet another example, where the electronic device is a foldable electronic device, the first state is a folded state and the second state is an unfolded state. When the screen state of the electronic device is switched between the folded state and the unfolded state, the display mode of the application interface is also changed. It should be noted that, an electronic device having a flexible screen also belongs to a foldable electronic device.
In some embodiments of the present invention, if the application program is switched from the background to the foreground, the user needs to re-search for the reading interruption position on behalf of the interface that needs to re-display the application program, and thus the display mode of the application interface is changed.
The following describes a specific implementation procedure of the information display method provided by the embodiment of the present invention in combination with a specific example interface.
As one example, the user is browsing the interface of the B application. And if the user browses the interface of the application B, switching the screen state of the electronic equipment from the vertical screen state to the horizontal screen state. As shown in fig. 2, the current application interface is displayed in a portrait screen display before the screen is rotated. The information of the user's eye gaze before rotating the screen is "xxxxxxxxx" in fig. 2. And in the corresponding relation between the application identifier and the user eye-gaze information, the target user eye-gaze information corresponding to the application identifier of the application B is "xxxxxxxxx".
And after the eye-gazing information of the target user corresponding to the application identifier of the application B is obtained from the corresponding relation, matching the eye-gazing information of the target user with the information in the current application interface in the horizontal screen display mode.
In a first way, information matching the eye gaze information of the target user may be highlighted in a predetermined manner to prompt the user. Wherein the predetermined manner includes at least one of: displaying fonts of information matched with eye gaze information of a target user in preset font colors; displaying fonts of information matched with eye gaze information of a target user in a preset font type; displaying the fonts of the information matched with the eye gaze information of the target user in a preset font size; and displaying the background of the information matched with the eye gaze information of the target user in a preset background color. As shown in fig. 3, the fonts of the information matched with the eye-gaze information of the target user are displayed in a first preset font color, and the fonts of the information not matched with the eye-gaze information of the target user are displayed in a second preset font color for prompting the user.
In a second way, the current gaze point of the user's eye may be re-detected. And then, adjusting the display position of the information matched with the eye gaze information of the target user in the current application interface in the horizontal screen display mode, so that the information matched with the eye gaze information of the target user is displayed at the position corresponding to the current gaze point of the user eye in the current application interface in the horizontal screen display mode. That is, the last information read by the user in the portrait screen state is displayed exactly at the current gaze point of the user's eyes.
In the embodiment of the invention, in the process of browsing the application interface by the user, under the condition that the display mode of the application interface is adjusted, the user does not need to search the last position read before the display mode is changed again, and the last information read before the display mode of the application interface is displayed in a preset mode to be directly prompted by the user or automatically adjusted to the last position read before the display mode is changed, so that the user reading experience is improved.
In the embodiment of the invention, when the change of the gaze point of the user in the current application interface in the second display mode is detected, namely, the user continues to read, the highlighting of the information matched with the eye gaze information of the target user is cleared, namely, the information matched with the eye gaze information of the target user is displayed in the original display mode, and the information matched with the eye gaze information of the target user is not displayed in the preset mode.
In some embodiments of the present invention, if a user releases an application, in the correspondence, the application identifier of the application and the eye gaze information of the user corresponding to the application identifier are cleared, so as to save the storage space of the electronic device, and when the user reopens the application, the application identifier of the application is newly added again, and the gaze information of the eyes of the user in the display interface of the application is associated with the application identifier.
Fig. 4 shows a schematic structural diagram of an information display device 400 according to an embodiment of the present invention. As shown in fig. 4, the information display apparatus 400 includes:
the first application identifier obtaining module 410 is configured to obtain, when the current application interface changes from the first display mode to the second display mode, a target application identifier of a target application to which the current application interface belongs.
The eye-gaze information determining module 420 is configured to determine, based on the established correspondence between the application identifier and the user eye-gaze information, target user eye-gaze information corresponding to the target application identifier, where the target user eye-gaze information is information of user eye-gaze in the current application interface in the first display mode.
And the information matching module 430 is configured to match the eye gaze information of the target user with information in the current application interface in the second display mode.
The display module 440 is configured to display, in a predetermined manner, information matching the eye-gaze information of the target user in the current application interface in the second display manner, or display, in a position corresponding to the current gaze point of the user's eye in the current application interface in the second display manner, information matching the eye-gaze information of the target user.
Wherein the information that does not match the eye gaze information of the target user is displayed in a manner different from the predetermined manner.
According to the embodiment of the invention, the latest information watched by the eyes of the user in the first recorded display mode is obtained, and the information matched with the eye-watched information of the target user is highlighted in an application interface in the second recorded display mode in a preset mode different from the display mode of the information not matched with the eye-watched information of the target user. Or, in the application interface in the second display mode, the information matched with the eye gaze information of the target user is automatically adjusted to the current gaze point of the eyes of the user, so that the user can quickly find the last position read by the user before the display mode of the application interface changes, the time for the user to search the last information read by the user before the display mode of the application interface changes is reduced, and the searching efficiency is improved.
In an embodiment of the present invention, the case that the current application interface changes from the first display mode to the second display mode includes any one of the following cases: the screen state of the electronic device is switched between a first state and a second state, and the target application is switched from the background to the foreground.
In the embodiment of the invention, the first state is a horizontal screen state, and the second state is a vertical screen state; or the first state is a split screen state, and the second state is a full screen state; or, in the case where the electronic device is a foldable electronic device, the first state is a folded state and the second state is an unfolded state.
In an embodiment of the invention, the predetermined manner comprises at least one of the following: displaying fonts of information matched with eye gaze information of a target user in preset font colors; displaying fonts of information matched with eye gaze information of a target user in a preset font type; displaying the fonts of the information matched with the eye gaze information of the target user in a preset font size; and displaying the background of the information matched with the eye gaze information of the target user in a preset background color.
In an embodiment of the present invention, the information display apparatus further includes:
and the image acquisition module is used for acquiring the face image.
And the position determining module is used for determining the position coordinates of the gaze point of the eyes of the user in the face image on the application interface.
And the eye gaze information acquisition module is used for acquiring user eye gaze information in a preset area taking the position coordinates as the center in the application interface.
And the second application identifier acquisition module is used for acquiring the application identifier of the application to which the application interface belongs.
And the corresponding relation establishing module is used for establishing the corresponding relation between the application identifier and the user eye gazing information.
The information display device provided in the embodiment of the present invention can implement each process in the method embodiments of fig. 1 to 3, and in order to avoid repetition, a detailed description is omitted here.
Fig. 5 is a schematic hardware structure of an electronic device implementing various embodiments of the present invention, where the electronic device 500 includes, but is not limited to: radio frequency unit 501, network module 502, audio output unit 503, input unit 504, sensor 505, display unit 506, user input unit 507, interface unit 508, memory 509, processor 510, and power source 511. It will be appreciated by those skilled in the art that the electronic device structure shown in fig. 5 is not limiting of the electronic device and that the electronic device may include more or fewer components than shown, or may combine certain components, or a different arrangement of components. In the embodiment of the invention, the electronic equipment comprises, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer and the like.
The processor 510 is configured to obtain a target application identifier of a target application to which the current application interface belongs, where the current application interface changes from the first display mode to the second display mode; determining target user eye gaze information corresponding to a target application identifier based on the established correspondence between the application identifier and the user eye gaze information, wherein the target user eye gaze information is information of user eye gaze in a current application interface in a first display mode; matching the eye gazing information of the target user with the information in the current application interface in the second display mode; displaying information matched with the eye-gazing information of the target user in a preset mode in the current application interface in the second display mode, or displaying the information matched with the eye-gazing information of the target user at a position corresponding to the current gazing point of the eyes of the user in the current application interface in the second display mode; wherein the information that does not match the eye gaze information of the target user is displayed in a manner different from the predetermined manner.
According to the embodiment of the invention, the latest information watched by the eyes of the user in the first recorded display mode is obtained, and the information matched with the eye-watched information of the target user is highlighted in an application interface in the second recorded display mode in a preset mode different from the display mode of the information not matched with the eye-watched information of the target user. Or, in the application interface in the second display mode, the information matched with the eye gaze information of the target user is automatically adjusted to the current gaze point of the eyes of the user, so that the user can quickly find the last position read by the user before the display mode of the application interface changes, the time for the user to search the last information read by the user before the display mode of the application interface changes is reduced, and the searching efficiency is improved.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 501 may be used to receive and send information or signals during a call, specifically, receive downlink data from a base station, and then process the downlink data with the processor 510; and, the uplink data is transmitted to the base station. Typically, the radio frequency unit 501 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 501 may also communicate with networks and other devices through a wireless communication system.
The electronic device provides wireless broadband internet access to the user through the network module 502, such as helping the user to send and receive e-mail, browse web pages, access streaming media, and the like.
The audio output unit 503 may convert audio data received by the radio frequency unit 501 or the network module 502 or stored in the memory 509 into an audio signal and output as sound. Also, the audio output unit 503 may also provide audio output (e.g., a call signal reception sound, a message reception sound, etc.) related to a specific function performed by the electronic device 500. The audio output unit 503 includes a speaker, a buzzer, a receiver, and the like.
The input unit 504 is used for receiving an audio or video signal. The input unit 504 may include a graphics processor (Graphics Processing Unit, GPU) 5041 and a microphone 5042, the graphics processor 5041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 506. The image frames processed by the graphics processor 5041 may be stored in the memory 509 (or other storage medium) or transmitted via the radio frequency unit 501 or the network module 502. Microphone 5042 may receive sound and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output that can be transmitted to the mobile communication base station via the radio frequency unit 501 in case of a telephone conversation mode.
The electronic device 500 also includes at least one sensor 505, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 5061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 5061 and/or the backlight when the electronic device 500 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when stationary, and can be used for recognizing the gesture of the electronic equipment (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; the sensor 505 may further include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which are not described herein.
The display unit 506 is used to display information input by a user or information provided to the user. The display unit 506 may include a display panel 5061, and the display panel 5061 may be configured in a form of a Liquid crystal display (Liquid CrystalDisplay, LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 507 is operable to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072. Touch panel 5071, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on touch panel 5071 or thereabout using any suitable object or accessory such as a finger, stylus, etc.). Touch panel 5071 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 510, and receives and executes commands sent by the processor 510. In addition, the touch panel 5071 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 5071, the user input unit 507 may include other input devices 5072. In particular, other input devices 5072 may include, but are not limited to, physical keyboards, function keys (e.g., volume control keys, switch keys, etc.), trackballs, mice, joysticks, and so forth, which are not described in detail herein.
Further, the touch panel 5071 may be overlaid on the display panel 5061, and when the touch panel 5071 detects a touch operation thereon or thereabout, the touch operation is transmitted to the processor 510 to determine a type of touch event, and then the processor 510 provides a corresponding visual output on the display panel 5061 according to the type of touch event. Although in fig. 5, the touch panel 5071 and the display panel 5061 are two independent components for implementing the input and output functions of the electronic device, in some embodiments, the touch panel 5071 and the display panel 5061 may be integrated to implement the input and output functions of the electronic device, which is not limited herein.
The interface unit 508 is an interface for connecting an external device to the electronic apparatus 500. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 508 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 500 or may be used to transmit data between the electronic apparatus 500 and an external device.
The memory 509 may be used to store software programs as well as various data. The memory 509 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, the memory 509 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 510 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 509, and calling data stored in the memory 509, thereby performing overall monitoring of the electronic device. Processor 510 may include one or more processing units; preferably, the processor 510 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 510.
The electronic device 500 may also include a power supply 511 (e.g., a battery) for powering the various components, and preferably the power supply 511 may be logically connected to the processor 510 via a power management system that performs functions such as managing charging, discharging, and power consumption.
In addition, the electronic device 500 includes some functional modules, which are not shown, and will not be described herein.
Preferably, the embodiment of the present invention further provides an electronic device, further including a processor 510, a memory 509, and a computer program stored in the memory 509 and capable of running on the processor 510, where the computer program when executed by the processor 510 implements each process of the above embodiment of the information display method, and the same technical effects can be achieved, and for avoiding repetition, a detailed description is omitted herein.
The embodiment of the invention also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor, realizes the processes of the information display method embodiment, and can achieve the same technical effects, and in order to avoid repetition, the description is omitted here. Wherein the computer readable storage medium is selected from Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention. The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are to be protected by the present invention.
Claims (8)
1. An information display method, characterized in that the method comprises:
under the condition that a current application interface is changed from a first display mode to a second display mode, acquiring a target application identifier of a target application to which the current application interface belongs;
determining target user eye gaze information corresponding to the target application identifier based on the established correspondence between the application identifier and the user eye gaze information, wherein the target user eye gaze information is information of user eye gaze in the current application interface in the first display mode;
matching the eye gaze information of the target user with the information in the current application interface in the second display mode;
displaying information matched with the eye gaze information of the target user in a preset mode in the current application interface in the second display mode, or displaying the information matched with the eye gaze information of the target user at a position corresponding to the current gaze point of the user in the current application interface in the second display mode;
wherein the display mode of the information which is not matched with the eye gaze information of the target user is different from the preset mode;
the condition that the current application interface is changed from the first display mode to the second display mode comprises any one of the following conditions:
the screen state of the electronic equipment is switched between a first state and a second state, and the target application is switched from the background to the foreground;
the first state is a split screen state, and the second state is a full screen state.
2. The method of claim 1, wherein the first state is a landscape state and the second state is a portrait state;
or, in the case that the electronic device is a foldable electronic device, the first state is a folded state and the second state is an unfolded state.
3. The method of claim 1, wherein the predetermined manner comprises at least one of:
displaying the fonts of the information matched with the eye gaze information of the target user in preset font colors;
displaying the fonts of the information matched with the eye gaze information of the target user in a preset font type;
displaying the fonts of the information matched with the eye gaze information of the target user in a preset font size; and
and displaying the background of the information matched with the eye gaze information of the target user in a preset background color.
4. The method according to claim 1, wherein the method further comprises:
acquiring a face image;
determining position coordinates of a gaze point of eyes of a user in the face image on the application interface;
acquiring user eye gaze information in a preset area with the position coordinates as the center in the application interface;
acquiring an application identifier of an application to which the application interface belongs;
and establishing a corresponding relation between the application identifier and the eye gaze information of the user.
5. An information display device, characterized in that the device comprises:
the first application identification acquisition module is used for acquiring a target application identification of a target application to which the current application interface belongs under the condition that the current application interface is changed from a first display mode to a second display mode;
the eye-gaze information determining module is used for determining target user eye-gaze information corresponding to the target application identifier based on the established correspondence between the application identifier and the user eye-gaze information, wherein the target user eye-gaze information is information of user eye-gaze in the current application interface in the first display mode;
the information matching module is used for matching the eye gazing information of the target user with the information in the current application interface in the second display mode;
the display module is used for displaying information matched with the eye-fixation information of the target user in a preset mode in the current application interface in the second display mode, or displaying the information matched with the eye-fixation information of the target user at a position corresponding to the current eye-fixation point of the user in the current application interface in the second display mode;
wherein the display mode of the information which is not matched with the eye gaze information of the target user is different from the preset mode;
the condition that the current application interface is changed from the first display mode to the second display mode comprises any one of the following conditions:
the screen state of the electronic equipment is switched between a first state and a second state, and the target application is switched from the background to the foreground;
the first state is a split screen state, and the second state is a full screen state.
6. The apparatus of claim 5, wherein the first state is a landscape state and the second state is a portrait state;
or, in the case that the electronic device is a foldable electronic device, the first state is a folded state and the second state is an unfolded state.
7. The apparatus of claim 5, wherein the predetermined manner comprises at least one of:
displaying the fonts of the information matched with the eye gaze information of the target user in preset font colors;
displaying the fonts of the information matched with the eye gaze information of the target user in a preset font type;
displaying the fonts of the information matched with the eye gaze information of the target user in a preset font size; and
and displaying the background of the information matched with the eye gaze information of the target user in a preset background color.
8. The apparatus of claim 5, wherein the apparatus further comprises:
the image acquisition module is used for acquiring a face image;
the position determining module is used for determining position coordinates of a gaze point of eyes of a user in the face image on the application interface;
the eye gaze information acquisition module is used for acquiring user eye gaze information in a preset area taking the position coordinates as the center in the application interface;
the second application identifier acquisition module is used for acquiring an application identifier of an application to which the application interface belongs;
and the corresponding relation establishing module is used for establishing the corresponding relation between the application identifier and the user eye gazing information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911044192.5A CN110928407B (en) | 2019-10-30 | 2019-10-30 | Information display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911044192.5A CN110928407B (en) | 2019-10-30 | 2019-10-30 | Information display method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110928407A CN110928407A (en) | 2020-03-27 |
| CN110928407B true CN110928407B (en) | 2023-06-09 |
Family
ID=69849912
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911044192.5A Active CN110928407B (en) | 2019-10-30 | 2019-10-30 | Information display method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110928407B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111596986B (en) * | 2020-04-24 | 2024-04-02 | 维沃移动通信有限公司 | Information prompting method and electronic equipment |
| CN111695516B (en) * | 2020-06-12 | 2023-11-07 | 百度在线网络技术（北京）有限公司 | Thermodynamic diagram generation method, device and equipment |
| CN113723351B (en) * | 2021-09-13 | 2024-07-02 | 中国银行股份有限公司 | Interface optimization method, system, storage medium and electronic equipment |
| CN114661401B (en) * | 2022-03-28 | 2024-06-21 | Oppo广东移动通信有限公司 | Interface display method and device, storage medium and terminal |
| CN116301357A (en) * | 2023-02-28 | 2023-06-23 | 维沃移动通信有限公司 | Display method and device and wearable equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108984489A (en) * | 2018-07-17 | 2018-12-11 | 北京七鑫易维信息技术有限公司 | For the reading method of electronic document, device, terminal device and storage medium |
| CN109634481A (en) * | 2018-12-03 | 2019-04-16 | 惠州Tcl移动通信有限公司 | Text display method, device, mobile terminal and storage medium |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8643680B2 (en) * | 2011-04-08 | 2014-02-04 | Amazon Technologies, Inc. | Gaze-based content display |
| CN102707946B (en) * | 2012-04-17 | 2016-08-17 | Tcl集团股份有限公司 | A kind of processing method and processing device of Application Program Interface |
| CN103399636A (en) * | 2013-07-30 | 2013-11-20 | 深圳市中兴移动通信有限公司 | Method and device for adjusting terminal font through eye motion |
| CN104808923B (en) * | 2015-05-25 | 2018-07-06 | 联想(北京)有限公司 | A kind of screen control method and electronic equipment |
| CN105892647B (en) * | 2016-03-23 | 2018-09-25 | 京东方科技集团股份有限公司 | A kind of display screen method of adjustment, its device and display device |
| CN106648056A (en) * | 2016-09-30 | 2017-05-10 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for switching between landscape display and portrait display of mobile terminal |
| CN106527693A (en) * | 2016-10-31 | 2017-03-22 | 维沃移动通信有限公司 | Application control method and mobile terminal |
| CN107885512B (en) * | 2017-11-14 | 2019-08-16 | 维沃移动通信有限公司 | A kind of application program installation method, mobile terminal |
| CN107993604A (en) * | 2017-11-28 | 2018-05-04 | 珠海格力电器股份有限公司 | Display screen adjusting method and device |
| CN109164908B (en) * | 2018-07-03 | 2021-12-24 | 维沃移动通信有限公司 | Interface control method and mobile terminal |
| CN108958587B (en) * | 2018-07-06 | 2020-09-08 | Oppo广东移动通信有限公司 | Split screen processing method and device, storage medium and electronic equipment |
| CN109270986A (en) * | 2018-07-27 | 2019-01-25 | 努比亚技术有限公司 | Flexible screen terminal and its display methods and computer readable storage medium |
| CN109782970B (en) * | 2018-12-25 | 2021-01-08 | 维沃移动通信有限公司 | Display method and terminal |
| CN110262659B (en) * | 2019-06-18 | 2022-03-15 | Oppo广东移动通信有限公司 | Application control method and related device |
| CN110308769B (en) * | 2019-06-28 | 2021-08-24 | 维沃移动通信有限公司 | Information display method and terminal |
-
2019
- 2019-10-30 CN CN201911044192.5A patent/CN110928407B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108984489A (en) * | 2018-07-17 | 2018-12-11 | 北京七鑫易维信息技术有限公司 | For the reading method of electronic document, device, terminal device and storage medium |
| CN109634481A (en) * | 2018-12-03 | 2019-04-16 | 惠州Tcl移动通信有限公司 | Text display method, device, mobile terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110928407A (en) | 2020-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019196707A1 (en) | Mobile terminal control method and mobile terminal | |
| US11258893B2 (en) | Method for prompting notification message and mobile terminal | |
| CN110928407B (en) | Information display method and device | |
| CN108073343B (en) | display interface adjusting method and mobile terminal | |
| CN109240577B (en) | Screen capturing method and terminal | |
| CN108182019A (en) | A kind of suspension control display processing method and mobile terminal | |
| CN108874352B (en) | Information display method and mobile terminal | |
| CN107728923B (en) | Operation processing method and mobile terminal | |
| CN109523253B (en) | Payment method and device | |
| CN109739407B (en) | Information processing method and terminal equipment | |
| CN109558046B (en) | Information display method and terminal equipment | |
| CN108898555B (en) | Image processing method and terminal equipment | |
| CN111031253B (en) | Shooting method and electronic equipment | |
| CN107608606A (en) | A kind of image display method, mobile terminal and computer-readable recording medium | |
| CN110933494A (en) | Picture sharing method and electronic equipment | |
| CN109669656B (en) | Information display method and terminal equipment | |
| CN111142679A (en) | Display processing method and electronic equipment | |
| CN107729100B (en) | Interface display control method and mobile terminal | |
| CN108196781B (en) | Interface display method and mobile terminal | |
| CN109522524A (en) | A kind of text browsing methods and terminal device | |
| CN109597546B (en) | Icon processing method and terminal equipment | |
| CN109902679B (en) | Icon display method and terminal equipment | |
| CN111522477A (en) | Application starting method and electronic equipment | |
| CN110851219A (en) | Information processing method and electronic equipment | |
| CN110780751A (en) | Information processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |