[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN109947617B - Method, terminal and readable storage medium for monitoring display content of application interface - Google Patents

Method, terminal and readable storage medium for monitoring display content of application interface Download PDF

Info

Publication number
CN109947617B
CN109947617B CN201910138579.0A CN201910138579A CN109947617B CN 109947617 B CN109947617 B CN 109947617B CN 201910138579 A CN201910138579 A CN 201910138579A CN 109947617 B CN109947617 B CN 109947617B
Authority
CN
China
Prior art keywords
control
target
interface
monitoring
application
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910138579.0A
Other languages
Chinese (zh)
Other versions
CN109947617A (en
Inventor
王照金
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Priority to CN201910138579.0A priority Critical patent/CN109947617B/en
Publication of CN109947617A publication Critical patent/CN109947617A/en
Application granted granted Critical
Publication of CN109947617B publication Critical patent/CN109947617B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The application relates to a method, a terminal and a readable storage medium for monitoring display content of an application interface, wherein the method comprises the following steps: starting a target interface; in the process of drawing the control in the target interface, determining whether the currently drawn control is a control to be positioned; under the condition that the currently drawn control is determined to be the control to be positioned, taking the currently drawn control as a target control, and monitoring whether the display state of the target control changes or not; and under the condition that the display state change is determined, acquiring control information of the target control, and sending a state change notification carrying the control information. The embodiment of the application solves the technical problems that the existing interface can be monitored only and the control cannot be monitored, and achieves the technical effect of simply and efficiently monitoring the display state change of the control.

Description

Method, terminal and readable storage medium for monitoring display content of application interface
Technical Field
The present disclosure relates to the field of wearable devices, and in particular, to a method, a terminal, and a readable storage medium for monitoring display content of an application interface.
Background
At present, when a related processing operation is executed by a third party application, it is generally required to determine which interface of the application is currently started, and the Android system only provides a class name of the interface, however, some third party applications add different controls in the same interface class name, so as to display different contents through the visible and invisible of the controls.
However, because of the addition of different controls, this results in an inability to locate which interface is currently displayed by the interface class name.
In view of the above problems, no effective solution has been proposed at present.
Disclosure of Invention
In order to solve the technical problems or at least partially solve the technical problems, the application provides a method, a terminal and a readable storage medium for monitoring display content of an application interface.
In a first aspect, the present application provides a method for monitoring display content of an application interface, including:
starting a target interface;
in the process of drawing the control in the target interface, determining whether the currently drawn control is a control to be positioned;
under the condition that the currently drawn control is determined to be the control to be positioned, taking the currently drawn control as a target control, and monitoring whether the display state of the target control changes or not;
and under the condition that the display state change is determined, acquiring control information of the target control, and sending a state change notification carrying the control information.
In one embodiment, when determining that the currently drawn control is a control to be positioned, taking the currently drawn control as a target control, and monitoring whether a display state change occurs in the target control, the method includes:
setting a monitoring mark for a control to be drawn currently under the condition that the control to be drawn currently is determined to be the control to be positioned;
and monitoring whether the display state of the target control changes according to the monitoring mark.
In one embodiment, the display state change includes one of: the invisible state changes from the visible state to the invisible state and the invisible state changes from the invisible state to the visible state.
In one embodiment, the control information includes at least one of: the class name of the control, the control ID, the description information of the control, and whether the control is visible.
In one embodiment, the initiation target interface includes:
receiving a starting request for a target application;
responding to the starting request, and starting the target application;
and under the condition of starting the target application, starting the target interface.
In one embodiment, the target application is an application installed in an Android system.
In one embodiment, when it is determined that a display state change occurs, control information of the target control is obtained, and a state change notification carrying the control information is sent, and then the method further includes:
and executing related processing operation according to the control information.
In one embodiment, after determining whether the control to be positioned exists in the target interface according to the drawing result, the method further includes:
determining whether drawing of all the controls in the target interface is completed or not;
and returning indication information under the condition that the drawing of all the controls in the target interface is finished and the control to be positioned is not found, wherein the indication information is used for indicating that the control to be positioned is not found.
In a second aspect, the present application provides a terminal, including:
a memory, a processor, and a computer program stored on the memory and executable on the processor;
the computer program when executed by the processor performs the steps of:
starting a target interface;
in the process of drawing the control in the target interface, determining whether the currently drawn control is a control to be positioned;
under the condition that the currently drawn control is determined to be the control to be positioned, taking the currently drawn control as a target control, and monitoring whether the display state of the target control changes or not;
and under the condition that the display state change is determined, acquiring control information of the target control, and sending a state change notification carrying the control information.
In a third aspect, the present application provides a computer readable storage medium having stored thereon a program for listening to display content of an application interface, the program for listening to display content of an application interface implementing the following steps when executed by a processor:
starting a target interface;
in the process of drawing the control in the target interface, determining whether the currently drawn control is a control to be positioned;
under the condition that the currently drawn control is determined to be the control to be positioned, taking the currently drawn control as a target control, and monitoring whether the display state of the target control changes or not;
and under the condition that the display state change is determined, acquiring control information of the target control, and sending a state change notification carrying the control information.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages:
according to the method provided by the embodiment of the application, in the process of starting the target interface and drawing the controls in the target interface, whether the currently drawn controls are the controls to be positioned or not is determined one by one, and under the condition that the currently drawn controls are determined to be the controls to be positioned, monitoring is conducted on the controls to determine whether the controls have display state changes or not. In other words, in the process of drawing the control, the identification of the target control is realized, so that the monitoring of the target control is finally realized, the existing technical problem that only the interface can be monitored and the control cannot be monitored is solved, and the technical effect of simply and efficiently monitoring the display state change of the control is achieved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, and it will be obvious to a person skilled in the art that other drawings can be obtained from these drawings without inventive effort.
Fig. 1 is a schematic diagram of a wearable device provided in various embodiments of the present application;
fig. 2 is another schematic diagram of a wearable device provided by various embodiments of the present application;
fig. 3 is a schematic hardware structure of a wearable device according to various embodiments of the present application;
fig. 4 is a flowchart of a method for monitoring display content of an application interface according to an embodiment of the present application.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
In the following description, suffixes such as "module", "component", or "unit" for representing elements are used only for facilitating the description of the present invention, and have no specific meaning per se. Thus, "module," "component," or "unit" may be used in combination.
The terminal may be implemented in various forms. For example, the terminals described in the present invention may include mobile terminals such as wearable devices, smart bracelets, cell phones, tablet computers, notebook computers, palm top computers, personal digital assistants (PersonalDigital Assistant, PDA), portable media players (Portable Media Player, PMP), navigation, pedometers, and the like. With the continuous development of screen technology, screen forms such as flexible screens, folding screens and the like appear, and the mobile terminal can also be used as a wearable device.
The following description will be given taking a mobile terminal as an example, and those skilled in the art will understand that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for a moving purpose.
Referring to fig. 1 and fig. 2, which are schematic structural diagrams of a wearable device provided in an embodiment of the present application, the fig. includes a wearable device 100, and referring to fig. 3, which is a schematic hardware structural diagram of a wearable device implementing various embodiments of the present invention, the wearable device 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an a/V (audio/video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. Those skilled in the art will appreciate that the wearable device structure shown in fig. 3 does not constitute a limitation of the wearable device, and that the wearable device may include more or fewer components than shown, or certain components in combination, or a different arrangement of components.
The following describes the various components of the wearable device in detail with reference to fig. 3:
the radio frequency unit 101 may be used for receiving and transmitting signals during the information receiving or communication process, specifically, after receiving downlink information of the base station, processing the downlink information by the processor 110; and, the uplink data is transmitted to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, global System for Mobile communications), GPRS (General Packet Radio Service ), CDMA2000 (Code Division Multiple Access, CDMA 2000), WCDMA (Wideband Code Division Multiple Access ), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, time Division synchronous code Division multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency Division Duplex Long term evolution), and TDD-LTE (Time Division Duplexing-Long Term Evolution, time Division Duplex Long term evolution), etc.
WiFi belongs to a short-distance wireless transmission technology, and the wearable device can help a user to send and receive emails, browse webpages, access streaming media and the like through the WiFi module 102, so that wireless broadband Internet access is provided for the user. Although fig. 3 shows a WiFi module 102, it is understood that it does not belong to the necessary constitution of the wearable device, and can be omitted entirely as required within the scope of not changing the essence of the invention.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the wearable device 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output (e.g., call signal reception sound, message reception sound, etc.) related to a specific function performed by the wearable device 100. The audio output unit 103 may include a speaker, a buzzer, and the like.
The a/V input unit 104 is used to receive an audio or video signal. The a/V input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, the graphics processor 1041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound into audio data. The processed audio (voice) data may be converted into a format output that can be transmitted to the mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting the audio signal.
The wearable device 100 further comprises at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and the proximity sensor can turn off the display panel 1061 and/or the backlight when the wearable device 100 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when stationary, and can be used for applications of recognizing the gesture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; as for other sensors such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that may also be configured in the mobile phone, the detailed description thereof will be omitted.
The display unit 106 is used to display information input by a user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 107 may be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the wearable device. In particular, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 1071 or thereabout by using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends the touch point coordinates to the processor 110, and can receive and execute commands sent from the processor 110. Further, the touch panel 1071 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 107 may include other input devices 1072 in addition to the touch panel 1071. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, mouse, joystick, etc., as specifically not limited herein.
Further, the touch panel 1071 may overlay the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or thereabout, the touch panel 1071 is transferred to the processor 110 to determine the type of touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of touch event. Although in fig. 3, the touch panel 1071 and the display panel 1061 are two independent components for implementing the input and output functions of the wearable device, in some embodiments, the touch panel 1071 may be integrated with the display panel 1061 to implement the input and output functions of the wearable device, which is not limited herein.
The interface unit 108 serves as an interface through which at least one external device can be connected with the wearable apparatus 100. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the wearable apparatus 100 or may be used to transmit data between the wearable apparatus 100 and the external device.
Memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area that may store an operating system, application programs required for at least one function (such as a sound playing function, an image playing function, etc.), and a storage data area; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 110 is a control center of the wearable device, connects various parts of the entire wearable device with various interfaces and lines, performs various functions of the wearable device and processes data by running or executing software programs and/or modules stored in the memory 109, and invoking data stored in the memory 109, thereby performing overall monitoring of the wearable device. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The wearable device 100 may further include a power source 111 (such as a battery) for powering the various components, and preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to perform functions of managing charging, discharging, and power consumption management through the power management system.
Although not shown in fig. 3, the wearable device 100 may further include a bluetooth module or the like, which is not described herein.
Based on the wearable mobile terminal hardware structure, various embodiments of the method are provided.
Fig. 4 is a flow chart of a method for a server to monitor display content of an application interface according to an embodiment of the present application. Although the present application provides a method operation step or terminal structure as shown in the following embodiments or drawings, more or fewer operation steps or module units may be included in the method or terminal based on conventional or non-inventive labor. In the steps or structures where there is no necessary causal relationship logically, the execution order of the steps or the module structure of the terminal is not limited to the execution order or the module structure shown in the drawings and described in the embodiments of the present application. The described methods or module structures may be implemented sequentially or in parallel (e.g., in a parallel processor or multithreaded environment, or even in a distributed processing environment) in accordance with the embodiments or the method or module structure connection illustrated in the figures when implemented in a practical end-use application.
As shown in fig. 4, a method for monitoring display content of an application interface according to an embodiment of the present application may include the following steps:
step 401: starting a target interface;
step 402: in the process of drawing the control in the target interface, determining whether the currently drawn control is a control to be positioned;
that is, in the process of drawing the controls, whether the current drawn control is the control to be positioned is determined one by one. The method comprises the steps of obtaining image information of a control to be identified in advance, comparing the object information of the control to be identified with a drawing result to determine whether the control to be drawn currently is the control to be positioned or not, if so, determining that the control to be drawn currently is the control to be positioned, and if not, determining that the control to be drawn currently is not the control to be positioned.
It is noted, however, that the matching scheme given above is only an exemplary description, when actually implemented. Other ways of matching are also possible, as this is not particularly limited in this application.
Step 403: under the condition that the currently drawn control is determined to be the control to be positioned, taking the currently drawn control as a target control, and monitoring whether the display state of the target control changes or not;
in order to realize effective monitoring, a monitoring mark can be set for the control needing to be positioned under the condition that the control needing to be positioned is determined to exist; and determining whether the display state of the target control changes according to the monitoring mark. That is, a monitoring mark is set for the target control, and is used for marking that the display state change of the control needs to be monitored, and based on the monitoring mark, simple and efficient monitoring can be realized.
Wherein, the display state change may include one of the following: the invisible state changes from the visible state to the invisible state and the invisible state changes from the invisible state to the visible state. That is, the control changes from visible to invisible or from invisible to visible, and can be used as a display state to change, i.e. all need to be reported
Step 404: and under the condition that the display state change is determined, acquiring control information of the target control, and sending a state change notification carrying the control information.
In an implementation, the control information may include, but is not limited to, at least one of: the class name of the control, the control ID, the description information of the control, and whether the control is visible.
In the above example, in the process of starting the target interface and drawing the controls in the target interface, determining whether the currently drawn controls are controls to be positioned one by one, and monitoring the controls to determine whether the controls have display state changes under the condition that the currently drawn controls are determined to be the controls to be positioned. In other words, in the process of drawing the control, the identification of the target control is realized, so that the monitoring of the target control is finally realized, the existing technical problem that only the interface can be monitored and the control cannot be monitored is solved, and the technical effect of simply and efficiently monitoring the display state change of the control is achieved.
The step 401 of starting the target interface may include:
s1: receiving a starting request for a target application;
s2: responding to the starting request, and starting the target application;
s3: and under the condition of starting the target application, starting the target interface.
The target application can be an application installed in the Android system, that is, the method can be adopted for a third party application installed in the Android system to effectively monitor the change of the control in the interface.
In one embodiment, in the case that the display state change is determined, control information of the target control is acquired, a state change notification carrying the control information is sent, and then related processing operations can be executed according to the control information. That is, operations to be performed can be performed according to the control information described above.
In the implementation process, the controls in the target interface are judged one by one, and if all the controls in the target interface are not the controls to be positioned, indication information is returned, wherein the indication information is used for indicating that the controls to be positioned are not found.
The above method is described below in connection with a specific embodiment, however, it should be noted that this specific embodiment is only for better illustrating the present application and is not meant to be a undue limitation on the present application.
In this example, a method for monitoring display content of an application interface is provided, which may include the following steps:
step 1: when an application starts a certain interface, when all the controls of the interface are drawn, if finding that the currently drawn controls need to be positioned, entering a step 2, otherwise, entering a step 5;
step 2: adding a monitoring mark;
step 3: when the control provided with the monitoring mark changes in a visible or invisible way, obtaining information such as class name, ID, description information, visibility and the like of the control, and sending a notification of the change of the control;
step 4: when a notification of the change of the control is received, executing related processing operation according to the control information;
step 5: prompting that the control was not found.
The embodiment of the application also provides a specific implementation mode of the electronic device, which can realize all the steps in the method for monitoring the display content of the application interface in the embodiment, wherein the terminal specifically comprises the following steps:
a processor (processor), a memory (memory), a communication interface (Communications Interface), and a bus;
the processor, the memory and the communication interface complete communication with each other through the bus; the processor is configured to invoke the computer program in the memory, where the processor executes the computer program to implement all the steps in the method for monitoring the display content of the application interface in the foregoing embodiment, for example, the processor executes the computer program to implement the following steps:
step 1: starting a target interface;
step 2: in the process of drawing the control in the target interface, determining whether the currently drawn control is a control to be positioned;
step 3: under the condition that the currently drawn control is determined to be the control to be positioned, taking the currently drawn control as a target control, and monitoring whether the display state of the target control changes or not;
step 4: and under the condition that the display state change is determined, acquiring control information of the target control, and sending a state change notification carrying the control information.
As can be seen from the foregoing description, in the embodiment of the present application, in the process of starting the target interface and drawing the controls in the target interface, whether the currently drawn control is a control to be positioned is determined one by one, and if the currently drawn control is determined to be a control to be positioned, monitoring is performed on the control to determine whether the control has a display state change. In other words, in the process of drawing the control, the identification of the target control is realized, so that the monitoring of the target control is finally realized, the existing technical problem that only the interface can be monitored and the control cannot be monitored is solved, and the technical effect of simply and efficiently monitoring the display state change of the control is achieved.
The embodiments of the present application also provide a computer readable storage medium capable of implementing all the steps in the method for monitoring application interface display content in the above embodiments, where the computer readable storage medium stores a computer program, and the computer program when executed by a processor implements all the steps in the method for monitoring application interface display content in the above embodiments, for example, the processor implements the following steps when executing the computer program:
step 1: starting a target interface;
step 2: in the process of drawing the control in the target interface, determining whether the currently drawn control is a control to be positioned;
step 3: under the condition that the currently drawn control is determined to be the control to be positioned, taking the currently drawn control as a target control, and monitoring whether the display state of the target control changes or not;
step 4: and under the condition that the display state change is determined, acquiring control information of the target control, and sending a state change notification carrying the control information.
As can be seen from the foregoing description, in the embodiment of the present application, in the process of starting the target interface and drawing the controls in the target interface, whether the currently drawn control is a control to be positioned is determined one by one, and if the currently drawn control is determined to be a control to be positioned, monitoring is performed on the control to determine whether the control has a display state change. In other words, in the process of drawing the control, the identification of the target control is realized, so that the monitoring of the target control is finally realized, the existing technical problem that only the interface can be monitored and the control cannot be monitored is solved, and the technical effect of simply and efficiently monitoring the display state change of the control is achieved.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are to be protected by the present invention.

Claims (10)

1. A method for monitoring display content of an application interface, comprising:
starting a target interface;
in the process of drawing the control in the target interface, determining whether the currently drawn control is a control to be positioned;
under the condition that the currently drawn control is determined to be the control to be positioned, taking the currently drawn control as a target control, and monitoring whether the display state of the target control changes or not;
acquiring control information of the target control and sending a state change notification carrying the control information under the condition that the display state change is determined;
the determining whether the currently drawn control is a control to be positioned comprises:
acquiring image information of a control to be identified in advance, and matching the image information with a drawing result;
and if so, determining the currently drawn control as the control to be positioned.
2. The method according to claim 1, wherein in the case of determining that the currently drawn control is a control to be positioned, taking the currently drawn control as a target control and monitoring whether a display state change occurs in the target control comprises:
setting a monitoring mark for a control to be drawn currently under the condition that the control to be drawn currently is determined to be the control to be positioned;
and monitoring whether the display state of the target control changes according to the monitoring mark.
3. The method of claim 1, wherein the display state change comprises one of: the invisible state changes from the visible state to the invisible state and the invisible state changes from the invisible state to the visible state.
4. The method of claim 1, wherein the control information comprises at least one of: the class name of the control, the control ID, the description information of the control, and whether the control is visible.
5. The method of claim 1, wherein initiating the target interface comprises:
receiving a starting request for a target application;
responding to the starting request, and starting the target application;
and under the condition of starting the target application, starting the target interface.
6. The method of claim 5, wherein the target application is an application installed in an Android system.
7. The method according to claim 1, wherein in a case where it is determined that a display state change occurs, acquiring control information of the target control, and sending a state change notification carrying the control information, further comprising:
and executing related processing operation according to the control information.
8. The method according to any one of claims 1 to 7, further comprising, after determining whether there is a control to be positioned in the target interface according to the drawing result:
determining whether drawing of all the controls in the target interface is completed or not;
and returning indication information under the condition that the drawing of all the controls in the target interface is finished and the control to be positioned is not found, wherein the indication information is used for indicating that the control to be positioned is not found.
9. A terminal, comprising:
a memory, a processor, and a computer program stored on the memory and executable on the processor;
the computer program implementing the steps of the method according to any one of claims 1 to 8 when executed by the processor.
10. A computer-readable storage medium, wherein a program for monitoring application interface display content is stored on the computer-readable storage medium, and the program for monitoring application interface display content, when executed by a processor, implements the steps of the method for monitoring application interface display content according to any one of claims 1 to 8.
CN201910138579.0A 2019-02-25 2019-02-25 Method, terminal and readable storage medium for monitoring display content of application interface Active CN109947617B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910138579.0A CN109947617B (en) 2019-02-25 2019-02-25 Method, terminal and readable storage medium for monitoring display content of application interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910138579.0A CN109947617B (en) 2019-02-25 2019-02-25 Method, terminal and readable storage medium for monitoring display content of application interface

Publications (2)

Publication Number Publication Date
CN109947617A CN109947617A (en) 2019-06-28
CN109947617B true CN109947617B (en) 2023-05-30

Family

ID=67008033

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910138579.0A Active CN109947617B (en) 2019-02-25 2019-02-25 Method, terminal and readable storage medium for monitoring display content of application interface

Country Status (1)

Country Link
CN (1) CN109947617B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110780967B (en) * 2019-10-30 2024-06-21 努比亚技术有限公司 Application display method, terminal and computer readable storage medium
CN111858331A (en) * 2020-07-16 2020-10-30 安徽听见科技有限公司 Method, device and equipment for detecting coverage of front-end control

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1204024A2 (en) * 2000-11-02 2002-05-08 Pascal Viguie Operating method for a computer help and support system
CN104965642A (en) * 2014-05-23 2015-10-07 腾讯科技(深圳)有限公司 Method and apparatus for generating a drop-down list
US9940203B1 (en) * 2015-06-11 2018-04-10 EMC IP Holding Company LLC Unified interface for cloud-based backup and restoration
CN107908443A (en) * 2017-10-10 2018-04-13 武汉极意网络科技有限公司 A kind of action listener method, smart machine and storage medium
CN108287745A (en) * 2018-02-11 2018-07-17 青岛海信电器股份有限公司 A kind of display methods and terminal device at the interfaces WebApp

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100462909C (en) * 2006-03-31 2009-02-18 腾讯科技(深圳)有限公司 Method and device for controlling window interface display

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1204024A2 (en) * 2000-11-02 2002-05-08 Pascal Viguie Operating method for a computer help and support system
CN104965642A (en) * 2014-05-23 2015-10-07 腾讯科技(深圳)有限公司 Method and apparatus for generating a drop-down list
US9940203B1 (en) * 2015-06-11 2018-04-10 EMC IP Holding Company LLC Unified interface for cloud-based backup and restoration
CN107908443A (en) * 2017-10-10 2018-04-13 武汉极意网络科技有限公司 A kind of action listener method, smart machine and storage medium
CN108287745A (en) * 2018-02-11 2018-07-17 青岛海信电器股份有限公司 A kind of display methods and terminal device at the interfaces WebApp

Also Published As

Publication number Publication date
CN109947617A (en) 2019-06-28

Similar Documents

Publication Publication Date Title
CN110752980B (en) Message sending method and electronic equipment
CN108255378B (en) Display control method and mobile terminal
CN111049979B (en) Application sharing method, electronic equipment and computer readable storage medium
CN110062105B (en) Interface display method and terminal equipment
CN108279948B (en) Application program starting method and mobile terminal
CN108897473B (en) Interface display method and terminal
CN109857297B (en) Information processing method and terminal equipment
CN111026484A (en) Application sharing method, first electronic device and computer-readable storage medium
CN111163224B (en) Voice message playing method and electronic equipment
CN109085968B (en) Screen capturing method and terminal equipment
CN107734170B (en) Notification message processing method, mobile terminal and wearable device
CN111049510B (en) Touch key, control method and electronic equipment
CN111143002A (en) Application sharing method, electronic equipment and computer readable storage medium
CN110096203B (en) Screenshot method and mobile terminal
CN111061404A (en) Control method and first electronic device
CN110225178A (en) A kind of information display method and terminal device
CN110012151B (en) Information display method and terminal equipment
CN111131607A (en) Information sharing method, electronic equipment and computer readable storage medium
CN111061446A (en) Display method and electronic equipment
CN111475066B (en) Background switching method of application program and electronic equipment
CN111093137B (en) Volume control method, volume control equipment and computer readable storage medium
CN111158815B (en) Dynamic wallpaper blurring method, terminal and computer readable storage medium
CN109639738B (en) Voice data transmission method and terminal equipment
CN109597546B (en) Icon processing method and terminal equipment
CN111562959A (en) Icon management method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant