CN111159269B

CN111159269B - Data processing method, device and system

Info

Publication number: CN111159269B
Application number: CN201911401990.9A
Authority: CN
Inventors: 强一鹏
Original assignee: Beijing QIYI Century Science and Technology Co Ltd
Current assignee: Beijing QIYI Century Science and Technology Co Ltd
Priority date: 2019-12-30
Filing date: 2019-12-30
Publication date: 2024-02-02
Anticipated expiration: 2039-12-30
Also published as: CN111159269A

Abstract

A data processing method, device and system belong to the technical field of data processing. In the technical scheme provided by the application, the user terminal can respond to the data display operation and send a data acquisition request to the server, the server can respond to the data acquisition request sent by the user terminal and acquire instant data from a plurality of data sources, when the preset response time is up and the instant data is not successfully acquired from the plurality of data sources, the target data source which fails to acquire the instant data is determined, the target data source identification of the target data source is acquired, response data is generated according to the successfully acquired instant data and the target data source identification, and the response data is sent to the user terminal; the user terminal may also determine target data to be displayed according to the response data, and display the target data. By adopting the technical scheme provided by the application, the problem that the response time of the data acquisition request is too long when the server is in an abnormal condition can be solved.

Description

Data processing method, device and system

Technical Field

The present disclosure relates to the field of data processing technologies, and in particular, to a data processing method, device, and system.

Background

The card type interface can realize personalized display of data by displaying data of different data sources in a plurality of cards, wherein the cards can be rectangular display areas containing pictures and text information. For example, the card interface may be a video recommendation interface of a video website, the cards may be video display areas in the video recommendation interface, and video data of different data sources may be displayed in each card in the card interface.

In the related art, in order to ensure timeliness of displaying data on a card interface, when a user terminal displays data on the card interface, a data acquisition request is sent to a server for providing data, where the data acquisition request is used for requesting to acquire instant data of a plurality of data sources. After the server acquires the instant data from all the data sources indicated by the data acquisition request, the acquired instant data is used as response data to be sent to the user terminal, so that the user terminal displays the instant data of the corresponding data source in each card in the card interface.

However, when the server has an abnormal condition such as an excessive load pressure or abnormal data interface with a certain data source, the server cannot timely acquire the instant data of all the data sources, so that response data cannot be generated timely, and the response time of a data acquisition request is too long.

Disclosure of Invention

An embodiment of the present application is directed to providing a data processing method, device and system, so as to solve the problem that when an abnormal condition occurs in a server, the response time of a data acquisition request is too long. The specific technical scheme is as follows:

in a first aspect of the application, there is first provided a data processing system, the system comprising a server and a user terminal, wherein,

the user terminal is used for responding to the data display operation and sending a data acquisition request to the server;

the server is used for responding to a data acquisition request sent by the user terminal, acquiring instant data from a plurality of data sources, determining a target data source with failed instant data acquisition when a preset response time is reached and the instant data is not successfully acquired from the plurality of data sources, acquiring a target data source identifier of the target data source, generating response data according to the successfully acquired instant data and the target data source identifier, and sending the response data to the user terminal;

and the user terminal is also used for determining target data to be displayed according to the response data and displaying the target data.

Optionally, the server is further configured to generate response data including the successfully acquired instant data and the target data source identifier;

the user terminal is further used for determining target cache data corresponding to the target data source identifier according to the corresponding relation between the pre-stored data source identifier and the cache data, and taking the target cache data and the instant data successfully acquired from the plurality of data sources as target data to be displayed.

Optionally, the user terminal is further configured to search for a data source identifier of a data source to which the instant data belongs in a corresponding relationship between the data source identifier and the cached data, and change the cached data corresponding to the searched data source identifier into the instant data.

Optionally, the server is further configured to determine, according to a correspondence between a pre-stored data source identifier and security data, target security data corresponding to the target data source identifier, and generate response data including instant data obtained successfully and the target security data, where the security data is history data obtained from a data source;

the user terminal is further used for taking the target security data and the instant data successfully acquired from the plurality of data sources as target data to be displayed.

Optionally, the server is further configured to obtain a load state parameter, and send a fusing prompt to the user terminal when the load state parameter is greater than a preset threshold, where the load state parameter is used to indicate a current load state of the server;

the user terminal is further configured to receive the fusing prompt sent by the server, determine a plurality of data sources of the instant data to be displayed when the data display operation is detected again in a preset fusing period, determine cache data corresponding to the data sources according to a corresponding relation between a pre-stored data source identifier and the cache data, and display the determined cache data.

Optionally, the server is further configured to add, in the response data, fusing character information for indicating that the sending of the data acquisition request is stopped;

the user terminal is further used for analyzing the response data and determining that the fusing prompt sent by the server is received when the response data contains preset fusing character information.

In a second aspect of the application, there is also provided a data processing method, the method being applied to a server, the method comprising:

Responding to a data acquisition request sent by a user terminal, and acquiring instant data from a plurality of data sources;

when the preset response time length is reached, if the instant data is not successfully acquired from the plurality of data sources, determining a target data source with failed instant data acquisition, and acquiring a target data source identifier of the target data source;

generating response data according to the successfully acquired instant data and the target data source identifier;

and sending the response data to the user terminal.

Optionally, the generating response data according to the successfully acquired instant data and the target data source identifier includes:

and generating response data containing the successfully acquired instant data and the target data source identification.

determining target safety data corresponding to the target data source identifier according to the corresponding relation between the pre-stored data source identifier and the safety data, wherein the safety data is historical data acquired from the data source;

and generating response data containing the successfully acquired instant data and the target security data.

Optionally, the method further comprises:

acquiring a load state parameter, wherein the load state parameter is used for representing the current load state of the server;

and if the load state parameter is greater than a preset threshold, sending a fusing prompt to the user terminal.

Optionally, the sending manner of the fusing prompt includes:

in the response data, fusing character information for indicating that the transmission stop data acquisition request operation is performed is added.

In a third aspect of the present application, there is also provided a data processing method, where the method is applied to a user terminal, the method includes:

responding to the data display operation, and sending a data acquisition request to a server;

receiving response data sent by the server, wherein the response data at least comprises instant data successfully acquired from a plurality of data sources;

determining target data to be displayed according to the response data;

and displaying the target data.

Optionally, in the case that the response data further includes the target data source identifier, the determining, according to the response data, target data to be displayed includes:

determining target cache data corresponding to the target data source identifier according to the corresponding relation between the pre-stored data source identifier and the cache data;

And taking the target cache data and the instant data successfully acquired from the plurality of data sources as target data to be displayed.

Optionally, the method further comprises:

searching a data source identifier of a data source to which the instant data belongs in a corresponding relation between the data source identifier and the cache data;

and changing the cache data corresponding to the searched data source identification into the instant data.

Optionally, in a case where the response data includes target security data, the target security data is history data acquired from the target data source, determining, according to the response data, target data to be displayed includes:

and taking the target security data and the instant data successfully acquired from the plurality of data sources as target data to be displayed.

Optionally, after displaying the target data, the method further includes:

receiving a fusing prompt sent by the server;

determining a plurality of data sources of instant data to be displayed if the data display operation is detected again within a preset fusing period;

determining cache data corresponding to a data source according to a corresponding relation between a pre-stored data source identifier and the cache data;

And displaying the determined cache data.

Optionally, the receiving the fusing prompt sent by the server includes:

analyzing the response data;

and if the response data contains preset fusing character information, determining that a fusing prompt sent by the server is received.

In a fourth aspect of the present application, there is also provided a data processing apparatus, the apparatus being applied to a server, the apparatus comprising:

the first acquisition module is used for responding to a data acquisition request sent by the user terminal and acquiring instant data from a plurality of data sources;

the determining module is used for determining a target data source with failed instant data acquisition and acquiring a target data source identifier of the target data source when the preset response time is reached and the instant data is not successfully acquired from the plurality of data sources;

the generation module is used for generating response data according to the successfully acquired instant data and the target data source identifier;

and the first sending module is used for sending the response data to the user terminal.

Optionally, the generating module includes:

and the first generation sub-module is used for generating response data containing the successfully acquired instant data and the target data source identification.

Optionally, the generating module includes:

the determining submodule is used for determining target safety data corresponding to the target data source identifier according to the corresponding relation between the pre-stored data source identifier and the safety data, wherein the safety data is historical data acquired from the data source;

and the second generation sub-module is used for generating response data containing the successfully acquired instant data and the target security data.

Optionally, the apparatus further includes:

the second acquisition module is used for acquiring a load state parameter, wherein the load state parameter is used for representing the current load state of the server;

and the second sending module is used for sending a fusing prompt to the user terminal when the load state parameter is larger than a preset threshold value so as to enable the user terminal to stop sending the data acquisition request.

Optionally, the second sending module includes:

and the adding sub-module is used for adding fusing character information for representing that the operation of stopping sending the data acquisition request is executed in the response data.

In a fifth aspect of the present application, there is also provided a data processing apparatus, the apparatus being applied to a user terminal, the apparatus comprising:

The sending module is used for responding to the data display operation and sending a data acquisition request to the server;

the first receiving module is used for receiving response data sent by the server, wherein the response data at least comprises instant data successfully acquired from a plurality of data sources;

the first determining module is used for determining target data to be displayed according to the response data;

and the display module is used for displaying the target data.

Optionally, the first determining module includes:

the first determining submodule is used for determining target cache data corresponding to the target data source identifier according to the corresponding relation between the pre-stored data source identifier and the cache data under the condition that the response data further comprises the target data source identifier;

and the second determining submodule is used for taking the target cache data and the instant data successfully acquired from the plurality of data sources as target data to be displayed.

Optionally, the apparatus further includes:

the searching module is used for searching the data source identifier of the data source to which the instant data belongs in the corresponding relation between the data source identifier and the cache data;

and the updating module is used for changing the cache data corresponding to the searched data source identifier into the instant data.

Optionally, the first determining module includes:

and the third determining sub-module is used for taking the target security data and the instant data successfully acquired from the plurality of data sources as target data to be displayed when the response data comprises the target security data and the target security data is the history data acquired from the target data sources.

Optionally, the apparatus further includes:

the second receiving module is used for receiving the fusing prompt sent by the server;

the second determining module is used for determining a plurality of data sources of the instant data to be displayed if the data display operation is detected again in the preset fusing period;

the third determining module is used for determining cache data corresponding to the data source according to the corresponding relation between the prestored data source identification and the cache data;

the display module is also used for displaying the determined cache data.

Optionally, the second receiving module includes:

the analysis sub-module is used for analyzing the response data;

and the fourth determining submodule is used for determining that the fusing prompt sent by the server is received when the response data contains preset fusing character information.

In a sixth aspect of the application, there is further provided an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;

a memory for storing a computer program;

a processor configured to implement the method steps of the second aspect, or any of the third aspects, when executing a program stored on a memory.

In yet another aspect of the application, there is also provided a computer readable storage medium having instructions stored therein, which when run on a computer, cause the computer to perform any of the data processing methods described above.

In yet another aspect of the implementations of the present application, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform any of the data processing methods described above.

In the technical scheme provided by the application, a server can respond to a data acquisition request sent by a user terminal to acquire instant data from a plurality of data sources; when the preset response time length is reached and the instant data is not successfully acquired from the plurality of data sources, determining a target data source with failed instant data acquisition and acquiring a target data source identifier of the target data source; and then, generating response data according to the successfully acquired instant data and the target data source identifier, and sending the response data to the user terminal. Then, the user terminal may determine target data to be displayed according to the response data, and display the target data. Because the server can generate response data according to the successfully acquired instant data and the target data source identification of the target data source when the instant data is not successfully acquired from the plurality of data sources within the preset response time, the response time of the data acquisition request can be reduced.

Of course, not all of the above advantages need be achieved simultaneously in the practice of any one of the products or methods of this application.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.

FIG. 1 is a signaling diagram of a data processing system according to an embodiment of the present application;

FIG. 2 is a flowchart of a data processing method according to an embodiment of the present application;

FIG. 3 is a signaling diagram of another data processing system according to an embodiment of the present application;

FIG. 4 is a flowchart of another data processing method according to an embodiment of the present application;

FIG. 5 is a flowchart of another data processing method according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a data processing apparatus according to an embodiment of the present application;

FIG. 7 is a schematic diagram of another data processing apparatus according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a server according to an embodiment of the present application;

fig. 9 is a schematic structural diagram of a user terminal in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

The embodiment of the application provides a data processing system, which comprises a server and a user terminal, wherein the server can be an electronic device with a data processing function, for example, the server can be a background server of a video website. The server may be connected to a plurality of data sources via data interfaces, the data sources may be electronic devices storing video data of movies, servers of news media. Accordingly, the data of the data source may be video data of a movie, news information.

In order to ensure timeliness of data display, the server can respond to a data acquisition request of the user terminal to acquire instant data from a data source and provide the instant data for the user terminal, wherein the user terminal can be an electronic device with a data display function such as a mobile phone, a tablet computer and a smart watch. The user terminal can display the instant data of different data sources through a plurality of cards contained in the card interface.

For example, the card interface may be a home page of a video website, each display area may be used as a card, the data displayed in the card may be video data of a movie or news information, and the data source to which the display data in the card belongs may be an electronic device storing the video data of the movie or a server of a news medium.

The following will describe in detail a specific processing procedure of a server and a user terminal in a data processing system provided in the embodiment of the present application with reference to a specific implementation manner, as shown in fig. 1, and specific steps are as follows:

step 101, the user terminal sends a data acquisition request to the server in response to the data display operation.

In an implementation, when the user wants to view the card interface, the user may perform a data display operation, where the data display operation may be clicking on a first page icon of the video website, or clicking on an update icon of the current page.

In response to the data display operation, the user terminal may generate a data acquisition request, and send the data acquisition request to the server.

The embodiment of the application provides three implementation modes of generating a data acquisition request by a user terminal:

in the first mode, generally, data of a certain data source is fixedly displayed in each card in the card interface, so that a data source identifier of the data source corresponding to each card can be stored in the user terminal in advance. Thus, in response to the data display operation, the user terminal can acquire the data source identifiers of the data sources corresponding to each card in the card type interface, and obtain a plurality of data source identifiers. The user terminal may then generate a data acquisition request containing a plurality of data source identifications.

In this embodiment, the data source corresponding to a card may be: the data source of the data displayed by the card history may also be determined by the user terminal according to the interface setting of the card interface, where the interface setting includes the data source of the display data in each card.

It will be appreciated that each card within the card interface may have data fixedly displayed therein for a source of data, which may be displayed in one or more cards.

In the second mode, the corresponding relation between the card identifier and the data source identifier can be stored in the server, so that the user terminal can determine the card identifier of each card in the card interface in response to the data display operation, and generate a data acquisition request containing the card identifier of each card.

In the third mode, the corresponding relation between the user identifier and the data source identifier can be stored in the server, so that the user terminal can acquire the user identifier and generate a data acquisition request containing the user identifier. For example, the user terminal may generate a data acquisition request including a user name by using the user name input when the user logs in to the video website as the user identification.

In step 102, the server obtains instant data from a plurality of data sources in response to a data obtaining request sent by the user terminal.

In an implementation, after receiving a data acquisition request sent by a user terminal, a server may determine a plurality of data sources by parsing the data acquisition request. For each data source, the server can acquire data through a data interface with the data source, and the acquired data is used as instant data. For example, the server may obtain news information of the current hot news through a data interface with the data source "hot news".

The embodiment of the application provides three implementation modes of analyzing a data acquisition request by a server: in the first mode, the data acquisition request may carry card identifiers of a plurality of cards included in the card interface, and the server may determine, for each card identifier, a data source identifier corresponding to the card identifier according to a correspondence between a pre-stored card identifier and the data source identifier, thereby obtaining a plurality of data source identifiers, that is, determining a plurality of data sources. In the second mode, the data acquisition request can carry the data source identifier of the data source, and the server can analyze the data acquisition request to obtain the data source identifiers of the plurality of data sources, so that the plurality of data sources are determined. In the third mode, the data acquisition request may carry a user identifier, and the server may determine, according to a correspondence between the user identifier and the data source identifier stored in advance, a plurality of data source identifiers corresponding to the user identifier carried by the data acquisition request, that is, determine a plurality of data sources.

In this embodiment of the present application, the server may acquire data from a data source by using any manner of acquiring data from a data source in a related technology, and the specific processing procedure is not described herein.

And 103, judging whether the instant data is successfully acquired from a plurality of data sources by the server when the preset response time is reached.

In order to ensure the response speed of the server to the data acquisition request, a preset response duration may be set in the server, where the preset response duration is, for example, 500ms.

In implementations, the server may record the time of receipt of the data acquisition request and calculate the time difference between the current run time and the time of receipt. The server may determine whether to successfully obtain the instant data from the plurality of data sources when the time difference reaches a preset response duration.

If the server obtains the instant data from each data source, the server may determine that the instant data is successfully obtained from the plurality of data sources, and then the server may generate response data including the instant data obtained from each data source, and then send the response data to the user terminal, so that the user terminal performs data display based on the response data.

If the server did not obtain the instant data from a data source, the server may determine that the instant data was not successfully obtained from multiple data sources, and then the server may perform step 104.

Step 104, if the instant data is not successfully acquired from the plurality of data sources, the server determines a target data source of which the instant data acquisition fails and acquires a target data source identification of the target data source.

In implementation, the server may use the data source from which the instant data is not obtained as the target data source, and then obtain the target data source identifier of the target data source.

In this embodiment of the present application, the server may read, as the target data source identifier, the data source identifier of the target data source from the locally pre-stored data source identifiers of the data sources, or may obtain, as the target data source identifier, the data source identifier of the target data source from the target data source.

And 105, the server generates response data according to the successfully acquired instant data and the target data source identifier.

In an implementation, in order to facilitate the user terminal to determine the data source to which the instant data included in the response data belongs and display the instant data in the card corresponding to the data source, the response data may further include a data source identifier of the data source to which each instant data belongs.

The specific processing procedure of the server for generating response data according to the instant data successfully acquired from the data source and the target data source identifier of the second data source will be described in detail later.

Step 106, the server sends the response data to the user terminal.

In step 107, the user terminal determines target data to be displayed according to the response data.

The response data at least comprises instant data successfully acquired from a plurality of data sources within a preset response time.

In an implementation, the user terminal may use each instant data included in the response data as the target data to be displayed in the corresponding card, where the corresponding card is a card corresponding to the first data source to which the instant data belongs.

In this embodiment of the present application, in addition to the instant data successfully acquired from the multiple data sources, the response data may further include other data, where the other data includes a target data source identifier of the target data source and target security data, and the target security data is historical data acquired from the target data source by the server. When the response data includes other data, the specific processing procedure of the user terminal for determining the target data to be displayed according to the response data will be described in detail later.

Step 108, the user terminal displays the target data.

In implementation, the user terminal may determine, for each determined target data, a data source to which the target data belongs, and a card displaying data of the data source, and then the user terminal may display the target data in the determined card.

In the embodiment of the application, the server can respond to a data acquisition request sent by the user terminal to acquire instant data from a plurality of data sources; when the preset response time length is reached and the instant data is not successfully acquired from the plurality of data sources, determining a target data source with failed instant data acquisition and acquiring a target data source identifier of the target data source; and then, generating response data according to the successfully acquired instant data and the target data source identifier, and sending the response data to the user terminal. Then, the user terminal may determine target data to be displayed according to the response data, and display the target data. Because the server can generate response data according to the successfully acquired instant data and the target data source identification of the target data source when the instant data is not successfully acquired from the plurality of data sources within the preset response time, the response time of the data acquisition request can be reduced.

Compared with the prior art that the server generates the response data after acquiring the instant data of all the data sources, the embodiment of the application is based on the idea of carrying out degradation limitation on the response time of the data interface between the server and the data sources, the server can determine the response data within the preset response time, the quick response of the data acquisition request is realized, and the response time of the data acquisition request is reduced. Furthermore, the user terminal can rapidly display data based on the response data, and user experience can be improved.

Optionally, the embodiment of the application provides two implementation manners of generating the response data by the server according to the successfully acquired instant data and the target data source identifier:

in the first mode, the server can generate response data containing the successfully acquired instant data and the target data source identification.

In the embodiment of the application, the server can generate the response data containing the successfully acquired instant data and the target data source identifier, so that after receiving the response data sent by the server, the user terminal can determine the target cache data corresponding to the target data source identifier according to the corresponding relationship between the target data source identifier contained in the response data and the locally stored data source identifier and the cache data. The user terminal may then display the target cache data and the immediate data successfully retrieved from the data source. Under the condition that the server does not successfully acquire the instant data from the plurality of data sources, the user terminal can still realize data display within the preset response time length, so that the user experience can be improved.

The second mode can store safety data in advance in a server, wherein the safety data is historical data acquired from each data source, and the server can determine response data according to a target data source identifier, the safety data and the successfully acquired instant data, and the specific processing process comprises the following steps:

and step 1, determining target safety data corresponding to the target data source identifier according to the corresponding relation between the pre-stored data source identifier and the safety data.

In implementation, the server may search for the target data source identifier in the correspondence between the pre-stored data source identifier and the secure data, and use the secure data corresponding to the target data source identifier as the target secure data.

And 2, generating response data containing the successfully acquired instant data and the target security data.

In the embodiment of the application, the server may determine the target security data corresponding to the target data source identifier according to the corresponding relationship between the pre-stored data source identifier and the security data, and regenerate the response data including the successfully acquired instant data and the target security data. Thus, the user terminal can display the target security data and the instant data successfully acquired from the data source after receiving the response data sent by the server. Because the user terminal can still realize data display within the preset response time when the server does not successfully acquire the data from the plurality of data sources, the user experience can be improved.

Based on the two implementation modes of generating the response data by the server, the response data received by the user terminal are different, and in the first mode, the response data can contain a target data source identifier of a target data source; in the second mode, the response data may include target security data.

The specific processing procedure of the user terminal for determining the target data to be displayed according to the response data is different according to the data contained in the response data. Next, specific processing procedures of the user terminal are described with respect to two types of response data in the embodiment of the present application:

aiming at the condition that the response data comprises the target data source identifier of the target data source in the first mode, the corresponding relation between the data source identifier and the cache data can be prestored in the user terminal, wherein the cache data is the historical data of the data source corresponding to the data source identifier, which is locally stored by the user terminal. Thus, as shown in fig. 2, the processing procedure of the user terminal for determining the target data to be displayed according to the response data includes:

step 201, the user terminal determines target cache data corresponding to the target data source identifier according to the corresponding relation between the pre-stored data source identifier and the cache data.

In implementation, the user terminal may search for the target data source identifier in the corresponding relationship between the data source identifier and the cached data. After the target data source identifier is found, the user terminal can use the cache data corresponding to the target data source identifier as target cache data.

Step 202, the user terminal uses the target cache data and the instant data successfully acquired from a plurality of data sources as target data to be displayed.

In this embodiment of the present application, a correspondence between a data source identifier and cache data may be stored in advance in a user terminal, and the user terminal may determine, according to the correspondence, target cache data corresponding to the target data source identifier. Then, the user terminal can take the target cache data and the instant data successfully acquired from the plurality of data sources as target data to be displayed.

Because the user terminal stores the cache data of each data source, even if the server can not acquire the instant data of all the data sources after the preset response time is reached, the user terminal can determine the target cache data of the target data source. Then, the user terminal can display the target cache data and the successfully acquired instant data in the card type interface, so that all cards in the card type interface are displayed with the data, the integrity of the display of the card type interface data is ensured, and the user experience can be improved.

Further, the server is ensured to return response data within the preset response time, and the response time of the server to the data acquisition request is reduced.

Aiming at the condition that the response data in the second mode contains the target security data, the user terminal determines the processing procedure of the target data to be displayed according to the response data, wherein the processing procedure comprises the following steps: and taking the target security data and the instant data successfully acquired from the plurality of data sources as target data to be displayed.

In the embodiment of the present application, since the response data includes the target security data and the instant data successfully acquired from the multiple data sources, the user terminal may display the target cache data and the instant data successfully acquired in the card interface after receiving the response data sent by the server. Because all cards in the card type interface are displayed with data, the integrity of the data display of the card type interface is ensured, and therefore the user experience can be improved.

Optionally, the embodiment of the present application provides an implementation manner for establishing a correspondence between a data source identifier and cached data by a user terminal: after receiving the response data for the first time, the user terminal can store the instant data and the data source identifier of the data source to which the instant data belongs in a local storage mode according to each instant data contained in the response data, and obtain the corresponding relation between the data source identifier and the cache data.

In the related art, the response data received by the user terminal includes instant data obtained from all data sources, and the user terminal directly stores the received response data to obtain cached response data. And when the server does not send the response data, the user terminal acquires the cache response data and displays the cache response data.

In the technical scheme provided by the embodiment of the application, the data of the user terminal level is added to be cached piece by piece, namely, the corresponding relation between the data source identifier and the cached data is established. Therefore, when the server only returns the instant data of part of the data sources, the user terminal can determine the target cache data of the target data sources with failed data acquisition based on the corresponding relation. Then, the user terminal can display the target cache data and the successfully acquired instant data in the card type interface, so that all cards in the card type interface are displayed with the data, the integrity of the display of the card type interface data is ensured, and the user experience can be improved.

In addition, due to the reasons of server load pressure, limited storage space and the like, the data are stored piece by piece at the user terminal side according to the data source to which the data belong, and the data storage reliability is higher.

Optionally, the user terminal may update the corresponding relationship between the data source identifier and the cached data, where the updating process may be: after receiving the response data each time, the user terminal can search the data source identifier of the data source to which the instant data belongs in the corresponding relation between the data source identifier and the cache data aiming at each instant data contained in the response data, and change the cache data corresponding to the searched data source identifier into the instant data.

In this embodiment of the present application, after receiving the response data, the user terminal may update the correspondence between the data source identifier and the cache data according to the response data. Therefore, the user terminal can determine and display updated cache data based on the corresponding relation later, so that the user terminal can display cache data with better timeliness under the condition of displaying target cache data of a target data source, and user experience is improved.

Optionally, the server may further determine, according to its own load status, whether to send a fusing notification to the user terminal, so that the user terminal fuses after receiving the fusing notification, thereby reducing its own load pressure. As shown in fig. 3, based on the fusing mechanism, the specific processing procedure of the server and the user terminal in the data processing system includes:

In step 301, the server obtains a load status parameter.

The load state parameter is used for measuring the current load state of the server. The load status parameters may be QPS (Query Per Second), CPU (Central Processing Unit ) usage, CPU idle rate.

In an implementation, the server may acquire the current load status parameter according to a preset acquisition period. The server may acquire the load state parameter by adopting any method for acquiring the load state parameter in the related art, and the specific processing procedure is not described herein.

Step 302, the server determines whether the load status parameter is greater than a preset threshold.

In implementation, after the load status parameter is obtained, the server may determine whether the load status parameter is greater than a preset threshold, and if the load status parameter is greater than the preset threshold, the server may execute step 303; if the load status parameter is less than or equal to the preset threshold, the server may perform step 304.

In step 303, the server sends a fusing hint to the user terminal.

In implementations, the server may send the fusing hint to the user terminal in a variety of ways, and in one possible implementation, the server may send a notification message directly to the user terminal to indicate the fusing hint, so that the user terminal fuses after receiving the notification message. In another possible implementation manner, the server may add fusing character information for indicating that the data acquisition request operation is stopped to be sent to the response data sent to the user terminal, so that the user terminal may perform fusing after analyzing the response data to obtain the fusing character information.

In the embodiment of the invention, the server sends the fusing prompt to the user terminal by adding the field information for indicating that the data acquisition request operation is stopped to be sent to the response data of the user terminal, so that the data transmission bandwidth occupied by independently sending the notification message can be reduced.

Step 304, the server does not perform subsequent processing.

In step 305, the user terminal receives the fusing prompt sent by the server.

In the implementation, corresponding to the sending mode of the fusing prompt sent by the server, the user terminal can receive the fusing prompt by receiving the notification message sent by the server and used for indicating the fusing prompt. The user terminal can also analyze the response data and judge whether the response data contains preset fusing character information. If the response data contains fusing character information, the user terminal can determine that a fusing prompt is received; if the response data does not contain the fusing character information, the user terminal may not perform subsequent processing.

In step 306, the user terminal determines a plurality of data sources of the data to be displayed if the data display operation is detected again within the preset fusing period.

The user terminal stores a preset fusing period, and the duration of the preset fusing period can be set according to the requirement, and the preset fusing period is 5 minutes for example.

In implementation, if the user terminal detects the data display operation again within a preset fusing period after receiving the fusing prompt, the user terminal does not send a data acquisition request to the server any more, but determines a plurality of data sources of data to be displayed. The specific processing procedure of the ue to determine the multiple data sources of the data to be displayed may refer to the description related to the first mode in step 101, which is not described herein.

Step 307, the user terminal determines the cache data corresponding to the data source according to the corresponding relation between the pre-stored data source identifier and the cache data.

In step 308, the user terminal displays the determined cached data.

In the embodiment of the application, the server can acquire the load state parameter, when the load state parameter is greater than a preset threshold, a fusing prompt is sent to the user terminal, and then, if the user terminal receives a data display request again in a preset fusing period after receiving the fusing prompt, the user terminal does not send the data acquisition request to the server, but displays locally prestored cache data; and when the load state parameter is smaller than or equal to a preset threshold value, no subsequent processing is performed. Because the fusing of the user terminal level is increased, that is, when the load state parameter is greater than the preset threshold, the server sends a fusing prompt to the user terminal, so that the user terminal stops sending the data acquisition request, and the load pressure of the server can be reduced.

Based on the same technical concept, the embodiment of the application provides a data processing method, which can be applied to a server, as shown in fig. 4, and the specific processing steps include:

in step 401, instant data is acquired from a plurality of data sources in response to a data acquisition request sent by a user terminal.

And step 402, when the preset response time is reached, if the instant data is not successfully acquired from the plurality of data sources, determining a target data source with failed instant data acquisition, and acquiring a target data source identifier of the target data source.

And step 403, generating response data according to the successfully acquired instant data and the target data source identifier.

Step 404, the response data is sent to the user terminal.

determining target safety data corresponding to the target data source identifier according to the corresponding relation between the pre-stored data source identifier and the safety data, wherein the safety data is historical data acquired from a data source;

Optionally, the method further comprises:

Optionally, the sending manner of the fusing prompt includes:

In this embodiment of the present invention, a server may obtain instant data from a plurality of data sources in response to a data obtaining request sent by a user terminal, determine a target data source that fails to obtain instant data when a preset response time is reached and the instant data is not successfully obtained from the plurality of data sources, obtain a target data source identifier of the target data source, generate response data according to the successfully obtained instant data and the target data source identifier, and then send the response data to the user terminal.

The embodiment of the application also provides a data processing method, which can be applied to the user terminal, as shown in fig. 5, and specifically comprises the following steps:

step 501, in response to a data display operation, sending a data acquisition request to a server;

step 502, receiving response data sent by a server, wherein the response data at least comprises instant data successfully acquired from a plurality of data sources;

step 503, determining target data to be displayed according to the response data;

step 504, the target data is displayed.

Optionally, the method further comprises:

Optionally, after displaying the target data, the method further includes:

receiving a fusing prompt sent by the server;

and displaying the determined cache data.

Optionally, the receiving the fusing prompt sent by the server includes:

analyzing the response data;

In this embodiment of the present application, the user terminal may send a data acquisition request to the server in response to the data display operation, and then, the user terminal may determine, according to the response data, target data to be displayed, and display the target data. Because the user terminal can still receive the response data, determine the target data to be displayed based on the response data and display the target data when the server cannot acquire the data of all the data sources within the preset response time, the problem that the response time of the data acquisition request is too long can be solved, and the user experience is ensured.

Based on the same technical concept, the embodiment of the present application further provides a data processing apparatus, where the apparatus is applied to a server, as shown in fig. 6, and the apparatus includes:

a first obtaining module 610, configured to obtain instant data from a plurality of data sources in response to a data obtaining request sent by a user terminal;

a determining module 620, configured to determine a target data source that fails to obtain immediate data when a preset response duration is reached and immediate data is not successfully obtained from the multiple data sources, and obtain a target data source identifier of the target data source;

a generating module 630, configured to generate response data according to the successfully obtained instant data and the target data source identifier;

and a first sending module 640, configured to send the response data to the user terminal.

Optionally, the generating module includes:

Optionally, the apparatus further includes:

Optionally, the second sending module includes:

The embodiment of the application provides a data processing device which can respond to a data acquisition request sent by a user terminal to acquire instant data from a plurality of data sources; when the preset response time length is reached and the instant data is not successfully acquired from the plurality of data sources, determining a target data source with failed instant data acquisition and acquiring a target data source identifier of the target data source; generating response data according to the successfully acquired instant data and the target data source identifier; and transmitting the response data to the user terminal so that the user terminal can display the data based on the response data. Because the server can generate response data according to the successfully acquired instant data and the target data source identification of the target data source when the instant data is not successfully acquired from the plurality of data sources within the preset response time, the response time of the data acquisition request can be reduced.

Based on the same technical concept, the embodiment of the present application further provides a data processing apparatus, where the apparatus is applied to a user terminal, as shown in fig. 7, and the apparatus includes:

a transmitting module 710, configured to transmit a data acquisition request to a server in response to a data display operation;

a first receiving module 720, configured to receive response data sent by the server, where the response data at least includes immediate data successfully acquired from a plurality of data sources;

a first determining module 730, configured to determine target data to be displayed according to the response data;

and a display module 740, configured to display the target data.

Optionally, the first determining module includes:

Optionally, the apparatus further includes:

Optionally, the first determining module includes:

Optionally, the apparatus further includes:

the display module is also used for displaying the determined cache data.

Optionally, the second receiving module includes:

the analysis sub-module is used for analyzing the response data;

The embodiment of the application provides a data processing device, which can respond to data display operation, send a data acquisition request to a server, and then can determine target data to be displayed according to response data, so as to display the target data. Because the user terminal can still receive the response data, determine the target data to be displayed based on the response data and display the target data when the server cannot acquire the data of all the data sources within the preset response time, the problem that the response time of the data acquisition request is too long can be solved, and the user experience is ensured.

Based on the same technical concept, the embodiment of the present application further provides a server, as shown in fig. 8, including a processor 801, a communication interface 802, a memory 803, and a communication bus 804, where the processor 801, the communication interface 802, and the memory 803 complete communication with each other through the communication bus 804,

A memory 803 for storing a computer program;

the processor 801 is configured to execute the program stored in the memory 803, thereby implementing the method steps executed by the server in the above method embodiment.

The communication bus mentioned by the server may be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.

The communication interface is used for communication between the server and other devices.

The Memory may include random access Memory (Random Access Memory, RAM) or may include Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.

The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also digital signal processors (Digital Signal Processing, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

Based on the same technical concept, the embodiment of the application also provides a user terminal, as shown in fig. 9, including a processor 901, a communication interface 902, a memory 903 and a communication bus 904, where the processor 901, the communication interface 902 and the memory 903 complete communication with each other through the communication bus 904,

a memory 903 for storing a computer program;

the processor 901 is configured to implement the method steps performed by the user terminal in the above method embodiment when executing the program stored in the memory 903.

The communication bus mentioned by the above-mentioned user terminal may be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.

The communication interface is used for communication between the user terminal and other devices.

In yet another embodiment provided herein, there is also provided a computer readable storage medium having stored therein a computer program which when executed by a processor implements the steps of any of the data processing methods described above.

In yet another embodiment provided herein, there is also provided a computer program product containing instructions that, when run on a computer, cause the computer to perform any of the data processing methods of the above embodiments.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present application, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.

It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The foregoing is merely a specific embodiment of the application to enable one skilled in the art to understand or practice the application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A data processing system, characterized in that the system comprises a server and a user terminal, wherein,

the user terminal is also used for determining target data to be displayed according to the response data and displaying the target data;

the user terminal is further used for determining target cache data corresponding to the target data source identifier according to the corresponding relation between the pre-stored data source identifier and the cache data, and taking the target cache data and the instant data successfully acquired from the plurality of data sources as target data to be displayed;

The server is further configured to obtain a load state parameter, and send a fusing prompt to the user terminal when the load state parameter is greater than a preset threshold, where the load state parameter is used to represent a current load state of the server;

2. The system of claim 1, wherein the user terminal is further configured to search for a data source identifier of a data source to which the instant data belongs in a correspondence between the data source identifier and the cached data, and change the cached data corresponding to the searched data source identifier to the instant data.

3. The system of claim 1, wherein the server is further configured to determine target security data corresponding to the target data source identifier according to a correspondence between a pre-stored data source identifier and security data, and generate response data including instant data successfully acquired and the target security data, where the security data is historical data acquired from a data source;

4. The system according to claim 3, wherein the server is further configured to add, in the response data, fusing character information for indicating that the transmission of the data acquisition request stopping operation is performed;

5. A data processing method, wherein the method is applied to a server, the method comprising:

the response data is sent to the user terminal, so that the user terminal determines target cache data corresponding to the target data source identifier according to the corresponding relation between the pre-stored data source identifier and the cache data, and the target cache data and instant data successfully acquired from the plurality of data sources are used as target data to be displayed;

Wherein the method further comprises: and when the load state parameter is larger than a preset threshold, sending a fusing prompt to the user terminal, wherein the load state parameter is used for representing the current load state of the server, so that the user terminal receives the fusing prompt, determines a plurality of data sources of instant data to be displayed when detecting data display operation again in a preset fusing period, determines cache data corresponding to the data sources according to the corresponding relation between a prestored data source identifier and the cache data, and displays the determined cache data.

6. The method of claim 5, wherein generating response data from the successfully obtained immediate data, the target data source identification, comprises:

7. The method of claim 5, wherein generating response data from the successfully obtained immediate data, the target data source identification, comprises:

8. The method of claim 7, wherein the sending manner of the fusing hint comprises:

9. A data processing method, wherein the method is applied to a user terminal, the method comprising:

receiving response data sent by the server, wherein the response data at least comprises instant data successfully acquired from a plurality of data sources, and the instant data is successfully acquired from each data source;

determining target data to be displayed according to the response data;

displaying the target data;

wherein, when the response data further includes the target data source identifier, the determining, according to the response data, target data to be displayed includes:

The target cache data and the instant data successfully acquired from a plurality of data sources are used as target data to be displayed;

wherein the method further comprises: receiving a fusing prompt sent by the server, determining a plurality of data sources of instant data to be displayed when a data display operation is detected again within a preset fusing period, determining cache data corresponding to the data sources according to the corresponding relation between a prestored data source identifier and the cache data, and displaying the determined cache data;

the fusing prompt is sent by the server when the load state parameter is larger than a preset threshold, and the load state parameter is used for indicating the current load state of the server.

10. The method according to claim 9, wherein the method further comprises:

11. The method of claim 9, wherein, in the case where the response data includes target security data, the target security data being history data obtained from the target data source, the determining target data to be displayed according to the response data includes:

12. The method of claim 11, wherein the receiving the fusing hint sent by the server comprises:

analyzing the response data;

13. A data processing apparatus, the apparatus being applied to a server, the apparatus comprising:

the first sending module is used for sending the response data to the user terminal, so that the user terminal determines target cache data corresponding to the target data source identifier according to the corresponding relation between the pre-stored data source identifier and the cache data, and takes the target cache data and instant data successfully acquired from the plurality of data sources as target data to be displayed;

Wherein the device is further for: and when the load state parameter is larger than a preset threshold, sending a fusing prompt to the user terminal, wherein the load state parameter is used for representing the current load state of the server, so that the user terminal receives the fusing prompt, determines a plurality of data sources of instant data to be displayed when detecting data display operation again in a preset fusing period, determines cache data corresponding to the data sources according to the corresponding relation between a prestored data source identifier and the cache data, and displays the determined cache data.

14. A data processing apparatus, the apparatus being applied to a user terminal, the apparatus comprising:

the first receiving module is used for receiving response data sent by the server, wherein the response data at least comprises instant data successfully acquired from a plurality of data sources, and the instant data is successfully acquired from each data source;

The display module is used for displaying the target data;

wherein, in the case that the response data further includes the target data source identifier, the display module is configured to:

wherein the device is further for: receiving a fusing prompt sent by the server, determining a plurality of data sources of instant data to be displayed when a data display operation is detected again within a preset fusing period, determining cache data corresponding to the data sources according to the corresponding relation between a prestored data source identifier and the cache data, and displaying the determined cache data;

15. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;

A memory for storing a computer program;

a processor for implementing the method steps of any of claims 5-8, or claims 9-12, when executing a program stored on a memory.

16. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program which, when executed by a processor, implements the method steps of any of claims 5-8, or of claims 9-12.