KR20070080313A - Service performance analysis method and system provided to client terminal - Google Patents

Abstract

The present invention relates to a method and system for performing measurement and monitoring for a service provided from an IT service providing server to a client terminal.

The service performance analysis system according to the present invention is a system for analyzing the performance of a service provided to a client terminal from a server (hereinafter, a service providing server) that operates an IT service such as a web service or an application service. Measuring means for requesting a desired service and measuring a time and service result required to provide the requested service through a screen on which the service is provided and output to the client terminal; Analyzing means for analyzing service quality and service availability using the data measured by the measuring means; And output means for collecting, sorting and displaying the indicators analyzed by the analyzing means.

Description

Method and system for analyzing performance of providing services to client terminal

The following drawings attached to this specification are illustrative of preferred embodiments of the present invention, and together with the detailed description of the invention to serve to further understand the technical spirit of the present invention, the present invention is a matter described in such drawings It should not be construed as limited to

1 is an exemplary diagram showing a schematic configuration of a system for analyzing performance by measuring packet movement in the related art.

2 is a conceptual diagram illustrating an example of a service performance measurement method of the present invention for comparison with a conventional method.

3 is a block diagram showing the configuration of a service performance analysis system according to an embodiment of the present invention.

4 is a flowchart illustrating a procedure of a service performance analysis method according to an embodiment of the present invention.

5 is an exemplary screen for explaining a key-in time and a specific character string of a user.

<Explanation of symbols for the main parts of the drawings>

10 ... Web Server 20 ... Agent Driver

30 ... User PC 100 ... Client Part

200 ... server part

The present invention relates to a measurement and monitoring system for a service provided from an IT service providing server to a client terminal, and more particularly, to a system and method for analyzing the performance of an application or a web service provided to a client terminal.

Recently, with the rapid development of information and communication technology, the spread of information and communication infrastructure such as the Internet has been expanded, and various methods using the same have been generated in the lives of ordinary people and the business of companies. By using the information and communication infrastructure such as the Internet, the services or work methods that were previously performed in the offline manner are rapidly becoming online. In addition, new services and methods of work using information and communication technologies will continue to be developed, and in the future, information technology (IT) -related technologies will become an essential means in modern life.

As IT related services increase, various methods are used to measure or monitor services provided. Previously, the same method as SMS (System Management System) was used, which mainly focuses on monitoring system resources (CPU, memory, network, etc.). It was thus far from the application and service issues (feature and performance issues) that real users of the application felt. Therefore, the need for application and service level monitoring solutions has emerged, and efforts are being made to switch to APM (Application Performance Management) and BPM (Business Process Management).

In the conventional service performance monitoring method, as shown in FIG. 1, when the service is provided by the web server 10 and used by the PC 30, an agent 20 is installed between the web server 10 and the PC. It measures a traffic by intercepting a packet transmitted between the 30. This method is a significant difference from the tangible performance that the real user feels in the form of checking only the packet without checking the key-in time or the state of the client screen in the PC 30 that is the client terminal. In addition, in this manner, it is possible to measure a web service in the form of a packet. However, in the case of a C / S screen, monitoring does not proceed when a pop-up screen is displayed.

The present invention has been made to solve the above problems, and an object thereof is to enable a real user who uses an IT service to measure and analyze service performance at a level felt by the user.

In addition, it is another object to be able to analyze service performance regardless of whether the client to be measured is a web screen or a client-server (C / S) screen.

Other objects and advantages of the invention will be described below and will be appreciated by the practice of the invention. Furthermore, the objects and advantages of the present invention can be realized by means and combinations indicated in the appended claims.

In order to achieve the above object, the service performance analysis system according to the present invention analyzes the performance of a service provided to a client terminal from a server (hereinafter, a service providing server) operating an IT service such as a web service or an application service. A system comprising: measuring means for requesting a desired service to the service providing server, and measuring time and service result required for providing a requested service through a screen on which a service is provided and output to the client terminal; Analyzing means for analyzing service quality and service availability using the data measured by the measuring means; And output means for collecting, sorting and displaying the indicators analyzed by the analyzing means.

The measuring means preferably compares a predetermined character string on an application screen output to the client terminal to measure a service providing time and a service result.

In particular, the service providing time is preferably measured from the time when the service request is started to the service providing server to the time when the corresponding service is provided to the client terminal and displayed on the screen.

In addition, the measurement of the service result is preferably made by checking whether a result corresponding to the service requested by the service providing server is provided.

Further, the measurement of the service result is characterized in that it is made by comparing the character string that is predetermined and stored with the character string output on the screen.

Preferably, said measuring means and said analyzing means are located in said client terminal.

The output means may also comprise means for storing the analyzed indicators; And means for classifying the analyzed indicators by items.

In addition, the output means is characterized in that it comprises an error detection means for setting the normal range of indicators, and notifying when the analyzed indicators are out of the range.

In particular, the service providing server is characterized in that it comprises a web server and an application server.

In the measurement means, the time required to provide a service is preferably measured, including the typing time of the user and the movement time of the mouse.

According to another aspect of the present invention, an apparatus for analyzing the performance of the IT service provided to the client terminal from the IT service providing server, such as a web service or application service, which is provided from the service providing server according to a predetermined execution cycle and schedule Means for executing a script for measuring the performance of the service, a script for requesting the service, the time required for the service to be output through the screen, and the performance of the service result; And means for analyzing service quality and service availability based on the required time and service performance data.

Preferably, the script requests a service from the service providing server, and compares a predetermined character string on an output screen of the provided service to measure a response time and a result.

According to another aspect of the present invention, a method for analyzing the performance of a service provided from an IT service providing server such as a web service or an application service to a client terminal, the method comprising: (a) requesting a service from the client terminal to the service providing server; Measuring a time and service result required to provide the requested service through a screen on which the corresponding service is provided and output; (b) analyzing service quality and service availability using the measured data; And (c) collecting the contents analyzed in the analyzing step, classifying the information by the performance indicators, and displaying the classified performance indicators.

Preferably, the step (a) compares a predetermined character string on the application screen output to the client terminal to measure whether the requested service is correctly provided and the time until then.

In addition, the service providing time measured in the step (a) preferably further comprises a user's typing time and the movement time of the mouse.

According to another aspect of the present invention, a method for analyzing the performance of a service provided from an IT service providing server, such as a web service or an application service, to a client terminal, comprising: (a) executing an execution cycle and a schedule of an automatic test script; Setting up; (b) the script is executed according to the set procedure to request a service from the service providing server to check a time when the provided service is output on a user screen and whether or not a service corresponding to the requested service is provided; creating a scripter); (c) analyzing the generated scripter to check a service response time and a service success rate; And (d) storing the analyzed information, correcting errors, and outputting a report for each performance index.

In particular, in the step (b), it is preferable to further measure a service providing time, further including a typing time of a user and a moving time of a mouse.

According to another aspect of the invention, a recording medium recording a program for analyzing the performance of a service provided from an IT service providing server, such as a web service or an application service to the client terminal, the service from the client terminal to the service providing server And comparing a predetermined string on the screen where the corresponding service is provided and outputting the measured time required to provide the requested service, including whether the requested service is correctly provided and the user's typing time and moving time of the mouse. A computer-readable record that records a program that executes a procedure, a process of analyzing service quality and service availability using the measured data, and a process of collecting and classifying the contents analyzed in the analysis step and displaying the information by performance indicators. Medium provided The.

According to another aspect of the present invention, a recording medium on which a program for analyzing the performance of a service provided from an IT service providing server, such as a web service or an application service, to a client terminal is recorded. A procedure for setting a schedule, a time when the script is executed to request a service to the service providing server according to the set procedure, and a time when a service provided on a user screen is output and whether a service corresponding to the requested service is provided; A process of generating a script by checking, a process of analyzing a generated scripter to check a service response time and a service success rate, and storing the analyzed information and correcting an error to output a report for each performance index. The computer that recorded the program that ran the procedure A readable recording medium is provided.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms or words used in the specification and claims should not be construed as having a conventional or dictionary meaning, and the inventors should properly explain the concept of terms in order to best explain their own invention. Based on the principle that can be defined, it should be interpreted as meaning and concept corresponding to the technical idea of the present invention. Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiment of the present invention and do not represent all of the technical idea of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalents and variations.

First, Figure 2 is an exemplary diagram showing a conceptual configuration for comparing the service performance analysis method of the present invention with the conventional method.

Referring to FIG. 2, the service performance analysis method of the present invention may perform performance based on a screen 40 on which a service (web service, application service, etc.) provided from the service providing server 10 to the client terminal 30 is output. Measure and analyze The analyzed information is collected by a remote central server and displayed on the console screen 50. In the conventional method, a separate agent (Agent) is installed between the service providing server 10 and the client terminal 30 to measure the movement of packets. The method and system for analyzing service performance according to the present invention is such a separate agent ( Agent does not need to analyze the performance directly on the screen of the client terminal (30).

The screen 40 output to the client terminal 30 is a screen in which a service request is made to the service providing server 10 and a corresponding service is provided and output. Here, it is checked whether the result is output correctly according to the request made to the service providing server 10. The service request success rate is measured by whether the output result is a result according to the requested service. The success rate is the ratio of the number of successful service provisions among the number of service requests, which is used as a service availability index. In addition, the time from the time of requesting a service to the service providing server 10 to the time of outputting the requested service on the screen 40 of the client terminal 30 is measured. The measured time is a time required to provide a service, and includes both a processing time at a server, a transmission time at a network, and a time at which the screen 40 is output at the client terminal 30. The time required to provide the service is used as an indicator of service quality. In particular, the measurement criteria using the screen 40 output from the client terminal 30 uses a character string output on the screen. The predetermined string is compared with the string displayed on the screen to determine whether the requested service is successfully provided and when the service is completed. The predetermined string is a specific string in an accurate result screen according to the service request.

For example, referring to FIG. 5, a request is made to the service providing server 10 to determine whether the login succeeds or fails as a result of the processing. At this time, the specific string of the screen output upon successful login is stored in advance, and when the login request is requested for the performance test and the stored string is output on the output screen of the result, it is determined to be successful. In addition, the time required to provide the service is calculated by measuring the time from when the login request is requested to when the string is output. In addition, as shown in FIG. 5, a time for inputting an ID and a password at the time of login (Key-in) and a time for clicking a login button by moving a mouse pointer may also be included in the time required to provide the service. This is to reflect the actual haptic time required for the actual user to use the service. Such a user's typing time, mouse movement time, etc. may be measured in advance for each user, or arbitrarily set an average time of a general user, and this may be commonly applied.

3 is a diagram illustrating a service performance analysis system according to an embodiment of the present invention.

Referring to FIG. 3, the service performance analysis system of the present invention is located in a client terminal that receives a service from a service providing server, and analyzes the performance of the provided service in the client unit 100 and the client unit 100. The server unit 200 collects the analyzed data and provides performance analysis information for each indicator.

The client unit 100 includes a script module 110, a scheduler module 120, and an analysis module 130. The script module 110 generates an automatic script for measuring service performance using a screen output to the client terminal. The generated script performs a test according to a predetermined algorithm and generates a scripter as a result. In addition, the algorithm of the script includes a procedure of requesting a service from a service providing server and measuring a performance of the service using a screen on which the service is provided and output to the client terminal. In particular, a measurement operation is performed by comparing a character string output on the screen with a predetermined character string. When the measurement operation is performed by the script, a scripter including corresponding measurement result values is generated. The script performs a task of measuring whether the service is requested and whether a corresponding service is provided and the time from the time of the service request until the service is provided and displayed on the screen. Here, the time required to provide the service may include the key-in time of the user and the movement time of the mouse described above with reference to FIG. 5. In particular, the script has been described as measuring the time required to provide a service and the success rate of the result of the requested service. However, the present invention is not limited thereto, and the performance of various services is measured using the result provided on the screen. Of course, you can use a script to measure.

The scheduler module 120 sets the execution cycle and execution schedule of the script generated by the script module 110 and executes the script accordingly.

The analysis module 130 executes the script to perform a measurement task and analyze the generated scripter. The script is analyzed to extract indicators such as transaction performance, service quality, availability, response time, and network performance.

The server unit 200 collects data analyzed by the client unit 100. The server unit 200 may include a storage unit for storing the collected data, a monitoring module 210 for managing the collected data and processing an error, and a report module 220 for reporting analyzed service performance indicators. ).

The monitoring module 210 collects data analyzed by the client unit 100 and sorts the collected data according to service performance indexes. In addition, a warning function of setting a normal range of the performance indicators and extracting and indicating an indicator that is out of the normal range from the collected data may be performed. This makes it easy for the administrator to identify service failures or errors.

The report module 220 generates a report according to various criteria for the performance indicators managed by the monitoring module 210 and provides the manager.

4 is a flowchart illustrating a procedure of a service performance analysis method according to an embodiment of the present invention.

Referring to FIG. 4, first, a scheduler module 120 of the client unit 100 located in the client terminal to analyze service performance is set. Here, the execution schedule and execution cycle of the script for measuring the service performance are set using the screen output from the client terminal (step S10).

According to the schedule set in step S10, the script module 110 prepares to execute the corresponding script. In addition, a script may be generated according to the schedule (step S20).

When the script prepared in step S20 or the generated script reaches the execution time set in the scheduler module 120, the corresponding script is executed. The script transmits a service request signal for performance test to the service providing server, and measures the result screen output to the client terminal accordingly. The script generates a script containing the measured data as a result of the execution. The script executes a script and stores data such as the number of successes, the number of failures, or the time required to provide a service for the requested service. In this case, the measurement of the required time may further include a key-in time of the user and a time required for moving the mouse. (Step S30).

The generated scripter is transmitted to the analysis module 130, and the analysis module 130 analyzes the received scripter. The script contains values and values measured by the script. The analysis module 130 analyzes the numerical values and values contained in the scripter to derive service performance indicators at the client terminal such as transaction performance, service quality, availability, response time, network performance, and the like. The derived performance indicator information is transmitted to the remote server 200 (step S40). In addition, the procedure from step S10 to step S40 is performed by the client unit 100 located in the client terminal.

The server unit 200 collects service performance data analyzed through the client unit 100. In addition, data received from the plurality of client units 100 is stored and processed to be a database. In particular, by managing the source and the received time of the collected data, such as the real-time accurate performance can be identified in one place. The collected data are classified and classified for each performance index to perform error processing and abnormal performance data. The criterion of the abnormal performance data is determined by setting the range of normal performance and then out of the range (step S50).

The performance indicators collected and processed in step S50 are provided to the administrator as service performance analysis information according to various criteria. The analysis information may be provided through the console screen of the server. In order to provide the analysis information, a reporting tool such as a graph or a chart may be used, and a report may be generated by adding a notification and warning function for abnormal service performance (step S60).

The procedure from step S50 to step S60 is performed in an independent server unit 200. In this way, the client unit 100 may be installed in the client terminal to analyze the performance, and data collected by the client unit 100 may be collected, integrated, processed, and managed in a remote server.

The terms or words used in this specification and claims are not to be construed as limiting in their usual or dictionary meanings, and the inventors may appropriately define the concept of terms in order to best explain their invention in the best way possible. It should be interpreted as meaning and concept corresponding to the technical idea of the present invention based on the principle that the present invention.

Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiment of the present invention and do not represent all of the technical idea of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalents and variations.

The present invention analyzes the performance of a service through a screen of a client terminal using an actual service by an actual user using an IT service, thereby providing a more accurate and realistic service performance.

In addition, the present invention provides an effect that can analyze the performance of the service regardless of the service provider by analyzing the performance of the service in the end user terminal.

Furthermore, it provides an effect that can analyze the service performance by reflecting the typing time, mouse movement time, etc. required for the actual user to use the service without writing a separate script.

Claims (19)

A system for analyzing the performance of a service provided to a client terminal from a server that operates an IT service such as a web service or an application service (hereinafter, a service providing server), Measuring means for requesting a desired service from the service providing server, and measuring time and service result required to provide the requested service through a screen on which a service is provided and output to the client terminal; Analyzing means for analyzing service quality and service availability using the data measured by the measuring means; And And output means for collecting, sorting and displaying the indicators analyzed by the analyzing means. The method of claim 1, And the measuring means compares a predetermined character string on an application screen output to the client terminal to measure a service providing time and a service result. The method of claim 2, The service performance time measurement is a service performance analysis system, characterized in that for measuring the time from the time when the service request to the service providing server from the time when the service is provided to the client terminal is displayed on the screen. The method of claim 2, And measuring the service result by checking whether a result corresponding to the service requested by the service providing server is provided. The method of claim 4, wherein The measurement of the service result is a service performance analysis system, characterized in that by comparing the predetermined and stored character strings and the character string output on the screen. The method of claim 1, The measuring means and the analyzing means are located in the client terminal. The method of claim 1, The output means comprises means for storing the analyzed indicators; And And a means for classifying the analyzed indicators by items. The method of claim 7, wherein And the output means comprises error detection means for setting a normal range of the indicators and notifying when the analyzed indicators are out of the range. The method of claim 1, The service providing server comprises a web server and an application server, characterized in that the service performance analysis system. The method according to claim 1 or 3, The service performance analysis system, characterized in that for measuring the time required to provide a service in the measuring means including the user's typing time and the mouse movement time. Apparatus for analyzing the performance of the IT services provided to the client terminal from the IT service providing server, such as Web services or application services, Means for executing a script for measuring the performance of a service provided from the service providing server according to a predetermined execution cycle and schedule; A script for requesting a service and measuring the time required for the service to be output through the screen and the performance of the service result; And And means for analyzing service quality and service availability based on the required time and service performance data. The method of claim 11, The script requests a service to the service providing server, and the service performance analysis apparatus, characterized in that for measuring the response time and results by comparing a predetermined string on the output screen of the provided service. As a method of analyzing the performance of a service provided to a client terminal from an IT service providing server such as a web service or an application service, (a) requesting a service from the client terminal to the service providing server and measuring a time and service result required to provide the requested service through a screen on which the corresponding service is provided and output; (b) analyzing service quality and service availability using the measured data; And (c) collecting and analyzing the contents analyzed in the analyzing step, and displaying the classified performance indicators. The method of claim 13, In the step (a), by comparing a predetermined character string on the application screen output to the client terminal, the service performance analysis method characterized in that it measures whether the requested service is provided correctly and the time until that time. The method according to claim 13 or 14, The service providing time measured in step (a) further comprises a user's typing time and the mouse movement time. A method of analyzing the performance of a service provided to a client terminal from an IT service providing server such as a web service or an application service, (a) setting an execution cycle and a schedule of an automatic test script; (b) the script is executed according to the set procedure to request a service from the service providing server to check a time when the provided service is output on a user screen and whether or not a service corresponding to the requested service is provided; creating a scripter); (c) analyzing the generated scripter to check a service response time and a service success rate; And (d) storing the analyzed information and correcting errors to output a report for each performance indicator. The method of claim 16, The service performance analysis method, characterized in that in the step (b) further comprising the user's typing time and the movement time of the mouse to measure the service providing time. A recording medium in which a program for analyzing the performance of a service provided from an IT service providing server, such as a web service or an application service, to a client terminal is recorded. The client terminal requests a service to the service providing server, compares a predetermined character string on a screen where the corresponding service is provided, and outputs the requested service including whether the requested service is correctly provided, a user's typing time, and a mouse's moving time. To measure the time it takes to deliver the services, A process of analyzing service quality and service availability using the measured data; and A computer-readable recording medium having recorded thereon a program for executing a procedure of collecting the contents analyzed in the analyzing step and classifying and displaying the results by performance indicators. A recording medium in which a program for analyzing the performance of a service provided from an IT service providing server, such as a web service or an application service, to a client terminal is recorded. A procedure for setting the execution cycle and schedule of the automatic test script, According to the set procedure, the script is executed to request a service to the service providing server to check a time when the provided service is output on the user screen and whether or not a service corresponding to the requested service is provided. Procedure to produce, Analyzing the generated scripts to determine service response time and service success rate; and A computer-readable recording medium storing a program for executing the procedure of storing the analyzed information, correcting errors and outputting a report for each performance index.

Images