KR20050020026A - Apparatus and Method for Automatic Verification of Mobile Communication System and Recording Medium Therefor - Google Patents

Abstract

PURPOSE: An SVAT(System Verification Automatic Test) device and a method of a mobile communication system and a recording medium thereof are provided to be installed between a BSM(Base Station Manager) and an automatic call generator, while preparing for a test program to automatically verify a system, thereby improving reliability on verified system results. CONSTITUTION: A system manager writes a desired scenario by selecting a necessary command from an automatic call generator or a BSM with the use of a test flow writer of an SVAT, and stores the written scenario(S101). A test flow is converted into a test program by a test program generator, and the test program is stored(S102). A test program driver continuously transmits a command to the BSM or the automatic call generator to execute the scenario(S103). The BSM or the automatic call generator carries out the command while transmitting the carried results, and the test program driver analyzes test results while storing the analyzed results(S104).

Description

Apparatus and Method for Automatic Verification of Mobile Communication System and Recording Medium Therefor}

The present invention relates to a system and method for verifying a mobile communication system, and more particularly, to an automatic verification apparatus for a mobile communication system for automatically verifying various functions provided in a mobile communication system to improve a service quality using a mobile communication system. A method and a recording medium therefor.

As competition among operators intensifies due to the saturation of the mobile communication service market, system software development is actively being promoted to rapidly launch new services and secure a quality advantage over competitors. As a result, system shapes are continuously diversified and complicated. And subscriber demand for mobile communication services is diversifying.

Verification of system software function is necessary such as redundancy test for various base station performance, but there is a problem of simple repetition, long time, and manual work. In addition, due to the lack of sufficient verification period and additional item discovery time for the added functions in the mobile communication system, the necessity of developing a verification tool based on the added functions and problems is recognized. Therefore, if a work gap occurs due to the movement of member work, it is highly likely that a failure will occur.

FIG. 1 is a diagram illustrating a verification method of a general mobile communication system, and illustrates a case based on a CDMA2000 1x EV-DO system.

The CDMA2000 1x EV-DO is an optimized system for high-speed packet transmission only. It uses the same frequency band (1.25MHz) as the IS-95 system and provides users with an average data transfer service of 600kbps. It can share several base station equipment such as IS-95 and RF stage and power supply, and can be implemented by adding access point to base station without modification of network such as base station controller or exchange. These mobile communication systems share base station equipment used in CDMA2000 1x, and thus can transmit data using a frequency band such as a voice channel in a wireless section. Therefore, it is possible to expect a cost reduction effect due to a small additional investment cost due to technology adoption.

As illustrated, the CDMA2000 1x EV-DO system includes a plurality of base stations (BTSs) 10-1 to 10-n and 20-1 to 20-n for supporting wireless section communication between the mobile communication terminal and the mobile communication network. A base station controller (BSC) 12, 22, which controls a base station, supports voice and data communication, and connects a mobile communication system with a mobile communication terminal for system maintenance, charging, authentication, etc. It is connected to a switch (MSC) 14, 24 and a base station controller 12, 22 for performing an exchange to provide a communication path and a handoff path between base stations through an ATM switch, and a packet data call is a node for processing packet data. It provides a path that can be transmitted and performs a matching function with the DLR (40), PDSN (50), AN-AAA (60) Gateway ATM Switch Network (GAN), the base station controller (GAN 30) 12, 22) to provide mobility maintenance and sessions for subscribers. A packet data service node (PDSN), which is connected to the base station controllers 12 and 22 through a data link register (DLR) 40 performing a function and the GAN 30, provides a packet data service to a subscriber; 50) is connected to the base station controllers 12 and 22 through the GAN 30 and is connected to the AN-AAA (Access Network Authentication, Authorization, Accounting, 60) and the GAN 30 to perform authentication for the mobile communication terminal. Including a base station manager (BSM) 70 in charge of operation maintenance required for the base stations 10-1 to 10-n, 20-1 to 20-n, and the base station controllers 12 and 22; It is composed.

In such a mobile communication system, the system manager uses the BSM 70 to manage the state and shape of the base station and the base station controller and collect and manage information on base station operation. In addition, the system manager inputs control messages related to operation information of a base station, a base station controller and the like and setting information of a test mobile communication terminal through the BSM 70 in order to verify system performance according to an operating environment of a mobile communication system. By the transmission and reception signals between the mobile terminal, the base station, and the base station controller, the performance of system software and hardware according to the function and environment of the mobile communication system is verified and analyzed.

However, until now, since the verification process of the mobile communication system is performed by the system administrator manually operating the BSM 70, the verification period and the verification personnel are excessively required to verify only basic functions for various shapes of the mobile communication system. Because the verification is performed based on the subject or experience of the verifier and the verification is focused on items and problems added to the system, important verification procedures can be omitted. have. In addition, at present, there is a disadvantage that the waste of manpower is caused as a high-quality manpower is put into such a simple operation.

The present invention has been made to solve the above problems and disadvantages, and the automatic verification apparatus and method of the mobile communication system that can shorten the verification period and reduce the number of verification by automating the performance and function verification process of the mobile communication system; There is a technical problem in providing a recording medium for this purpose.

Another technical problem of the present invention is to automate the verification of performance and function of a mobile communication system to improve reliability and prevent human waste in verifying software and hardware added for a new service.

The automatic verification apparatus of the mobile communication system of the present invention is connected to the base station management apparatus and / or the call automatic generating apparatus, performs information management and state management for the base station management apparatus and / or the call automatic generating apparatus, and at least for system verification. Manage one or more test scenarios, provide a list and contents of the stored scenarios at the request of a system administrator, and select commands from the base station management device and / or the call generation device according to the mobile communication system verification purpose. Save the test flow file, convert the test flow file into a test program file, and transmit the command included in the test program file to the base station management device and / or the call automatic generation device to execute the test program. After receiving the test result And seats.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 is a diagram illustrating an example of a communication network to which an automatic verification apparatus of a mobile communication system according to the present invention is applied, and illustrates a case based on a CDMA2000 1x EV-DO system.

As illustrated, the CDMA2000 1x EV-DO system includes a plurality of base stations (BTSs) 10-1 to 10-n and 20-1 to 20-n for supporting wireless section communication between the mobile communication terminal and the mobile communication network. A base station controller (BSC) 12, 22, which controls a base station, supports voice and data communication, and connects a mobile communication system with a mobile communication terminal for system maintenance, charging, authentication, etc. It is connected to a switch (MSC) 14, 24 and a base station controller 12, 22 for performing an exchange to provide a communication path and a handoff path between base stations through an ATM switch, and a packet data call is a node for processing packet data. A base station controller 12 through a gateway ATM switch network (GAN) 30, which provides a path that can be transmitted and performs matching with the DLR 40, the PDSN 50, and the AN-AAA 60, 12. , 22) to provide mobility maintenance and session A packet data service node (PDSN), which is connected to the base station controllers 12 and 22 through a data link register (DLR) 40 performing a function and the GAN 30, provides a packet data service to a subscriber; 50) is connected to the base station controllers 12 and 22 through the GAN 30 and is connected to the AN-AAA (Access Network Authentication, Authorization, Accounting, 60) and the GAN 30 to perform authentication for the mobile communication terminal. It includes a base station manager (BSM) 70 in charge of operation maintenance required for the base stations 10-1 to 10-n, 20-1 to 20-n, and the base station controllers 12 and 22. .

System Verification Automatic Test (hereinafter referred to as 'SVAT', 100) according to the present invention is connected to the BSM 70, performs information management and state management for the BSM 70, the base station 10 -1 to 10-n, 20-1 to 20-n) is connected to the call automatic generating device 200 connected to the test mobile communication terminal 300 for performing wireless communication for the call automatic generating device 200 It performs information management and status management, manages various scenarios prepared for system verification, and provides the list and contents of stored scenarios according to system administrator's request.

In order to verify the system, the SVAT 100 stores a scenario according to the system verification purpose as a test flow file and converts it into a test program file according to a system administrator's request. The test program is transmitted to the apparatus 200 to execute the test program, and the test results are received from the BSM 70 or the call automatic generating apparatus 200 and analyzed.

The SVAT 100 transmits and receives signals through the BSM 70 and the call generator 200 and the internal communication interface such as a TCP / IP interface or Ethernet, and the BSM 70 and the call generator 200 Are connected to each other to perform verification, or connected simultaneously with the BSM 70 and the call automatic generator 200 to perform a comprehensive interworking test of the mobile communication system.

FIG. 3 is a detailed configuration diagram of the mobile communication system automatic verification apparatus shown in FIG. 2.

As shown, the SVAT 100 according to the present invention includes a controller 1100, a system verification processor 1200, a peripheral device manager 1300, a scenario manager 1400, and a storage means 1500. Here, the system verification processing unit 1200 includes a test flow creating unit 1210, a test program generating unit 1220, a test program driving unit 1230, and a system matching unit 1240, and the peripheral device managing unit 1300. Includes peripheral information management means 1310 and peripheral state management means 1320.

Referring to the function and operation of each component, first, the test flow creation means 1210 is a graphical user interface (GUI), a login screen that allows a system administrator to request authentication by entering a user number and password, and login. In addition to providing a screen to change the password, the system administrator must also provide a menu to log out. In addition, you can select the target system and host to run the test scenario, and the system administrator can select various options to create a verification scenario and save it as a test flow file. For this, various menus and shortcuts are provided. The menus provided include file, edit, build, result, configuration, window, and help. The File menu contains new test flows. New to generate, open to load a pre-written test flow, save to save the created test flow, save as new name to save the created test flow under a different file name Submenus include Save as, Close to close the test flow file being created, and Exit to exit the test engine.

In addition, the edit menu includes submenus such as cut, copy, paste, undo, redo, and the like. Build to convert the code, run to run the test program on a case-by-case basis, batch run to run multiple test programs, and abort to stop the test program from running Submenus).

In addition, the environment menu contains the display used for various block and font coloring, the default path for storing batch files and test case files, the directory for setting the default path for browsers and text editors, and the test. Submenus include new users for the engine and accessibility for adding new hosts to the system. In addition, a shortcut key may be provided for each submenu described above.

The test flow in the test flow creating means 1210, that is, the test scenario creation method will be described below. Test scenarios, like general flowcharts, include icons representing the start and stop of a test flow, action icons for entering test items, and decisions for entering test item performance analysis results. ) Icon, a comment icon for annotating a test item, and a timer icon for inputting a schedule time of a test item, and a system administrator uses each icon and an arrow. You will create a test flow.

When the system administrator selects each icon, the system administrator should be able to check and modify the stored command values to set the icon, and select each icon to enter and modify the memo.

The test program generating unit 1220 performs a function of converting and storing the flow into a test program by a generation menu after the system administrator creates a test flow using the test flow creating unit 1210, and a test program driving unit. 1230 transmits the written command of the test program to the BSM 70 or the call generator 200 to execute the test program. In this case, the test program may be executed for each case or collectively executed.

In other words, the created test flow can be converted to a test program to be executed, undone, or re-executed, and at least two scenario files can be selected and entered into a batch file list for processing. Allows you to check the status of the currently running scenario.

The system matching means 1240 allows information to be transmitted and received between the SVAT 100 and the BSM 70, the SVAT 100, and the call generating device 200 through the TCP / IP interface.

Next, the peripheral device management unit 1300 includes a peripheral device information management means 1310 and the peripheral device status management means 1320. Peripheral device information management means 1310 has a function of managing the information on the BSM 70 and the automatic call generating device 200 and add / delete / change the management target list. Here, the BSM 70-related management information includes a BSM identification number (BSM_ID), a system identification number (SID), a network identification number (NID), an IP address of the BSM (IP_ADDR), a port number of the BSM (PORT_NO), and the like. The call generator 200 related management information includes an IP address IP_ADDR of the call generator, a port number PORT_NO of the call generator, and the like.

In addition, the peripheral device state management means 1320 obtains the state information of the BSM 70 and the call automatic generator 200, respectively, causing a failure in the network or the BSM 70 and / or the call automatic generator 200 Detect and notify when it is down.

Meanwhile, the scenario manager 1400 must manage at least one or more test scenarios created and stored by the system administrator for system verification, and provide the stored scenario list and contents according to the system administrator's request. The storage means 1500 stores a test flow, a test program, a scenario, a test result, an analysis result thereof, and the like.

4 is a view for explaining a mobile communication system verification method by connecting the mobile communication system automatic verification apparatus and the base station management apparatus according to the present invention.

The SVAT 100 according to the present invention matches and manages all the management blocks of the BSM 70 by means of a TCP / IP interface through a Connection and Communication Manager (CCM 720). 70 includes a user interface manager (UIM) for a user interface.

The system administrator, that is, the SVAT (100) operator selects the necessary commands among all the commands used in the BSM 70 to create a scenario (test flow), and the SVAT 100 continuously writes to the BSM 70 according to the written scenarios. Send the command to execute the command. The BSM 70 executes the received command according to the request of the SVAT 100, and transmits the command execution result to the SVAT 100 for each scenario according to a predetermined form.

Through this, the SVAT 100 comprehensively verifies the verification of the alarm function, configuration function, load function, system status and fault function, call processing and handoff function, statistical function, normal function, system expansion and reduction function of the mobile communication system. It can be done with

The management block of the BSM 70 includes a test manager TSM 730, a configuration data manager CDM 740, a status manager STM 750, and a service failure management device. (Fault Manager; FLM, 760), Statistics Measurement Manager (SMM, 770), System Loading Manager (SLM, 780), Sanity Manager (SAM, 790), etc. Included.

5 is a view for explaining a method of verifying a mobile communication system by connecting a mobile communication system automatic verification device and a call automatic generation device according to the present invention.

The SVAT 100 according to the present invention matches and automatically communicates with the call generating device 200 through a communication module 2120 by a TCP / IP interface or Ethernet.

The SVAT 100 creates a scenario by selecting a command according to a command type used in the call generating device, and continuously transmits the command to the call generating device 200 according to the written scenario so that the command is executed. In addition, the call automatic generating device 200 executes the command according to the request of the SVAT 100 and provides the command execution result for each scenario in a predetermined form.

The call generating device 200 includes a system matching unit 2100 and a call automatic generating unit 2200, and the system matching unit 2100 includes a call automatic generating server 2110 and a communication module 2120. The call automatic generation server 2110 is a part that assists communication with the SVAT 100. The call generation server 2110 sets and transmits parameters required for call generation from the SVAT 100 for each test mobile communication terminal 300-1 to 300-n. do. In addition, the call generation unit 2200 is driven to generate a call, and the test result according to the call generation of the call generation unit 2200 is transmitted to the SVAT 100.

In this case, parameters for call generation are as follows [Table 1] and [Table 2] according to the case of generating a voice call and the case of generating a data call, [Table 1] is a case of generating a voice call, [ Table 2] shows the case of generating a data call.

parameter Explanation Idle Time Time to wait before call setup Setup time Time given to call setup process Traffic time Call retention time Call count Occurrences of all test calls Phone reset Perform terminal reset after the number of failures Call type 0: Do not make a call and measure only in idle state 1: Outgoing-Generated by the given number in dial digit 2: Incoming call-Receive incoming call automatically Destination FTP connection ID Dialed Digit FTP connection password Service option Storage location for upload / download files on FTP server

parameter Explanation Idle Time Time to wait before call setup Setup time Time given to call setup process Traffic time Call retention time Call count Occurrences of all test calls Phone reset Perform terminal reset after the number of failures Host FTP server URL or IP address Login ID FTP connection ID Password FTP connection password Change directory Storage location for upload / download files on FTP server Get file File to download Put file File to upload Pending 0: no pending check, 1: pending check Pending Throughput 0: PPP, 1: FTP Pending Start Time When to apply the pending Pending Timeout Pending Segment Time Pending Threshold Threshold to hold through foot

In addition, the types of commands executed in the call automatic generation server 2110 are shown in [Table 3].

command action Login Socket setting after running call auto-generating program Logout Terminate call generation program after disconnecting socket Start Drive call generator according to setting value Get Load result generated after call automatic occurrence

On the other hand, the call automatic generator 2200 is connected to a plurality of test mobile communication terminals (300-1 ~ 300-n), and performs the call generation according to the command required for each scenario of the call automatic generation server 2110 It saves the execution result and provides the result value for analysis by the system administrator's request.

In addition, the SVAT 100 may be combined with the BSM 70 and the call automatic generator 200 to create a scenario comprehensively. The SVAT 100 executes the BSM 70 and the call automatic generating device 200 according to the written scenario, and receives the command execution result in a predetermined form for each scenario.

6 is a flowchart illustrating a method for automatically verifying a mobile communication system according to the present invention, which will be described with reference to FIG. 3 again.

First, the system administrator selects a command required from the BSM 70 or the call generator 200 using the test flow creating means 1210 of the SVAT 100, creates a desired scenario, and stores the stored scenario in the storage means 1500. (S101). The scenario thus created is managed by the scenario manager 1400. Thereafter, the test flow stored in the storage means 1500 is converted into a test program by the test program generating means 1220 and stored (S102), and the test program driving means 1230 continuously performs the BSM (in response to a request of the system administrator). 70) or by sending a command to the automatic call generator 200 to run the scenario (S103).

The BSM 70 or the call generator 200 executes the command according to the command requested by the SVAT 100, and transmits the execution result for each scenario, and the test program driving unit 1230 analyzes and analyzes the test result. The result is stored in the storage means 1500 (S104).

FIG. 7 is a flowchart illustrating a method for automatically verifying a mobile communication system in connection with an automatic call generation device, and illustrates a method of verifying the performance and function of a mobile communication system according to voice call or data call generation.

First, the SVAT 100 sets parameters (refer to Table 1 and Table 2) necessary for call generation for each verification scenario for each mobile communication terminal and transmits them to the call generation server 2110 together with a command (S301 and S202). . Verification scenarios for this purpose must be created by the system administrator. After receiving the parameters and commands, the call auto generation server 2110 analyzes the commands required by the SVAT 100, drives the call auto generation unit 2120, and sends the parameter values to the call auto generation unit 2120. The call is generated to be transmitted (S203).

Accordingly, the call automatic generation unit 2120 generates a call to the test mobile communication terminal (S204), obtains and stores a call generation result (S205, S206), and the SVAT (100) through the call automatic generation server 2110. (S207, S208). The SVAT 100 stores and analyzes the performance result according to the call generation obtained from the call automatic generator 200 and presents the result value at the request of the system administrator (S209).

The system automatic verification device (SVAT) proposed in the present invention is configured to be connected to the base station management device and the call automatic generation device, and the system manager writes a test scenario to be measured and then runs a test program to improve the performance of the system. Additional system verifications are made automatically.

The verification processing unit 1200 and the peripheral device management unit 1300 of the system automatic verification device may be configured as hardware or may be configured as a single software, and may be used after being installed in a computer connected to the BSM 70. have.

The present invention described above will be understood by those skilled in the art to which the present invention pertains can be embodied in other specific forms without changing the technical spirit or essential features thereof. Therefore, the above-described embodiments are to be understood as illustrative in all respects and not as restrictive. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

According to the present invention, a system automatic verification apparatus is installed between a base station management apparatus and a call automatic generation apparatus, and the system verification is automatically performed by writing and driving a test program to be measured by the system administrator. Can improve the reliability.

In addition, by automatically processing system verification, it is possible to prevent waste of manpower or time, and even if the system configuration is complicated and diversified, it is possible to improve the quality of service by ensuring that all necessary system verification is accurate and seamless. Accordingly, it is possible to improve the profit of the mobile communication provider.

1 is a view for explaining a verification method of a general mobile communication system,

2 is an exemplary diagram of a communication network to which an automatic verification apparatus of a mobile communication system according to the present invention is applied;

FIG. 3 is a detailed configuration diagram of an automatic verification system for mobile communication system shown in FIG. 2;

4 is a view for explaining a mobile communication system verification method by connecting the mobile communication system automatic verification apparatus and the base station management apparatus according to the present invention;

5 is a view for explaining a mobile communication system verification method by connecting the automatic communication system automatic verification device and the call automatic generation device according to the present invention;

6 is a flowchart illustrating a method for automatically verifying a mobile communication system according to the present invention;

7 is a flowchart illustrating a method for automatically verifying a mobile communication system associated with a call automatic generator.

<Description of the symbols for the main parts of the drawings>

10-1 to 10-n, 20-1 to 20-n: base station 12, 22: base station controller

14, 24: exchanger 30: GAN

40: DLR 50: Packet Data Service Node

60: AN-AAA 70: base station management device

100: mobile communication system automatic verification device

200: call automatic generator 300, 300-1 ~ 300-n: mobile communication terminal

1100 control unit 1200 system verification processing unit

1210: test flow creation means 1220: test program generation means

1230: test program driving means 1240: system matching means

1300: peripheral device management unit 1310: peripheral device information management means

1320: peripheral device state management means 1400: scenario management unit

1500: storage unit 2100: system matching unit

2110: call automatic generation server 2120: communication module

2200: automatic call generator

Claims (15)

It is connected to the base station management device that is in charge of the operation and maintenance necessary for the base station and the base station controller of the mobile communication system, and connected to the call automatic generator connected to the test mobile communication terminal for performing wireless communication through the base station, A system automatic verification device for performing performance verification of a communication system, In accordance with the request of a system administrator who performs information management and state management for the base station management device and / or the call automatic generation device, manages at least one test scenario for system verification, and operates the system automatic verification device. Providing a list and contents of the stored scenarios, Select a command from the base station management device and / or the call auto-generating device according to the mobile communication system verification purpose and store the test flow file, convert the test flow file into a test program file, and include the command in the test program file. And transmitting the command to the base station management device and / or the call automatic generation device to execute the test program, and receiving and analyzing the test result. The method of claim 1, The apparatus for automatically verifying a system is an apparatus for automatically verifying a mobile communication system, characterized in that the base station management apparatus transmits and receives a signal through a TCP / IP interface or an Ethernet. The method of claim 1, The system automatic verification device includes a control unit; A system verification processing unit for creating and storing a test scenario and a test program according to the verification purpose of the mobile communication system; A peripheral device manager for managing the base station management device and / or the call automatic generation device; A scenario manager for managing the test scenarios; And Storage means for storing the test scenario, test program, test result and analysis result; Automatic verification device of a mobile communication system, characterized in that comprises a. The method of claim 3, wherein The system verification processing unit provides an environment in which a system administrator can access the system automatic verification device, provides an environment in which the test scenario can be created, edited, stored, and executed, and selects a target system to run the test scenario. Test flow creation means for performing; Test program generating means for converting and storing a test program in the test scenario created by the test flow creating means; Test program driving means for transmitting the command of the test program generated by the test program generating means to the base station management device and / or the call automatic generation device to execute the test program; And System matching means for providing a communication interface between the base station management device and / or the call automatic generation device and the system automatic verification device to transmit and receive information; Automatic verification device of a mobile communication system comprising a. The method of claim 4, wherein The test flow creating means includes a file menu, an edit menu, a build menu, a result menu, a configuration menu, a window menu, a help for creating the test scenario. (help) provides a menu and its shortcut keys, The file menu includes a new menu for creating a new test flow, an open menu for loading a previously created test flow, a save menu for storing a created test flow, and a created test flow. A submenu that includes a save as menu to save a different file name, a close menu to close the test flow file being created, and an exit menu to shut down the test engine. Including, The edit menu includes a submenu including a cut menu, a copy menu, a paste menu, an undo menu, a redo menu, The generation menu includes a build menu for converting a test flow into a test program, a run menu for executing a test program for each case, and a batch run menu for executing a plurality of test programs. , A submenu with an abort menu to abort execution of the test program, The environment menu includes a display menu used for various block and font coloring, a directory menu for setting a default path for storing batch files and test case files, and a default path for a browser and a text editor, Automated system verification of a mobile communication system, comprising a submenu that includes an accessibility menu for adding a new host to a system and a new user of the test engine, and providing a shortcut for each of the submenus Device. The method of claim 4, wherein And the test program driving means causes each of the instructions of the test program to be executed or two or more instructions to be collectively executed. The method of claim 3, wherein The peripheral device management unit manages information on the base station management device and / or the automatic call generation device and the peripheral device information management step for adding / deleting / changing the management target list; And Peripheral device state management for acquiring state information of the base station management device and / or the call automatic generation device, respectively, to detect and notify when a failure occurs in the network or when the base station management device and / or the call automatic generation device are down. Way; Automatic verification device of a mobile communication system comprising a. The method of claim 7, wherein The management information related to the base station management apparatus includes a BSM identification number (BSM_ID), a system identification number (SID), a network identification number (NID), an IP address of the BSM (IP_ADDR), and a port number (PORT_NO) of the BSM. Automatic verification device of the mobile communication system. The method of claim 7, wherein The automatic call generator related management information includes an IP address (IP_ADDR) of the call automatic generator and a port number (PORT_NO) of the call automatic generator. The method of claim 1, The system automatic verification device selects a command according to a command type used in the call generating device, creates and stores a test scenario, and continuously transmits the command to the automatic generating device according to the test scenario to execute the command. And setting a parameter for call generation and transmitting it to the call automatic generator. The call generation device generates a call to a plurality of mobile communication terminals with reference to the parameter according to a request of the system automatic verification device, and outputs the execution result of the command for each scenario and the execution result according to the call generation. Automatic verification device of a mobile communication system, characterized in that it has a function for transmitting to the automatic verification device. It is connected to the base station management device that is in charge of the operation and maintenance necessary for the base station and the base station controller of the mobile communication system, connected to the call automatic generator connected to the test mobile communication terminal for performing wireless communication through the base station, the mobile A system verification method in a system automatic verification apparatus for performing performance verification of a communication system, Selecting a required command from the base station management device and / or the call automatic generation device to create and store a test scenario; Converting the test scenario into a test program; Continuously transmitting a command to the base station management device and / or the call generating device to execute the test program; And Receiving, by the scenario, command execution results included in the test program from the base station management device and / or the call automatic generation device, and analyzing and storing test results; Automatic verification method of a mobile communication system comprising a. The method of claim 11, The step of driving the test program is a method for automatically verifying a mobile communication system, characterized in that to execute the instructions of the test program, respectively, or to execute at least two instructions collectively. The method of claim 11, The step of creating the test flow may include a file menu, an edit menu, a build menu, a result menu, a configuration menu, a window menu for creating the test scenario. , The help menu and its shortcut keys, The file menu includes a new menu for creating a new test flow, an open menu for loading a previously created test flow, a save menu for storing a created test flow, and a created test flow. A submenu that includes a save as menu to save a different file name, a close menu to close the test flow file being created, and an exit menu to shut down the test engine. Including, The edit menu includes a submenu including a cut menu, a copy menu, a paste menu, an undo menu, a redo menu, The generation menu includes a build menu for converting a test flow into a test program, a run menu for executing a test program for each case, and a batch run menu for executing a plurality of test programs. , A submenu with an abort menu to abort execution of the test program, The environment menu includes a display menu used for various block and font coloring, a directory menu for setting a default path for storing batch files and test case files, and a default path for a browser and a text editor, Automated system verification of a mobile communication system, comprising a submenu that includes an accessibility menu for adding a new host to a system and a new user of the test engine, and providing a shortcut for each of the submenus Way. The method of claim 11, The call generation device may include a call generation server for assisting communication with the system automatic verification device; After receiving the call generation request and the parameters for the call generation from the system automatic verification apparatus through the call automatic generation server and generating a call to a plurality of test mobile communication terminals accordingly, the call generation result is performed by the call automatic generation server. Call automatic generation unit for transmitting to the system automatic verification apparatus through; The method for automatically verifying the mobile communication system is connected to the automatic call verification system is the system automatic verification device Setting, by the system automatic verification device, a parameter necessary for call generation for each test scenario for each test mobile communication terminal and transmitting the test command to the call generation server together with a test command; After the call automatic generation server receiving the parameter and the command for the call generation analyzes the command, driving the call automatic generation unit and transmitting the parameter value to the call automatic generation unit to perform call generation; Generating a call to the test mobile communication terminal, acquiring and storing a call generation result, and transmitting the call to the system automatic verification apparatus through the call automatic generation server; And Storing and analyzing a result of performing the call in the system automatic verification apparatus; Automatic verification method of a mobile communication system comprising a. It is connected to the base station management device that is in charge of the operation and maintenance necessary for the base station and the base station controller of the mobile communication system, and connected to the call automatic generator connected to the test mobile communication terminal for performing wireless communication through the base station, A recording medium for system verification of an automated system for verifying performance of a communication system, Selecting a necessary command from the base station management device and / or the call automatic generation device to create and store a test scenario; Converting the test scenario into a test program; A function of continuously transmitting a command to the base station management device and / or the call automatic generation device to execute the test program; And A function of receiving, by the scenario, a command execution result included in the test program from the base station management device and / or the call automatic generation device for each scenario, and analyzing and storing a test result; A computer-readable recording medium that records a program for executing the program.