CN112333271B - Satellite data storage system, method, electronic equipment and storage medium - Google Patents
Satellite data storage system, method, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112333271B CN112333271B CN202011219758.6A CN202011219758A CN112333271B CN 112333271 B CN112333271 B CN 112333271B CN 202011219758 A CN202011219758 A CN 202011219758A CN 112333271 B CN112333271 B CN 112333271B
- Authority
- CN
- China
- Prior art keywords
- server
- satellite data
- data
- interface controller
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000013500 data storage Methods 0.000 title claims abstract description 26
- 238000012545 processing Methods 0.000 claims abstract description 60
- 238000007726 management method Methods 0.000 claims abstract description 28
- 230000006870 function Effects 0.000 claims description 23
- 230000008569 process Effects 0.000 claims description 16
- 230000002688 persistence Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 12
- 238000010586 diagram Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 6
- 230000001360 synchronised effect Effects 0.000 description 6
- 238000011161 development Methods 0.000 description 5
- 238000012423 maintenance Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 108091092878 Microsatellite Proteins 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000013467 fragmentation Methods 0.000 description 1
- 238000006062 fragmentation reaction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000003863 physical function Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/70—Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
- G06F21/88—Detecting or preventing theft or loss
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
- H04L67/62—Establishing a time schedule for servicing the requests
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Radio Relay Systems (AREA)
Abstract
The embodiment of the application provides a satellite data storage system, a satellite data storage method, electronic equipment and a storage medium, and relates to the technical field of satellite-borne computer systems. The system comprises an acquisition device, a data acquisition device and a data processing device, wherein the acquisition device comprises a plurality of hardware devices for acquiring satellite data of different kinds; the storage server comprises a cache server and a hard disk server and is used for caching the satellite data acquired by the acquisition equipment through the cache server and storing the earliest satellite data to the hard disk server for processing when the cache server is full; the distributed server comprises a service management module and a function server, wherein the service management module is used for uniformly allocating the function server and processing the satellite data so as to solve the problems of low data acquisition capacity and serious data loss of the conventional satellite data acquisition device.
Description
Technical Field
The application relates to the technical field of satellite-borne computer systems, in particular to a satellite data storage system, a satellite data storage method, electronic equipment and a storage medium.
Background
With the development of commercial aerospace, the demand of commercial microsatellites is gradually increased, and the requirement of data acquisition devices of the satellites is higher and higher.
The commercial microsatellite has the advantages of single function, short research and development period, more and more emission amount and more demand of corresponding hardware monitoring equipment, and meanwhile, the data acquisition of the satellite is performed by taking seconds as an interval unit, and the acquisition frequency is high, so that larger acquisition capacity is needed, and the problems of low data acquisition capacity and serious data loss of the existing satellite data acquisition device are more and more prominent.
Disclosure of Invention
An object of the embodiments of the present application is to provide a satellite data storage system, a satellite data storage method, an electronic device, and a storage medium, so as to solve the problems of low data acquisition capacity and serious data loss of the existing satellite data acquisition device.
An embodiment of the present application provides a satellite data storage system, including:
the acquisition equipment comprises a plurality of hardware devices for acquiring satellite data of different kinds;
the storage server comprises a cache server and a hard disk server and is used for caching the satellite data acquired by the acquisition equipment through the cache server and storing the earliest satellite data to the hard disk server for processing when the cache server is full;
the distributed server comprises a service management module and a function server, wherein the service management module is used for uniformly allocating the function server to process the satellite data.
In the implementation process, different types of satellite data acquired by the acquisition equipment are stored by the cache server and the hard disk server, and can be stored to the cache server and the hard disk server according to the requirement of storage time, so that the optimization of storage space is facilitated, and the loss of the acquired satellite data is avoided; the service management module is used as a unified allocation center of the distributed server, and the function server is allocated in a unified mode through the service management module, so that the maintenance cost of the whole server cluster is reduced, the safety and the stability are improved, and the problems that the data acquisition capacity of the existing satellite data acquisition device is low and the data loss is serious are solved.
Further, the function server further includes:
the gateway server is used for transmitting the satellite data of different types to the service management module through the gateway server;
the modularized interface controller server is connected with the service management module and is used for providing input and output channels of different satellite data;
the modularized service logic processing server is used for providing logic processing service for the satellite data;
the message queue server is used for providing cache for the satellite data in the cache server;
and the timing server is used for sending the satellite data in the message queue server to the modularized service logic processing server in a timing mode through the corresponding modularized interface controller server.
In the implementation process, the gateway server is used as an entrance of the whole distributed server, can be sent to the modularized service logic processing server through the corresponding modularized interface controller server according to the type of satellite data to be transmitted, and performs logic processing through the corresponding modularized service logic processing server; satellite data in the cache server can be issued to the message queue server to be sent to the service management module through the timing server, the timing server can also send satellite data in the hard disk server to the service management module at regular time, a plurality of circulation modes of the satellite data are provided, the satellite data collected by the collecting equipment can adopt a processing mode of multi-channel synchronous and asynchronous unified gathering, and the stability and timeliness of the data are guaranteed in multi-dimension.
Further, the system further comprises:
and the data persistence server is used for storing the data processed by the componentized service logic processing server so as to uniformly call the data.
In the implementation process, the processed satellite data is uniformly stored to a data persistence server so as to be convenient for subsequent calling and prevent data loss.
Furthermore, at least 2 servers with different IP addresses for realizing the same function are arranged in the function server.
In the implementation process, two or more servers with different IPs must be deployed on the same functional server, and this cluster mode with multiple surviving servers and multiple servers is beneficial to improving the performance of the servers.
The embodiment of the application further provides a satellite data storage method, which is applied to the service management module, and the method comprises the following steps:
receiving an interface control server calling instruction sent by a gateway server;
and analyzing the interface control server calling instruction to send the identification information of the corresponding componentized interface controller server to the gateway server, so that the gateway server sends the satellite data to the corresponding componentized interface controller server.
In the implementation process, the service management module is adopted to carry out uniform allocation on the modular interface controller server and the modular service logic processing server, and the modular interface controller server can transmit satellite data to the corresponding modular service logic processing server, so that the maintenance cost of the whole server cluster is reduced, the safety and the stability are improved, and the communication efficiency is improved; and the service management module is used for carrying out redesign and distribution on each data flow module, so that data loss and data delay caused by objective reasons such as network communication and the like are reduced to the greatest extent.
Further, the method further comprises:
receiving a logic processing service calling instruction sent by the componentized interface controller server;
analyzing the logic processing service calling instruction to send the identification information of the corresponding modular service logic processing server to the modular interface controller server so that the modular interface controller server sends the satellite data to the corresponding modular service logic processing server for logic processing and stores the processed satellite data to a data persistence server.
In the implementation process, the modularized interface controller server is used for controlling the circulation of satellite data acquired by different acquisition devices according to different acquisition devices, so that transmission channels corresponding to the acquisition devices with different functions are integrated to form the modularized interface controller server.
Further, the method further comprises:
receiving an interface control server calling instruction sent by a timing server;
analyzing the interface control server calling instruction to send the identification information of the corresponding modularized interface controller server to the timing server so that the timing server sends satellite data in the timing server to the corresponding modularized interface controller server, wherein the satellite data is the satellite data which is released to a message queue server in a cache server or the satellite data which is stored in a hard disk server due to the failure of releasing to the message queue server by the cache server.
In the implementation process, a data circulation process of asynchronous operation is given, satellite data issued to the message queue server by the cache server can be sent to the modularized interface controller server at regular time through the timing server, cache failure data of the cache server are stored in the hard disk server, the timing server reads satellite data in the hard disk server and sends the satellite data to the modularized interface controller server at regular time, the satellite data are matched with synchronous operation to avoid data loss, stability and timeliness of the data are guaranteed in multiple dimensions, a synchronous and asynchronous sending mode is adopted, the stability and timeliness of the data are guaranteed in the multiple dimensions, and the problems that data acquisition capacity is low and data loss is serious in an existing satellite data acquisition device are solved.
Further, before the step of receiving an interface control server call instruction sent by the gateway server, the method further includes:
and respectively allocating a unique identification code to each server in the modularized interface controller servers and sending the unique identification code to the gateway server and the timing server so as to realize the calling of the corresponding modularized interface controller servers.
In the implementation process, the service management module allocates a unique identification code to each server to realize the registration of the server in the service management module, and if the server needs to be called and the corresponding unique identification code is acquired, the server can be called.
An embodiment of the present application further provides an electronic device, where the electronic device includes a memory and a processor, the memory is used for storing a computer program, and the processor runs the computer program to make the computer device execute the satellite data storage method described in any one of the above.
An embodiment of the present application further provides a readable storage medium, in which computer program instructions are stored, and when the computer program instructions are read and executed by a processor, the satellite data storage method described in any one of the above is executed.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a block diagram illustrating a satellite data storage system according to an embodiment of the present disclosure;
fig. 2 is a flowchart of a satellite data storage method provided in an embodiment of the present application;
FIG. 3 is a flow diagram for sending data to a componentized service logic processing server according to an embodiment of the present application;
fig. 4 is a flowchart of sending data by a timing server according to an embodiment of the present application;
fig. 5 is a block diagram of a service administration device according to an embodiment of the present application.
Icon:
101-an antenna; 102-baseband; 103-a power amplifier; 104-a frequency converter; 105-a gateway server; 106-a componentized interface controller server; 107-service administration module; 108-a componentized service logic processing server; 109-a data persistence server; 110-a timing server; 111-message queue server; 112-hard disk server; 113-a cache server; 200-a first receiving unit; 201-a first parsing unit; 202-a second receiving unit; 203-a second parsing unit; 204-a third receiving unit; 205-third parsing unit.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined or explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
Referring to fig. 1, fig. 1 is a block diagram illustrating a satellite data storage system according to an embodiment of the present disclosure. The embodiment of the application provides a data acquisition and storage system of satellite monitoring Hardware based on an HCDM (hybrid data management) architecture mode, which is suitable for data acquisition under the conditions of large batch, high concurrency and high load, and comprises a Hardware Hardware processing layer, a Cache data Cache region, a DCS (distributed control system) distributed server and an MQ (message queue), specifically:
the Hardware Hardware processing layer, namely acquisition equipment, comprises a plurality of Hardware devices for acquiring different satellite data, wherein the acquisition equipment comprises but is not limited to an antenna 101, a baseband 102, a power amplifier (a power amplifier 103) and a frequency converter 104, modular pluggable packaging is carried out according to different physical functionalities of the Hardware devices, and meanwhile, data output ports of all the Hardware devices are subjected to unified classification processing, so that the maintenance cost and the development period of data output are reduced, and the output efficiency is improved.
The Cache data Cache region is a storage server and comprises a Cache server 113 and a hard disk server 112, and is used for caching satellite data acquired by the acquisition equipment through the Cache server 113, and storing the earliest satellite data to the hard disk server 112 to be processed when the Cache server 113 is full;
the storage server performs fragmentation processing of different categories on satellite data acquired by a hardware device, and the satellite data is divided into a cache server 113 and a hard disk server 112, wherein the cache server 113 is a certain cache space which is opened up, the performance of the space can be optimized, a certain space size is set, if the space is full, the oldest data are written into the hard disk server 112, and the space is released at the same time; the hard disk server 112 may perform a persistence process on the overflow data of the cache server 113.
Illustratively, satellite data may be written to hard disk server 112 if cache server 113 is full or if the data sent by cache server 113 to the Message Queue (MQ) server fails.
The DCS distributed server comprises a service management module 107 and a function server, wherein the service management module 107 is used for uniformly allocating the function server to process the satellite data.
The service management module 107 is a Nacos registration center and serves as a heart module of the whole distributed service, all the function servers are uniformly dispatched by the service management module 107 no matter how many servers corresponding to all functions are built, a single long connection rpc (Remote Procedure Call Protocol) Remote communication mode is adopted in the service management module, the maintenance cost of the whole server cluster is greatly reduced, and meanwhile, the safety and the stability are high; and a Rest API channel is established for the data acquisition output interface and the data logic processing service layer, so that data loss is greatly prevented.
Before performing unified scheduling, the service administration module 107 will assign a unique identification code to each server, and complete registration.
The function servers include gateway server 105, componentized interface controller server 106, componentized service logic processing server 108, message queue server 111, and timing server 110, among others.
The gateway server 105 is the only gateway of the whole distributed service, the whole service is registered in the service administration module 107, the communication mode is called remotely through rpc, the gateway server communicates with the service administration module 107, the gateway server 105 is used as a unified gateway, the development cost can be reduced, the maintenance is convenient, and the performance of the whole distributed server can be improved by adding degradation protection and fusing protection.
The modularized interface controller server 106 may be specifically divided into an antenna 101 interface controller, a baseband 102 interface controller, a power amplifier interface controller, a frequency conversion interface controller, and the like according to the types of the acquisition devices, so as to control the circulation of different types of satellite data, and register the satellite data to the service administration module 107, so as to perform uniform deployment through the service administration module 107.
Similarly, the modularized service logic processing server 108 may be specifically divided into an antenna 101 logic processing server, a baseband 102 logic processing server, a power amplifier logic processing server, a frequency conversion logic processing server, and the like according to the type of the acquisition device, and performs logic modularized packaging on the hardware with different physical functions and registers the hardware into the service management module 107, so as to perform unified deployment through the service management module 107.
The system further includes a data persistence server 109, i.e., a data persistence layer, configured to store data processed by the componentized service logic processing server 108, so that the service administration module 107 performs unified call on the data.
When the satellite data is transmitted through the gateway server 105 or the timing server 110, a corresponding interface controller (controller) registered in the service administration module 107 is called, and then the corresponding interface controller calls a corresponding logic processing server (service) through the service administration module 107 to perform logic processing, and the processed satellite data is stored in the data persistence layer.
The cache server 113 will issue the data to be cached to the Message Queue (MQ) server, the timing server 110 will listen to the Message Queue (MQ) server continuously, if there is data in the Message Queue (MQ) server, the timing server 110 will call the corresponding interface control server (controller) registered by the registry; if the cache server 113 fails to issue data to the Message Queue (MQ) server, the data is written into the hard disk server 112, the timing server 110 reads the data in the hard disk server 112 at a set time point, then calls a corresponding interface control server, then a corresponding interface controller calls a corresponding logic processing server (service) through the service administration module 107 to perform logic processing, and the processed satellite data is stored in the data persistence layer.
The cooperative use of the message queue server 111 and the timing server 110 and the data transmission through the gateway server 105 realize synchronous and asynchronous operation, and by using asynchronous operation, the server is not blocked, thereby avoiding affecting the performance of the server, effectively avoiding data loss, and playing an auxiliary role in the correction, new addition and change of data.
For a data circulation mode, a processing mode of multi-channel synchronous and asynchronous unified summarization is adopted, and the stability and timeliness of data are guaranteed in multiple dimensions.
In addition, at least 2 servers with different IP addresses for realizing the same function in the functional server are provided, for example, at least 2 servers such as the timing server 110 and the antenna 101 interface controller are provided, so that the operation of the whole system is not influenced even if one server cannot work normally, namely, a cluster mode of multiple survivors and multiple servers is adopted, and the performance of the server is improved.
Therefore, by adopting the HCDM architecture design mode, the high concurrency and high load capacity of the server are greatly improved, and the coupling degree between codes is reduced; the stability and timeliness of data acquisition of the satellite monitoring hardware equipment are improved, the data acquisition capacity is improved, and the data loss problem is reduced; the service allocation is uniformly completed by the service management module 107, so that the load cost of the whole distributed cluster is reduced, and the communication efficiency between the services is improved; through the modular design, the coupling degree between the modules is reduced, the development and iteration cost of system software is reduced, and the working efficiency of developers is improved.
Example 2
The embodiment of the application provides a satellite data storage method, which is applied to the service governance module 107 in the embodiment 1, as shown in fig. 2, and is a flow chart of the satellite data storage method, and the method includes the following steps:
step S100: receiving an interface control server call instruction sent by the gateway server 105;
before the step of receiving the interface control server call instruction sent by the gateway server 105, the method further includes:
and respectively allocating a unique identification code to each server in the componentized interface controller servers 106 and sending the unique identification code to the gateway server 105 and the timing server 110 so as to realize the calling of the corresponding componentized interface controller server 106.
The unique identification code of the corresponding component interface controller server 106 is sent to the gateway server 105 to realize the calling of the corresponding component interface controller server 106, and the service administration module 107 allocates the unique identification code to each server with different IP addresses, so that the calling of the corresponding server can be realized through the unique identification code.
Because the different acquisition devices, such as the antenna 101, the baseband 102, the power amplifier, and the frequency converter 104, have different types of acquired data, it is necessary to invoke the corresponding transmission channel, i.e., the corresponding modular interface controller server 106, to transmit the data.
The componentized interface controllers need to be registered with the service administration module 107 prior to invocation, i.e., each server in the componentized interface controllers is assigned a unique identification code by the service administration module 107 to complete the registration.
Similarly, for the componentized service logic processing server 108, registration is also required to be realized through the unique identification code assigned by the service administration module 107, which is not described in detail herein.
Step S200: the interface control server call instruction is parsed to send the identification information of the corresponding componentized interface controller server 106 to the gateway server 105, so that the gateway server 105 sends the satellite data to the corresponding componentized interface controller server 106.
As shown in fig. 3, a flow chart for sending data to the componentized service logic processing server 108, the method further comprising:
step S300: receiving a logic processing service call instruction sent by the componentized interface controller server 106;
step S400: and analyzing the logic processing service call instruction to send the identification information of the corresponding modularized service logic processing server 108 to the modularized interface controller server 106, so that the modularized interface controller server 106 sends the satellite data to the corresponding modularized service logic processing server 108 for logic processing and stores the processed satellite data to the data persistence server 109.
As shown in fig. 4, which is a flowchart of the data transmission of the timing server 110, the method further includes:
step S110: receiving an interface control server call instruction sent by the timing server 110;
step S111: analyzing the interface control server call instruction to send the identification information of the corresponding componentized interface controller server 106 to the timing server 110, so that the timing server 110 sends the satellite data in the timing server to the corresponding componentized interface controller server 106, wherein the satellite data is the satellite data released to the message queue server 111 in the cache server 113 or the satellite data stored in the hard disk server 112 due to the failure of the cache server 113 to the message queue server 111.
Through the data circulation of asynchronous operation, can cooperate with synchronous operation each other, avoid data loss, the stability and the promptness of data have been guaranteed to the multidimension degree.
In addition, the gateway server 105 serves as a gateway of the data request, if the external application needs to call the satellite data of the data persistence server 109, it is necessary to send an interface control server call instruction to the service administration module 107 through the gateway server 105 to transmit the satellite data to the gateway server 105 through the corresponding modularized interface controller server 106, thereby realizing the external call of the satellite data.
Therefore, unified allocation of a plurality of servers with different addresses is realized through the service management module 107, and a working mode of a plurality of servers is adopted by matching an HCDM (hybrid control and data distribution) architecture mode with the same function, so that the problems of low data acquisition capacity and serious data loss of the conventional satellite data acquisition device can be solved, the development efficiency of a satellite monitoring equipment system developer is effectively improved, the iteration cycle of the system is greatly shortened, the stability of the system and the concurrency of the system are improved, and the transfer speed of communication data is improved.
Example 3
The embodiment of the present application provides a service governance device, where the device is applied to a service governance module 107, as shown in fig. 5, the device is a structural block diagram of the service governance device, and the device may specifically include but is not limited to:
a first receiving unit 200, configured to receive an interface control server call instruction sent by the gateway server 105;
a first parsing unit 201, configured to parse the interface control server call instruction to send the identification information of the corresponding component interface controller server 106 to the gateway server 105, so that the gateway server 105 sends the satellite data to the corresponding component interface controller server 106.
Further comprising:
a second receiving unit 202, configured to receive a logic processing service call instruction sent by the componentized interface controller server 106;
the second parsing unit 203 parses the logic processing service call instruction to send the identification information of the corresponding modularized service logic processing server 108 to the modularized interface controller server 106, so that the modularized interface controller server 106 sends the satellite data to the corresponding modularized service logic processing server 108 for logic processing and stores the processed satellite data to the data persistence server 109.
Further comprising:
a third receiving unit 204, which receives the interface control server call instruction sent by the timing server 110;
a third parsing unit 205, parsing the interface control server call instruction to send the identification information of the corresponding modular interface controller server 106 to the timing server 110, so that the timing server 110 sends satellite data in the timing server to the corresponding modular interface controller server 106, where the satellite data is the satellite data issued to the message queue server 111 in the cache server 113 or the satellite data stored in the hard disk server 112 due to failure of the cache server 113 to issue to the message queue server 111.
Before the call is made, a unique identification code needs to be respectively allocated to each server in the componentized interface controller servers 106 and sent to the gateway server 105 and the timing server 110, so as to realize the call of the corresponding componentized interface controller server 106.
An embodiment of the present application further provides an electronic device, where the electronic device includes a memory and a processor, the memory is used for storing a computer program, and the processor runs the computer program to make the computer device execute the satellite data storage method described in embodiment 2.
The embodiment of the present application further provides a readable storage medium, in which computer program instructions are stored, and when the computer program instructions are read and executed by a processor, the satellite data storage method described in embodiment 2 is executed.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (7)
1. A satellite data storage system, the system comprising:
the acquisition equipment comprises a plurality of hardware devices for acquiring satellite data of different kinds;
the storage server comprises a cache server and a hard disk server and is used for caching the satellite data acquired by the acquisition equipment through the cache server and storing the earliest satellite data to the hard disk server for processing when the cache server is full;
the distributed server comprises a service management module and a function server, wherein the service management module is used for uniformly allocating the function server to process the satellite data;
the gateway server is used for transmitting the satellite data of different types to the service management module through the gateway server;
the modularized interface controller server is connected with the service management module and is used for providing input and output channels of different satellite data;
the modularized service logic processing server is used for providing logic processing service for the satellite data;
the message queue server is used for providing cache for the satellite data in the cache server;
and the timing server is used for sending the satellite data in the message queue server to the modularized service logic processing server in a timing mode through the corresponding modularized interface controller server.
2. The satellite data storage system of claim 1, wherein said system further comprises:
and the data persistence server is used for storing the data processed by the componentized service logic processing server so as to uniformly call the data.
3. The satellite data storage system of claim 1, wherein there are at least 2 servers of different IP addresses implementing the same function among said function servers.
4. A satellite data storage method applied to the service governance module according to any one of claims 1 to 3, the method comprising:
receiving an interface control server calling instruction sent by a gateway server;
analyzing the interface control server calling instruction to send the identification information of the corresponding modular interface controller server to the gateway server so that the gateway server sends satellite data to the corresponding modular interface controller server;
receiving a logic processing service calling instruction sent by the componentized interface controller server;
analyzing the logic processing service calling instruction to send the identification information of the corresponding modular service logic processing server to the modular interface controller server so that the modular interface controller server sends the satellite data to the corresponding modular service logic processing server for logic processing and stores the processed satellite data to a data persistence server;
the method further comprises the following steps:
receiving an interface control server calling instruction sent by a timing server;
analyzing the interface control server calling instruction to send the identification information of the corresponding modularized interface controller server to the timing server so that the timing server sends satellite data in the timing server to the corresponding modularized interface controller server, wherein the satellite data is the satellite data which is released to a message queue server in a cache server or the satellite data which is stored in a hard disk server due to the failure of releasing to the message queue server by the cache server.
5. The satellite data storage method as claimed in claim 4, wherein prior to the step of receiving the interface control server call instruction transmitted from the gateway server, the method further comprises:
and respectively allocating a unique identification code to each server in the modularized interface controller servers and sending the unique identification code to the gateway server and the timing server so as to realize the calling of the corresponding modularized interface controller servers.
6. An electronic device, characterized in that the electronic device comprises a memory for storing a computer program and a processor for executing the computer program to cause the computer device to perform the satellite data storage method according to claim 4 or 5.
7. A readable storage medium having stored therein computer program instructions which, when read and executed by a processor, perform the satellite data storage method of claim 4 or 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011219758.6A CN112333271B (en) | 2020-11-04 | 2020-11-04 | Satellite data storage system, method, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011219758.6A CN112333271B (en) | 2020-11-04 | 2020-11-04 | Satellite data storage system, method, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112333271A CN112333271A (en) | 2021-02-05 |
| CN112333271B true CN112333271B (en) | 2022-06-07 |
Family
ID=74315814
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011219758.6A Active CN112333271B (en) | 2020-11-04 | 2020-11-04 | Satellite data storage system, method, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112333271B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112910546B (en) * | 2021-02-25 | 2022-06-21 | 北京微纳星空科技有限公司 | Satellite data acquisition system and method |
| CN116048577B (en) * | 2022-12-29 | 2024-05-17 | 哈尔滨工大卫星技术有限公司 | Distributed digital satellite system upgrading method, device and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101060362A (en) * | 2007-04-13 | 2007-10-24 | 北京神州天鸿科技有限公司 | Satellite communication system-based multiple data service system |
| CN201266936Y (en) * | 2007-08-08 | 2009-07-01 | 吕海龙 | Portable colourful frequency spectrum digital star finder |
| CN101501626A (en) * | 2005-03-10 | 2009-08-05 | 全球定位有限公司 | Method and apparatus for managing network elements in a satellite navigation data distribution system |
| CN102521687A (en) * | 2011-12-01 | 2012-06-27 | 中国资源卫星应用中心 | Miniaturized universal platform for preprocessing remote-sensing satellite data |
| CN105049343A (en) * | 2015-06-29 | 2015-11-11 | 中国科学院遥感与数字地球研究所 | Distributed satellite data center efficient and cooperative lightweight high-flux gateway system |
| CN106856495A (en) * | 2015-12-09 | 2017-06-16 | 重庆蓝阳船舶修造有限公司 | A kind of ship craft integrated data sampling and processing and Transmission system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10523758B2 (en) * | 2018-02-09 | 2019-12-31 | Vector Launch Inc. | Distributed storage management in a satellite environment |
| CN110647289A (en) * | 2018-06-27 | 2020-01-03 | 北京市环境保护监测中心 | Satellite remote sensing cloud computing platform and system |
-
2020
- 2020-11-04 CN CN202011219758.6A patent/CN112333271B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101501626A (en) * | 2005-03-10 | 2009-08-05 | 全球定位有限公司 | Method and apparatus for managing network elements in a satellite navigation data distribution system |
| CN101060362A (en) * | 2007-04-13 | 2007-10-24 | 北京神州天鸿科技有限公司 | Satellite communication system-based multiple data service system |
| CN201266936Y (en) * | 2007-08-08 | 2009-07-01 | 吕海龙 | Portable colourful frequency spectrum digital star finder |
| CN102521687A (en) * | 2011-12-01 | 2012-06-27 | 中国资源卫星应用中心 | Miniaturized universal platform for preprocessing remote-sensing satellite data |
| CN105049343A (en) * | 2015-06-29 | 2015-11-11 | 中国科学院遥感与数字地球研究所 | Distributed satellite data center efficient and cooperative lightweight high-flux gateway system |
| CN106856495A (en) * | 2015-12-09 | 2017-06-16 | 重庆蓝阳船舶修造有限公司 | A kind of ship craft integrated data sampling and processing and Transmission system |
Non-Patent Citations (1)
| Title |
|---|
| 卫星数据的分布式存储系统设计与验证;黄炜;《遥感信息》;20201020;第35卷(第5期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112333271A (en) | 2021-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109314726B (en) | System and method for communication between operating system containers | |
| US7689709B2 (en) | Native format tunneling | |
| US5519875A (en) | Distributed processing system for modules, each having modularized objects | |
| CN112333271B (en) | Satellite data storage system, method, electronic equipment and storage medium | |
| CN101022431A (en) | Interface gateway and interface gateway data processing method | |
| US20040068714A1 (en) | Exchange infrastructure system and method | |
| CN105338086A (en) | Distributed message forwarding method | |
| CN112788074A (en) | Data transmitting method, processing method, receiving method and equipment and storage medium | |
| CN102810069A (en) | JAVA object requesting and responding methods, devices and systems and terminal | |
| CN110086759B (en) | Method and device for realizing message transmission between heterogeneous systems | |
| CN102054213A (en) | Information integration method, device and system | |
| CN101478545A (en) | Data distribution processing method, apparatus and system based on Web service interface | |
| EP2590366A1 (en) | Method and system for monitoring message objects sent from a client to invoke operations on a server in a distributed computing environment | |
| CN107911317B (en) | Message scheduling method and device | |
| WO2022065555A1 (en) | Advanced operation method for legacy apparatus using 5th generation mobile communication network-based opc ua | |
| JP4257857B2 (en) | Data processing system and data processing method | |
| US7952996B2 (en) | Method and apparatus for assessing traffic load of a communication network | |
| CN113986566A (en) | Message path selection method for industrial Internet | |
| CN113608861A (en) | Software load computing resource virtualization distribution method and device | |
| CN115767448B (en) | Message sending method, device, equipment and storage medium | |
| CN111865675B (en) | Container receiving and dispatching speed limiting method, device and system | |
| CN113407611B (en) | Data integration distribution platform and system | |
| US7898964B1 (en) | Queue information monitoring system and method | |
| US7426531B1 (en) | Distributed electronic data processing | |
| CN115955519B (en) | Method, device and system for sharing physical communication channel by multi-service application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: Room 1101, 11 / F, building 4, zone 1, 81 Beiqing Road, Haidian District, Beijing Patentee after: Beijing Weina Starry Sky Technology Co.,Ltd. Country or region after: China Address before: Room 1101, 11 / F, building 4, zone 1, 81 Beiqing Road, Haidian District, Beijing Patentee before: BEIJING MINOSPACE TECHNOLOGY CO.,LTD. Country or region before: China |
|
| CP03 | Change of name, title or address |