WO2024187779A1

WO2024187779A1 - Service data storage method and apparatus, computer device, and storage medium

Info

Publication number: WO2024187779A1
Application number: PCT/CN2023/129235
Authority: WO
Inventors: 谈少民
Original assignee: 金蝶软件（中国）有限公司
Priority date: 2023-03-14
Filing date: 2023-11-02
Publication date: 2024-09-19
Also published as: CN116185305A

Abstract

A service data storage method, comprising: acquiring an initial index sequence corresponding to target service data (S202); determining target sub-data from a plurality of pieces of service sub-data comprised in the target service data, and taking, as a target index space, an index space corresponding to the target sub-data in the initial index sequence (S204); when a target data length corresponding to the target sub-data is less than or equal to a spatial data length of the target index space, writing the target sub-data into the target index space to obtain a target index sequence (S206); and when the target data length corresponding to the target sub-data is greater than the spatial data length of the target index space, writing the target sub-data into a target heap space corresponding to the target service data to obtain a target pointer corresponding to the target sub-data, and writing the target pointer into the target index space to obtain a target index sequence (S208).

Description

Business data storage method, device, computer equipment and storage medium

Related Applications

This application claims priority to Chinese patent application number 2023103111471, filed on March 14, 2023, entitled “Business data storage method, device, computer equipment and storage medium”, the entire text of which is hereby incorporated by reference.

Technical Field

The present application relates to the field of computer technology, and in particular to a business data storage method, apparatus, computer equipment, storage medium and computer program product.

Background Art

With the development of data storage technology, heap storage technology has emerged. It stores massive amounts of data of different lengths in a heap and records the indexes corresponding to each piece of data. The index stores the pointer corresponding to the data in the heap. The value of the data can be obtained by accessing the heap through the pointer.

However, using traditional heap storage technology and blindly storing data in the heap will result in low resource utilization.

Summary of the invention

The present application provides a method for storing business data. The method comprises:

Obtain the initial index sequence corresponding to the target business data;

Determine target sub-data from each sub-business data included in the target business data, and use the index space corresponding to the target sub-data in the initial index sequence as the target index space;

When the target data length corresponding to the target sub-data is less than or equal to the spatial data length of the target index space, the target sub-data is written into the target index space to obtain a target index sequence;

When the target data length corresponding to the target sub-data is greater than the space data length of the target index space, the target sub-data is written into the target heap space corresponding to the target business data, the target pointer corresponding to the target sub-data is obtained, and the target pointer is written into the target index space to obtain the target index sequence.

The present application also provides a business data storage device. The device comprises:

An index sequence acquisition module is used to acquire an initial index sequence corresponding to target business data;

The target sub-data determination module is used to determine the target sub-data from each sub-business data included in the target business data. The index space corresponding to the target sub-data in the initial index sequence is used as the target index space;

A target sub-data storage module, used for writing the target sub-data into the target index space to obtain a target index sequence when the target data length corresponding to the target sub-data is less than or equal to the spatial data length of the target index space;

The target sub-data storage module is also used to write the target sub-data into the target heap space corresponding to the target business data when the target data length corresponding to the target sub-data is greater than the space data length of the target index space, obtain the target pointer corresponding to the target sub-data, write the target pointer into the target index space, and obtain the target index sequence.

A computer device includes a memory and a processor. The memory stores a computer program. When the processor executes the computer program, the steps of the business data storage method are implemented.

A computer-readable storage medium stores a computer program, which implements the steps of the above-mentioned business data storage method when executed by a processor.

A computer program product includes a computer program, which implements the steps of the above-mentioned business data storage method when executed by a processor.

Details of one or more embodiments of the present application are set forth in the following drawings and description. Other features, objects, and advantages of the present application will become apparent in the specification, drawings, and claims.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the conventional technology, the drawings required for use in the embodiments or the conventional technology descriptions will be briefly introduced below. Obviously, the drawings described below are merely embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on the disclosed drawings without paying any creative work.

FIG1 is an application environment diagram of a business data storage method in one embodiment;

FIG2 is a schematic diagram of a flow chart of a method for storing business data in one embodiment;

FIG3 is a schematic diagram of a process for determining the length of spatial data in one embodiment;

FIG4 is a schematic diagram of business data storage in one embodiment;

FIG5 is a schematic diagram of business data storage in another embodiment;

FIG6 is a block diagram of a business data storage device in one embodiment;

FIG7 is a block diagram of a service data storage device in another embodiment;

FIG8 is a diagram showing the internal structure of a computer device in one embodiment;

FIG. 9 is a diagram showing the internal structure of a computer device in another embodiment.

DETAILED DESCRIPTION

In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

The business data storage method provided in the embodiment of the present application can be applied to the application environment shown in Figure 1. Among them, the terminal 102 communicates with the server 104 through the network. The data storage system can store the data that the server 104 needs to process. The data storage system can be integrated on the server 104, or it can be placed on the cloud or other network servers. The terminal 102 can be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, Internet of Things devices and portable wearable devices. The Internet of Things devices can be smart TVs, smart car-mounted devices, etc. Portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc. The server 104 can be implemented with an independent server or a server cluster consisting of multiple servers. The terminal 102 and the server 104 can be directly or indirectly connected via wired or wireless communication, and this application is not limited here.

Both the terminal and the server can be used independently to execute the business data storage method provided in the embodiments of the present application.

For example, the terminal obtains the initial index sequence corresponding to the target business data. The terminal determines the target sub-data from the various sub-business data contained in the target business data, and uses the index space corresponding to the target sub-data in the initial index sequence as the target index space. When the target data length corresponding to the target sub-data is less than or equal to the spatial data length of the target index space, the terminal writes the target sub-data into the target index space to obtain a target index sequence. When the target data length corresponding to the target sub-data is greater than the spatial data length of the target index space, the terminal writes the target sub-data into the target heap space corresponding to the target business data, obtains the target pointer corresponding to the target sub-data, writes the target pointer into the target index space, and obtains the target index sequence.

The terminal and the server can also be used together to execute the business data storage method provided in the embodiments of the present application.

For example, the terminal sends a business data storage request carrying the target business data identifier to the server, and the server obtains the initial index sequence corresponding to the target business data based on the target business data identifier. The server determines the target sub-data from the various sub-business data contained in the target business data, and uses the index space corresponding to the target sub-data in the initial index sequence as the target index space. When the target data length corresponding to the target sub-data is less than or equal to the spatial data length of the target index space, the server writes the target sub-data into the target index space to obtain the target index sequence. When the target data length corresponding to the target sub-data is greater than the spatial data length of the target index space, the server writes the target sub-data into the target heap space corresponding to the target business data, obtains the target pointer corresponding to the target sub-data, writes the target pointer into the target index space, and obtains the target index sequence. The server returns the business data storage result to the terminal.

In one embodiment, as shown in FIG2 , a business data storage method is provided, and the method is applied to a computer device as an example for explanation. The computer device may be a terminal or a server, and the method may be executed by the terminal or the server itself alone, or may be implemented through interaction between the terminal and the server. The business data storage method includes the following steps:

Step S202: Acquire an initial index sequence corresponding to the target business data.

Among them, business data refers to a business object containing a large amount of sub-business data to be stored. For example, a business object can be an information registration form, and the data information in the cells in the form is the sub-business data; a business object can be a document, and the data information to be stored contained in the document is the sub-business data; and so on. Target business data refers to business data that needs to be stored. Index sequence refers to a sequence composed of index spaces corresponding to each sub-business data in the target business data. The initial index sequence refers to the index sequence corresponding to the target business data before the storage operation is performed on the target sub-data.

Exemplarily, when the target business data is stored using a heap storage solution, first, a corresponding storage space is allocated for the target sub-data in the heap, and then the target sub-data is written into the corresponding storage space in the heap, and the pointer corresponding to the storage space is written into the target index space corresponding to the target business data in the initial index sequence. However, when the target business data contains a large amount of sub-business data of variable length, that is, the data length of the sub-business data is not fixed, and there is a large amount of sub-business data whose data length is less than or equal to the index space length, blindly storing the sub-business data in the heap will cause a waste of resources. Therefore, when performing a storage operation on the target business data, the computer device first obtains the initial index sequence corresponding to the target business data, and then compares the spatial data length of the target index space in the initial index sequence with the target data length of the target sub-data to determine the storage method corresponding to the target sub-data, so that the target sub-data can be stored in the corresponding storage method.

Step S204: determine target sub-data from each sub-service data included in the target service data, and use the index space corresponding to the target sub-data in the initial index sequence as the target index space.

Among them, the target sub-data refers to the sub-business data that is determined from the various sub-business data contained in the target business data and needs to perform data storage operations. The index space refers to the storage space used to store pointers corresponding to the sub-business data or directly store the sub-business data. When performing data query, when the data stored in the index space is a pointer, the corresponding sub-business data can be read in the heap through the pointer stored in the index space. When the data stored in the index space is sub-business data, the sub-business data can be directly read in the index space. The target index space refers to the index space corresponding to the target sub-data.

Exemplarily, when the target business data has a corresponding sub-business data storage order, the computer device determines the target sub-data in each sub-business data included in the target business data according to the sub-business data storage order. When the target business data does not have a corresponding sub-business data storage order, any sub-business data among the sub-business data to be stored included in the target business data is used as the target sub-data. Then, the index space corresponding to the target sub-data is determined in the initial index sequence, and the index space is used as the target index space corresponding to the target sub-data.

Step S206, when the target data length corresponding to the target sub-data is less than or equal to the spatial data length of the target index space, the target sub-data is written into the target index space to obtain a target index sequence.

The target data length refers to the data length of the target sub-data. For example, when the target sub-data is character data, the target data length is 1 byte. When the target sub-data is integer data, the target data length is 4 bytes, etc. The space data length refers to the size of the storage space occupied by the index space. For example, the space data length of the target index space can be 4 bytes, 8 bytes, etc. The target index sequence refers to the index sequence obtained after the target sub-data is stored, that is, after the target index space in the initial index sequence is updated based on the target sub-data.

Exemplarily, the target data length of the target sub-data and the spatial data length of the target index space are compared. When the target data length is less than or equal to the spatial data length of the target index space, the target sub-data is directly written into the target index space to obtain an updated target index sequence. The target sub-data is continuously determined in each sub-business data contained in the target business data, and the step of returning to obtain the initial index sequence corresponding to the target business data is executed until all sub-business data contained in the target business data are written into the corresponding storage space.

In one embodiment, the security level corresponding to the target sub-data is obtained. When the target data length of the target sub-data is less than or equal to the space data length and the security level of the target sub-data is less than the preset security level, the target sub-data is stored in the target index space. If the security level of the target sub-data is greater than or equal to the preset level, the target sub-data is stored in the target heap space corresponding to the target business data. A corresponding security level is set for each sub-business data contained in the target business data, and the corresponding storage method is determined according to the security level and data length corresponding to different sub-business data, which can improve resource utilization while ensuring the security of data storage.

In one embodiment, the access level corresponding to the target sub-data is obtained, and the access level is used to characterize the frequency of the target sub-data being accessed. If the target sub-data is data that needs to be accessed frequently, the access level corresponding to the target sub-data is higher. The security level corresponding to the target sub-data is obtained. When the target data length of the target sub-data is less than or equal to the spatial data length, and the access level corresponding to the target sub-data is greater than or equal to the preset access level, the target sub-data is stored in the target index space, thereby improving the query speed and improving resource utilization. When the target data length of the target sub-data is less than or equal to the spatial data length, the access level corresponding to the target sub-data is less than the preset access level, and the security level corresponding to the target sub-data is greater than or equal to the preset security level, the target sub-data is stored in the target heap space, thereby improving the security of the target sub-data. When the target data length of the target sub-data is less than or equal to the spatial data length, the security level corresponding to the target sub-data is less than the preset security level, and the access level corresponding to the target sub-data is less than the preset access level, the target sub-data is stored in the target index space, thereby improving the query speed and improving resource utilization. Corresponding security levels and access levels are set for each sub-business data contained in the target business data, and the corresponding storage method is determined according to the security level, access level and data length corresponding to different sub-business data. In this way, the security needs and access needs corresponding to different sub-business data are comprehensively considered during data storage, effectively improving the flexibility of data storage.

Step S208, when the target data length corresponding to the target sub-data is greater than the spatial data length of the target index space, the target sub-data is written into the target heap space corresponding to the target business data, and a target pointer corresponding to the target sub-data is obtained. Write the target pointer into the target index space to obtain the target index sequence.

The target heap space refers to the heap storage space allocated for the target business data. The target pointer refers to the first address of the storage space corresponding to the target sub-data in the target heap space. For example, when the target sub-data is the first sub-data stored in the target heap space, the target pointer corresponding to the target sub-data is 0. If the data length of the target sub-data is 4 bytes, the target pointer corresponding to the second sub-data stored in the target heap space is 4.

Exemplarily, the target data length of the target sub-data and the spatial data length of the target index space are compared. When the target data length is greater than the spatial data length of the target index space, the computer device allocates corresponding storage space for the target sub-data in the heap as the target heap space corresponding to the target sub-data. The target sub-data is written into the target heap space, and the target pointer corresponding to the target heap space is written into the target index space to obtain a target index sequence. The target sub-data is continued to be determined in each sub-business data contained in the target business data, and the step of returning to obtain the initial index sequence corresponding to the target business data is executed until all sub-business data contained in the target business data are written into the corresponding storage space.

In the above-mentioned business data storage method, by obtaining the initial index sequence corresponding to the target business data, and determining the target sub-data from each sub-business data contained in the target business data, the index space corresponding to the target sub-data in the initial index sequence is used as the target index space. When the target data length corresponding to the target sub-data is less than or equal to the spatial data length of the target index space, the target sub-data is written into the target index space to obtain the target index sequence. When the target data length corresponding to the target sub-data is greater than the spatial data length of the target index space, the target sub-data is written into the target heap space corresponding to the target business data, and the target pointer corresponding to the target sub-data is obtained, and the target pointer is written into the target index space to obtain the target index sequence. In this way, when the target data length corresponding to the target sub-data is less than or equal to the spatial data length of the target index space, the target sub-data is directly written into the target index space without allocating the corresponding heap space for the target sub-data, which can avoid opening up unnecessary resource space and effectively improve resource utilization.

In one embodiment, the business data storage method further includes:

The data lengths corresponding to each sub-business data are counted to obtain the estimated data length corresponding to the target business data; and the spatial data length is determined based on the estimated data length.

The estimated data length refers to the length of the storage space required to store each sub-business data included in the target business data.

Exemplarily, the computer device counts the data lengths corresponding to the sub-business data contained in the target business data, calculates the sum of the data lengths corresponding to the sub-business data, and obtains the estimated data length corresponding to the target business data. The spatial data length corresponding to the index space is calculated based on the estimated data length. For example, the spatial data length corresponding to the index space of the target business data is usually 4 bytes or 8 bytes. When the spatial data length is 4 bytes, the corresponding maximum addressing range is 2 ³¹ -1. When the spatial data length is 8 bytes, the corresponding maximum addressing range is 2 ⁶³ -1. If the estimated data length is 2 ³⁰ bytes, the spatial data length can be set to 4 bytes. If the estimated data length is 2 ⁴⁰ bytes, The spatial data length can be set to 8 bytes.

In one embodiment, the computer device determines the lengths of each candidate data corresponding to the index space based on the expected data length. The candidate data length refers to the length of each candidate space data corresponding to the index space. The maximum addressing range corresponding to the candidate data length is greater than the expected data length, and the maximum value of the candidate data length is 8 bytes. In order to improve resource utilization, the minimum value of each candidate data length is used as the space data length. For example, when the expected data length is ²³⁰ bytes, the lengths of each candidate data corresponding to the index space are 4 bytes, 5 bytes, 6 bytes, 7 bytes and 8 bytes, respectively, and the space data length is set to 4 bytes; when the expected data length is ²⁵⁰ bytes, the lengths of each candidate data corresponding to the index space are 7 bytes and 8 bytes, respectively, and the space data length is set to 7 bytes.

In one embodiment, the spatial data length corresponding to the target business data can be set manually. Specifically, the spatial data length required for the target business data is determined by judging the business type to which the target business data belongs. For example, when the maximum value of the storage space size required for the business type to which the target business data belongs is less than 2 ³¹ -1 bytes, the spatial data length corresponding to the target business data can be set to 4 bytes manually; when the maximum value of the storage space size required for the business type to which the target business data belongs is greater than 2 ³¹ -1 bytes, the spatial data length corresponding to the target business data can be set to 8 bytes manually; and so on.

In the above embodiment, the expected data length corresponding to the target business data is determined by counting the data lengths corresponding to each sub-business data, and the spatial data length corresponding to the index space is determined based on the expected data length, which can effectively save the storage resources of computer equipment and improve resource utilization.

In one embodiment, as shown in FIG3 , determining the spatial data length based on the expected data length includes:

Step S302, performing binary conversion on the estimated data length to obtain a conversion result, and obtaining an initial data length based on the conversion result.

Step S304, obtaining a reference data length, and determining an extended length range based on the reference data length and the initial data length.

Step S306: Count the sub-business data whose statistical data length is within the extended length range in the sub-business data corresponding to the target business data, and obtain the extended sub-data volume.

Step S308: Count the sub-business data included in the target business data to obtain the target sub-data volume.

Step S310, when the ratio between the expanded sub-data volume and the target sub-data volume is greater than a preset ratio, the initial data length is updated based on the reference data length to obtain the spatial data length.

The conversion result refers to the result obtained by converting the expected data length into binary.

The initial data length refers to the initial spatial data length corresponding to the index space determined based on the expected data length. The reference data length refers to the data length used to expand the initial data length. The reference data length is greater than or equal to the initial data length. For example, the reference data length can usually be set to 8 bytes. The extended length range refers to the initial data length. The data length range is determined by the initial data length and the reference data length. The initial data length is the lower limit of the extended length range, the reference data length is the upper limit of the extended length range, and the extended length range includes the reference data length. For example, when the initial data length is 2 bytes and the reference data length is 4 bytes, the extended length range is (2,4]. The extended sub-data volume refers to the number of sub-business data whose data length is within the extended length range. The target sub-data volume refers to the number of sub-business data contained in the target business data.

Exemplarily, the expected data length is converted into binary to obtain a conversion result, and the initial data length corresponding to the index space is determined based on the number of bits of the conversion result. For example, when the expected data length is 255 bytes, the conversion result obtained by converting 255 into binary is 1111 1111, and the number of bits corresponding to the conversion result is 8 bits. Therefore, the initial data length should be greater than or equal to 1 byte, for example, the initial data length can be set to 1 byte or 2 bytes. Obtain the reference data length, and when the initial data length is less than the reference data length, determine the extended length range based on the initial data length and the reference data length. In each sub-business data included in the target business data, count each sub-business data whose statistical data length is within the extended length range to obtain the extended sub-data amount. Count each sub-business data included in the target business data to obtain the target sub-data amount. Calculate the ratio between the extended sub-data amount and the target sub-data amount. When the ratio is greater than or equal to the preset ratio, update the initial data length with the reference data length to obtain the space data length. For example, the preset ratio can be set to 0.5, that is, when the data length of 50% or more of the sub-business data in the target business data is within the extended length range, the initial data length is updated with the reference data length. For example, when the reference data length is 8 bytes and the initial data length is 4 bytes, the initial data length is updated to 8 bytes.

In the above embodiment, the amount of sub-data to be expanded is determined by counting the sub-service data within the extended length range. When the ratio of the amount of sub-data to be expanded to the target amount of sub-data is greater than a preset threshold, it indicates that there is still a large amount of sub-service data with a shorter data length that needs to be stored in the heap space. At this time, the initial data length is updated based on the reference data length, so that each sub-service data with a data length within the extended length range can be directly written into the index space, which can further improve resource utilization.

In one embodiment, the business data storage method further includes:

In the target index sequence, based on the storage method corresponding to the target sub-data, the target mark bit corresponding to the target index space is updated; the storage method includes heap space storage and index space storage, and the target mark bit is used to characterize the storage method corresponding to the target sub-data.

Among them, the mark bit refers to the storage space in the index sequence used to record the storage methods corresponding to each sub-data. For example, as shown in Figure 4, the mark bit can be located before the index space and occupy 1 byte. When the mark bit corresponding to the sub-data is 1, it means that the storage method corresponding to the sub-data is index space storage, that is, pointer space storage. When the mark bit corresponding to the sub-data is 0, it means that the storage method corresponding to the sub-data is heap space storage, that is, heap storage. The target mark bit refers to the mark bit corresponding to the target sub-data in the target index sequence. Heap space storage refers to allocating corresponding The storage space is used as the heap space corresponding to the sub-data, and the sub-data is stored in the heap space. Index space storage refers to directly storing the sub-data in the corresponding index space.

Exemplarily, the computer device updates the target flag bit corresponding to the target index space based on the storage mode corresponding to the target sub-data. For example, it can be stipulated that when the storage mode corresponding to the target sub-data is index space storage, the target flag bit corresponding to the target sub-data is set to 1, and when the storage mode corresponding to the target sub-data is heap space storage, the target flag bit corresponding to the target sub-data is set to 0.

In one embodiment, the target flag bit corresponding to the target index space may be stored outside the target index sequence. For example, a flag bit sequence may be established, and the flag bits corresponding to each index space may be stored in the flag bit sequence.

In the above embodiment, based on the storage method corresponding to the target sub-data, the target mark bit corresponding to the target sub-data is updated, so that when performing data query, the storage method corresponding to the target sub-data can be determined according to the target mark bit, and then the target sub-data can be queried from the corresponding storage space based on the storage method corresponding to the target sub-data, thereby ensuring the reliability of data query.

In one embodiment, the business data storage method further includes:

A sub-data query request is obtained, wherein the sub-data query request carries a data identifier corresponding to the sub-data to be queried; based on the data identifier, a current index sequence corresponding to the business data to which the sub-data to be queried belongs is obtained; based on the data identifier, an index space to be queried corresponding to the sub-data to be queried is determined in the current index sequence; based on a to-be-queried mark bit corresponding to the index space to be queried, a storage method corresponding to the sub-data to be queried is determined; based on the storage method corresponding to the sub-data to be queried, the sub-data to be queried is read from the corresponding storage space, and the sub-data to be queried is returned to the querying party corresponding to the sub-data query request.

Among them, the sub-data query request refers to the query request corresponding to the sub-data to be queried in the target business data. The sub-data to be queried refers to the sub-business data queried by the sub-data query request. The data identifier refers to the identifier corresponding to the sub-data to be queried, which can indicate the current index sequence corresponding to the sub-data to be queried, and the index space to be queried corresponding to the sub-data to be queried in the current index sequence. The current index sequence refers to the index sequence corresponding to the business data to which the sub-data to be queried belongs. The index space to be queried refers to the index space corresponding to the sub-data to be queried in the current index sequence. The mark bit to be queried refers to the mark bit of the index space to be queried corresponding to the sub-data to be queried. The query party corresponding to the sub-data query request refers to the computer device that issues the sub-data query request, and the query party can be a terminal or a server.

Exemplarily, the computer device obtains the sub-data query request sent by the query party, and based on the data identifier carried in the sub-data query request, searches for the current index sequence corresponding to the business data to which the sub-data to be queried belongs, and then determines the index space to be queried corresponding to the sub-data to be queried in the current index sequence through the data identifier. According to the to-be-queried mark corresponding to the index space to be queried, the storage method corresponding to the sub-data to be queried is determined. Then, based on the storage method corresponding to the sub-data to be queried and the index space to be queried, the storage space corresponding to the sub-data to be queried is determined, the sub-data to be queried is read from the corresponding storage space, and the queried sub-data to be queried is returned to the query party corresponding to the sub-data query request.

In the above embodiment, the sub-data query request carries the data identifier corresponding to the sub-data to be queried, and the index space to be queried corresponding to the sub-data to be queried is determined based on the data identifier, and then the storage method corresponding to the sub-data to be queried is determined based on the mark to be queried corresponding to the index space, and then the sub-data to be queried is read from the corresponding storage space based on the storage method corresponding to the sub-data to be queried, thereby ensuring the reliability of data query.

In one embodiment, based on the storage mode corresponding to the sub-data to be queried, reading the sub-data to be queried from the corresponding storage space includes:

When the storage method corresponding to the sub-data to be queried is heap space storage, based on the pointer stored in the index space to be queried, the storage space to be queried of the sub-data to be queried in the corresponding heap space to be queried is determined, and the sub-data to be queried is read from the storage space to be queried; when the storage method corresponding to the sub-data to be queried is index space storage, the sub-data to be queried is read from the index space to be queried.

The heap space to be queried refers to the heap storage space allocated for the target business data to which the sub-data to be queried belongs. The storage space to be queried refers to the storage space in the heap space to be queried that stores the sub-data to be queried.

Exemplarily, when the storage mode corresponding to the sub-data to be queried is heap space storage, a pointer corresponding to the sub-data to be queried is obtained from the index space to be queried, and the storage space to be queried corresponding to the sub-data to be queried is determined in the heap space to be queried corresponding to the sub-data to be queried through the pointer, and the sub-data to be queried is read from the storage space to be queried. When the storage mode corresponding to the sub-data to be queried is index space storage, the sub-data to be queried is read from the index space to be queried corresponding to the sub-data to be queried.

In the above embodiment, when the storage method corresponding to the sub-data to be queried is index space storage, the sub-data to be queried is directly read from the index space to be queried corresponding to the sub-business data to be queried, thereby reducing the time overhead of locating the storage space to be queried corresponding to the sub-data to be queried based on the pointer and improving the efficiency of data query.

In one embodiment, the target business data is a target table, and the target sub-data is target cell data.

The target table refers to a table that needs to store data, and the target table contains a large amount of cell data of indefinite length. The target cell data refers to the data stored in the cells of the target table.

In a specific embodiment, the business data storage method of the present application can be applied to data stored in a table. The business data storage method includes the following steps:

1. Get the index sequence corresponding to the target table

The computer device obtains an initial index sequence corresponding to the target table, and obtains the spatial data length of the index space in the initial index sequence.

2. Determine the target cell data and target index space

The computer device determines the target cell data from each cell data contained in the target table, and uses the index space corresponding to the target cell data in the initial index sequence as the target index space.

3. Store target cell data

As shown in Figure 5, when the data length corresponding to the target cell data is less than or equal to the spatial data length of the index space, the target cell data is written into the target index space, that is, stored using the pointer space, and the mark bit corresponding to the target index space is updated to obtain the target index sequence. When the data length corresponding to the target cell data is greater than the spatial data length of the index space, the target cell data and the data length corresponding to the target cell data and other information are written into the target heap space corresponding to the target table to obtain the target pointer corresponding to the target cell data, and the target pointer is written into the target index space to obtain the target index sequence.

In the above embodiment, when there is a large amount of cell data in the target table whose data length is less than or equal to the length of the index space, such cell data is directly stored in the corresponding index space, the index space is fully utilized, and a mark bit is used to mark whether the data is directly stored using the index space or stored in the heap. This can greatly improve resource utilization and reduce resource waste. In addition, by storing the cell data at the index, when querying data, the consumption of searching the storage space based on the pointer can be reduced once, that is, the time overhead of locating the storage space corresponding to the cell data in the heap according to the pointer is reduced, thereby improving data reading performance and making the program more efficient.

It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

Based on the same inventive concept, the embodiment of the present application also provides a business data storage device for implementing the business data storage method involved above. The implementation solution provided by the device to solve the problem is similar to the implementation solution recorded in the above method, so the specific limitations in the one or more business data storage device embodiments provided below can refer to the limitations on the business data storage method above, and will not be repeated here.

In one embodiment, as shown in FIG. 6 , a business data storage device is provided, including: an index sequence acquisition module 602, a target sub-data determination module 604 and a target sub-data storage module 606, wherein:

The target sub-data determination module is used to determine the target sub-data from the various sub-business data included in the target business data, and use the index space corresponding to the target sub-data in the initial index sequence as the target index space.

The target sub-data storage module is used to write the target sub-data into the target index space to obtain the target index sequence when the target data length corresponding to the target sub-data is less than or equal to the spatial data length of the target index space.

The target sub-data storage module is also used to store the target sub-data when the target data length corresponding to the target sub-data is greater than the target index space. When the spatial data length is reached, the target sub-data is written into the target heap space corresponding to the target business data, the target pointer corresponding to the target sub-data is obtained, and the target pointer is written into the target index space to obtain the target index sequence.

The above-mentioned business data storage device obtains the initial index sequence corresponding to the target business data, and determines the target sub-data from each sub-business data contained in the target business data, and uses the index space corresponding to the target sub-data in the initial index sequence as the target index space. When the target data length corresponding to the target sub-data is less than or equal to the spatial data length of the target index space, the target sub-data is written into the target index space to obtain the target index sequence. When the target data length corresponding to the target sub-data is greater than the spatial data length of the target index space, the target sub-data is written into the target heap space corresponding to the target business data, and the target pointer corresponding to the target sub-data is obtained, and the target pointer is written into the target index space to obtain the target index sequence. In this way, when the target data length corresponding to the target sub-data is less than or equal to the spatial data length of the target index space, the target sub-data is directly written into the target index space without allocating the corresponding heap space for the target sub-data, which can avoid opening up unnecessary resource space and effectively improve resource utilization.

In one embodiment, as shown in FIG7 , the service data storage device further includes:

The spatial data length determination module 702 is used to count the data lengths corresponding to each sub-service data to obtain the estimated data length corresponding to the target service data; and determine the spatial data length based on the estimated data length.

The target mark bit update module 704 is used to update the target mark bit corresponding to the target index space in the target index sequence based on the storage method corresponding to the target sub-data; the storage method includes heap space storage and index space storage, and the target mark bit is used to characterize the storage method corresponding to the target sub-data.

The query request response module 706 is used to obtain a sub-data query request, wherein the sub-data query request carries a data identifier corresponding to the sub-data to be queried; based on the data identifier, obtain the current index sequence corresponding to the business data to which the sub-data to be queried belongs; based on the data identifier, determine the index space to be queried corresponding to the sub-data to be queried in the current index sequence; based on the to-be-queried mark bit corresponding to the index space to be queried, determine the storage method corresponding to the sub-data to be queried; based on the storage method corresponding to the sub-data to be queried, read the sub-data to be queried from the corresponding storage space, and return the sub-data to be queried to the query party corresponding to the sub-data query request.

In one embodiment, the spatial data length determination module 702 is further configured to:

Perform binary conversion on the expected data length to obtain a conversion result, and obtain an initial data length based on the conversion result; obtain a reference data length, and determine an extended length range based on the reference data length and the initial data length; among the sub-business data corresponding to the target business data, count the sub-business data whose statistical length is within the extended length range to obtain an extended sub-data volume; count the sub-business data included in the target business data to obtain a target sub-data volume; when the ratio between the extended sub-data volume and the target sub-data volume is greater than a preset ratio, update the initial data length based on the reference data length to obtain the spatial data length.

In one embodiment, the query request response module 706 is further configured to:

Each module in the above-mentioned business data storage device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each module above.

In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be shown in FIG8. The computer device includes a processor, a memory, an input/output interface (Input/Output, referred to as I/O) and a communication interface. The processor, the memory and the input/output interface are connected via a system bus, and the communication interface is connected to the system bus via the input/output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data such as an initial index sequence and target sub-data. The input/output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a business data storage method is implemented.

In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be shown in FIG9. The computer device includes a processor, a memory, an input/output interface, a communication interface, a display unit, and an input device. The processor, the memory, and the input/output interface are connected via a system bus, and the communication interface, the display unit, and the input device are connected to the system bus via the input/output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input/output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a business data storage method is implemented. The display unit of the computer device is used to form a visually visible picture, which may be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

Those skilled in the art will appreciate that the structures shown in FIGS. 8 and 9 are only partial structures related to the present application. The block diagram of the structure does not constitute a limitation on the computer device to which the present application solution is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned method embodiments when executing the computer program.

In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above method embodiments are implemented.

In one embodiment, a computer program product or computer program is provided, the computer product or computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the steps in the above-mentioned method embodiments.

It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic unit, a data processing logic unit based on quantum computing, etc., but are not limited to this.

The technical features of the above embodiments can be combined arbitrarily. All possible combinations of various technical features are described; however, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the patent of the present application. It should be pointed out that, for ordinary technicians in this field, several modifications and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the attached claims.

Claims

A business data storage method, the method comprising:

Obtain the initial index sequence corresponding to the target business data;

Determine target sub-data from each sub-service data included in the target service data, and use the index space corresponding to the target sub-data in the initial index sequence as the target index space;

When the target data length corresponding to the target sub-data is less than or equal to the space data length of the target index space, writing the target sub-data into the target index space to obtain a target index sequence; and

When the target data length corresponding to the target sub-data is greater than the space data length of the target index space, the target sub-data is written into the target heap space corresponding to the target business data, and the target pointer corresponding to the target sub-data is obtained. The target pointer is written into the target index space to obtain a target index sequence.
The method according to claim 1, wherein the method further comprises:

Counting the data lengths corresponding to the sub-service data to obtain the estimated data length corresponding to the target service data; and

The spatial data length is determined based on the expected data length.
The method according to claim 2, wherein the determining the spatial data length based on the expected data length comprises:

Performing binary conversion on the estimated data length to obtain a conversion result, and obtaining an initial data length based on the conversion result;

Acquire a reference data length, and determine an extended length range based on the reference data length and the initial data length;

In the sub-service data corresponding to the target service data, the sub-service data whose statistical data length is within the extended length range is obtained to obtain the extended sub-data volume;

Counting the sub-service data included in the target service data to obtain a target sub-data volume; and

When the ratio between the extended sub-data amount and the target sub-data amount is greater than a preset ratio, the initial data length is updated based on the reference data length to obtain the spatial data length.
The method according to claim 1, wherein the method further comprises:

In the target index sequence, based on the storage method corresponding to the target sub-data, the target mark bit corresponding to the target index space is updated; the storage method includes heap space storage and index space storage, and the target mark bit is used to characterize the storage method corresponding to the target sub-data.
The method according to claim 1, wherein the method further comprises:

Obtaining a sub-data query request, wherein the sub-data query request carries a data identifier corresponding to the sub-data to be queried;

Based on the data identifier, obtaining a current index sequence corresponding to the business data to which the sub-data to be queried belongs;

Based on the data identifier, determining the to-be-queried index space corresponding to the to-be-queried sub-data in the current index sequence;

Determining a storage mode corresponding to the sub-data to be queried based on the to-be-queried mark bit corresponding to the to-be-queried index space; and

Based on the storage mode corresponding to the sub-data to be queried, the sub-data to be queried is read from the corresponding storage space, and the sub-data to be queried is returned to the querying party corresponding to the sub-data query request.
The method according to claim 5, wherein the reading the sub-data to be queried from the corresponding storage space based on the storage mode corresponding to the sub-data to be queried comprises:

When the storage mode corresponding to the sub-data to be queried is heap space storage, determining the storage space to be queried of the sub-data to be queried in the corresponding heap space to be queried based on the pointer stored in the index space to be queried, and reading the sub-data to be queried from the storage space to be queried; and

When the storage mode corresponding to the sub-data to be queried is index space storage, the sub-data to be queried is read from the index space to be queried.
The method according to any one of claims 1 to 6, wherein the target business data is a target table, and the target sub-data is target cell data.
A business data storage device, the device comprising:

An index sequence acquisition module is used to acquire an initial index sequence corresponding to target business data;

A target sub-data determining module, configured to determine target sub-data from each sub-service data included in the target service data, and use the index space corresponding to the target sub-data in the initial index sequence as the target index space;

A target sub-data storage module, configured to write the target sub-data into the target index space to obtain a target index sequence when the target data length corresponding to the target sub-data is less than or equal to the spatial data length of the target index space;

The target sub-data storage module is also used to write the target sub-data into the target heap space corresponding to the target business data when the target data length corresponding to the target sub-data is greater than the space data length of the target index space, obtain the target pointer corresponding to the target sub-data, write the target pointer into the target index space, and obtain the target index sequence.
A computer device comprises a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of any one of the methods of claims 1 to 7 when executing the computer program.
A computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the method according to any one of claims 1 to 7.