how to speed up the data loading during the #205

useryq8 · 2024-04-22T11:56:48Z

useryq8
Apr 22, 2024

I used the following code. EclipseStroe 1.2.0, Java 21, linux ubuntu 20. the springboot starts become slower as the EclipseStroe file becomes bigger. the startup time is about 3-5min now. I only calls openByPathWithEclipseStore 3 times for I have 3 different DataRoot, the data size is about 500M , 134M, 400M. Do we have some ways to speed up the programs startup

My logs show that the openByPathWithEclipseStore method consumes the most startup time

@fh-ms @hg-ms , Could you give some suggestions? Thank you in advance!

` public EmbeddedStorageManager openByPathWithEclipseStore(String graphDbPath)
{
var builder = EmbeddedStorageConfiguration.Builder();
builder.setHousekeepingAdaptive(true);

var foundation = builder
  .setStorageDirectory(graphDbPath)
  .setChannelCount(1)
  .setDataFileMaximumSize(ByteSize.New(2, ByteUnit.GB))
  .setHousekeepingInterval(Duration.of(5, ChronoUnit.SECONDS))
  .setHousekeepingTimeBudget(Duration.of(3, ChronoUnit.SECONDS))
  .setHousekeepingMaximumTimeBudget(Duration.of(4, ChronoUnit.SECONDS))
  .setHousekeepingIncreaseAmount(Duration.of(1, ChronoUnit.SECONDS))
  .setEntityCacheTimeout(Duration.of(1, ChronoUnit.MINUTES))
  .createEmbeddedStorageFoundation();

foundation.onConnectionFoundation(BinaryHandlersJDK8::registerJDK8TypeHandlers);

var manager = foundation.createEmbeddedStorageManager().start();
manager.persistenceManager().objectRegistry().ensureCapacity( 1024 * 1024 * 10);


return manager;

}`

useryq8 · 2024-05-21T09:33:10Z

useryq8
May 21, 2024
Author

@fh-ms @hg-ms , Could you give some suggestions? Thank you !
My application starts consumes about 5min nows, it is too slow for loading the eclipsestore, my eclipse data is only 2.8G and 1.5G (I have two dataRoots for different object storing, so there are two eclipsestore files, which need to be opened when application starts)

0 replies

Flo9520 · 2024-06-26T07:03:26Z

Flo9520
Jun 26, 2024

Are you using blob storage for your data? We had the same issue because the housekeeping is not working in blobs

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

how to speed up the data loading during the #205

Uh oh!

{{title}}

Uh oh!

Replies: 2 comments

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

how to speed up the data loading during the #205

Uh oh!

useryq8 Apr 22, 2024

Replies: 2 comments

Uh oh!

useryq8 May 21, 2024 Author

Uh oh!

Flo9520 Jun 26, 2024

useryq8
Apr 22, 2024

useryq8
May 21, 2024
Author

Flo9520
Jun 26, 2024