Full Backup with Azure Blob #411

Flo9520 · 2025-06-12T07:36:52Z

Flo9520
Jun 12, 2025

I am writing full backups of my data every hour into my Azure blob storage. With more and more data I am facing the issue that Java is not able to write the backup because since it is a Zip file Java neads to load the whole data into the heap and I run into the followign Exception:

Caused by: java.lang.OutOfMemoryError: Cannot reserve 16597574 bytes of direct buffer memory (allocated: 258072259, limit: 268435456)
	at java.base/java.nio.Bits.reserveMemory(Unknown Source)
	at java.base/java.nio.DirectByteBuffer.<init>(Unknown Source)
	at java.base/java.nio.ByteBuffer.allocateDirect(Unknown Source)
	at org.eclipse.serializer.memory.XMemory.allocateDirectNative(XMemory.java:846)
	at org.eclipse.serializer.memory.XMemory.allocateDirectNative(XMemory.java:853)
	at org.eclipse.serializer.afs.types.AIoHandler$Abstract.copyGeneric(AIoHandler.java:295)
	at org.eclipse.serializer.afs.types.AIoHandler$Abstract.copyFrom(AIoHandler.java:931)
	at org.eclipse.serializer.afs.types.AWritableFile.copyFrom(AWritableFile.java:69)
	at org.eclipse.store.storage.types.StorageFile$Abstract.copyTo(StorageFile.java:276)
	at org.eclipse.store.storage.types.StorageFileManager$Default.lambda$exportData$2(StorageFileManager.java:1313)
	at org.eclipse.serializer.afs.types.AFS.executeWriting(AFS.java:156)
	at org.eclipse.serializer.afs.types.AFS.executeWriting(AFS.java:143)
	at org.eclipse.store.storage.types.StorageFileManager$Default.exportData(StorageFileManager.java:1312)
	at org.eclipse.store.storage.types.StorageChannel$Default.exportData(StorageChannel.java:665)
	at org.eclipse.store.storage.types.StorageRequestTaskExportChannels$Default.internalProcessBy(StorageRequestTaskExportChannels.java:57)
	at org.eclipse.store.storage.types.StorageRequestTaskExportChannels$Default.internalProcessBy(StorageRequestTaskExportChannels.java:20)
	at org.eclipse.store.storage.types.StorageChannelTask$Abstract.processBy(StorageChannelTask.java:244)
	at org.eclipse.store.storage.types.StorageChannel$Default.work(StorageChannel.java:453)
	at org.eclipse.store.storage.types.StorageChannel$Default.run(StorageChannel.java:536)
	... 1 common frames omitted

Is there a way to not write the backup as a Zip?
For now I have increased the available heap space but this is not a solution.

Thank you very much in advance!

hg-ms · 2025-06-13T04:49:58Z

hg-ms
Jun 13, 2025
Collaborator

Hi,
by default, Eclipse-Store does not write into zip files. I guess you are using some integration into another framework.
If you have access to the EmbeddedStorageManager instance you can issue the default full back up, that does not create a zip file:

EmbeddedStorageManager storageManager = EmbeddedStorage.start();
...	
ADirectory backupDirectory = NioFileSystem.New().ensureDirectoryPath("/stoarge/backup");
storageManager.issueFullBackup(backupDirectory);

The docu is here: https://docs.eclipsestore.io/manual/storage/configuration/backup/full-backup.html

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Full Backup with Azure Blob #411

Uh oh!

{{title}}

Uh oh!

Replies: 1 comment

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Full Backup with Azure Blob #411

Uh oh!

Flo9520 Jun 12, 2025

Replies: 1 comment

Uh oh!

hg-ms Jun 13, 2025 Collaborator

Flo9520
Jun 12, 2025

hg-ms
Jun 13, 2025
Collaborator