Recovery from out of disk error?

EventStoreDB
1

Hi All,

I ran out of disk space and now when I try to run the EventStore I get the following error. Any ideas?

Thanks,

Brian

[02774,18,21:58:03.045] Verifying hash for TFChunk ‘/home/ec2-user/events/chunk-000018.000000’…

[02774,25,21:58:05.336] SLOW BUS MSG [MainBus]: EventCommitted - 93ms. Handler: WideningHandler`2.

[02774,25,21:58:05.336] SLOW QUEUE MSG [MainQueue]: EventCommitted - 105ms. Q: 0/368.

  • Assertion at sgen-alloc.c:456, condition `*p == NULL’ not met

Stacktrace:

at <0xffffffff>

at (wrapper managed-to-native) object.__icall_wrapper_mono_object_new_fast (intptr) <0xffffffff>

at EventStore.Core.Services.Storage.ReaderIndex.IndexCommitter.Commit (System.Collections.Generic.IList`1<EventStore.Core.TransactionLog.LogRecords.PrepareLogRecord>,bool) <0x00145>

at EventStore.Core.Services.Storage.ReaderIndex.IndexCommitter.Init (long) <0x003de>

at EventStore.Core.Services.Storage.StorageChaser.ChaseTransactionLog () <0x000af>

at System.Threading.Thread.StartInternal () <0x0006f>

at (wrapper runtime-invoke) object.runtime_invoke_void__this__ (object,intptr,intptr,intptr) <0xffffffff>

Native stacktrace:

/home/ec2-user/EventStore-v3.4.0/eventstored() [0x6127b2]

/lib64/libpthread.so.0(+0xf100) [0x7fb24375d100]

/lib64/libc.so.6(gsignal+0x37) [0x7fb2433c15f7]

/lib64/libc.so.6(abort+0x148) [0x7fb2433c2ce8]

/home/ec2-user/EventStore-v3.4.0/eventstored() [0x5708a9]

/home/ec2-user/EventStore-v3.4.0/eventstored() [0x570aaf]

/home/ec2-user/EventStore-v3.4.0/eventstored() [0x570bf6]

/home/ec2-user/EventStore-v3.4.0/eventstored() [0x50bbda]

/home/ec2-user/EventStore-v3.4.0/eventstored() [0x50c11f]

[0x41331f93]

Debug info from gdb:

2

Is it still out of disk after? This is a GC assertion which is a bit odd.

3

This was after growing the hard drive.

4

Is it possible to send us the db through a private channel?

5

I will check and get back to you.

6

Also can you send the logs from when it ran out of disk? I want to see
which operation it might have ran out of disk on.

Greg

7

Sure.