fatal exception

Raimondas_Tijunaitis · May 10, 2016, 6:47pm

hi, we just encountered cluster outage with following exception:
ES: 3.6.0

Has anyone dealt with this before?

ERROR TableIndex ] Error in TableIndex.ReadOffQueue

System.ComponentModel.Win32Exception (0x80004005): An attempt was made to move the file pointer before the beginning of the file

at EventStore.Core.TransactionLog.Unbuffered.NativeFile.Seek(SafeFileHandle handle, Int64 position, SeekOrigin origin) in c:\projects\eventstore\src\EventStore.Core\TransactionLog\Unbuffered\NativeFile.cs:line 242

at EventStore.Core.TransactionLog.Unbuffered.UnbufferedFileStream.Read(Byte[] buffer, Int32 offset, Int32 count) in c:\projects\eventstore\src\EventStore.Core\TransactionLog\Unbuffered\UnbufferedFileStream.cs:line 183

at EventStore.Core.TransactionLog.Unbuffered.UnbufferedFileStream.Read(Byte[] buffer, Int32 offset, Int32 count) in c:\projects\eventstore\src\EventStore.Core\TransactionLog\Unbuffered\UnbufferedFileStream.cs:line 198

at EventStore.Core.Index.PTable.ReadUntilWithMd5(Int64 nextPos, Stream fileStream, MD5 md5) in c:\projects\eventstore\src\EventStore.Core\Index\PTable.cs:line 206

at EventStore.Core.Index.PTable.CacheMidpointsAndVerifyHash(Int32 depth) in c:\projects\eventstore\src\EventStore.Core\Index\PTable.cs:line 195

at EventStore.Core.Index.PTable…ctor(String filename, Guid id, Int32 initialReaders, Int32 maxReaders, Int32 depth) in c:\projects\eventstore\src\EventStore.Core\Index\PTable.cs:line 112

at EventStore.Core.Index.PTable.MergeTo2(IList1 tables, Int64 fileSize, String outputFile, Func2 recordExistsAt, Int32 cacheDepth) in c:\projects\eventstore\src\EventStore.Core\Index\PTableConstruction.cs:line 194

at EventStore.Core.Index.PTable.MergeTo(IList1 tables, String outputFile, Func2 recordExistsAt, Int32 cacheDepth) in c:\projects\eventstore\src\EventStore.Core\Index\PTableConstruction.cs:line 68

at EventStore.Core.Index.IndexMap.AddPTable(PTable tableToAdd, Int64 prepareCheckpoint, Int64 commitCheckpoint, Func`2 recordExistsAt, IIndexFilenameProvider filenameProvider, Int32 indexCacheDepth) in c:\projects\eventstore\src\EventStore.Core\Index\IndexMap.cs:line 334

at EventStore.Core.Index.TableIndex.ReadOffQueue() in c:\projects\eventstore\src\EventStore.Core\Index\TableIndex.cs:line 256

Greg_Young1 · May 10, 2016, 6:53pm

If you look above in log, it was reading an index file. What is the
size of this index file?

Greg_Young1 · May 10, 2016, 7:05pm

Or just copy/paste the logs above about the merge that was happening
and I can figure it out

Raimondas_Tijunaitis · May 10, 2016, 7:20pm

those are the lines above. Basically it was restarted and verification was going on

[PID:01540:008 2016.05.10 16:22:40.421 TRACE TFChunk ] Verifying hash for TFChunk ‘d:/Store/Banners\chunk-000000.000000’…

[PID:01540:010 2016.05.10 16:23:19.155 TRACE ClusterStorageWriter] Completing data chunk 580-580…

[PID:01540:010 2016.05.10 16:23:19.155 TRACE TFChunk ] CACHED TFChunk #581-581 (chunk-000581.000000) in 00:00:00.0006908.

[PID:01540:059 2016.05.10 16:23:19.202 TRACE TFChunk ] UNCACHED TFChunk #579-579 (chunk-000579.000000).

[PID:01540:006 2016.05.10 16:25:26.995 TRACE PTable ] PTables merge finished in 00:27:05.8283496 ([116634958, 127715308] entries merged into 242275015).

[PID:01540:006 2016.05.10 16:25:26.995 TRACE PTable ] Loading and Verification of PTable ‘2254f312-a55c-4efc-be87-b6e2777607b8’ started…

[PID:01540:006 2016.05.10 16:27:28.088 ERROR TableIndex ] Error in TableIndex.ReadOffQueue