.NET Runtime - Unhandled Exception

Event store version 3.2.0.0 running under Windows.

Our Event Store stopped running, and in the Windows Event Log, we had the following message.

Application: EventStore.ClusterNode.exe

Framework Version: v4.0.30319

Description: The process was terminated due to an unhandled exception.

Exception Info: exception code 80000003, exception address 000007FA80AC6BFA

Stack:

at EventStore.Projections.Core.v8.Js1.CompilePrelude(System.String, System.String, LoadModuleDelegate, EnterCancellableRegionDelegate, ExitCancellableRegionDelegate, LogDelegate)

at EventStore.Projections.Core.v8.Js1.CompilePrelude(System.String, System.String, LoadModuleDelegate, EnterCancellableRegionDelegate, ExitCancellableRegionDelegate, LogDelegate)

at EventStore.Projections.Core.v8.PreludeScript.CompileScript(System.String, System.String)

at EventStore.Projections.Core.v8.PreludeScript…ctor(System.String, System.String, System.Func2<System.String,System.Tuple2<System.String,System.String>>, System.Action2<Int32,System.Action>, System.Action2<System.String,System.Object[]>)

at EventStore.Projections.Core.Services.v8.V8ProjectionStateHandler…ctor(System.String, System.String, System.Func2<System.String,System.Tuple2<System.String,System.String>>, System.Action2<System.String,System.Object[]>, System.Action2<Int32,System.Action>)

at EventStore.Projections.Core.Services.Management.ProjectionStateHandlerFactory.Create(System.String, System.String, System.Action2<Int32,System.Action>, System.Action2<System.String,System.Object[]>)

at EventStore.Projections.Core.Services.Processing.ProjectionCoreService.CreateStateHandler(EventStore.Projections.Core.Services.ISingletonTimeoutScheduler, EventStore.Common.Log.ILogger, System.String, System.String)

at EventStore.Projections.Core.Services.Processing.ProjectionCoreService.Handle(CreateAndPrepare)

at EventStore.Core.Bus.MessageHandler`1[[System.__Canon, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089]].TryHandle(EventStore.Core.Messaging.Message)

at EventStore.Core.Bus.InMemoryBus.Publish(EventStore.Core.Messaging.Message)

at EventStore.Core.Bus.QueuedHandlerMRES.ReadFromQueue(System.Object)

at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)

at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)

at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)

at System.Threading.ThreadHelper.ThreadStart(System.Object)

Anyone any idea what happened?

You are running with projections enabled…
Do you have any logs from ES around the time of the crash?

Can you tell a bit more about what might have been going on?

We had two projections running.
There was traffic coming through the Event Store, but nothing more than a few events per minute.

I have attached the log file.

The server we are running this on is very low specification, and the memory usage is always running >95%. Not sure whether thats relevant or not.

if you need anything else, just let me know.

127.0.0.1-2113-cluster-node.log (106 KB)

"The server we are running this on is very low specification, and the
memory usage is always running >95%. Not sure whether thats relevant
or not."

Actually this may be. It seems the error occurred when compiling JavaScript.

Even so we should probably handle this better in EventStore.Projections.Core.v8.Js1.CompilePrelude in JS1 - almost certainly related to memory usage though.

Yes we should handle it better its a bit bizarre that its coming back
as a 800000003 though. This is normally a debugger interrupt in my
experience.