one 2 Billion Stream breaks GES ?

Hello there ! happy new year :slight_smile:

I heard the about the limitation of 2 billions per stream and then we decided to run some tests.

So we basically (it took some hours) added 2 billions event in the same stream.

Around 400 GB later the GES server crashed : “ArgumentOutOfRangeException: Specified argument was out of the range of valid values”

Wouldn’t it be nicer to have the GES server to close the stream or refuse any further events (like an hard delete) ?

Then I just restarted the GES server and … well after a while it crashed again : “ArgumentOutOfRangeException: entry.Version should be non negative”

So, one stream limitation crashed the all system, i’m now a little scared.

Of course we won’t have a 2Billions stream in production, but we could have a projection on $ce-mycategory,

and after a few years, this stream of linked events perhaps will reach 2Billions events …

and then our all system goes down ?

What can we do to prevent this ?

At least what can I do to make my GES test server to restart properly from this catastrophic state ?

127.0.0.1-2114-cluster-node-err.log (4.68 KB)

It shouldnt crash will look why it may be. It should reject requests past 2b

Perhaps it’s because I activated projections ?

Le ven. 15 janv. 2016 Ă  17:09, Greg Young gregoryyoung1@gmail.com a Ă©crit :

what is a full stack trace? I can repro but obviously that takes 400GB
or so of time :slight_smile:

How can I get the full stack ?

I got it nevermind.

Cheers,

Greg