Heya! So I’ve got a few hundred small streams and I want to build a set of new streams out of them. I made a persistent subscription that reads $all, and when it sees a relevant event, appends a Link to the relevant output stream. This works fantastic! I’ve now got a few hundred new streams with my data organized nicely. The problem is that memory usage has ballooned from 1.5GiB to 20GiB. I ran a scavenge and it did nothing (there wasn’t anything to delete, but I figured it wouldn’t hurt to try). Rebooting ESDB resets it down to ~1.6GiB and stays there while idling.
I’m running a single instance using the eventstore/eventstore:21.10.8-buster-slim
image in GKE and the only non-default config I’ve got is EVENTSTORE_CACHED_CHUNKS=3
How do I keep it’s memory use under control?