Let’s say we have an event stream that is a series of observations, such as SensorsRead. Imagine, for example, that there are 1000 sensors that are all read atomically, so an event has a field for each reading:
In best practice using the EventStore, would one store each observation independently (possibly at a large cost in space), or would one pre-de-duplicate the data. Rather than storing a SensorsRead event, one would store a SensorReadingsChanged event, and only store the values which are different from the immediately previous reading.
The latter option is a very crude compression of the data size, but can be extremely effective if there are many duplicate readings. If EventStore is already doing a smarter compression against the event JSON, however, it probably be better to just store the independent observations.
Thanks your insight,