log compaction by eventtype

Fredrik_Skeel_Lokke · February 10, 2016, 9:26pm

Hi

Have you thought about doing something like kafkas log compaction where it's possible to keep the latest message, in the tail of a topic, for each unique message key?

Thanks

Greg_Young1 · February 10, 2016, 9:37pm

Per stream? Just set maxcount

Fredrik_Skeel_Lokke · February 10, 2016, 9:48pm

Max count or max time would define the tail, but instead of deleting the tail, keep latest event for each eventtype.

Greg_Young1 · February 10, 2016, 9:53pm

It’s all about how you lay out you streams you can get this behavior using linkto and writing stream per event type with a projection (linkto) to other streams

Fredrik_Skeel_Lokke · February 10, 2016, 10:01pm

Interesting, I'll have to try that out at the keyboard.