Tons of timestamp errors

Hey ESDB Team,

I am getting tons of gossip related timestamp errors like:

Time difference between us and ["Unspecified/IP_HERE"] is too great! UTC now: 2024-08-31 13:15:30.878, peer's time stamp: 2024-08-26 07:03:29.453.

The thing is, this time difference is huge (multiple days). And I noticed in our dashboard the following:

A few questions

  1. What is the manager role referring to? (Looking at gossip it seems it is just node 2/3 which should both be followers). In the docs it says nodes can either be leaders, followers, or read-only replicas (previously clones).
  2. Do you have any suggestions for figuring out why this timestamp is static and days behind?

ESDB Version 23.10.1

Thank you in advance for any insights.

Also just to follow up on this, Node 1 had crashed hence only one follower in the screenshot. Once rebooted we have 3 nodes, but still these two managers with outdated timestamps exist.

Hi, could you post the configuration of each node?

1 Like

Sorry, I didn’t realize someone else on my team also posted and provided more details. No need to respond further to this.