[PID:11553:001 2015.07.04 15:02:23.992 INFO ProgramBase`1 ] ES VERSION: 3.0.5.0 (release-v3.0.5/a9a82d955a0ac1db548b1873fa3be66923dc6032, Tue, 26 May 2015 18:51:16 +0000) OS: Unknown (Unix 3.13.0.55) RUNTIME: 3.12.0 (tarball) (64-bit) GC: 2 GENERATIONS LOGS: /tmp/log HELP: False () VERSION: False () LOG: /tmp/log (Command Line) CONFIG: () DEFINES: () WHAT IF: False () INT IP: 192.168.33.13 (Command Line) EXT IP: 192.168.33.13 (Command Line) INT HTTP PORT: 2113 (Command Line) EXT HTTP PORT: 2114 (Command Line) INT TCP PORT: 1111 (Command Line) INT SECURE TCP PORT: 0 () EXT TCP PORT: 1112 (Command Line) EXT SECURE TCP PORT: 0 () INT TCP HEARTBEAT TIMEOUT: 3000 (Command Line) EXT TCP HEARTBEAT TIMEOUT: 3000 (Command Line) INT TCP HEARTBEAT INTERVAL: 700 () EXT TCP HEARTBEAT INTERVAL: 2000 () FORCE: False () CLUSTER SIZE: 3 (Command Line) NODE PRIORITY: 0 () MIN FLUSH DELAY MS: 2 () COMMIT COUNT: -1 () PREPARE COUNT: -1 () ADMIN ON EXT: True () STATS ON EXT: True () GOSSIP ON EXT: True () DISABLE SCAVENGE MERGING: False () DISCOVER VIA DNS: True () CLUSTER DNS: escluster.mooo.com (Command Line) CLUSTER GOSSIP PORT: 2113 (Command Line) GOSSIP SEED: () STATS PERIOD SEC: 30 () CACHED CHUNKS: -1 () CHUNKS CACHE SIZE: 536871424 () MAX MEM TABLE SIZE: 1000000 () DB: /tmp/db (Command Line) MEM DB: False () SKIP DB VERIFY: False () RUN PROJECTIONS: All (Command Line) PROJECTION THREADS: 3 () WORKER THREADS: 5 () HTTP PREFIXES: [ http://*:2114/ ] (Command Line) ENABLE TRUSTED AUTH: False () CERTIFICATE STORE LOCATION: () CERTIFICATE STORE NAME: () CERTIFICATE SUBJECT NAME: () CERTIFICATE THUMBPRINT: () CERTIFICATE FILE: () CERTIFICATE PASSWORD: () USE INTERNAL SSL: False () SSL TARGET HOST: n/a () SSL VALIDATE SERVER: True () AUTHENTICATION TYPE: internal () PREPARE TIMEOUT MS: 3000 (Command Line) COMMIT TIMEOUT MS: 3000 (Command Line) UNSAFE DISABLE FLUSH TO DISK: False () GOSSIP INTERVAL MS: 5000 (Command Line) GOSSIP ALLOWED DIFFERENCE MS: 1200000 (Command Line) GOSSIP TIMEOUT MS: 3000 (Command Line) [PID:11553:001 2015.07.04 15:02:24.008 INFO ProgramBase`1 ] Quorum size set to 2 [PID:11553:001 2015.07.04 15:02:24.011 INFO ProgramBase`1 ] Can't find plugins path: plugins [PID:11553:001 2015.07.04 15:02:24.026 INFO ProgramBase`1 ] INSTANCE ID: ce8cb83c-2b53-4706-84b1-bb795850ec9b DATABASE: /tmp/db WRITER CHECKPOINT: 40055076 (0x2633124) CHASER CHECKPOINT: 40055076 (0x2633124) EPOCH CHECKPOINT: 40048594 (0x26317D2) TRUNCATE CHECKPOINT: -1 (0xFFFFFFFFFFFFFFFF) [PID:11553:001 2015.07.04 15:02:24.128 TRACE MessageHierarchy ] MessageHierarchy initialization took 00:00:00.0777042. [PID:11553:001 2015.07.04 15:02:24.354 TRACE TFChunk ] CACHED TFChunk #0-0 (chunk-000000.000000) in 00:00:00.0111952. [PID:11553:001 2015.07.04 15:02:24.484 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/projections [PID:11553:001 2015.07.04 15:02:24.484 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections/v8/Prelude ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/Prelude [PID:11553:001 2015.07.04 15:02:24.484 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections/resources ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/web-resources/js [PID:11553:001 2015.07.04 15:02:24.484 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/{*remaining_path} [PID:11553:001 2015.07.04 15:02:24.484 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/v8/Prelude/{*remaining_path} [PID:11553:001 2015.07.04 15:02:24.485 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/resources/{*remaining_path} [PID:11553:001 2015.07.04 15:02:24.485 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/{*remaining_path} [PID:11553:001 2015.07.04 15:02:24.485 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/v8/Prelude/{*remaining_path} [PID:11553:001 2015.07.04 15:02:24.485 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/resources/{*remaining_path} [PID:11553:001 2015.07.04 15:02:24.493 INFO MiniWeb ] Starting MiniWeb for /web ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/clusternode-web [PID:11553:001 2015.07.04 15:02:24.493 TRACE MiniWeb ] Binding MiniWeb to /web/{*remaining_path} [PID:11553:001 2015.07.04 15:02:24.493 INFO MiniWeb ] Starting MiniWeb for /web/users ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/Users/web [PID:11553:001 2015.07.04 15:02:24.493 TRACE MiniWeb ] Binding MiniWeb to /web/users/{*remaining_path} [PID:11553:001 2015.07.04 15:02:24.493 INFO MiniWeb ] Starting MiniWeb for /web ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/clusternode-web [PID:11553:001 2015.07.04 15:02:24.493 TRACE MiniWeb ] Binding MiniWeb to /web/{*remaining_path} [PID:11553:001 2015.07.04 15:02:24.493 INFO MiniWeb ] Starting MiniWeb for /web/users ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/Users/web [PID:11553:001 2015.07.04 15:02:24.493 TRACE MiniWeb ] Binding MiniWeb to /web/users/{*remaining_path} [PID:11553:010 2015.07.04 15:02:24.508 INFO ClusterVNodeControll] ========== [192.168.33.13:2113] SYSTEM INIT... [PID:11553:010 2015.07.04 15:02:24.520 INFO TcpServerListener ] Starting Normal TCP listening on TCP endpoint: 192.168.33.13:1112. [PID:11553:010 2015.07.04 15:02:24.522 INFO TcpServerListener ] Starting Normal TCP listening on TCP endpoint: 192.168.33.13:1111. [PID:11553:015 2015.07.04 15:02:24.531 INFO IndexCommitter ] TableIndex initialization... [PID:11553:015 2015.07.04 15:02:24.535 INFO IndexCommitter ] ReadIndex building... [PID:11553:010 2015.07.04 15:02:24.547 INFO HttpAsyncServer ] Starting HTTP server on [http://*:2114/]... [PID:11553:010 2015.07.04 15:02:24.549 INFO HttpAsyncServer ] HTTP server is up and listening on [http://*:2114/] [PID:11553:010 2015.07.04 15:02:24.549 INFO HttpAsyncServer ] Starting HTTP server on [http://192.168.33.13:2113/]... [PID:11553:010 2015.07.04 15:02:24.549 INFO HttpAsyncServer ] HTTP server is up and listening on [http://192.168.33.13:2113/] [PID:11553:010 2015.07.04 15:02:24.562 TRACE QueuedHandlerAutoRes] SLOW QUEUE MSG [MainQueue]: SystemInit - 56ms. Q: 0/591. [PID:11553:010 2015.07.04 15:02:24.562 INFO ClusterVNodeControll] ========== [192.168.33.13:2113] Service 'StorageReader' initialized. [PID:11553:010 2015.07.04 15:02:24.562 INFO ClusterVNodeControll] ========== [192.168.33.13:2113] Service 'StorageWriter' initialized. [PID:11553:010 2015.07.04 15:02:24.601 TRACE GossipServiceBase ] CLUSTER HAS CHANGED Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Unknown, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 424273/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:24.550 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Unknown, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 424273/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:24.550 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.12:2113, 192.168.33.12:2113] | 2015-07-04 15:02:24.581 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.11:2113, 192.168.33.11:2113] | 2015-07-04 15:02:24.581 -------------------------------------------------------------------------------- [PID:11553:015 2015.07.04 15:02:24.630 DEBUG IndexCommitter ] ReadIndex rebuilding done: total processed 4496 records, time elapsed: 00:00:00.0943330. [PID:11553:010 2015.07.04 15:02:24.635 INFO ClusterVNodeControll] ========== [192.168.33.13:2113] Service 'StorageChaser' initialized. [PID:11553:010 2015.07.04 15:02:24.635 INFO ClusterVNodeControll] ========== [192.168.33.13:2113] SYSTEM START... [PID:11553:010 2015.07.04 15:02:24.643 INFO ClusterVNodeControll] ========== [192.168.33.13:2113] IS UNKNOWN!!! WHOA!!! [PID:11553:010 2015.07.04 15:02:24.665 DEBUG ElectionsService ] ELECTIONS: STARTING ELECTIONS. [PID:11553:010 2015.07.04 15:02:24.665 DEBUG ElectionsService ] ELECTIONS: (V=0) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:24.665 DEBUG ElectionsService ] ELECTIONS: (V=0) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:25.669 DEBUG ElectionsService ] ELECTIONS: (V=0) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:25.669 DEBUG ElectionsService ] ELECTIONS: (V=1) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:25.669 DEBUG ElectionsService ] ELECTIONS: (V=1) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:26.670 DEBUG ElectionsService ] ELECTIONS: (V=1) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:26.670 DEBUG ElectionsService ] ELECTIONS: (V=2) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:26.670 DEBUG ElectionsService ] ELECTIONS: (V=2) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:27.671 DEBUG ElectionsService ] ELECTIONS: (V=2) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:27.671 DEBUG ElectionsService ] ELECTIONS: (V=3) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:27.671 DEBUG ElectionsService ] ELECTIONS: (V=3) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:27.678 TRACE GossipServiceBase ] Looks like node [192.168.33.12:2113] is DEAD (Gossip send failed). [PID:11553:010 2015.07.04 15:02:27.679 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [192.168.33.12:2113]) Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Unknown, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:26.636 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.12:2113, 192.168.33.12:2113] | 2015-07-04 15:02:24.581 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.11:2113, 192.168.33.11:2113] | 2015-07-04 15:02:24.581 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Unknown, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:26.636 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.12:2113, 192.168.33.12:2113] | 2015-07-04 15:02:27.678 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.11:2113, 192.168.33.11:2113] | 2015-07-04 15:02:24.581 -------------------------------------------------------------------------------- [PID:11553:010 2015.07.04 15:02:28.052 TRACE GossipServiceBase ] Looks like node [192.168.33.11:2113] is DEAD (Gossip send failed). [PID:11553:010 2015.07.04 15:02:28.053 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [192.168.33.11:2113]) Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Unknown, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:26.636 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.12:2113, 192.168.33.12:2113] | 2015-07-04 15:02:27.678 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.11:2113, 192.168.33.11:2113] | 2015-07-04 15:02:24.581 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Unknown, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:26.636 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.12:2113, 192.168.33.12:2113] | 2015-07-04 15:02:27.678 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.11:2113, 192.168.33.11:2113] | 2015-07-04 15:02:28.053 -------------------------------------------------------------------------------- [PID:11553:010 2015.07.04 15:02:28.607 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [192.168.33.11:2113]) Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Unknown, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:26.636 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.12:2113, 192.168.33.12:2113] | 2015-07-04 15:02:27.678 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.11:2113, 192.168.33.11:2113] | 2015-07-04 15:02:28.053 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Unknown, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:28.607 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:27.276 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:28.597 -------------------------------------------------------------------------------- [PID:11553:010 2015.07.04 15:02:28.672 DEBUG ElectionsService ] ELECTIONS: (V=3) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:28.672 DEBUG ElectionsService ] ELECTIONS: (V=4) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:28.672 DEBUG ElectionsService ] ELECTIONS: (V=4) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:29.350 DEBUG ElectionsService ] ELECTIONS: (V=8) VIEWCHANGE FROM [192.168.33.11:2113, {6ff90c93-e223-4750-bfc0-9272ac1b5c40}]. [PID:11553:010 2015.07.04 15:02:29.350 DEBUG ElectionsService ] ELECTIONS: (V=8) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:29.350 DEBUG ElectionsService ] ELECTIONS: (V=8) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:29.350 DEBUG ElectionsService ] ELECTIONS: (V=8) MAJORITY OF VIEWCHANGE. [PID:11553:010 2015.07.04 15:02:29.542 DEBUG ElectionsService ] ELECTIONS: (V=8) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:11553:010 2015.07.04 15:02:30.351 DEBUG ElectionsService ] ELECTIONS: (V=8) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:30.351 DEBUG ElectionsService ] ELECTIONS: (V=9) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:30.351 DEBUG ElectionsService ] ELECTIONS: (V=9) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:30.541 DEBUG ElectionsService ] ELECTIONS: (V=9) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:11553:010 2015.07.04 15:02:30.543 DEBUG ElectionsService ] ELECTIONS: (V=9) MAJORITY OF VIEWCHANGE. [PID:11553:010 2015.07.04 15:02:30.544 DEBUG ElectionsService ] ELECTIONS: (V=9) SHIFT TO PREPARE PHASE. [PID:11553:010 2015.07.04 15:02:30.545 DEBUG ElectionsService ] ELECTIONS: (V=9) PREPARE_OK FROM [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}). [PID:11553:010 2015.07.04 15:02:30.560 DEBUG ElectionsService ] ELECTIONS: (V=9) PREPARE_OK FROM [192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}). [PID:11553:010 2015.07.04 15:02:30.560 DEBUG ElectionsService ] ELECTIONS: (V=9) SHIFT TO REG_LEADER. [PID:11553:010 2015.07.04 15:02:30.565 DEBUG ElectionsService ] ELECTIONS: (V=9) SENDING PROPOSAL CANDIDATE: [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}), ME: [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}). [PID:11553:010 2015.07.04 15:02:30.565 DEBUG ElectionsService ] ELECTIONS: (V=9) ACCEPT FROM [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}] M=[192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}]). [PID:11553:028 2015.07.04 15:02:31.094 INFO TcpService ] Internal TCP connection accepted: [Normal, 192.168.33.12:55892, L192.168.33.13:1111, {524a6878-466d-4cc1-8217-f30338008279}]. [PID:11553:010 2015.07.04 15:02:31.229 DEBUG ElectionsService ] ELECTIONS: (V=9) ACCEPT FROM [192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}] M=[192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}]). [PID:11553:010 2015.07.04 15:02:31.229 INFO ElectionsService ] ELECTIONS: (V=9) DONE. ELECTED MASTER = [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}). ME=[192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}). [PID:11553:010 2015.07.04 15:02:31.231 INFO ClusterVNodeControll] ========== [192.168.33.13:2113] PRE-MASTER STATE, WAITING FOR CHASER TO CATCH UP... [PID:11553:010 2015.07.04 15:02:31.234 INFO ClusterVNodeControll] ========== [192.168.33.13:2113] IS MASTER!!! SPARTA!!! [PID:11553:007 2015.07.04 15:02:31.270 DEBUG EpochManager ] === Writing E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19} (previous epoch at 40048594). [PID:11553:007 2015.07.04 15:02:31.273 DEBUG EpochManager ] === Update Last Epoch E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19} (previous epoch at 40048594). [PID:11553:028 2015.07.04 15:02:31.294 TRACE MonitoringService ] Created stats stream '$stats-192.168.33.13:2114', code = WrongExpectedVersion [PID:11553:010 2015.07.04 15:02:31.644 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [192.168.33.12:2113]) Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40056258/40056431/40056431/E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19} | 2015-07-04 15:02:31.637 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:23.871 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:28.590 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40056258/40056431/40056431/E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19} | 2015-07-04 15:02:31.643 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [PreReplica, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:31.690 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:29.382 -------------------------------------------------------------------------------- [PID:11553:010 2015.07.04 15:02:32.124 INFO MasterReplicationSer] SUBSCRIBE REQUEST from [192.168.33.12:1111,C:{524a6878-466d-4cc1-8217-f30338008279},S:{18687dbf-7ce6-4905-9837-db20e464093f},40055076(0x2633124),E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}, E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1}, E133@39983814:{c0cded26-1a88-477d-b4d9-f1770514f020}, E132@39960180:{95125519-cc01-46f6-82a4-f72e78a5989b}, E131@39936556:{a801f35d-ab23-49b8-8634-0066891f698e}, E130@39912302:{9a79f233-02cf-4568-a398-63492914bf47}, E129@39888648:{3cad6072-0328-4c3b-91ef-a83c8d28dfda}, E128@39847279:{326cf4bb-15ab-476c-8a58-6db922df92c1}, E127@39823075:{fb90f2c8-d978-43dc-b691-d10b91f1d5e6}, E126@39782421:{8d5d40df-5a9a-49f2-9d14-cdb7b33fa1d5}, E125@39758209:{2f8c22f8-1895-45e5-8348-08754a501b7c}, E124@39733956:{057cc854-cf4c-47c9-9e08-5f3ed6e29b8c}, E123@39692601:{603911e6-8bc9-41ee-bdc2-f4e79593c26b}, E122@39668342:{fb4f55bc-f1e1-4ba2-8aa3-9540c059dc88}, E121@39644103:{98f1fc90-f698-4a8f-9a38-afa3f07a2e39}, E120@39626803:{c674ff7b-d53d-449f-b7a0-c264f45e3ea9}, E119@39609494:{ce7adc56-7ecd-48d4-8729-6dbfeeb1f097}, E118@39585341:{ddbf4c4d-9dd4-47b3-807b-661923638afd}, E117@39544000:{ede4e63c-470d-4be8-ade9-31277ed46e10}, E116@39468372:{f35deff1-9c3c-408c-8a9d-1758a35fb617}]... [PID:11553:010 2015.07.04 15:02:32.126 INFO MasterReplicationSer] Subscribed replica [192.168.33.12:1111,S:18687dbf-7ce6-4905-9837-db20e464093f] for data send at 40055076 (0x2633124). [PID:11553:010 2015.07.04 15:02:35.060 TRACE TwoPhaseRequestManag] IDEMPOTENT WRITE TO STREAM ClientCorrelationID a7a6d0b1-79dc-40dd-9ebe-b7aa5693c2a8, EventStreamId: $projections-$master, CorrelationId: a7a6d0b1-79dc-40dd-9ebe-b7aa5693c2a8, FirstEventNumber: 1178, LastEventNumber: 1178. [PID:11553:010 2015.07.04 15:02:35.060 TRACE TwoPhaseRequestManag] IDEMPOTENT WRITE TO STREAM ClientCorrelationID de7505ab-0252-4570-8d4d-8b575d503e8e, EventStreamId: $projections-$master, CorrelationId: de7505ab-0252-4570-8d4d-8b575d503e8e, FirstEventNumber: 1179, LastEventNumber: 1179. [PID:11553:010 2015.07.04 15:02:35.060 TRACE TwoPhaseRequestManag] IDEMPOTENT WRITE TO STREAM ClientCorrelationID d9afa8e5-108f-48ec-96ad-2bbccf58e26e, EventStreamId: $projections-$master, CorrelationId: d9afa8e5-108f-48ec-96ad-2bbccf58e26e, FirstEventNumber: 1177, LastEventNumber: 1177. [PID:11553:010 2015.07.04 15:02:40.049 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [192.168.33.12:2113]) Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40076524/40077063/40077063/E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19} | 2015-07-04 15:02:36.638 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [PreReplica, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:32.128 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:29.382 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40076524/40077063/40077063/E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19} | 2015-07-04 15:02:40.048 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Slave, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40076524/40077063/40077063/E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19} | 2015-07-04 15:02:39.982 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:34.874 -------------------------------------------------------------------------------- [PID:11553:030 2015.07.04 15:02:40.355 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:028 2015.07.04 15:02:40.355 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:028 2015.07.04 15:02:42.342 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:028 2015.07.04 15:02:43.860 ERROR GossipController ] Received as POST invalid ClusterInfo from [http://192.168.33.13:2113/gossip]. Content-Type: application/json, Body: . [PID:11553:028 2015.07.04 15:02:44.351 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:010 2015.07.04 15:02:45.849 DEBUG ElectionsService ] ELECTIONS: (V=19) VIEWCHANGE FROM [192.168.33.11:2113, {6ff90c93-e223-4750-bfc0-9272ac1b5c40}]. [PID:11553:010 2015.07.04 15:02:45.849 DEBUG ElectionsService ] ELECTIONS: (V=19) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:45.849 DEBUG ElectionsService ] ELECTIONS: (V=19) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:45.850 DEBUG ElectionsService ] ELECTIONS: (V=19) MAJORITY OF VIEWCHANGE. [PID:11553:032 2015.07.04 15:02:46.051 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:028 2015.07.04 15:02:46.352 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:032 2015.07.04 15:02:46.848 DEBUG GossipController ] Error while reading request (gossip): EndRead failure [PID:11553:010 2015.07.04 15:02:46.850 DEBUG ElectionsService ] ELECTIONS: (V=11) VIEWCHANGE FROM [192.168.33.11:2113, {6ff90c93-e223-4750-bfc0-9272ac1b5c40}]. [PID:11553:010 2015.07.04 15:02:46.852 DEBUG ElectionsService ] ELECTIONS: (V=19) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:46.852 DEBUG ElectionsService ] ELECTIONS: (V=20) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:46.852 DEBUG ElectionsService ] ELECTIONS: (V=20) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:47.854 DEBUG ElectionsService ] ELECTIONS: (V=20) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:47.854 DEBUG ElectionsService ] ELECTIONS: (V=21) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:47.854 DEBUG ElectionsService ] ELECTIONS: (V=21) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:48.855 DEBUG ElectionsService ] ELECTIONS: (V=21) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:48.856 DEBUG ElectionsService ] ELECTIONS: (V=22) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:48.856 DEBUG ElectionsService ] ELECTIONS: (V=22) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:49.239 DEBUG ElectionsService ] ELECTIONS: (IV=19) VIEWCHANGEPROOF FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. JUMPING TO NON-LEADER STATE. [PID:11553:010 2015.07.04 15:02:49.239 DEBUG ElectionsService ] ELECTIONS: (V=19) SHIFT TO REG_NONLEADER. [PID:11553:010 2015.07.04 15:02:49.240 DEBUG ElectionsService ] ELECTIONS: (V=21) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:11553:010 2015.07.04 15:02:49.240 DEBUG ElectionsService ] ELECTIONS: (V=21) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:49.240 DEBUG ElectionsService ] ELECTIONS: (V=21) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:49.240 DEBUG ElectionsService ] ELECTIONS: (V=21) MAJORITY OF VIEWCHANGE. [PID:11553:010 2015.07.04 15:02:49.240 DEBUG ElectionsService ] ELECTIONS: (V=21) SHIFT TO PREPARE PHASE. [PID:11553:010 2015.07.04 15:02:49.240 DEBUG ElectionsService ] ELECTIONS: (V=21) PREPARE_OK FROM [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40076524,W=40077063,C=40077063,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). [PID:11553:010 2015.07.04 15:02:50.241 DEBUG ElectionsService ] ELECTIONS: (V=21) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:50.241 DEBUG ElectionsService ] ELECTIONS: (V=22) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:50.241 DEBUG ElectionsService ] ELECTIONS: (V=22) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:51.244 DEBUG ElectionsService ] ELECTIONS: (V=22) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:51.244 DEBUG ElectionsService ] ELECTIONS: (V=23) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:51.244 DEBUG ElectionsService ] ELECTIONS: (V=23) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:52.246 DEBUG ElectionsService ] ELECTIONS: (V=23) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:52.246 DEBUG ElectionsService ] ELECTIONS: (V=24) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:52.246 DEBUG ElectionsService ] ELECTIONS: (V=24) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:52.560 DEBUG ElectionsService ] ELECTIONS: (V=22) VIEWCHANGE FROM [192.168.33.11:2113, {6ff90c93-e223-4750-bfc0-9272ac1b5c40}]. [PID:11553:010 2015.07.04 15:02:52.560 DEBUG ElectionsService ] ELECTIONS: (V=22) MAJORITY OF VIEWCHANGE. [PID:11553:010 2015.07.04 15:02:52.560 DEBUG ElectionsService ] ELECTIONS: (V=24) SHIFT TO PREPARE PHASE. [PID:11553:010 2015.07.04 15:02:52.560 DEBUG ElectionsService ] ELECTIONS: (V=24) PREPARE_OK FROM [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40076524,W=40077063,C=40077063,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). [PID:11553:010 2015.07.04 15:02:53.248 DEBUG ElectionsService ] ELECTIONS: (V=24) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:53.248 DEBUG ElectionsService ] ELECTIONS: (V=25) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:53.248 DEBUG ElectionsService ] ELECTIONS: (V=25) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:53.253 DEBUG ElectionsService ] ELECTIONS: (V=25) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:11553:010 2015.07.04 15:02:53.253 DEBUG ElectionsService ] ELECTIONS: (V=25) MAJORITY OF VIEWCHANGE. [PID:11553:010 2015.07.04 15:02:54.249 DEBUG ElectionsService ] ELECTIONS: (V=25) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:54.249 DEBUG ElectionsService ] ELECTIONS: (V=26) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:54.249 DEBUG ElectionsService ] ELECTIONS: (V=26) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:55.069 DEBUG ElectionsService ] ELECTIONS: (V=27) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:11553:010 2015.07.04 15:02:55.069 DEBUG ElectionsService ] ELECTIONS: (V=27) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:55.069 DEBUG ElectionsService ] ELECTIONS: (V=27) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:55.069 DEBUG ElectionsService ] ELECTIONS: (V=27) MAJORITY OF VIEWCHANGE. [PID:11553:010 2015.07.04 15:02:55.069 DEBUG ElectionsService ] ELECTIONS: (V=27) SHIFT TO PREPARE PHASE. [PID:11553:010 2015.07.04 15:02:55.069 DEBUG ElectionsService ] ELECTIONS: (V=27) PREPARE_OK FROM [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40077063,W=40094167,C=40094167,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). [PID:11553:010 2015.07.04 15:02:55.069 DEBUG ElectionsService ] ELECTIONS: (V=28) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:11553:010 2015.07.04 15:02:55.069 DEBUG ElectionsService ] ELECTIONS: (V=28) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:55.070 DEBUG ElectionsService ] ELECTIONS: (V=28) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:55.070 DEBUG ElectionsService ] ELECTIONS: (V=28) MAJORITY OF VIEWCHANGE. [PID:11553:010 2015.07.04 15:02:56.071 DEBUG ElectionsService ] ELECTIONS: (V=28) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:56.071 DEBUG ElectionsService ] ELECTIONS: (V=29) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:56.071 DEBUG ElectionsService ] ELECTIONS: (V=29) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:048 2015.07.04 15:02:57.069 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:010 2015.07.04 15:02:57.071 DEBUG ElectionsService ] ELECTIONS: (V=29) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:11553:010 2015.07.04 15:02:57.071 DEBUG ElectionsService ] ELECTIONS: (V=29) MAJORITY OF VIEWCHANGE. [PID:11553:010 2015.07.04 15:02:57.071 DEBUG ElectionsService ] ELECTIONS: (V=29) TIMED OUT! (S=ElectingLeader, M=). [PID:11553:010 2015.07.04 15:02:57.071 DEBUG ElectionsService ] ELECTIONS: (V=30) SHIFT TO LEADER ELECTION. [PID:11553:010 2015.07.04 15:02:57.071 DEBUG ElectionsService ] ELECTIONS: (V=30) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:11553:010 2015.07.04 15:02:57.254 DEBUG ElectionsService ] ELECTIONS: (V=30) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:11553:010 2015.07.04 15:02:57.254 DEBUG ElectionsService ] ELECTIONS: (V=30) MAJORITY OF VIEWCHANGE. [PID:11553:010 2015.07.04 15:02:57.254 DEBUG ElectionsService ] ELECTIONS: (V=30) SHIFT TO PREPARE PHASE. [PID:11553:010 2015.07.04 15:02:57.254 DEBUG ElectionsService ] ELECTIONS: (V=30) PREPARE_OK FROM [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40077063,W=40094167,C=40094167,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). [PID:11553:010 2015.07.04 15:02:57.258 DEBUG ElectionsService ] ELECTIONS: (V=30) PREPARE_OK FROM [192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}](L=40077063,W=40094167,C=40094167,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). [PID:11553:010 2015.07.04 15:02:57.258 DEBUG ElectionsService ] ELECTIONS: (V=30) SHIFT TO REG_LEADER. [PID:11553:010 2015.07.04 15:02:57.258 DEBUG ElectionsService ] ELECTIONS: (V=30) SENDING PROPOSAL CANDIDATE: [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40077063,W=40094167,C=40094167,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}), ME: [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40077063,W=40094167,C=40094167,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). [PID:11553:010 2015.07.04 15:02:57.259 DEBUG ElectionsService ] ELECTIONS: (V=30) ACCEPT FROM [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}] M=[192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}]). [PID:11553:010 2015.07.04 15:02:57.752 DEBUG ElectionsService ] ELECTIONS: (V=30) ACCEPT FROM [192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}] M=[192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}]). [PID:11553:010 2015.07.04 15:02:57.752 INFO ElectionsService ] ELECTIONS: (V=30) DONE. ELECTED MASTER = [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40077063,W=40094167,C=40094167,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). ME=[192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40077063,W=40094167,C=40094167,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). [PID:11553:007 2015.07.04 15:02:57.754 DEBUG EpochManager ] === Writing E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} (previous epoch at 40055076). [PID:11553:007 2015.07.04 15:02:57.757 DEBUG EpochManager ] === Update Last Epoch E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} (previous epoch at 40055076). [PID:11553:010 2015.07.04 15:03:05.075 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [192.168.33.12:2113]) Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:01.643 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Slave, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40077063/40094167/40094167/E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19} | 2015-07-04 15:02:57.301 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:49.401 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:05.073 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Slave, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:04.986 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:49.401 -------------------------------------------------------------------------------- [PID:11553:010 2015.07.04 15:03:14.384 TRACE GossipServiceBase ] Looks like node [192.168.33.11:2113] is DEAD (Gossip send failed). [PID:11553:010 2015.07.04 15:03:14.384 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [192.168.33.11:2113]) Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:11.652 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Slave, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:11.698 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:49.401 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:11.652 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Slave, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:11.698 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:03:14.384 -------------------------------------------------------------------------------- [PID:11553:051 2015.07.04 15:03:20.892 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:052 2015.07.04 15:03:20.892 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:051 2015.07.04 15:03:20.892 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:052 2015.07.04 15:03:20.892 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:051 2015.07.04 15:03:21.386 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:051 2015.07.04 15:03:23.430 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:051 2015.07.04 15:03:24.932 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:051 2015.07.04 15:03:25.597 INFO TcpConnection ] ES TcpConnection closed [15:03:25.587: N192.168.33.12:55892, L192.168.33.13:1111, {524a6878-466d-4cc1-8217-f30338008279}]: Received bytes: 4905, Sent bytes: 62675 Send calls: 81, callbacks: 81 Receive calls: 70, callbacks: 70 Close reason: [Success] Socket closed [PID:11553:010 2015.07.04 15:03:25.598 TRACE GossipServiceBase ] Looks like node [192.168.33.12:1111] is DEAD (TCP connection lost). [PID:11553:010 2015.07.04 15:03:25.598 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (TCP connection lost to [192.168.33.12:1111]) Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40094392/40111478/40111478/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:24.943 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Slave, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40094392/40111478/40111478/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:24.987 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:03:14.384 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40094392/40111478/40111478/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:24.943 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Slave, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40094392/40111478/40111478/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:25.598 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:03:14.384 -------------------------------------------------------------------------------- [PID:11553:051 2015.07.04 15:03:25.612 INFO TcpConnectionManager] Connection 'internal-normal' [192.168.33.12:55892, {524a6878-466d-4cc1-8217-f30338008279}] closed: Success. [PID:11553:052 2015.07.04 15:03:25.931 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:051 2015.07.04 15:03:25.933 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:11553:052 2015.07.04 15:03:25.933 DEBUG ElectController ] Error while reading request: EndRead failure.