[PID:12916:001 2015.07.04 15:02:22.218 INFO ProgramBase`1 ] ES VERSION: 3.0.5.0 (release-v3.0.5/a9a82d955a0ac1db548b1873fa3be66923dc6032, Tue, 26 May 2015 18:51:16 +0000) OS: Unknown (Unix 3.13.0.55) RUNTIME: 3.12.0 (tarball) (64-bit) GC: 2 GENERATIONS LOGS: /tmp/log HELP: False () VERSION: False () LOG: /tmp/log (Command Line) CONFIG: () DEFINES: () WHAT IF: False () INT IP: 192.168.33.12 (Command Line) EXT IP: 192.168.33.12 (Command Line) INT HTTP PORT: 2113 (Command Line) EXT HTTP PORT: 2114 (Command Line) INT TCP PORT: 1111 (Command Line) INT SECURE TCP PORT: 0 () EXT TCP PORT: 1112 (Command Line) EXT SECURE TCP PORT: 0 () INT TCP HEARTBEAT TIMEOUT: 3000 (Command Line) EXT TCP HEARTBEAT TIMEOUT: 3000 (Command Line) INT TCP HEARTBEAT INTERVAL: 700 () EXT TCP HEARTBEAT INTERVAL: 2000 () FORCE: False () CLUSTER SIZE: 3 (Command Line) NODE PRIORITY: 0 () MIN FLUSH DELAY MS: 2 () COMMIT COUNT: -1 () PREPARE COUNT: -1 () ADMIN ON EXT: True () STATS ON EXT: True () GOSSIP ON EXT: True () DISABLE SCAVENGE MERGING: False () DISCOVER VIA DNS: True () CLUSTER DNS: escluster.mooo.com (Command Line) CLUSTER GOSSIP PORT: 2113 (Command Line) GOSSIP SEED: () STATS PERIOD SEC: 30 () CACHED CHUNKS: -1 () CHUNKS CACHE SIZE: 536871424 () MAX MEM TABLE SIZE: 1000000 () DB: /tmp/db (Command Line) MEM DB: False () SKIP DB VERIFY: False () RUN PROJECTIONS: All (Command Line) PROJECTION THREADS: 3 () WORKER THREADS: 5 () HTTP PREFIXES: [ http://*:2114/ ] (Command Line) ENABLE TRUSTED AUTH: False () CERTIFICATE STORE LOCATION: () CERTIFICATE STORE NAME: () CERTIFICATE SUBJECT NAME: () CERTIFICATE THUMBPRINT: () CERTIFICATE FILE: () CERTIFICATE PASSWORD: () USE INTERNAL SSL: False () SSL TARGET HOST: n/a () SSL VALIDATE SERVER: True () AUTHENTICATION TYPE: internal () PREPARE TIMEOUT MS: 3000 (Command Line) COMMIT TIMEOUT MS: 3000 (Command Line) UNSAFE DISABLE FLUSH TO DISK: False () GOSSIP INTERVAL MS: 5000 (Command Line) GOSSIP ALLOWED DIFFERENCE MS: 1200000 (Command Line) GOSSIP TIMEOUT MS: 3000 (Command Line) [PID:12916:001 2015.07.04 15:02:22.233 INFO ProgramBase`1 ] Quorum size set to 2 [PID:12916:001 2015.07.04 15:02:22.236 INFO ProgramBase`1 ] Can't find plugins path: plugins [PID:12916:001 2015.07.04 15:02:22.250 INFO ProgramBase`1 ] INSTANCE ID: 063e7ae3-2e97-4c75-ad51-e415a7419e4f DATABASE: /tmp/db WRITER CHECKPOINT: 40055076 (0x2633124) CHASER CHECKPOINT: 40055076 (0x2633124) EPOCH CHECKPOINT: 40048594 (0x26317D2) TRUNCATE CHECKPOINT: -1 (0xFFFFFFFFFFFFFFFF) [PID:12916:001 2015.07.04 15:02:22.339 TRACE MessageHierarchy ] MessageHierarchy initialization took 00:00:00.0680525. [PID:12916:001 2015.07.04 15:02:22.562 TRACE TFChunk ] CACHED TFChunk #0-0 (chunk-000000.000000) in 00:00:00.0111276. [PID:12916:001 2015.07.04 15:02:22.696 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/projections [PID:12916:001 2015.07.04 15:02:22.696 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections/v8/Prelude ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/Prelude [PID:12916:001 2015.07.04 15:02:22.696 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections/resources ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/web-resources/js [PID:12916:001 2015.07.04 15:02:22.697 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/{*remaining_path} [PID:12916:001 2015.07.04 15:02:22.697 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/v8/Prelude/{*remaining_path} [PID:12916:001 2015.07.04 15:02:22.697 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/resources/{*remaining_path} [PID:12916:001 2015.07.04 15:02:22.698 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/{*remaining_path} [PID:12916:001 2015.07.04 15:02:22.698 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/v8/Prelude/{*remaining_path} [PID:12916:001 2015.07.04 15:02:22.698 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/resources/{*remaining_path} [PID:12916:001 2015.07.04 15:02:22.704 INFO MiniWeb ] Starting MiniWeb for /web ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/clusternode-web [PID:12916:001 2015.07.04 15:02:22.704 TRACE MiniWeb ] Binding MiniWeb to /web/{*remaining_path} [PID:12916:001 2015.07.04 15:02:22.704 INFO MiniWeb ] Starting MiniWeb for /web/users ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/Users/web [PID:12916:001 2015.07.04 15:02:22.705 TRACE MiniWeb ] Binding MiniWeb to /web/users/{*remaining_path} [PID:12916:001 2015.07.04 15:02:22.705 INFO MiniWeb ] Starting MiniWeb for /web ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/clusternode-web [PID:12916:001 2015.07.04 15:02:22.705 TRACE MiniWeb ] Binding MiniWeb to /web/{*remaining_path} [PID:12916:001 2015.07.04 15:02:22.705 INFO MiniWeb ] Starting MiniWeb for /web/users ==> /home/vagrant/EventStore-OSS-Linux-v3.0.5/Users/web [PID:12916:001 2015.07.04 15:02:22.705 TRACE MiniWeb ] Binding MiniWeb to /web/users/{*remaining_path} [PID:12916:010 2015.07.04 15:02:22.722 INFO ClusterVNodeControll] ========== [192.168.33.12:2113] SYSTEM INIT... [PID:12916:010 2015.07.04 15:02:22.742 INFO TcpServerListener ] Starting Normal TCP listening on TCP endpoint: 192.168.33.12:1112. [PID:12916:010 2015.07.04 15:02:22.744 INFO TcpServerListener ] Starting Normal TCP listening on TCP endpoint: 192.168.33.12:1111. [PID:12916:015 2015.07.04 15:02:22.753 INFO IndexCommitter ] TableIndex initialization... [PID:12916:015 2015.07.04 15:02:22.757 INFO IndexCommitter ] ReadIndex building... [PID:12916:010 2015.07.04 15:02:22.778 INFO HttpAsyncServer ] Starting HTTP server on [http://*:2114/]... [PID:12916:010 2015.07.04 15:02:22.781 INFO HttpAsyncServer ] HTTP server is up and listening on [http://*:2114/] [PID:12916:010 2015.07.04 15:02:22.781 INFO HttpAsyncServer ] Starting HTTP server on [http://192.168.33.12:2113/]... [PID:12916:010 2015.07.04 15:02:22.781 INFO HttpAsyncServer ] HTTP server is up and listening on [http://192.168.33.12:2113/] [PID:12916:010 2015.07.04 15:02:22.811 TRACE QueuedHandlerAutoRes] SLOW QUEUE MSG [MainQueue]: SystemInit - 78ms. Q: 0/655. [PID:12916:010 2015.07.04 15:02:22.811 INFO ClusterVNodeControll] ========== [192.168.33.12:2113] Service 'StorageWriter' initialized. [PID:12916:010 2015.07.04 15:02:22.811 INFO ClusterVNodeControll] ========== [192.168.33.12:2113] Service 'StorageReader' initialized. [PID:12916:015 2015.07.04 15:02:22.891 DEBUG IndexCommitter ] ReadIndex rebuilding done: total processed 4496 records, time elapsed: 00:00:00.1331630. [PID:12916:010 2015.07.04 15:02:22.899 TRACE GossipServiceBase ] CLUSTER HAS CHANGED Old: VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 1148745/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:22.782 New: MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.13:2113, 192.168.33.13:2113] | 2015-07-04 15:02:22.844 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 1148745/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:22.782 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.11:2113, 192.168.33.11:2113] | 2015-07-04 15:02:22.844 -------------------------------------------------------------------------------- [PID:12916:010 2015.07.04 15:02:22.925 TRACE InMemoryBus ] SLOW BUS MSG [MainBus]: GotGossipSeedSources - 56ms. Handler: NodeGossipService. [PID:12916:010 2015.07.04 15:02:22.925 TRACE QueuedHandlerAutoRes] SLOW QUEUE MSG [MainQueue]: GotGossipSeedSources - 80ms. Q: 927/3021. [PID:12916:010 2015.07.04 15:02:22.962 INFO ClusterVNodeControll] ========== [192.168.33.12:2113] Service 'StorageChaser' initialized. [PID:12916:010 2015.07.04 15:02:22.990 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [192.168.33.11:2113]) Old: MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.13:2113, 192.168.33.13:2113] | 2015-07-04 15:02:22.844 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Initializing, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:22.900 MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.11:2113, 192.168.33.11:2113] | 2015-07-04 15:02:22.844 New: MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.13:2113, 192.168.33.13:2113] | 2015-07-04 15:02:22.844 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Initializing, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:22.963 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:22.832 -------------------------------------------------------------------------------- [PID:12916:010 2015.07.04 15:02:22.990 INFO ClusterVNodeControll] ========== [192.168.33.12:2113] SYSTEM START... [PID:12916:010 2015.07.04 15:02:22.997 INFO ClusterVNodeControll] ========== [192.168.33.12:2113] IS UNKNOWN!!! WHOA!!! [PID:12916:010 2015.07.04 15:02:23.015 DEBUG ElectionsService ] ELECTIONS: STARTING ELECTIONS. [PID:12916:010 2015.07.04 15:02:23.015 DEBUG ElectionsService ] ELECTIONS: (V=0) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:23.015 DEBUG ElectionsService ] ELECTIONS: (V=0) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:24.017 DEBUG ElectionsService ] ELECTIONS: (V=0) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:24.017 DEBUG ElectionsService ] ELECTIONS: (V=1) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:24.017 DEBUG ElectionsService ] ELECTIONS: (V=1) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:25.018 DEBUG ElectionsService ] ELECTIONS: (V=1) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:25.018 DEBUG ElectionsService ] ELECTIONS: (V=2) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:25.018 DEBUG ElectionsService ] ELECTIONS: (V=2) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:26.015 TRACE GossipServiceBase ] Looks like node [192.168.33.13:2113] is DEAD (Gossip send failed). [PID:12916:010 2015.07.04 15:02:26.015 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [192.168.33.13:2113]) Old: MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.13:2113, 192.168.33.13:2113] | 2015-07-04 15:02:22.844 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:24.980 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:22.933 New: MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.13:2113, 192.168.33.13:2113] | 2015-07-04 15:02:26.016 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:24.980 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:22.933 -------------------------------------------------------------------------------- [PID:12916:010 2015.07.04 15:02:26.020 DEBUG ElectionsService ] ELECTIONS: (V=2) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:26.020 DEBUG ElectionsService ] ELECTIONS: (V=3) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:26.020 DEBUG ElectionsService ] ELECTIONS: (V=3) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:26.264 TRACE GossipServiceBase ] Looks like node [192.168.33.11:2113] is DEAD (Gossip send failed). [PID:12916:010 2015.07.04 15:02:26.265 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [192.168.33.11:2113]) Old: MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.13:2113, 192.168.33.13:2113] | 2015-07-04 15:02:26.016 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:24.980 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:22.933 New: MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.13:2113, 192.168.33.13:2113] | 2015-07-04 15:02:26.016 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:24.980 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:26.264 -------------------------------------------------------------------------------- [PID:12916:010 2015.07.04 15:02:26.764 DEBUG ElectionsService ] ELECTIONS: (V=4) VIEWCHANGE FROM [192.168.33.11:2113, {6ff90c93-e223-4750-bfc0-9272ac1b5c40}]. [PID:12916:010 2015.07.04 15:02:26.764 DEBUG ElectionsService ] ELECTIONS: (V=4) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:26.764 DEBUG ElectionsService ] ELECTIONS: (V=4) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:26.764 DEBUG ElectionsService ] ELECTIONS: (V=4) MAJORITY OF VIEWCHANGE. [PID:12916:010 2015.07.04 15:02:26.766 DEBUG ElectionsService ] ELECTIONS: (V=4) SHIFT TO PREPARE PHASE. [PID:12916:010 2015.07.04 15:02:26.767 DEBUG ElectionsService ] ELECTIONS: (V=4) PREPARE_OK FROM [192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}). [PID:12916:010 2015.07.04 15:02:27.276 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [192.168.33.11:2113]) Old: MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.13:2113, 192.168.33.13:2113] | 2015-07-04 15:02:26.016 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:24.980 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:26.264 New: MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.13:2113, 192.168.33.13:2113] | 2015-07-04 15:02:26.016 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:27.276 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:23.135 -------------------------------------------------------------------------------- [PID:12916:010 2015.07.04 15:02:27.768 DEBUG ElectionsService ] ELECTIONS: (V=6) VIEWCHANGE FROM [192.168.33.11:2113, {6ff90c93-e223-4750-bfc0-9272ac1b5c40}]. [PID:12916:010 2015.07.04 15:02:27.768 DEBUG ElectionsService ] ELECTIONS: (V=6) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:27.769 DEBUG ElectionsService ] ELECTIONS: (V=6) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:27.769 DEBUG ElectionsService ] ELECTIONS: (V=6) MAJORITY OF VIEWCHANGE. [PID:12916:010 2015.07.04 15:02:27.769 DEBUG ElectionsService ] ELECTIONS: (V=6) SHIFT TO PREPARE PHASE. [PID:12916:010 2015.07.04 15:02:27.769 DEBUG ElectionsService ] ELECTIONS: (V=6) PREPARE_OK FROM [192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}). [PID:12916:010 2015.07.04 15:02:28.272 TRACE GossipServiceBase ] Looks like node [192.168.33.11:2113] is DEAD (Gossip send failed). [PID:12916:010 2015.07.04 15:02:28.272 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [192.168.33.11:2113]) Old: MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.13:2113, 192.168.33.13:2113] | 2015-07-04 15:02:26.016 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:27.276 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:23.135 New: MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.13:2113, 192.168.33.13:2113] | 2015-07-04 15:02:26.016 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:27.276 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:28.272 -------------------------------------------------------------------------------- [PID:12916:010 2015.07.04 15:02:28.771 DEBUG ElectionsService ] ELECTIONS: (V=6) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:28.771 DEBUG ElectionsService ] ELECTIONS: (V=7) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:28.771 DEBUG ElectionsService ] ELECTIONS: (V=7) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:29.283 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [192.168.33.13:2113]) Old: MAN {00000000-0000-0000-0000-000000000000} [Manager, 192.168.33.13:2113, 192.168.33.13:2113] | 2015-07-04 15:02:26.016 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:27.276 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:28.272 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Unknown, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:24.921 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:29.282 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:28.272 -------------------------------------------------------------------------------- [PID:12916:010 2015.07.04 15:02:29.283 DEBUG ElectionsService ] ELECTIONS: (V=7) VIEWCHANGE FROM [192.168.33.11:2113, {6ff90c93-e223-4750-bfc0-9272ac1b5c40}]. [PID:12916:010 2015.07.04 15:02:29.283 DEBUG ElectionsService ] ELECTIONS: (V=7) MAJORITY OF VIEWCHANGE. [PID:12916:010 2015.07.04 15:02:29.283 DEBUG ElectionsService ] ELECTIONS: (V=7) SHIFT TO PREPARE PHASE. [PID:12916:010 2015.07.04 15:02:29.283 DEBUG ElectionsService ] ELECTIONS: (V=7) PREPARE_OK FROM [192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}). [PID:12916:010 2015.07.04 15:02:29.287 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [192.168.33.11:2113]) Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Unknown, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:24.921 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:29.282 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:28.272 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Unknown, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:24.921 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Unknown, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:29.285 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:28.236 -------------------------------------------------------------------------------- [PID:12916:010 2015.07.04 15:02:29.401 DEBUG ElectionsService ] ELECTIONS: (V=8) VIEWCHANGE FROM [192.168.33.11:2113, {6ff90c93-e223-4750-bfc0-9272ac1b5c40}]. [PID:12916:010 2015.07.04 15:02:29.401 DEBUG ElectionsService ] ELECTIONS: (V=8) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:29.401 DEBUG ElectionsService ] ELECTIONS: (V=8) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:29.401 DEBUG ElectionsService ] ELECTIONS: (V=8) MAJORITY OF VIEWCHANGE. [PID:12916:010 2015.07.04 15:02:29.593 DEBUG ElectionsService ] ELECTIONS: (V=8) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:30.403 DEBUG ElectionsService ] ELECTIONS: (V=8) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:30.403 DEBUG ElectionsService ] ELECTIONS: (V=9) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:30.403 DEBUG ElectionsService ] ELECTIONS: (V=9) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:30.594 DEBUG ElectionsService ] ELECTIONS: (V=9) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:30.594 DEBUG ElectionsService ] ELECTIONS: (V=9) MAJORITY OF VIEWCHANGE. [PID:12916:010 2015.07.04 15:02:30.604 DEBUG ElectionsService ] ELECTIONS: (V=9) PREPARE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:30.604 DEBUG ElectionsService ] ELECTIONS: (V=9) SHIFT TO REG_NONLEADER. [PID:12916:010 2015.07.04 15:02:31.101 DEBUG ElectionsService ] ELECTIONS: (V=9) PROPOSAL FROM [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}] M=[192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}). ME=[192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}). [PID:12916:010 2015.07.04 15:02:31.103 DEBUG ElectionsService ] ELECTIONS: (V=9) ACCEPT FROM [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}] M=[192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}]). [PID:12916:010 2015.07.04 15:02:31.103 DEBUG ElectionsService ] ELECTIONS: (V=9) ACCEPT FROM [192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}] M=[192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}]). [PID:12916:010 2015.07.04 15:02:31.103 INFO ElectionsService ] ELECTIONS: (V=9) DONE. ELECTED MASTER = [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}). ME=[192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}](L=40054209,W=40055076,C=40055076,E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8}). [PID:12916:010 2015.07.04 15:02:31.104 INFO ClusterVNodeControll] ========== [192.168.33.12:2113] PRE-REPLICA STATE, WAITING FOR CHASER TO CATCH UP... MASTER IS [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}] [PID:12916:010 2015.07.04 15:02:31.146 INFO ReplicaService ] Subscribing at LogPosition: 40055076 (0x2633124) to MASTER [192.168.33.13:1111, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}] as replica with SubscriptionId: {c268ed53-a1aa-4144-9c27-e0decdd1a3b9}, ConnectionId: {043296b3-e3fd-43b5-a939-68e19441b934}, LocalEndPoint: [], Epochs: E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} E133@39983814:{c0cded26-1a88-477d-b4d9-f1770514f020} E132@39960180:{95125519-cc01-46f6-82a4-f72e78a5989b} E131@39936556:{a801f35d-ab23-49b8-8634-0066891f698e} E130@39912302:{9a79f233-02cf-4568-a398-63492914bf47} E129@39888648:{3cad6072-0328-4c3b-91ef-a83c8d28dfda} E128@39847279:{326cf4bb-15ab-476c-8a58-6db922df92c1} E127@39823075:{fb90f2c8-d978-43dc-b691-d10b91f1d5e6} E126@39782421:{8d5d40df-5a9a-49f2-9d14-cdb7b33fa1d5} E125@39758209:{2f8c22f8-1895-45e5-8348-08754a501b7c} E124@39733956:{057cc854-cf4c-47c9-9e08-5f3ed6e29b8c} E123@39692601:{603911e6-8bc9-41ee-bdc2-f4e79593c26b} E122@39668342:{fb4f55bc-f1e1-4ba2-8aa3-9540c059dc88} E121@39644103:{98f1fc90-f698-4a8f-9a38-afa3f07a2e39} E120@39626803:{c674ff7b-d53d-449f-b7a0-c264f45e3ea9} E119@39609494:{ce7adc56-7ecd-48d4-8729-6dbfeeb1f097} E118@39585341:{ddbf4c4d-9dd4-47b3-807b-661923638afd} E117@39544000:{ede4e63c-470d-4be8-ade9-31277ed46e10} E116@39468372:{f35deff1-9c3c-408c-8a9d-1758a35fb617}... . [PID:12916:028 2015.07.04 15:02:31.158 INFO TcpConnectionManager] Connection 'master-normal' ({043296b3-e3fd-43b5-a939-68e19441b934}) to [192.168.33.13:1111] established. [PID:12916:010 2015.07.04 15:02:31.690 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [192.168.33.13:2113]) Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Unknown, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:31.158 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [PreReplica, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:31.112 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:29.382 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40056258/40056431/40056431/E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19} | 2015-07-04 15:02:31.637 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [PreReplica, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40054209/40055076/40055076/E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} | 2015-07-04 15:02:31.690 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:29.382 -------------------------------------------------------------------------------- [PID:12916:010 2015.07.04 15:02:32.147 INFO ReplicaService ] Subscribing at LogPosition: 40055076 (0x2633124) to MASTER [192.168.33.13:1111, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}] as replica with SubscriptionId: {18687dbf-7ce6-4905-9837-db20e464093f}, ConnectionId: {043296b3-e3fd-43b5-a939-68e19441b934}, LocalEndPoint: [192.168.33.12:55892], Epochs: E135@40048594:{4cc1fd86-9b4d-4671-b0fa-574a5453c7c8} E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} E133@39983814:{c0cded26-1a88-477d-b4d9-f1770514f020} E132@39960180:{95125519-cc01-46f6-82a4-f72e78a5989b} E131@39936556:{a801f35d-ab23-49b8-8634-0066891f698e} E130@39912302:{9a79f233-02cf-4568-a398-63492914bf47} E129@39888648:{3cad6072-0328-4c3b-91ef-a83c8d28dfda} E128@39847279:{326cf4bb-15ab-476c-8a58-6db922df92c1} E127@39823075:{fb90f2c8-d978-43dc-b691-d10b91f1d5e6} E126@39782421:{8d5d40df-5a9a-49f2-9d14-cdb7b33fa1d5} E125@39758209:{2f8c22f8-1895-45e5-8348-08754a501b7c} E124@39733956:{057cc854-cf4c-47c9-9e08-5f3ed6e29b8c} E123@39692601:{603911e6-8bc9-41ee-bdc2-f4e79593c26b} E122@39668342:{fb4f55bc-f1e1-4ba2-8aa3-9540c059dc88} E121@39644103:{98f1fc90-f698-4a8f-9a38-afa3f07a2e39} E120@39626803:{c674ff7b-d53d-449f-b7a0-c264f45e3ea9} E119@39609494:{ce7adc56-7ecd-48d4-8729-6dbfeeb1f097} E118@39585341:{ddbf4c4d-9dd4-47b3-807b-661923638afd} E117@39544000:{ede4e63c-470d-4be8-ade9-31277ed46e10} E116@39468372:{f35deff1-9c3c-408c-8a9d-1758a35fb617}... . [PID:12916:010 2015.07.04 15:02:32.189 INFO ClusterVNodeControll] ========== [192.168.33.12:2113] IS CATCHING UP!!! BANZAI!!! MASTER IS [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}] [PID:12916:007 2015.07.04 15:02:32.198 INFO ClusterStorageWriter] === SUBSCRIBED to [192.168.33.13:1111,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}] at 40055076 (0x2633124). SubscriptionId: {18687dbf-7ce6-4905-9837-db20e464093f}. [PID:12916:010 2015.07.04 15:02:32.205 INFO ClusterVNodeControll] ========== [192.168.33.12:2113] CLONE ASSIGNMENT RECEIVED FROM [192.168.33.13:1111,n/a,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:32.205 INFO ClusterVNodeControll] ========== [192.168.33.12:2113] IS CLONE!!! SPARTA!!! MASTER IS [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}] [PID:12916:015 2015.07.04 15:02:32.220 DEBUG EpochManager ] === Update Last Epoch E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19} (previous epoch at 40048594). [PID:12916:010 2015.07.04 15:02:33.275 INFO ClusterVNodeControll] ========== [192.168.33.12:2113] SLAVE ASSIGNMENT RECEIVED FROM [192.168.33.13:1111,n/a,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:33.276 INFO ClusterVNodeControll] ========== [192.168.33.12:2113] IS SLAVE!!! SPARTA!!! MASTER IS [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}] [PID:12916:021 2015.07.04 15:02:36.401 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:12916:032 2015.07.04 15:02:43.897 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:12916:010 2015.07.04 15:02:46.104 DEBUG ElectionsService ] ELECTIONS: (V=19) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:46.104 DEBUG ElectionsService ] ELECTIONS: (V=19) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:46.104 DEBUG ElectionsService ] ELECTIONS: (V=19) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:46.104 DEBUG ElectionsService ] ELECTIONS: (V=19) MAJORITY OF VIEWCHANGE. [PID:12916:010 2015.07.04 15:02:46.104 DEBUG ElectionsService ] ELECTIONS: (V=19) SHIFT TO PREPARE PHASE. [PID:12916:010 2015.07.04 15:02:46.104 DEBUG ElectionsService ] ELECTIONS: (V=19) PREPARE_OK FROM [192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}](L=40076524,W=40077063,C=40077063,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). [PID:12916:010 2015.07.04 15:02:47.105 DEBUG ElectionsService ] ELECTIONS: (V=19) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:47.105 DEBUG ElectionsService ] ELECTIONS: (V=20) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:47.105 DEBUG ElectionsService ] ELECTIONS: (V=20) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:48.106 DEBUG ElectionsService ] ELECTIONS: (V=20) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:48.106 DEBUG ElectionsService ] ELECTIONS: (V=21) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:48.106 DEBUG ElectionsService ] ELECTIONS: (V=21) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:48.783 DEBUG ElectionsService ] ELECTIONS: (V=20) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:48.783 DEBUG ElectionsService ] ELECTIONS: (V=20) MAJORITY OF VIEWCHANGE. [PID:12916:010 2015.07.04 15:02:48.784 DEBUG ElectionsService ] ELECTIONS: (V=21) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:034 2015.07.04 15:02:48.784 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:12916:010 2015.07.04 15:02:49.107 DEBUG ElectionsService ] ELECTIONS: (V=21) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:49.107 DEBUG ElectionsService ] ELECTIONS: (V=22) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:49.107 DEBUG ElectionsService ] ELECTIONS: (V=22) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:49.299 DEBUG ElectionsService ] ELECTIONS: (V=22) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:49.299 DEBUG ElectionsService ] ELECTIONS: (V=22) MAJORITY OF VIEWCHANGE. [PID:12916:010 2015.07.04 15:02:49.299 DEBUG ElectionsService ] ELECTIONS: (V=22) SHIFT TO PREPARE PHASE. [PID:12916:010 2015.07.04 15:02:49.299 DEBUG ElectionsService ] ELECTIONS: (V=22) PREPARE_OK FROM [192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}](L=40076524,W=40077063,C=40077063,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). [PID:12916:010 2015.07.04 15:02:50.109 DEBUG ElectionsService ] ELECTIONS: (V=22) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:50.109 DEBUG ElectionsService ] ELECTIONS: (V=23) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:50.109 DEBUG ElectionsService ] ELECTIONS: (V=23) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:51.110 DEBUG ElectionsService ] ELECTIONS: (V=23) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:51.110 DEBUG ElectionsService ] ELECTIONS: (V=24) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:51.110 DEBUG ElectionsService ] ELECTIONS: (V=24) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:52.111 DEBUG ElectionsService ] ELECTIONS: (V=24) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:52.111 DEBUG ElectionsService ] ELECTIONS: (V=25) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:52.111 DEBUG ElectionsService ] ELECTIONS: (V=25) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:53.113 DEBUG ElectionsService ] ELECTIONS: (V=25) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:53.113 DEBUG ElectionsService ] ELECTIONS: (V=26) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:53.113 DEBUG ElectionsService ] ELECTIONS: (V=26) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:54.114 DEBUG ElectionsService ] ELECTIONS: (V=26) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:54.114 DEBUG ElectionsService ] ELECTIONS: (V=27) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:54.114 DEBUG ElectionsService ] ELECTIONS: (V=27) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:043 2015.07.04 15:02:54.295 DEBUG ElectController ] Error while reading request: EndRead failure. [PID:12916:010 2015.07.04 15:02:55.033 DEBUG ElectionsService ] ELECTIONS: (V=23) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:55.033 DEBUG ElectionsService ] ELECTIONS: (V=23) MAJORITY OF VIEWCHANGE. [PID:12916:010 2015.07.04 15:02:55.033 DEBUG ElectionsService ] ELECTIONS: (V=24) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:55.033 DEBUG ElectionsService ] ELECTIONS: (V=25) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:55.035 DEBUG ElectionsService ] ELECTIONS: (V=26) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:55.116 DEBUG ElectionsService ] ELECTIONS: (V=27) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:55.116 DEBUG ElectionsService ] ELECTIONS: (V=28) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:55.116 DEBUG ElectionsService ] ELECTIONS: (V=28) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:56.117 DEBUG ElectionsService ] ELECTIONS: (V=28) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:56.117 DEBUG ElectionsService ] ELECTIONS: (V=29) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:56.117 DEBUG ElectionsService ] ELECTIONS: (V=29) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:044 2015.07.04 15:02:56.455 DEBUG GossipController ] Error while reading request (gossip): EndRead failure [PID:12916:010 2015.07.04 15:02:57.118 DEBUG ElectionsService ] ELECTIONS: (V=29) TIMED OUT! (S=ElectingLeader, M=). [PID:12916:010 2015.07.04 15:02:57.118 DEBUG ElectionsService ] ELECTIONS: (V=30) SHIFT TO LEADER ELECTION. [PID:12916:010 2015.07.04 15:02:57.118 DEBUG ElectionsService ] ELECTIONS: (V=30) VIEWCHANGE FROM [192.168.33.12:2113, {063e7ae3-2e97-4c75-ad51-e415a7419e4f}]. [PID:12916:010 2015.07.04 15:02:57.301 DEBUG ElectionsService ] ELECTIONS: (V=28) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:57.301 DEBUG ElectionsService ] ELECTIONS: (V=28) MAJORITY OF VIEWCHANGE. [PID:12916:010 2015.07.04 15:02:57.301 DEBUG ElectionsService ] ELECTIONS: (V=29) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:57.301 DEBUG ElectionsService ] ELECTIONS: (V=30) VIEWCHANGE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:57.305 DEBUG ElectionsService ] ELECTIONS: (V=30) PREPARE FROM [192.168.33.13:2113, {ce8cb83c-2b53-4706-84b1-bb795850ec9b}]. [PID:12916:010 2015.07.04 15:02:57.305 DEBUG ElectionsService ] ELECTIONS: (V=30) SHIFT TO REG_NONLEADER. [PID:12916:010 2015.07.04 15:02:57.621 DEBUG ElectionsService ] ELECTIONS: (V=30) PROPOSAL FROM [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}] M=[192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40077063,W=40094167,C=40094167,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). ME=[192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}](L=40077063,W=40094167,C=40094167,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). [PID:12916:010 2015.07.04 15:02:57.621 DEBUG ElectionsService ] ELECTIONS: (V=30) ACCEPT FROM [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}] M=[192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}]). [PID:12916:010 2015.07.04 15:02:57.621 DEBUG ElectionsService ] ELECTIONS: (V=30) ACCEPT FROM [192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}] M=[192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}]). [PID:12916:010 2015.07.04 15:02:57.621 INFO ElectionsService ] ELECTIONS: (V=30) DONE. ELECTED MASTER = [192.168.33.13:2113,{ce8cb83c-2b53-4706-84b1-bb795850ec9b}](L=40077063,W=40094167,C=40094167,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). ME=[192.168.33.12:2113,{063e7ae3-2e97-4c75-ad51-e415a7419e4f}](L=40077063,W=40094167,C=40094167,E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19}). [PID:12916:015 2015.07.04 15:02:57.811 DEBUG EpochManager ] === Update Last Epoch E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} (previous epoch at 40055076). [PID:12916:010 2015.07.04 15:03:05.125 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [192.168.33.13:2113]) Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40077063/40094167/40094167/E136@40055076:{569e1b48-2eef-4b9a-965a-e6e5b41dcc19} | 2015-07-04 15:02:56.642 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Slave, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:04.986 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:49.401 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:05.073 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Slave, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:05.125 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:49.401 -------------------------------------------------------------------------------- [PID:12916:010 2015.07.04 15:03:14.994 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [192.168.33.13:2113]) Old: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:11.645 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Slave, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:14.987 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:02:49.401 New: VND {ce8cb83c-2b53-4706-84b1-bb795850ec9b} [Master, 192.168.33.13:1111, n/a, 192.168.33.13:1112, n/a, 192.168.33.13:2113, 192.168.33.13:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:14.942 VND {063e7ae3-2e97-4c75-ad51-e415a7419e4f} [Slave, 192.168.33.12:1111, n/a, 192.168.33.12:1112, n/a, 192.168.33.12:2113, 192.168.33.12:2114] 40077063/40094392/40094392/E137@40094167:{a0f547f7-91f7-4978-b5d9-3ef47c563047} | 2015-07-04 15:03:14.994 VND {6ff90c93-e223-4750-bfc0-9272ac1b5c40} [Unknown, 192.168.33.11:1111, n/a, 192.168.33.11:1112, n/a, 192.168.33.11:2113, 192.168.33.11:2114] 40047727/40048594/40048594/E134@40041501:{b7ca6407-32dd-4835-81b4-73ddc4b652b1} | 2015-07-04 15:03:14.384 -------------------------------------------------------------------------------- [PID:12916:048 2015.07.04 15:03:20.941 DEBUG GossipController ] Error while reading request (gossip): EndRead failure