[09866,14,09:44:00.736] ========== [127.0.0.1:2112] Service 'StorageChaser' initialized. [09866,14,09:44:00.737] ========== [127.0.0.1:2112] SYSTEM START... [09866,14,09:44:00.740] ========== [127.0.0.1:2112] IS UNKNOWN... [09866,24,09:44:00.752] Subscriptions received state change to Unknown stopping listening. [09866,14,09:44:00.766] ELECTIONS: STARTING ELECTIONS. [09866,14,09:44:00.766] ELECTIONS: (V=0) SHIFT TO LEADER ELECTION. [09866,14,09:44:00.767] ELECTIONS: (V=0) VIEWCHANGE FROM [127.0.0.1:2112, {2a106fb7-4965-4e7a-9bb4-d1f00eb9e553}]. [09866,14,09:44:00.767] ELECTIONS: (V=0) MAJORITY OF VIEWCHANGE. [09866,14,09:44:00.768] ELECTIONS: (V=0) SHIFT TO PREPARE PHASE. [09866,14,09:44:00.768] ELECTIONS: (V=0) PREPARE_OK FROM [127.0.0.1:2112,{2a106fb7-4965-4e7a-9bb4-d1f00eb9e553}](L=155435103710,W=155435120799,C=155435120799,E4@155434820576:{ff07f60b-0528-4568-9033-ba51f009f9c5}). [09866,14,09:44:00.769] ELECTIONS: (V=0) SHIFT TO REG_LEADER. [09866,14,09:44:00.774] ELECTIONS: (V=0) SENDING PROPOSAL CANDIDATE: [127.0.0.1:2112,{2a106fb7-4965-4e7a-9bb4-d1f00eb9e553}](L=155435103710,W=155435120799,C=155435120799,E4@155434820576:{ff07f60b-0528-4568-9033-ba51f009f9c5}), ME: [127.0.0.1:2112,{2a106fb7-4965-4e7a-9bb4-d1f00eb9e553}](L=155435103710,W=155435120799,C=155435120799,E4@155434820576:{ff07f60b-0528-4568-9033-ba51f009f9c5}). [09866,14,09:44:00.774] ELECTIONS: (V=0) ACCEPT FROM [127.0.0.1:2112,{2a106fb7-4965-4e7a-9bb4-d1f00eb9e553}] M=[127.0.0.1:2112,{2a106fb7-4965-4e7a-9bb4-d1f00eb9e553}]). [09866,14,09:44:00.775] ELECTIONS: (V=0) DONE. ELECTED MASTER = [127.0.0.1:2112,{2a106fb7-4965-4e7a-9bb4-d1f00eb9e553}](L=155435103710,W=155435120799,C=155435120799,E4@155434820576:{ff07f60b-0528-4568-9033-ba51f009f9c5}). ME=[127.0.0.1:2112,{2a106fb7-4965-4e7a-9bb4-d1f00eb9e553}](L=155435103710,W=155435120799,C=155435120799,E4@155434820576:{ff07f60b-0528-4568-9033-ba51f009f9c5}). [09866,14,09:44:00.776] ========== [127.0.0.1:2112] PRE-MASTER STATE, WAITING FOR CHASER TO CATCH UP... [09866,19,09:44:00.776] Subscriptions received state change to PreMaster stopping listening. [09866,14,09:44:00.777] ========== [127.0.0.1:2112] IS MASTER... SPARTA! [09866,06,09:44:00.778] Subscriptions Became Master so now handling subscriptions [09866,12,09:44:00.811] === Writing E5@155435120799:{a4d68221-6ca9-4dea-add1-c3dd48791a02} (previous epoch at 155434820576). [09866,12,09:44:01.289] === Update Last Epoch E5@155435120799:{a4d68221-6ca9-4dea-add1-c3dd48791a02} (previous epoch at 155434820576). [09866,12,09:44:01.289] SLOW QUEUE MSG [StorageWriterQueue]: BecomeMaster - 511ms. Q: 0/0. [09866,20,09:44:01.301] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 507ms. Q: 0/0. [09866,24,09:44:01.301] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 513ms. Q: 0/0. [09866,21,09:44:01.302] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 561ms. Q: 0/1. [09866,32,09:44:01.313] PROJECTIONS: Starting Projections Core Coordinator. (Node State : Master) [09866,32,09:44:01.327] PROJECTIONS: Starting Projections Manager. (Node State : Master) [09866,32,09:44:01.327] PROJECTIONS: SubComponent Started: EventReaderCoreService [09866,32,09:44:01.327] PROJECTIONS: SubComponent Started: EventReaderCoreService [09866,32,09:44:01.327] PROJECTIONS: SubComponent Started: EventReaderCoreService [09866,32,09:44:01.327] PROJECTIONS: SubComponent Started: ProjectionCoreService [09866,32,09:44:01.327] PROJECTIONS: SubComponent Started: ProjectionCoreService [09866,32,09:44:01.327] PROJECTIONS: SubComponent Started: ProjectionCoreService [09866,33,09:44:01.339] PROJECTIONS: Starting Projection Core Reader (reads from $projections-$1eae3cf2c91f4d90baec9ced17130049) [09866,34,09:44:01.339] PROJECTIONS: Starting Projection Core Reader (reads from $projections-$d3ea3d9c8ce3450c8feac2f07351ccf8) [09866,35,09:44:01.339] PROJECTIONS: Starting Projection Core Reader (reads from $projections-$5bfc081f079e45fdbbf909438ddbfdef) [09866,32,09:44:01.352] PROJECTIONS: Starting Projection Manager Response Reader (reads from $projections-$master) [09866,22,09:44:01.416] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 637ms. Q: 0/1. [09866,33,09:44:01.428] PROJECTIONS: Resetting Master Writer [09866,33,09:44:01.428] SLOW BUS MSG [bus]: StartCore - 85ms. Handler: ProjectionCoreResponseWriter. [09866,33,09:44:01.428] SLOW QUEUE MSG [Projection Core #0]: StartCore - 111ms. Q: 3/5. [09866,32,09:44:01.441] PROJECTIONS: Resetting Worker Writer [09866,34,09:44:01.441] PROJECTIONS: Resetting Master Writer [09866,35,09:44:01.441] PROJECTIONS: Resetting Master Writer [09866,34,09:44:01.441] SLOW BUS MSG [bus]: StartCore - 98ms. Handler: ProjectionCoreResponseWriter. [09866,35,09:44:01.441] SLOW BUS MSG [bus]: StartCore - 98ms. Handler: ProjectionCoreResponseWriter. [09866,32,09:44:01.441] SLOW BUS MSG [manager input bus]: Starting - 87ms. Handler: ProjectionManagerCommandWriter. [09866,34,09:44:01.441] SLOW QUEUE MSG [Projection Core #1]: StartCore - 125ms. Q: 3/5. [09866,35,09:44:01.441] SLOW QUEUE MSG [Projection Core #2]: StartCore - 125ms. Q: 3/5. [09866,32,09:44:01.441] SLOW QUEUE MSG [Projections Master]: Starting - 113ms. Q: 0/2. [09866,30,09:44:01.593] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadAllEventsForward - 276ms. Q: 0/1. [09866,24,09:44:01.596] SLOW QUEUE MSG [StorageReaderQueue #2]: CheckStreamAccess - 294ms. Q: 1/4. [09866,21,09:44:01.841] SLOW QUEUE MSG [StorageReaderQueue #1]: CheckStreamAccess - 538ms. Q: 0/5. [09866,27,09:44:01.865] Created stats stream '$stats-127.0.0.1:2113', code = WrongExpectedVersion [09866,30,09:44:02.105] SLOW QUEUE MSG [StorageReaderQueue #3]: CheckStreamAccess - 512ms. Q: 0/1. [09866,24,09:44:02.198] SLOW QUEUE MSG [StorageReaderQueue #2]: CheckStreamAccess - 602ms. Q: 1/2. [09866,33,09:44:02.302] PROJECTIONS: Finished Starting Projection Core Reader (reads from $projections-$1eae3cf2c91f4d90baec9ced17130049) [09866,32,09:44:02.302] PROJECTIONS: SubComponent Started: ProjectionCoreServiceCommandReader [09866,33,09:44:02.303] PROJECTIONS: Starting read $projections-$control-a4d68221-6ca9-4dea-add1-c3dd48791a02 [09866,21,09:44:02.316] SLOW QUEUE MSG [StorageReaderQueue #1]: CheckStreamAccess - 472ms. Q: 3/6. ... [09866,14,09:44:06.594] ========== [127.0.0.1:2112] Sub System 'Projections' initialized. [09866,32,09:44:06.747] PROJECTIONS: Scheduling the writing of $create-prepared to $projections-$1eae3cf2-c91f-4d90-baec-9ced17130049. Current status of Writer: Busy: False [09866,06,09:44:06.813] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 221ms. Q: 0/2. [09866,32,09:44:06.814] PROJECTIONS: Scheduling the writing of $create-prepared to $projections-$1eae3cf2-c91f-4d90-baec-9ced17130049. Current status of Writer: Busy: True [09866,09,09:44:06.830] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 237ms. Q: 0/1. [09866,32,09:44:06.830] PROJECTIONS: Scheduling the writing of $create-prepared to $projections-$5bfc081f-079e-45fd-bbf9-09438ddbfdef. Current status of Writer: Busy: False [09866,26,09:44:06.922] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 330ms. Q: 0/3. [09866,32,09:44:06.924] PROJECTIONS: Scheduling the writing of $create-and-prepare to $projections-$d3ea3d9c-8ce3-450c-8fea-c2f07351ccf8. Current status of Writer: Busy: False [09866,22,09:44:07.091] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 371ms. Q: 0/1. [09866,32,09:44:07.093] PROJECTIONS: Scheduling the writing of $create-prepared to $projections-$d3ea3d9c-8ce3-450c-8fea-c2f07351ccf8. Current status of Writer: Busy: True [09866,06,09:44:07.102] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 288ms. Q: 1/1. [09866,32,09:44:07.103] PROJECTIONS: Scheduling the writing of $create-and-prepare to $projections-$d3ea3d9c-8ce3-450c-8fea-c2f07351ccf8. Current status of Writer: Busy: True [09866,09,09:44:07.305] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 474ms. Q: 0/1. [09866,32,09:44:07.305] PROJECTIONS: Scheduling the writing of $create-prepared to $projections-$1eae3cf2-c91f-4d90-baec-9ced17130049. Current status of Writer: Busy: True [09866,32,09:44:07.362] PROJECTIONS: Finished writing events to $projections-$1eae3cf2c91f4d90baec9ced17130049: $create-prepared [09866,26,09:44:07.478] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 555ms. Q: 2/3. [09866,32,09:44:07.478] PROJECTIONS: Scheduling the writing of $create-and-prepare to $projections-$5bfc081f-079e-45fd-bbf9-09438ddbfdef. Current status of Writer: Busy: True [09866,33,09:44:07.481] PROJECTIONS: Command received: 0@$create-prepared [09866,33,09:44:07.500] PROJECTIONS: Scheduling the writing of $prepared to $projections-$master. Current status of Writer: Busy: True [09866,32,09:44:07.604] PROJECTIONS: Finished writing events to $projections-$d3ea3d9c8ce3450c8feac2f07351ccf8: $create-and-prepare [09866,34,09:44:07.604] PROJECTIONS: Command received: 0@$create-and-prepare [09866,34,09:44:07.608] PROJECTIONS: Scheduling the writing of $prepared to $projections-$master. Current status of Writer: Busy: True [09866,06,09:44:07.720] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 617ms. Q: 0/5. ... [09866,18,09:44:28.360] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 225ms. Q: 22/22. [09866,11,09:44:28.433] Verifying hash for TFChunk './chunk-000567.000001'... [09866,09,09:44:28.548] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 255ms. Q: 50/50. [09866,34,09:44:28.605] SLOW BUS MSG [bus]: ReadStreamEventsBackwardCompleted - 57ms. Handler: RequestResponseDispatcher`2. [09866,34,09:44:28.605] SLOW QUEUE MSG [Projection Core #1]: ReadStreamEventsBackwardCompleted - 57ms. Q: 0/0. [09866,18,09:44:28.678] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 315ms. Q: 14/14. [09866,09,09:44:28.837] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 231ms. Q: 49/49. [09866,09,09:44:29.076] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 238ms. Q: 48/48. [09866,18,09:44:29.297] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 248ms. Q: 11/11. [09866,09,09:44:29.376] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 299ms. Q: 47/49. [09866,09,09:44:29.760] Read Stream Events Backward operation has expired for Stream: Tracking-1FE35490B97E11E0, From Event Number: -1, Max Count: 1. Operation Expired at 9/17/2018 9:44:29 AM [09866,09,09:44:29.761] Read Stream Events Backward operation has expired for Stream: Tracking-761465674, From Event Number: -1, Max Count: 1. Operation Expired at 9/17/2018 9:44:29 AM [09866,32,09:44:29.761] PROJECTIONS: Response received: 18631891@$started [09866,32,09:44:29.762] PROJECTIONS: Response received: 18631898@$started [09866,18,09:44:29.779] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 284ms. Q: 9/14. [09866,09,09:44:29.961] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 200ms. Q: 47/48. [09866,18,09:44:29.993] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 214ms. Q: 13/13. [09866,18,09:44:31.036] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 1042ms. Q: 12/12. [09866,09,09:44:31.109] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 1147ms. Q: 47/47. [09866,18,09:44:31.253] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 217ms. Q: 11/11. [09866,35,09:44:31.410] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.410] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.410] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.411] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.412] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:31.414] Read backward of stream $ce-Message timed out. Retrying [09866,09,09:44:31.507] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 227ms. Q: 44/55. [09866,09,09:44:31.507] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052828, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,09,09:44:31.508] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052824, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,09,09:44:31.508] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052820, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,09,09:44:31.508] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052816, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,09,09:44:31.508] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052812, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,09,09:44:31.508] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052808, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,09,09:44:31.508] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052804, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,09,09:44:31.508] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052800, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,09,09:44:31.508] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052796, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,09,09:44:31.508] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052792, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,09,09:44:31.508] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052788, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,18,09:44:31.573] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 319ms. Q: 10/22. [09866,09,09:44:31.891] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 205ms. Q: 30/30. [09866,18,09:44:32.160] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 232ms. Q: 19/19. [09866,09,09:44:32.416] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 328ms. Q: 29/29. [09866,18,09:44:32.532] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 225ms. Q: 17/17. [09866,35,09:44:32.727] Read backward of stream $ce-Queue timed out. Retrying [09866,35,09:44:32.728] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:32.728] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:32.728] Read backward of stream $ce-Session timed out. Retrying [09866,35,09:44:32.728] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:32.728] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:32.728] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:32.728] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:32.728] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:32.728] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:32.728] Read backward of stream $ce-Message timed out. Retrying [09866,35,09:44:32.728] Read backward of stream $ce-Message timed out. Retrying [09866,09,09:44:32.945] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 529ms. Q: 28/31. [09866,18,09:44:33.156] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 623ms. Q: 15/18. [09866,09,09:44:33.210] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 264ms. Q: 30/30. [09866,09,09:44:33.437] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 226ms. Q: 29/29. [09866,18,09:44:33.558] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 225ms. Q: 16/16. [09866,09,09:44:33.658] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 221ms. Q: 28/28. [09866,18,09:44:33.774] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 215ms. Q: 15/15. [09866,09,09:44:34.065] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 249ms. Q: 26/26. [09866,09,09:44:34.281] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 215ms. Q: 25/25. [09866,07,09:44:34.316] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsForward - 21813ms. Q: 3/104. [09866,17,09:44:34.316] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsForward - 8940ms. Q: 23/58. [09866,07,09:44:34.317] ---!!! VERY SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsForward - 21813ms. Q: 3/104. [09866,17,09:44:34.317] ---!!! VERY SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsForward - 8940ms. Q: 23/58. [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Session, From Event Number: 1752825, Max Count: 1. Operation Expired at 9/17/2018 9:44:21 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052846, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read All Stream Events Forward operation has expired for C:155435168604/P:0. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052842, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read All Stream Events Forward operation has expired for C:155435168604/P:0. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052838, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Stats, From Event Number: 58667, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052834, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Queue, From Event Number: 15989, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052830, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052937, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052826, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Queue, From Event Number: 15983, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052822, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052933, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052818, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052929, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052814, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052925, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052810, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052921, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052806, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Session, From Event Number: 1752825, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052802, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052915, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052798, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052911, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052794, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052907, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052790, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052903, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Session, From Event Number: 1752825, Max Count: 1. Operation Expired at 9/17/2018 9:44:31 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052899, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Stats, From Event Number: 58667, Max Count: 1. Operation Expired at 9/17/2018 9:44:32 AM [09866,07,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052895, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.317] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052933, Max Count: 1. Operation Expired at 9/17/2018 9:44:32 AM [09866,07,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052891, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Session, From Event Number: 1752825, Max Count: 1. Operation Expired at 9/17/2018 9:44:32 AM [09866,07,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052887, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052903, Max Count: 1. Operation Expired at 9/17/2018 9:44:32 AM [09866,07,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052883, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052887, Max Count: 1. Operation Expired at 9/17/2018 9:44:32 AM [09866,07,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052879, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052871, Max Count: 1. Operation Expired at 9/17/2018 9:44:32 AM [09866,07,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052875, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,17,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052855, Max Count: 1. Operation Expired at 9/17/2018 9:44:32 AM [09866,07,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052871, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,07,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052867, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,07,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052863, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,07,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052859, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,07,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052855, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,07,09:44:34.318] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052851, Max Count: 1. Operation Expired at 9/17/2018 9:44:22 AM [09866,07,09:44:34.320] Read Stream Events Backward operation has expired for Stream: $ce-Queue, From Event Number: 15990, Max Count: 1. Operation Expired at 9/17/2018 9:44:23 AM [09866,07,09:44:34.320] Read Stream Events Backward operation has expired for Stream: $ce-Message, From Event Number: 31052935, Max Count: 1. Operation Expired at 9/17/2018 9:44:29 AM ... [09866,11,09:58:37.460] Verifying hash for TFChunk './chunk-000466.000002'... [09866,25,09:58:37.511] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 268ms. Q: 7/7. [09866,27,09:58:37.547] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 241ms. Q: 14/14. [09866,10,09:58:37.672] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 403ms. Q: 7/8. [09866,18,09:58:37.680] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 439ms. Q: 13/13. [09866,25,09:58:37.891] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 239ms. Q: 5/5. [09866,10,09:58:37.894] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 222ms. Q: 7/7. [09866,18,09:58:37.916] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 236ms. Q: 11/11. [09866,27,09:58:37.928] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 259ms. Q: 10/11. [09866,10,09:58:38.195] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 299ms. Q: 6/6. [09866,27,09:58:38.299] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 371ms. Q: 10/10. [09866,25,09:58:38.360] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 253ms. Q: 2/2. [09866,18,09:58:38.591] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 227ms. Q: 7/16. [09866,10,09:58:38.696] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 340ms. Q: 4/12. [09866,27,09:58:38.719] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 208ms. Q: 6/14. [09866,22,09:58:38.880] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 326ms. Q: 0/7. [09866,10,09:58:38.944] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 247ms. Q: 11/11. [09866,27,09:58:39.071] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 351ms. Q: 13/13. [09866,10,09:58:39.186] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 242ms. Q: 10/11. [09866,18,09:58:39.220] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 214ms. Q: 12/12. [09866,10,09:58:39.463] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 276ms. Q: 8/8. [09866,27,09:58:39.525] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 248ms. Q: 9/16. [09866,34,09:58:39.593] SLOW BUS MSG [bus]: CoreTick - 116ms. Handler: ProjectionCoreService. [09866,34,09:58:39.593] SLOW QUEUE MSG [Projection Core #1]: CoreTick - 116ms. Q: 20/42. ... [09866,27,09:58:59.063] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 410ms. Q: 13/13. [09866,27,09:58:59.327] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 263ms. Q: 12/13. [09866,27,09:59:00.327] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 271ms. Q: 6/6. [09866,27,09:59:00.903] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 531ms. Q: 4/4. [09866,18,09:59:01.222] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 228ms. Q: 0/1. [09866,18,09:59:01.443] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 221ms. Q: 0/0. [09866,07,09:59:01.486] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 304ms. Q: 0/0. [09866,11,09:59:38.903] Verifying hash for TFChunk './chunk-000448.000002'... ... [09866,11,10:01:32.707] Verifying hash for TFChunk './chunk-000381.000003'... [09866,12,10:01:35.587] SLOW QUEUE MSG [StorageWriterQueue]: WritePrepares - 585ms. Q: 0/0. [09866,11,10:01:35.685] Verifying hash for TFChunk './chunk-000380.000002'... ... [09866,11,10:03:34.073] Verifying hash for TFChunk './chunk-000334.000002'... [09866,12,10:03:36.530] SLOW QUEUE MSG [StorageWriterQueue]: WritePrepares - 1228ms. Q: 0/0. [09866,11,10:03:37.165] Verifying hash for TFChunk './chunk-000333.000002'... ... [09866,11,10:04:35.025] Verifying hash for TFChunk './chunk-000305.000002'... [09866,12,10:04:37.681] SLOW QUEUE MSG [StorageWriterQueue]: WritePrepares - 2238ms. Q: 0/0. [09866,11,10:04:38.097] Verifying hash for TFChunk './chunk-000304.000002'... ... [09866,11,10:05:03.697] Verifying hash for TFChunk './chunk-000295.000002'... [09866,12,10:05:06.608] SLOW QUEUE MSG [StorageWriterQueue]: WritePrepares - 1089ms. Q: 0/0. [09866,11,10:05:06.769] Verifying hash for TFChunk './chunk-000294.000002'... ... [09866,11,10:07:05.240] Verifying hash for TFChunk './chunk-000252.000002'... [09866,12,10:07:06.477] SLOW QUEUE MSG [StorageWriterQueue]: WritePrepares - 659ms. Q: 0/0. [09866,11,10:07:08.526] Verifying hash for TFChunk './chunk-000251.000002'... ... [09866,11,10:08:06.915] Verifying hash for TFChunk './chunk-000223.000002'... [09866,12,10:08:07.132] SLOW QUEUE MSG [StorageWriterQueue]: WritePrepares - 1162ms. Q: 0/0. [09866,11,10:08:09.867] Verifying hash for TFChunk './chunk-000222.000002'... ... [09866,11,10:09:35.163] Verifying hash for TFChunk './chunk-000187.000003'... [09866,12,10:09:37.067] SLOW QUEUE MSG [StorageWriterQueue]: WritePrepares - 876ms. Q: 0/0. [09866,11,10:09:38.062] Verifying hash for TFChunk './chunk-000186.000002'... ... [09866,11,10:11:05.220] Verifying hash for TFChunk './chunk-000148.000002'... [09866,12,10:11:07.722] SLOW QUEUE MSG [StorageWriterQueue]: WritePrepares - 1312ms. Q: 0/0. [09866,11,10:11:08.546] Verifying hash for TFChunk './chunk-000147.000002'... ... [09866,11,10:12:07.877] Verifying hash for TFChunk './chunk-000066.000001'... [09866,12,10:12:08.044] SLOW QUEUE MSG [StorageWriterQueue]: WritePrepares - 1475ms. Q: 0/0. [09866,11,10:12:10.471] Verifying hash for TFChunk './chunk-000065.000001'... ... [09866,11,10:13:09.779] Verifying hash for TFChunk './chunk-000000.000002'... [09866,10,10:18:00.573] Segments count: 1, buffers count: 20, should be when full: 20 [09866,23,10:18:30.809] SLOW QUEUE MSG [MonitoringQueue]: GetFreshStats - 131ms. Q: 0/1. [09866,32,10:19:11.069] Enabling 'ByPeer' projection [09866,32,10:19:11.070] PROJECTIONS: Scheduling the writing of $dispose to $projections-$1eae3cf2-c91f-4d90-baec-9ced17130049. Current status of Writer: Busy: False [09866,32,10:19:11.071] PROJECTIONS: Scheduling the writing of $create-and-prepare to $projections-$1eae3cf2-c91f-4d90-baec-9ced17130049. Current status of Writer: Busy: True [09866,32,10:19:11.158] PROJECTIONS: Finished writing events to $projections-$1eae3cf2c91f4d90baec9ced17130049: $dispose [09866,33,10:19:11.159] PROJECTIONS: Command received: 8@$dispose [09866,32,10:19:11.270] PROJECTIONS: Finished writing events to $projections-$1eae3cf2c91f4d90baec9ced17130049: $create-and-prepare [09866,33,10:19:11.270] PROJECTIONS: Command received: 9@$create-and-prepare [09866,33,10:19:11.330] SLOW BUS MSG [bus]: CreateAndPrepare - 59ms. Handler: ProjectionCoreService. [09866,33,10:19:11.330] SLOW QUEUE MSG [Projection Core #0]: CreateAndPrepare - 60ms. Q: 1/5. [09866,33,10:19:11.331] PROJECTIONS: Scheduling the writing of $prepared to $projections-$master. Current status of Writer: Busy: True [09866,33,10:19:11.537] PROJECTIONS: Finished writing events to $projections-$master: $prepared [09866,32,10:19:11.537] PROJECTIONS: Response received: 18632070@$prepared [09866,32,10:19:11.649] 'ByPeer' projection source has been written [09866,32,10:19:11.649] PROJECTIONS: Scheduling the writing of $start to $projections-$1eae3cf2-c91f-4d90-baec-9ced17130049. Current status of Writer: Busy: False [09866,32,10:19:11.759] PROJECTIONS: Finished writing events to $projections-$1eae3cf2c91f4d90baec9ced17130049: $start [09866,33,10:19:11.759] PROJECTIONS: Command received: 10@$start [09866,33,10:19:11.760] PROJECTIONS: Scheduling the writing of $started to $projections-$master. Current status of Writer: Busy: True [09866,33,10:19:12.247] PROJECTIONS: Finished writing events to $projections-$master: $started [09866,32,10:19:12.247] PROJECTIONS: Response received: 18632073@$started [09866,24,10:19:17.513] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsForward - 5753ms. Q: 0/5. [09866,23,10:19:17.743] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 225ms. Q: 0/4. [09866,18,10:19:17.747] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 230ms. Q: 0/5. [09866,08,10:19:17.856] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 212ms. Q: 3/3. [09866,18,10:19:18.008] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 260ms. Q: 4/5. [09866,08,10:19:18.074] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 217ms. Q: 3/3. [09866,23,10:19:18.119] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 375ms. Q: 3/4. [09866,08,10:19:18.344] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 270ms. Q: 2/3. [09866,18,10:19:18.356] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 347ms. Q: 4/5. [09866,23,10:19:18.438] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 318ms. Q: 3/4. [09866,08,10:19:18.566] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 220ms. Q: 2/4. [09866,23,10:19:18.722] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 284ms. Q: 3/4. [09866,23,10:19:19.072] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 349ms. Q: 4/5. [09866,06,10:19:19.408] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 306ms. Q: 0/0. [09866,10,10:19:19.477] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 375ms. Q: 0/1. [09866,32,10:19:20.003] Enabling 'ByDate' projection [09866,32,10:19:20.004] PROJECTIONS: Scheduling the writing of $dispose to $projections-$d3ea3d9c-8ce3-450c-8fea-c2f07351ccf8. Current status of Writer: Busy: False [09866,32,10:19:20.004] PROJECTIONS: Scheduling the writing of $create-and-prepare to $projections-$d3ea3d9c-8ce3-450c-8fea-c2f07351ccf8. Current status of Writer: Busy: True [09866,32,10:19:20.187] PROJECTIONS: Finished writing events to $projections-$d3ea3d9c8ce3450c8feac2f07351ccf8: $dispose [09866,32,10:19:20.375] PROJECTIONS: Finished writing events to $projections-$d3ea3d9c8ce3450c8feac2f07351ccf8: $create-and-prepare [09866,33,10:19:20.690] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:20.691] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:20.691] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,24,10:19:22.992] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsForward - 5478ms. Q: 0/18. [09866,10,10:19:23.279] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 261ms. Q: 0/3. [09866,24,10:19:23.405] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 273ms. Q: 18/19. [09866,20,10:19:23.559] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 542ms. Q: 0/2. [09866,33,10:19:23.712] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:23.712] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:23.712] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,10,10:19:23.739] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 459ms. Q: 2/3. [09866,20,10:19:23.794] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 234ms. Q: 1/1. [09866,24,10:19:23.810] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 404ms. Q: 18/20. [09866,10,10:19:24.013] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 273ms. Q: 2/2. [09866,24,10:19:24.206] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 396ms. Q: 19/20. [09866,34,10:19:24.310] SLOW BUS MSG [bus]: UnwrapEnvelopeMessage - 95ms. Handler: UnwrapEnvelopeHandler. [09866,34,10:19:24.310] SLOW QUEUE MSG [Projection Core #1]: UnwrapEnvelopeMessage - 95ms. Q: 0/36. [09866,34,10:19:24.311] PROJECTIONS: Command received: 8@$dispose [09866,34,10:19:24.311] PROJECTIONS: Command received: 9@$create-and-prepare [09866,34,10:19:24.372] SLOW BUS MSG [bus]: CreateAndPrepare - 60ms. Handler: ProjectionCoreService. [09866,34,10:19:24.372] SLOW QUEUE MSG [Projection Core #1]: CreateAndPrepare - 60ms. Q: 7/10. [09866,34,10:19:24.372] PROJECTIONS: Scheduling the writing of $prepared to $projections-$master. Current status of Writer: Busy: True [09866,24,10:19:24.600] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 384ms. Q: 6/8. [09866,24,10:19:24.811] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 211ms. Q: 7/8. [09866,34,10:19:25.127] PROJECTIONS: Finished writing events to $projections-$master: $prepared [09866,32,10:19:25.128] PROJECTIONS: Response received: 18632084@$prepared [09866,32,10:19:25.482] 'ByDate' projection source has been written [09866,32,10:19:25.483] PROJECTIONS: Scheduling the writing of $start to $projections-$d3ea3d9c-8ce3-450c-8fea-c2f07351ccf8. Current status of Writer: Busy: False [09866,33,10:19:25.722] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:25.722] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:25.722] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,32,10:19:25.837] PROJECTIONS: Finished writing events to $projections-$d3ea3d9c8ce3450c8feac2f07351ccf8: $start [09866,34,10:19:25.837] PROJECTIONS: Command received: 10@$start [09866,34,10:19:25.837] PROJECTIONS: Scheduling the writing of $started to $projections-$master. Current status of Writer: Busy: True [09866,30,10:19:26.447] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadAllEventsForward - 609ms. Q: 0/1. [09866,33,10:19:26.794] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,34,10:19:26.794] Failed to write events to stream $ce-Peer. Error: CommitTimeout [09866,33,10:19:26.794] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,32,10:19:26.795] SLOW BUS MSG [manager input bus]: GetStatistics - 82ms. Handler: ProjectionManager. [09866,33,10:19:26.795] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,32,10:19:26.795] SLOW QUEUE MSG [Projections Master]: GetStatistics - 82ms. Q: 0/1. [09866,34,10:19:26.795] PROJECTIONS: Finished writing events to $projections-$master: $started [09866,07,10:19:26.879] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadAllEventsForward - 431ms. Q: 0/0. [09866,21,10:19:27.058] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 606ms. Q: 0/0. [09866,09,10:19:27.346] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadAllEventsForward - 466ms. Q: 0/1. [09866,33,10:19:28.810] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:28.810] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:28.810] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:29.818] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,34,10:19:29.818] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:29.818] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:29.819] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,17,10:19:30.363] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsForward - 7371ms. Q: 0/22. [09866,17,10:19:30.363] ---!!! VERY SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsForward - 7371ms. Q: 0/22. [09866,19,10:19:30.794] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 427ms. Q: 0/4. [09866,32,10:19:30.828] Enabling 'ByDate' projection [09866,17,10:19:30.837] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 473ms. Q: 20/25. [09866,29,10:19:30.959] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadStreamEventsBackward - 592ms. Q: 0/2. [09866,17,10:19:31.153] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 314ms. Q: 23/23. [09866,33,10:19:32.841] Failed to write events to stream Peer-XXX. Error: CommitTimeout ... [09866,34,10:19:33.849] Failed to write events to stream $ce-Peer. Error: CommitTimeout [09866,33,10:19:33.850] Failed to write events to stream Peer-XXX. Error: CommitTimeout ... [09866,13,10:19:35.664] Read forward of stream $projections-$master timed out. Retrying [09866,32,10:19:35.664] Read forward of stream $projections-$master timed out. Retrying [09866,33,10:19:35.866] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,18,10:19:37.347] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsForward - 6983ms. Q: 0/4. [09866,17,10:19:37.449] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadAllEventsForward - 6295ms. Q: 20/39. [09866,17,10:19:37.453] Check Stream Access operation has expired for Stream: $ce-Peer. Operation Expired at 9/17/2018 10:19:34 AM [09866,17,10:19:37.453] Read All Stream Events Forward operation has expired for C:155436177583/P:0. Operation Expired at 9/17/2018 10:19:34 AM [09866,17,10:19:37.453] Check Stream Access operation has expired for Stream: Peer-XXX. Operation Expired at 9/17/2018 10:19:34 AM [09866,17,10:19:37.453] Read All Stream Events Forward operation has expired for C:155436179795/P:0. Operation Expired at 9/17/2018 10:19:35 AM [09866,17,10:19:37.453] Read Stream Events Forward operation has expired for Stream: $projections-$master, From Event Number: 18632087, Max Count: 10. Operation Expired at 9/17/2018 10:19:35 AM [09866,17,10:19:37.453] Read Stream Events Backward operation has expired for Stream: $scavenges, From Event Number: -1, Max Count: 1. Operation Expired at 9/17/2018 10:19:36 AM [09866,17,10:19:37.453] Check Stream Access operation has expired for Stream: Peer-XXX. Operation Expired at 9/17/2018 10:19:36 AM [09866,17,10:19:37.453] Check Stream Access operation has expired for Stream: Peer-XXX. Operation Expired at 9/17/2018 10:19:36 AM [09866,17,10:19:37.453] Check Stream Access operation has expired for Stream: Peer-XXX. Operation Expired at 9/17/2018 10:19:36 AM [09866,17,10:19:37.453] Read All Stream Events Forward operation has expired for C:153905209601/P:0. Operation Expired at 9/17/2018 10:19:37 AM [09866,21,10:19:37.456] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadAllEventsForward - 3042ms. Q: 0/12. [09866,27,10:19:37.456] SLOW QUEUE MSG [StorageReaderQueue #4]: ReadAllEventsForward - 2387ms. Q: 0/6. [09866,32,10:19:37.456] PROJECTIONS: Response received: 18632090@$started [09866,35,10:19:37.636] SLOW BUS MSG [bus]: UnwrapEnvelopeMessage - 180ms. Handler: UnwrapEnvelopeHandler. [09866,34,10:19:37.636] SLOW BUS MSG [bus]: UnwrapEnvelopeMessage - 180ms. Handler: UnwrapEnvelopeHandler. [09866,35,10:19:37.637] SLOW QUEUE MSG [Projection Core #2]: UnwrapEnvelopeMessage - 180ms. Q: 0/190. [09866,34,10:19:37.637] SLOW QUEUE MSG [Projection Core #1]: UnwrapEnvelopeMessage - 180ms. Q: 0/198. [09866,33,10:19:37.646] SLOW BUS MSG [bus]: UnwrapEnvelopeMessage - 181ms. Handler: UnwrapEnvelopeHandler. [09866,33,10:19:37.646] SLOW QUEUE MSG [Projection Core #0]: UnwrapEnvelopeMessage - 191ms. Q: 0/200. [09866,21,10:19:37.791] SLOW QUEUE MSG [StorageReaderQueue #3]: ReadStreamEventsBackward - 334ms. Q: 6/7. [09866,33,10:19:37.873] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:37.874] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,33,10:19:37.874] Failed to write events to stream Peer-XXX. Error: CommitTimeout [09866,18,10:19:37.910] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsBackward - 454ms. Q: 5/7. [09866,17,10:19:38.160] SLOW QUEUE MSG [StorageReaderQueue #1]: ReadStreamEventsBackward - 706ms. Q: 24/29. ...