Aug 04 11:28:23 fenced fenced 3.0.12 started Aug 04 11:28:23 fenced cpg_join fenced:daemon ... Aug 04 11:28:23 fenced setup_cpg_daemon 10 Aug 04 11:28:23 fenced group_mode 3 compat 0 Aug 04 11:28:23 fenced fenced:daemon conf 8 1 0 memb 1 2 3 4 5 6 7 8 join 1 left Aug 04 11:28:23 fenced fenced:daemon ring 1:84 8 memb 1 2 3 4 5 6 7 8 Aug 04 11:28:23 fenced receive_protocol from 5 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 5 max 0.0.0.0 run 0.0.0.0 Aug 04 11:28:23 fenced daemon node 5 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced run protocol from nodeid 5 Aug 04 11:28:23 fenced daemon run 1.1.1 max 1.1.1 Aug 04 11:28:23 fenced receive_protocol from 6 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 6 max 0.0.0.0 run 0.0.0.0 Aug 04 11:28:23 fenced daemon node 6 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 1 max 1.1.1.0 run 0.0.0.0 Aug 04 11:28:23 fenced daemon node 1 max 0.0.0.0 run 0.0.0.0 Aug 04 11:28:23 fenced daemon node 1 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 1 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 1 max 1.1.1.0 run 0.0.0.0 Aug 04 11:28:23 fenced daemon node 1 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 3 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 3 max 0.0.0.0 run 0.0.0.0 Aug 04 11:28:23 fenced daemon node 3 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 7 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 7 max 0.0.0.0 run 0.0.0.0 Aug 04 11:28:23 fenced daemon node 7 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 7 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 7 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 7 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 3 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 3 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 3 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 3 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 3 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 3 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 7 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 7 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 7 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 8 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 8 max 0.0.0.0 run 0.0.0.0 Aug 04 11:28:23 fenced daemon node 8 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 8 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 8 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 8 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 8 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 8 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 8 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 2 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 2 max 0.0.0.0 run 0.0.0.0 Aug 04 11:28:23 fenced daemon node 2 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 2 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 2 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 2 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 2 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 2 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 2 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced receive_protocol from 4 max 1.1.1.0 run 1.1.1.0 Aug 04 11:28:23 fenced daemon node 4 max 0.0.0.0 run 0.0.0.0 Aug 04 11:28:23 fenced daemon node 4 join 1280914103 left 0 local quorum 1280914103 Aug 04 11:28:23 fenced client connection 3 fd 11 Aug 04 11:28:24 fenced added 8 nodes from ccs Aug 04 11:28:24 fenced cpg_join fenced:default ... Aug 04 11:28:24 fenced fenced:default conf 8 1 0 memb 1 2 3 4 5 6 7 8 join 1 left Aug 04 11:28:24 fenced add_change cg 1 joined nodeid 1 Aug 04 11:28:24 fenced add_change cg 1 m 8 j 1 r 0 f 0 Aug 04 11:28:24 fenced check_ringid cluster 84 cpg 0:0 Aug 04 11:28:24 fenced fenced:default ring 1:84 8 memb 1 2 3 4 5 6 7 8 Aug 04 11:28:24 fenced check_ringid done cluster 84 cpg 1:84 Aug 04 11:28:24 fenced check_quorum done Aug 04 11:28:24 fenced send_start 1:1 flags 1 started 0 m 8 j 1 r 0 f 0 Aug 04 11:28:24 fenced receive_start 3:5 len 392 Aug 04 11:28:24 fenced match_change 3:5 matches cg 1 Aug 04 11:28:24 fenced wait_messages cg 1 need 7 of 8 Aug 04 11:28:24 fenced receive_start 4:2 len 392 Aug 04 11:28:24 fenced match_change 4:2 matches cg 1 Aug 04 11:28:24 fenced wait_messages cg 1 need 6 of 8 Aug 04 11:28:24 fenced receive_start 5:7 len 392 Aug 04 11:28:24 fenced match_change 5:7 matches cg 1 Aug 04 11:28:24 fenced wait_messages cg 1 need 5 of 8 Aug 04 11:28:24 fenced receive_start 6:8 len 392 Aug 04 11:28:24 fenced match_change 6:8 matches cg 1 Aug 04 11:28:24 fenced wait_messages cg 1 need 4 of 8 Aug 04 11:28:24 fenced receive_start 7:6 len 392 Aug 04 11:28:24 fenced match_change 7:6 matches cg 1 Aug 04 11:28:24 fenced wait_messages cg 1 need 3 of 8 Aug 04 11:28:24 fenced receive_start 8:3 len 392 Aug 04 11:28:24 fenced match_change 8:3 matches cg 1 Aug 04 11:28:24 fenced wait_messages cg 1 need 2 of 8 Aug 04 11:28:24 fenced receive_start 2:4 len 392 Aug 04 11:28:24 fenced match_change 2:4 matches cg 1 Aug 04 11:28:24 fenced wait_messages cg 1 need 1 of 8 Aug 04 11:28:24 fenced receive_start 1:1 len 392 Aug 04 11:28:24 fenced match_change 1:1 matches cg 1 Aug 04 11:28:24 fenced wait_messages cg 1 got all 8 Aug 04 11:28:24 fenced set_master from 0 to complete node 2 Aug 04 11:28:24 fenced receive_complete 2:4 len 392 Aug 04 11:31:15 fenced cluster node 2 removed seq 88 Aug 04 11:31:15 fenced cluster node 3 removed seq 88 Aug 04 11:31:15 fenced cluster node 4 removed seq 88 Aug 04 11:31:15 fenced cluster node 8 removed seq 88 Aug 04 11:31:24 fenced cluster node 2 added seq 92 Aug 04 11:31:24 fenced cluster node 3 added seq 92 Aug 04 11:31:25 fenced cluster node 4 added seq 92 Aug 04 11:31:25 fenced cluster node 8 added seq 92 Aug 04 11:31:34 fenced fenced:daemon conf 7 0 1 memb 1 3 4 5 6 7 8 join left 2 Aug 04 11:31:34 fenced fenced:daemon conf 6 0 1 memb 1 4 5 6 7 8 join left 3 Aug 04 11:31:34 fenced fenced:daemon conf 5 0 1 memb 1 5 6 7 8 join left 4 Aug 04 11:31:34 fenced fenced:daemon conf 4 0 1 memb 1 5 6 7 join left 8 Aug 04 11:31:34 fenced fenced:daemon conf 5 1 0 memb 1 2 5 6 7 join 2 left Aug 04 11:31:34 fenced cpg_mcast_joined retried 5 protocol Aug 04 11:31:34 fenced fenced:daemon ring 1:92 8 memb 1 2 3 4 5 6 7 8 Aug 04 11:31:34 fenced fenced:default conf 7 0 1 memb 1 3 4 5 6 7 8 join left 2 Aug 04 11:31:34 fenced add_change cg 2 remove nodeid 2 reason 3 Aug 04 11:31:34 fenced add_change cg 2 m 7 j 0 r 1 f 1 Aug 04 11:31:34 fenced add_victims node 2 Aug 04 11:31:34 fenced check_ringid cluster 92 cpg 1:84 Aug 04 11:31:34 fenced fenced:default conf 6 0 1 memb 1 4 5 6 7 8 join left 3 Aug 04 11:31:34 fenced add_change cg 3 remove nodeid 3 reason 3 Aug 04 11:31:34 fenced add_change cg 3 m 6 j 0 r 1 f 1 Aug 04 11:31:34 fenced add_victims node 3 Aug 04 11:31:34 fenced check_ringid cluster 92 cpg 1:84 Aug 04 11:31:34 fenced fenced:default conf 5 0 1 memb 1 5 6 7 8 join left 4 Aug 04 11:31:34 fenced add_change cg 4 remove nodeid 4 reason 3 Aug 04 11:31:34 fenced add_change cg 4 m 5 j 0 r 1 f 1 Aug 04 11:31:34 fenced add_victims node 4 Aug 04 11:31:34 fenced check_ringid cluster 92 cpg 1:84 Aug 04 11:31:34 fenced fenced:default conf 4 0 1 memb 1 5 6 7 join left 8 Aug 04 11:31:34 fenced add_change cg 5 remove nodeid 8 reason 3 Aug 04 11:31:34 fenced add_change cg 5 m 4 j 0 r 1 f 1 Aug 04 11:31:34 fenced add_victims node 8 Aug 04 11:31:34 fenced check_ringid cluster 92 cpg 1:84 Aug 04 11:31:34 fenced fenced:default conf 5 1 0 memb 1 2 5 6 7 join 2 left Aug 04 11:31:34 fenced add_change cg 6 joined nodeid 2 Aug 04 11:31:34 fenced add_change cg 6 m 5 j 1 r 0 f 0 Aug 04 11:31:34 fenced check_ringid cluster 92 cpg 1:84 Aug 04 11:31:34 fenced fenced:default ring 1:92 8 memb 1 2 3 4 5 6 7 8 Aug 04 11:31:34 fenced check_ringid done cluster 92 cpg 1:92 Aug 04 11:31:34 fenced check_quorum done Aug 04 11:31:34 fenced send_start 1:6 flags 2 started 1 m 5 j 1 r 0 f 0 Aug 04 11:31:34 fenced receive_protocol from 5 max 1.1.1.0 run 1.1.1.1 Aug 04 11:31:34 fenced daemon node 5 max 1.1.1.0 run 1.1.1.0 Aug 04 11:31:34 fenced daemon node 5 join 1280914103 left 0 local quorum 1280914284 Aug 04 11:31:34 fenced receive_protocol from 6 max 1.1.1.0 run 1.1.1.1 Aug 04 11:31:34 fenced daemon node 6 max 1.1.1.0 run 1.1.1.0 Aug 04 11:31:34 fenced daemon node 6 join 1280914103 left 0 local quorum 1280914284 Aug 04 11:31:34 fenced receive_protocol from 7 max 1.1.1.0 run 1.1.1.1 Aug 04 11:31:34 fenced daemon node 7 max 1.1.1.0 run 1.1.1.0 Aug 04 11:31:34 fenced daemon node 7 join 1280914103 left 0 local quorum 1280914284 Aug 04 11:31:34 fenced receive_protocol from 1 max 1.1.1.0 run 1.1.1.1 Aug 04 11:31:34 fenced daemon node 1 max 1.1.1.0 run 1.1.1.0 Aug 04 11:31:34 fenced daemon node 1 join 1280914103 left 0 local quorum 1280914284 Aug 04 11:31:34 fenced receive_start 5:12 len 392 Aug 04 11:31:34 fenced match_change 5:12 skip cg 2 expect counts 7 0 1 1 Aug 04 11:31:34 fenced match_change 5:12 skip cg 3 expect counts 6 0 1 1 Aug 04 11:31:34 fenced match_change 5:12 skip cg 4 expect counts 5 0 1 1 Aug 04 11:31:34 fenced match_change 5:12 skip cg 5 expect counts 4 0 1 1 Aug 04 11:31:34 fenced match_change 5:12 matches cg 6 Aug 04 11:31:34 fenced wait_messages cg 6 need 4 of 5 Aug 04 11:31:34 fenced receive_start 6:13 len 392 Aug 04 11:31:34 fenced match_change 6:13 skip cg 2 expect counts 7 0 1 1 Aug 04 11:31:34 fenced match_change 6:13 skip cg 3 expect counts 6 0 1 1 Aug 04 11:31:34 fenced match_change 6:13 skip cg 4 expect counts 5 0 1 1 Aug 04 11:31:34 fenced match_change 6:13 skip cg 5 expect counts 4 0 1 1 Aug 04 11:31:34 fenced match_change 6:13 matches cg 6 Aug 04 11:31:34 fenced wait_messages cg 6 need 3 of 5 Aug 04 11:31:34 fenced receive_start 7:11 len 392 Aug 04 11:31:34 fenced match_change 7:11 skip cg 2 expect counts 7 0 1 1 Aug 04 11:31:34 fenced match_change 7:11 skip cg 3 expect counts 6 0 1 1 Aug 04 11:31:34 fenced match_change 7:11 skip cg 4 expect counts 5 0 1 1 Aug 04 11:31:34 fenced match_change 7:11 skip cg 5 expect counts 4 0 1 1 Aug 04 11:31:34 fenced match_change 7:11 matches cg 6 Aug 04 11:31:34 fenced wait_messages cg 6 need 2 of 5 Aug 04 11:31:34 fenced receive_start 1:6 len 392 Aug 04 11:31:34 fenced match_change 1:6 skip cg 2 expect counts 7 0 1 1 Aug 04 11:31:34 fenced match_change 1:6 skip cg 3 expect counts 6 0 1 1 Aug 04 11:31:34 fenced match_change 1:6 skip cg 4 expect counts 5 0 1 1 Aug 04 11:31:34 fenced match_change 1:6 skip cg 5 expect counts 4 0 1 1 Aug 04 11:31:34 fenced match_change 1:6 matches cg 6 Aug 04 11:31:34 fenced wait_messages cg 6 need 1 of 5