Aug 04 11:02:16 gfs_controld gfs_controld 3.0.12 started Aug 04 11:02:16 gfs_controld group_mode 3 compat 0 Aug 04 11:02:16 gfs_controld setup_cpg_daemon 13 Aug 04 11:02:16 gfs_controld gfs:controld conf 1 1 0 memb 2 join 2 left Aug 04 11:02:16 gfs_controld gfs:controld conf 2 1 0 memb 1 2 join 1 left Aug 04 11:02:16 gfs_controld set_protocol member_count 2 propose daemon 1.1.1 kernel 1.1.1 Aug 04 11:02:16 gfs_controld run protocol from nodeid 1 Aug 04 11:02:16 gfs_controld daemon run 1.1.1 max 1.1.1 kernel run 1.1.1 max 1.1.1 Aug 04 11:02:21 gfs_controld gfs:controld conf 3 1 0 memb 1 2 3 join 3 left Aug 04 11:02:21 gfs_controld gfs:controld conf 4 1 0 memb 1 2 3 4 join 4 left Aug 04 11:02:22 gfs_controld gfs:controld conf 5 1 0 memb 1 2 3 4 6 join 6 left Aug 04 11:02:22 gfs_controld gfs:controld conf 6 1 0 memb 1 2 3 4 6 7 join 7 left Aug 04 11:02:22 gfs_controld gfs:controld conf 7 1 0 memb 1 2 3 4 5 6 7 join 5 left Aug 04 11:02:22 gfs_controld gfs:controld conf 8 1 0 memb 1 2 3 4 5 6 7 8 join 8 left Aug 04 11:03:09 gfs_controld client connection 5 fd 16 Aug 04 11:03:09 gfs_controld join: /mnt gfs2 lock_dlm rhel6:gfs2 rw /dev/vdb2 Aug 04 11:03:09 gfs_controld join: fs requires cluster="rhel6" current="fabbione" Aug 04 11:03:09 gfs_controld client_reply_join gfs2 ci 5 result -53 Aug 04 11:03:09 gfs_controld connection 5 read error -1 Aug 04 11:06:45 gfs_controld client connection 5 fd 16 Aug 04 11:06:45 gfs_controld join: /mnt gfs2 lock_dlm gfs2:fabbione rw /dev/vdb2 Aug 04 11:06:45 gfs_controld join: fs requires cluster="gfs2" current="fabbione" Aug 04 11:06:45 gfs_controld client_reply_join fabbione ci 5 result -53 Aug 04 11:06:45 gfs_controld connection 5 read error -1 Aug 04 11:08:42 gfs_controld client connection 5 fd 16 Aug 04 11:08:42 gfs_controld join: /mnt gfs2 lock_dlm fabbione:gfs2 rw /dev/vdb2 Aug 04 11:08:42 gfs_controld gfs2 join: cluster name matches: fabbione Aug 04 11:08:42 gfs_controld gfs2 process_dlmcontrol register 0 Aug 04 11:08:42 gfs_controld gfs:mount:gfs2 conf 1 1 0 memb 2 join 2 left Aug 04 11:08:42 gfs_controld gfs2 add_change cg 1 joined nodeid 2 Aug 04 11:08:42 gfs_controld gfs2 add_change cg 1 we joined Aug 04 11:08:42 gfs_controld gfs2 add_change cg 1 counts member 1 joined 1 remove 0 failed 0 Aug 04 11:08:42 gfs_controld gfs2 wait_conditions skip for zero started_count Aug 04 11:08:42 gfs_controld gfs2 send_start cg 1 id_count 1 om 0 nm 1 oj 0 nj 0 Aug 04 11:08:42 gfs_controld gfs:mount:gfs2 conf 2 1 0 memb 2 5 join 5 left Aug 04 11:08:42 gfs_controld gfs2 add_change cg 2 joined nodeid 5 Aug 04 11:08:42 gfs_controld gfs2 add_change cg 2 counts member 2 joined 1 remove 0 failed 0 Aug 04 11:08:42 gfs_controld gfs2 wait_conditions skip for zero started_count Aug 04 11:08:42 gfs_controld gfs2 send_start cg 2 id_count 2 om 0 nm 2 oj 0 nj 0 Aug 04 11:08:42 gfs_controld gfs:mount:gfs2 conf 3 1 0 memb 2 5 6 join 6 left Aug 04 11:08:42 gfs_controld gfs2 add_change cg 3 joined nodeid 6 Aug 04 11:08:42 gfs_controld gfs2 add_change cg 3 counts member 3 joined 1 remove 0 failed 0 Aug 04 11:08:42 gfs_controld gfs2 wait_conditions skip for zero started_count Aug 04 11:08:42 gfs_controld gfs2 send_start cg 3 id_count 3 om 0 nm 3 oj 0 nj 0 Aug 04 11:08:42 gfs_controld gfs:mount:gfs2 conf 4 1 0 memb 2 5 6 7 join 7 left Aug 04 11:08:42 gfs_controld gfs2 add_change cg 4 joined nodeid 7 Aug 04 11:08:42 gfs_controld gfs2 add_change cg 4 counts member 4 joined 1 remove 0 failed 0 Aug 04 11:08:42 gfs_controld gfs2 wait_conditions skip for zero started_count Aug 04 11:08:42 gfs_controld gfs2 send_start cg 4 id_count 4 om 0 nm 4 oj 0 nj 0 Aug 04 11:08:42 gfs_controld gfs:mount:gfs2 conf 5 1 0 memb 2 5 6 7 8 join 8 left Aug 04 11:08:42 gfs_controld gfs2 add_change cg 5 joined nodeid 8 Aug 04 11:08:42 gfs_controld gfs2 add_change cg 5 counts member 5 joined 1 remove 0 failed 0 Aug 04 11:08:42 gfs_controld gfs2 wait_conditions skip for zero started_count Aug 04 11:08:42 gfs_controld gfs2 send_start cg 5 id_count 5 om 0 nm 5 oj 0 nj 0 Aug 04 11:08:42 gfs_controld gfs2 receive_start 2:1 len 92 Aug 04 11:08:42 gfs_controld gfs2 match_change 2:1 matches cg 1 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 5 need 5 of 5 Aug 04 11:08:42 gfs_controld gfs2 receive_start 2:2 len 104 Aug 04 11:08:42 gfs_controld gfs2 match_change 2:2 skip 1 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:2 matches cg 2 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 5 need 5 of 5 Aug 04 11:08:42 gfs_controld gfs2 receive_start 2:3 len 116 Aug 04 11:08:42 gfs_controld gfs2 match_change 2:3 skip 1 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:3 skip 2 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:3 matches cg 3 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 5 need 5 of 5 Aug 04 11:08:42 gfs_controld gfs2 receive_start 2:4 len 128 Aug 04 11:08:42 gfs_controld gfs2 match_change 2:4 skip 1 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:4 skip 2 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:4 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:4 matches cg 4 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 5 need 5 of 5 Aug 04 11:08:42 gfs_controld gfs2 receive_start 2:5 len 140 Aug 04 11:08:42 gfs_controld gfs2 match_change 2:5 skip 1 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:5 skip 2 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:5 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:5 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:5 matches cg 5 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 5 need 4 of 5 Aug 04 11:08:42 gfs_controld gfs:mount:gfs2 conf 6 1 0 memb 2 3 5 6 7 8 join 3 left Aug 04 11:08:42 gfs_controld gfs2 add_change cg 6 joined nodeid 3 Aug 04 11:08:42 gfs_controld gfs2 add_change cg 6 counts member 6 joined 1 remove 0 failed 0 Aug 04 11:08:42 gfs_controld gfs2 wait_conditions skip for zero started_count Aug 04 11:08:42 gfs_controld gfs2 send_start cg 6 id_count 6 om 0 nm 6 oj 0 nj 0 Aug 04 11:08:42 gfs_controld gfs:mount:gfs2 conf 7 1 0 memb 2 3 4 5 6 7 8 join 4 left Aug 04 11:08:42 gfs_controld gfs2 add_change cg 7 joined nodeid 4 Aug 04 11:08:42 gfs_controld gfs2 add_change cg 7 counts member 7 joined 1 remove 0 failed 0 Aug 04 11:08:42 gfs_controld gfs2 wait_conditions skip for zero started_count Aug 04 11:08:42 gfs_controld gfs2 send_start cg 7 id_count 7 om 0 nm 7 oj 0 nj 0 Aug 04 11:08:42 gfs_controld gfs2 receive_start 5:1 len 104 Aug 04 11:08:42 gfs_controld gfs2 match_change 5:1 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 5:1 matches cg 2 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 7 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 5:2 len 116 Aug 04 11:08:42 gfs_controld gfs2 match_change 5:2 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 5:2 skip 2 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:2 matches cg 3 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 7 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 5:3 len 128 Aug 04 11:08:42 gfs_controld gfs2 match_change 5:3 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 5:3 skip 2 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:3 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:3 matches cg 4 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 7 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 5:4 len 140 Aug 04 11:08:42 gfs_controld gfs2 match_change 5:4 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 5:4 skip 2 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:4 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:4 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:4 matches cg 5 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 7 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 5:5 len 152 Aug 04 11:08:42 gfs_controld gfs2 match_change 5:5 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 5:5 skip 2 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:5 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:5 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:5 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:5 matches cg 6 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 7 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 6:1 len 116 Aug 04 11:08:42 gfs_controld gfs2 match_change 6:1 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 6:1 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 6:1 matches cg 3 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 7 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 6:2 len 128 Aug 04 11:08:42 gfs_controld gfs2 match_change 6:2 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 6:2 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 6:2 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:2 matches cg 4 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 7 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 6:3 len 140 Aug 04 11:08:42 gfs_controld gfs2 match_change 6:3 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 6:3 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 6:3 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:3 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:3 matches cg 5 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 7 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 6:4 len 152 Aug 04 11:08:42 gfs_controld gfs2 match_change 6:4 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 6:4 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 6:4 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:4 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:4 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:4 matches cg 6 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 7 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 6:5 len 164 Aug 04 11:08:42 gfs_controld gfs2 match_change 6:5 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 6:5 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 6:5 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:5 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:5 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:5 skip 6 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:5 matches cg 7 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 6 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 7:1 len 128 Aug 04 11:08:42 gfs_controld gfs2 match_change 7:1 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:1 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:1 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:1 matches cg 4 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 6 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 7:2 len 140 Aug 04 11:08:42 gfs_controld gfs2 match_change 7:2 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:2 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:2 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:2 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 7:2 matches cg 5 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 6 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 7:3 len 152 Aug 04 11:08:42 gfs_controld gfs2 match_change 7:3 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:3 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:3 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:3 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 7:3 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 7:3 matches cg 6 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 6 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 8:1 len 140 Aug 04 11:08:42 gfs_controld gfs2 match_change 8:1 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:1 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:1 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:1 skip cg 4 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:1 matches cg 5 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 6 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 8:2 len 152 Aug 04 11:08:42 gfs_controld gfs2 match_change 8:2 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:2 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:2 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:2 skip cg 4 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:2 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 8:2 matches cg 6 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 6 of 7 Aug 04 11:08:42 gfs_controld gfs2 receive_start 8:3 len 164 Aug 04 11:08:42 gfs_controld gfs2 match_change 8:3 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:3 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:3 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:3 skip cg 4 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:3 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 8:3 skip 6 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 8:3 matches cg 7 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 7 need 5 of 7 Aug 04 11:08:42 gfs_controld gfs:mount:gfs2 conf 8 1 0 memb 1 2 3 4 5 6 7 8 join 1 left Aug 04 11:08:42 gfs_controld gfs2 add_change cg 8 joined nodeid 1 Aug 04 11:08:42 gfs_controld gfs2 add_change cg 8 counts member 8 joined 1 remove 0 failed 0 Aug 04 11:08:42 gfs_controld gfs2 wait_conditions skip for zero started_count Aug 04 11:08:42 gfs_controld gfs2 send_start cg 8 id_count 8 om 0 nm 8 oj 0 nj 0 Aug 04 11:08:42 gfs_controld gfs2 receive_start 2:6 len 152 Aug 04 11:08:42 gfs_controld gfs2 match_change 2:6 skip 1 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:6 skip 2 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:6 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:6 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:6 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:6 matches cg 6 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 8 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 2:7 len 164 Aug 04 11:08:42 gfs_controld gfs2 match_change 2:7 skip 1 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:7 skip 2 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:7 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:7 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:7 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:7 skip 6 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:7 matches cg 7 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 8 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 3:1 len 152 Aug 04 11:08:42 gfs_controld gfs2 match_change 3:1 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:1 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:1 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:1 skip cg 4 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:1 skip cg 5 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:1 matches cg 6 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 8 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 3:2 len 164 Aug 04 11:08:42 gfs_controld gfs2 match_change 3:2 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:2 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:2 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:2 skip cg 4 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:2 skip cg 5 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:2 skip 6 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 3:2 matches cg 7 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 8 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 3:3 len 176 Aug 04 11:08:42 gfs_controld gfs2 match_change 3:3 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:3 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:3 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:3 skip cg 4 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:3 skip cg 5 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 3:3 skip 6 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 3:3 skip 7 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 3:3 matches cg 8 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 7 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 4:1 len 164 Aug 04 11:08:42 gfs_controld gfs2 match_change 4:1 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 4:1 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 4:1 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 4:1 skip cg 4 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 4:1 skip cg 5 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 4:1 skip cg 6 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 4:1 matches cg 7 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 7 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 4:2 len 176 Aug 04 11:08:42 gfs_controld gfs2 match_change 4:2 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 4:2 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 4:2 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 4:2 skip cg 4 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 4:2 skip cg 5 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 4:2 skip cg 6 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 4:2 skip 7 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 4:2 matches cg 8 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 6 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 5:6 len 164 Aug 04 11:08:42 gfs_controld gfs2 match_change 5:6 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 5:6 skip 2 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:6 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:6 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:6 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:6 skip 6 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:6 matches cg 7 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 6 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 5:7 len 176 Aug 04 11:08:42 gfs_controld gfs2 match_change 5:7 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 5:7 skip 2 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:7 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:7 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:7 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:7 skip 6 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:7 skip 7 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 5:7 matches cg 8 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 5 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 6:6 len 176 Aug 04 11:08:42 gfs_controld gfs2 match_change 6:6 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 6:6 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 6:6 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:6 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:6 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:6 skip 6 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:6 skip 7 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 6:6 matches cg 8 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 4 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 7:4 len 164 Aug 04 11:08:42 gfs_controld gfs2 match_change 7:4 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:4 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:4 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:4 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 7:4 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 7:4 skip 6 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 7:4 matches cg 7 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 4 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 7:5 len 176 Aug 04 11:08:42 gfs_controld gfs2 match_change 7:5 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:5 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:5 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 7:5 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 7:5 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 7:5 skip 6 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 7:5 skip 7 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 7:5 matches cg 8 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 3 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 8:4 len 176 Aug 04 11:08:42 gfs_controld gfs2 match_change 8:4 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:4 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:4 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:4 skip cg 4 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 8:4 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 8:4 skip 6 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 8:4 skip 7 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 8:4 matches cg 8 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 2 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 1:1 len 176 Aug 04 11:08:42 gfs_controld gfs2 match_change 1:1 skip cg 1 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 1:1 skip cg 2 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 1:1 skip cg 3 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 1:1 skip cg 4 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 1:1 skip cg 5 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 1:1 skip cg 6 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 1:1 skip cg 7 sender not member Aug 04 11:08:42 gfs_controld gfs2 match_change 1:1 matches cg 8 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 need 1 of 8 Aug 04 11:08:42 gfs_controld gfs2 receive_start 2:8 len 176 Aug 04 11:08:42 gfs_controld gfs2 match_change 2:8 skip 1 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:8 skip 2 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:8 skip 3 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:8 skip 4 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:8 skip 5 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:8 skip 6 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:8 skip 7 already start Aug 04 11:08:42 gfs_controld gfs2 match_change 2:8 matches cg 8 Aug 04 11:08:42 gfs_controld gfs2 wait_messages cg 8 got all 8 Aug 04 11:08:42 gfs_controld gfs2 pick_first_recovery_master low 1 old 0 Aug 04 11:08:42 gfs_controld gfs2 sync_state all_nodes_new first_recovery_needed master 1 Aug 04 11:08:42 gfs_controld gfs2 create_old_nodes all new Aug 04 11:08:42 gfs_controld gfs2 create_new_nodes 1 ro 0 spect 0 Aug 04 11:08:42 gfs_controld gfs2 create_new_nodes 2 ro 0 spect 0 Aug 04 11:08:42 gfs_controld gfs2 create_new_nodes 3 ro 0 spect 0 Aug 04 11:08:42 gfs_controld gfs2 create_new_nodes 4 ro 0 spect 0 Aug 04 11:08:42 gfs_controld gfs2 create_new_nodes 5 ro 0 spect 0 Aug 04 11:08:42 gfs_controld gfs2 create_new_nodes 6 ro 0 spect 0 Aug 04 11:08:42 gfs_controld gfs2 create_new_nodes 7 ro 0 spect 0 Aug 04 11:08:42 gfs_controld gfs2 create_new_nodes 8 ro 0 spect 0 Aug 04 11:08:42 gfs_controld gfs2 create_failed_journals all new Aug 04 11:08:42 gfs_controld gfs2 create_new_journals 1 gets jid 0 Aug 04 11:08:42 gfs_controld gfs2 create_new_journals 2 gets jid 1 Aug 04 11:08:42 gfs_controld gfs2 create_new_journals 3 gets jid 2 Aug 04 11:08:42 gfs_controld gfs2 create_new_journals 4 gets jid 3 Aug 04 11:08:42 gfs_controld gfs2 create_new_journals 5 gets jid 4 Aug 04 11:08:42 gfs_controld gfs2 create_new_journals 6 gets jid 5 Aug 04 11:08:42 gfs_controld gfs2 create_new_journals 7 gets jid 6 Aug 04 11:08:42 gfs_controld gfs2 create_new_journals 8 gets jid 7 Aug 04 11:08:42 gfs_controld gfs2 receive_first_recovery_done from 1 master 1 mount_client_notified 0 Aug 04 11:08:42 gfs_controld gfs2 start_kernel cg 8 member_count 8 Aug 04 11:08:42 gfs_controld gfs2 set /sys/fs/gfs2/fabbione:gfs2/lock_module/block to 0 Aug 04 11:08:42 gfs_controld gfs2 set open /sys/fs/gfs2/fabbione:gfs2/lock_module/block error -1 2 Aug 04 11:08:42 gfs_controld gfs2 client_reply_join_full ci 5 result 0 hostdata=jid=1:id=1953800822:first=0 Aug 04 11:08:42 gfs_controld client_reply_join gfs2 ci 5 result 0 Aug 04 11:08:42 gfs_controld gfs2 wait_recoveries done Aug 04 11:08:42 gfs_controld gfs2 receive_mount_done from 1 result 0 Aug 04 11:08:42 gfs_controld gfs2 wait_recoveries done Aug 04 11:08:42 gfs_controld uevent add gfs2 /fs/gfs2/fabbione:gfs2 Aug 04 11:08:42 gfs_controld gfs2 ping_kernel_mount 0 Aug 04 11:08:43 gfs_controld uevent change gfs2 /fs/gfs2/fabbione:gfs2 Aug 04 11:08:43 gfs_controld gfs2 recovery_uevent jid 1 ignore Aug 04 11:08:43 gfs_controld uevent online gfs2 /fs/gfs2/fabbione:gfs2 Aug 04 11:08:43 gfs_controld gfs2 ping_kernel_mount 0 Aug 04 11:08:43 gfs_controld mount_done: gfs2 result 0 Aug 04 11:08:43 gfs_controld connection 5 read error -1 Aug 04 11:08:43 gfs_controld gfs2 receive_mount_done from 2 result 0 Aug 04 11:08:43 gfs_controld gfs2 wait_recoveries done Aug 04 11:08:43 gfs_controld gfs2 receive_mount_done from 6 result 0 Aug 04 11:08:43 gfs_controld gfs2 wait_recoveries done Aug 04 11:08:43 gfs_controld gfs2 receive_mount_done from 3 result 0 Aug 04 11:08:43 gfs_controld gfs2 wait_recoveries done Aug 04 11:08:43 gfs_controld gfs2 receive_mount_done from 7 result 0 Aug 04 11:08:43 gfs_controld gfs2 wait_recoveries done Aug 04 11:08:44 gfs_controld gfs2 receive_mount_done from 4 result 0 Aug 04 11:08:44 gfs_controld gfs2 wait_recoveries done Aug 04 11:08:44 gfs_controld gfs2 receive_mount_done from 5 result 0 Aug 04 11:08:44 gfs_controld gfs2 wait_recoveries done Aug 04 11:08:44 gfs_controld gfs2 receive_mount_done from 8 result 0 Aug 04 11:08:44 gfs_controld gfs2 wait_recoveries done Aug 04 11:13:47 gfs_controld cluster node 5 removed Aug 04 11:13:47 gfs_controld cluster node 6 removed Aug 04 11:13:47 gfs_controld cluster node 7 removed Aug 04 11:13:47 gfs_controld cluster node 5 added Aug 04 11:13:47 gfs_controld cluster node 6 added Aug 04 11:13:47 gfs_controld cluster node 7 added Aug 04 11:14:01 gfs_controld gfs:controld conf 7 0 1 memb 1 2 3 4 6 7 8 join left 5 Aug 04 11:14:01 gfs_controld gfs:controld conf 6 0 1 memb 1 2 3 4 7 8 join left 6 Aug 04 11:14:01 gfs_controld gfs:controld conf 5 0 1 memb 1 2 3 4 8 join left 7 Aug 04 11:14:01 gfs_controld gfs:mount:gfs2 conf 7 0 1 memb 1 2 3 4 6 7 8 join left 5 Aug 04 11:14:01 gfs_controld gfs2 add_change cg 9 remove nodeid 5 reason 3 Aug 04 11:14:01 gfs_controld gfs2 add_change cg 9 counts member 7 joined 0 remove 1 failed 1 Aug 04 11:14:01 gfs_controld gfs2 stop_kernel Aug 04 11:14:01 gfs_controld gfs2 set /sys/fs/gfs2/fabbione:gfs2/lock_module/block to 1 Aug 04 11:14:01 gfs_controld gfs2 check_dlm_notify nodeid 5 begin Aug 04 11:14:01 gfs_controld gfs:mount:gfs2 conf 6 0 1 memb 1 2 3 4 7 8 join left 6 Aug 04 11:14:01 gfs_controld gfs2 add_change cg 10 remove nodeid 6 reason 3 Aug 04 11:14:01 gfs_controld gfs2 add_change cg 10 counts member 6 joined 0 remove 1 failed 1 Aug 04 11:14:01 gfs_controld gfs:mount:gfs2 conf 5 0 1 memb 1 2 3 4 8 join left 7 Aug 04 11:14:01 gfs_controld gfs2 add_change cg 11 remove nodeid 7 reason 3 Aug 04 11:14:01 gfs_controld gfs2 add_change cg 11 counts member 5 joined 0 remove 1 failed 1 Aug 04 11:14:01 gfs_controld gfs2 process_dlmcontrol notified nodeid 5 result 0 Aug 04 11:14:01 gfs_controld gfs2 check_dlm_notify nodeid 6 begin Aug 04 11:14:01 gfs_controld gfs2 process_dlmcontrol notified nodeid 6 result 0 Aug 04 11:14:01 gfs_controld gfs2 check_dlm_notify nodeid 7 begin Aug 04 11:14:01 gfs_controld gfs2 process_dlmcontrol notified nodeid 7 result 0 Aug 04 11:14:01 gfs_controld gfs2 check_dlm_notify done Aug 04 11:14:01 gfs_controld gfs2 send_start cg 11 id_count 8 om 5 nm 0 oj 0 nj 3 Aug 04 11:14:01 gfs_controld gfs2 receive_start 8:7 len 176 Aug 04 11:14:01 gfs_controld gfs2 match_change 8:7 skip cg 9 expect counts 7 0 1 1 Aug 04 11:14:01 gfs_controld gfs2 match_change 8:7 skip cg 10 expect counts 6 0 1 1 Aug 04 11:14:01 gfs_controld gfs2 match_change 8:7 matches cg 11 Aug 04 11:14:01 gfs_controld gfs2 wait_messages cg 11 need 4 of 5 Aug 04 11:14:01 gfs_controld gfs2 receive_start 2:11 len 176 Aug 04 11:14:01 gfs_controld gfs2 match_change 2:11 skip cg 9 expect counts 7 0 1 1 Aug 04 11:14:01 gfs_controld gfs2 match_change 2:11 skip cg 10 expect counts 6 0 1 1 Aug 04 11:14:01 gfs_controld gfs2 match_change 2:11 matches cg 11 Aug 04 11:14:01 gfs_controld gfs2 wait_messages cg 11 need 3 of 5 Aug 04 11:14:01 gfs_controld gfs2 receive_start 3:6 len 176 Aug 04 11:14:01 gfs_controld gfs2 match_change 3:6 skip cg 9 expect counts 7 0 1 1 Aug 04 11:14:01 gfs_controld gfs2 match_change 3:6 skip cg 10 expect counts 6 0 1 1 Aug 04 11:14:01 gfs_controld gfs2 match_change 3:6 matches cg 11 Aug 04 11:14:01 gfs_controld gfs2 wait_messages cg 11 need 2 of 5 Aug 04 11:14:01 gfs_controld gfs2 receive_start 1:4 len 176 Aug 04 11:14:01 gfs_controld gfs2 match_change 1:4 skip cg 9 expect counts 7 0 1 1 Aug 04 11:14:01 gfs_controld gfs2 match_change 1:4 skip cg 10 expect counts 6 0 1 1 Aug 04 11:14:01 gfs_controld gfs2 match_change 1:4 matches cg 11 Aug 04 11:14:01 gfs_controld gfs2 wait_messages cg 11 need 1 of 5 Aug 04 11:14:01 gfs_controld gfs2 receive_start 4:5 len 176 Aug 04 11:14:01 gfs_controld gfs2 match_change 4:5 skip cg 9 expect counts 7 0 1 1 Aug 04 11:14:01 gfs_controld gfs2 match_change 4:5 skip cg 10 expect counts 6 0 1 1 Aug 04 11:14:01 gfs_controld gfs2 match_change 4:5 matches cg 11 Aug 04 11:14:01 gfs_controld gfs2 wait_messages cg 11 got all 5 Aug 04 11:14:01 gfs_controld gfs2 sync_state first_recovery_msg Aug 04 11:14:01 gfs_controld gfs2 set_failed_journals jid 6 nodeid 7 Aug 04 11:14:01 gfs_controld gfs2 set_failed_journals jid 5 nodeid 6 Aug 04 11:14:01 gfs_controld gfs2 set_failed_journals jid 4 nodeid 5 Aug 04 11:14:01 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:01 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:01 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:01 gfs_controld gfs2 start_journal_recovery jid 6 Aug 04 11:14:01 gfs_controld gfs2 set /sys/fs/gfs2/fabbione:gfs2/lock_module/recover to 6 Aug 04 11:14:32 gfs_controld cluster node 5 removed Aug 04 11:14:32 gfs_controld cluster node 6 removed Aug 04 11:14:32 gfs_controld cluster node 7 removed Aug 04 11:14:33 gfs_controld gfs2 receive_recovery_result from 4 jid 6 result 308 Aug 04 11:14:33 gfs_controld gfs2 jid 6 failed_recovery_count 1 Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:33 gfs_controld gfs2 receive_recovery_result from 8 jid 6 result 308 Aug 04 11:14:33 gfs_controld gfs2 jid 6 failed_recovery_count 2 Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:33 gfs_controld gfs2 receive_recovery_result from 3 jid 6 result 308 Aug 04 11:14:33 gfs_controld gfs2 jid 6 failed_recovery_count 3 Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:33 gfs_controld uevent change gfs2 /fs/gfs2/fabbione:gfs2 Aug 04 11:14:33 gfs_controld gfs2 recovery_uevent jid 6 status 308 local_recovery_done 0 needs_recovery 1 Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:33 gfs_controld gfs2 start_journal_recovery jid 5 Aug 04 11:14:33 gfs_controld gfs2 set /sys/fs/gfs2/fabbione:gfs2/lock_module/recover to 5 Aug 04 11:14:33 gfs_controld gfs2 receive_recovery_result from 2 jid 6 result 308 Aug 04 11:14:33 gfs_controld gfs2 jid 6 failed_recovery_count 4 Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:33 gfs_controld gfs2 receive_recovery_result from 3 jid 5 result 308 Aug 04 11:14:33 gfs_controld gfs2 jid 5 failed_recovery_count 1 Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:33 gfs_controld uevent change gfs2 /fs/gfs2/fabbione:gfs2 Aug 04 11:14:33 gfs_controld gfs2 recovery_uevent jid 5 status 308 local_recovery_done 0 needs_recovery 1 Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:33 gfs_controld gfs2 start_journal_recovery jid 4 Aug 04 11:14:33 gfs_controld gfs2 set /sys/fs/gfs2/fabbione:gfs2/lock_module/recover to 4 Aug 04 11:14:33 gfs_controld gfs2 receive_recovery_result from 4 jid 5 result 308 Aug 04 11:14:33 gfs_controld gfs2 jid 5 failed_recovery_count 2 Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:33 gfs_controld gfs2 receive_recovery_result from 2 jid 5 result 308 Aug 04 11:14:33 gfs_controld gfs2 jid 5 failed_recovery_count 3 Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:33 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:34 gfs_controld gfs2 receive_recovery_result from 4 jid 4 result 308 Aug 04 11:14:34 gfs_controld gfs2 jid 4 failed_recovery_count 1 Aug 04 11:14:34 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:34 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:34 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:34 gfs_controld uevent change gfs2 /fs/gfs2/fabbione:gfs2 Aug 04 11:14:34 gfs_controld gfs2 recovery_uevent jid 4 status 308 local_recovery_done 0 needs_recovery 1 Aug 04 11:14:34 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:34 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:34 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:34 gfs_controld gfs2 receive_recovery_result from 2 jid 4 result 308 Aug 04 11:14:34 gfs_controld gfs2 jid 4 failed_recovery_count 2 Aug 04 11:14:34 gfs_controld gfs2 wait_recoveries jid 6 nodeid 7 unrecovered Aug 04 11:14:34 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:34 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:34 gfs_controld gfs2 receive_recovery_result from 1 jid 6 result 309 Aug 04 11:14:34 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:34 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:36 gfs_controld gfs2 receive_recovery_result from 1 jid 5 result 308 Aug 04 11:14:36 gfs_controld gfs2 jid 5 failed_recovery_count 4 Aug 04 11:14:36 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:36 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:36 gfs_controld gfs2 receive_recovery_result from 1 jid 4 result 308 Aug 04 11:14:36 gfs_controld gfs2 jid 4 failed_recovery_count 3 Aug 04 11:14:36 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:36 gfs_controld gfs2 wait_recoveries jid 4 nodeid 5 unrecovered Aug 04 11:14:37 gfs_controld gfs2 receive_recovery_result from 3 jid 4 result 309 Aug 04 11:14:37 gfs_controld gfs2 wait_recoveries jid 5 nodeid 6 unrecovered Aug 04 11:14:37 gfs_controld gfs2 receive_recovery_result from 8 jid 5 result 309 Aug 04 11:14:37 gfs_controld gfs2 wait_recoveries done Aug 04 11:14:37 gfs_controld gfs2 apply_recovery start_kernel Aug 04 11:14:37 gfs_controld gfs2 start_kernel cg 11 member_count 5 Aug 04 11:14:37 gfs_controld gfs2 set /sys/fs/gfs2/fabbione:gfs2/lock_module/block to 0 Aug 04 11:18:49 gfs_controld cluster node 1 removed Aug 04 11:18:49 gfs_controld cluster node 3 removed Aug 04 11:18:49 gfs_controld cluster node 4 removed Aug 04 11:18:49 gfs_controld cluster node 8 removed Aug 04 11:18:50 gfs_controld cluster node 3 added Aug 04 11:18:50 gfs_controld cluster node 4 added Aug 04 11:18:50 gfs_controld cluster node 8 added Aug 04 11:18:50 gfs_controld cluster node 1 added Aug 04 11:18:50 gfs_controld gfs:controld conf 4 0 1 memb 2 3 4 8 join left 1 Aug 04 11:18:50 gfs_controld gfs:controld conf 3 0 1 memb 2 3 4 join left 8 Aug 04 11:18:50 gfs_controld gfs:mount:gfs2 conf 4 0 1 memb 2 3 4 8 join left 1 Aug 04 11:18:50 gfs_controld gfs2 add_change cg 12 remove nodeid 1 reason 3 Aug 04 11:18:50 gfs_controld gfs2 add_change cg 12 counts member 4 joined 0 remove 1 failed 1 Aug 04 11:18:50 gfs_controld gfs2 stop_kernel Aug 04 11:18:50 gfs_controld gfs2 set /sys/fs/gfs2/fabbione:gfs2/lock_module/block to 1 Aug 04 11:18:50 gfs_controld gfs2 check_dlm_notify nodeid 1 begin Aug 04 11:18:50 gfs_controld gfs:mount:gfs2 conf 3 0 1 memb 2 3 4 join left 8 Aug 04 11:18:50 gfs_controld gfs2 add_change cg 13 remove nodeid 8 reason 3 Aug 04 11:18:50 gfs_controld gfs2 add_change cg 13 counts member 3 joined 0 remove 1 failed 1 Aug 04 11:18:50 gfs_controld gfs2 process_dlmcontrol notified nodeid 1 result 0 Aug 04 11:18:50 gfs_controld gfs2 check_dlm_notify nodeid 8 begin Aug 04 11:18:50 gfs_controld gfs2 process_dlmcontrol notified nodeid 8 result 0 Aug 04 11:18:50 gfs_controld gfs2 check_dlm_notify done Aug 04 11:18:50 gfs_controld gfs2 send_start cg 13 id_count 5 om 3 nm 0 oj 0 nj 2 Aug 04 11:18:50 gfs_controld gfs2 receive_start 2:13 len 140 Aug 04 11:18:50 gfs_controld gfs2 match_change 2:13 skip cg 12 expect counts 4 0 1 1 Aug 04 11:18:50 gfs_controld gfs2 match_change 2:13 matches cg 13 Aug 04 11:18:50 gfs_controld gfs2 wait_messages cg 13 need 2 of 3 Aug 04 11:18:50 gfs_controld gfs2 receive_start 3:8 len 140 Aug 04 11:18:50 gfs_controld gfs2 match_change 3:8 skip cg 12 expect counts 4 0 1 1 Aug 04 11:18:50 gfs_controld gfs2 match_change 3:8 matches cg 13 Aug 04 11:18:50 gfs_controld gfs2 wait_messages cg 13 need 1 of 3 Aug 04 11:18:50 gfs_controld gfs2 receive_start 4:7 len 140 Aug 04 11:18:50 gfs_controld gfs2 match_change 4:7 skip cg 12 expect counts 4 0 1 1 Aug 04 11:18:50 gfs_controld gfs2 match_change 4:7 matches cg 13 Aug 04 11:18:50 gfs_controld gfs2 wait_messages cg 13 got all 3 Aug 04 11:18:50 gfs_controld gfs2 sync_state first_recovery_msg Aug 04 11:18:50 gfs_controld gfs2 set_failed_journals jid 7 nodeid 8 Aug 04 11:18:50 gfs_controld gfs2 set_failed_journals jid 0 nodeid 1 Aug 04 11:18:50 gfs_controld gfs2 wait_recoveries jid 7 nodeid 8 unrecovered Aug 04 11:18:50 gfs_controld gfs2 wait_recoveries jid 0 nodeid 1 unrecovered Aug 04 11:18:50 gfs_controld gfs2 start_journal_recovery jid 7 Aug 04 11:18:50 gfs_controld gfs2 set /sys/fs/gfs2/fabbione:gfs2/lock_module/recover to 7 Aug 04 11:19:19 gfs_controld cluster node 1 removed Aug 04 11:19:19 gfs_controld cluster node 8 removed