Aug 04 11:28:22 gfs_controld gfs_controld 3.0.12 started
Aug 04 11:28:22 gfs_controld group_mode 3 compat 0
Aug 04 11:28:22 gfs_controld setup_cpg_daemon 13
Aug 04 11:28:22 gfs_controld gfs:controld conf 4 1 0 memb 3 5 6 7 join 3 left
Aug 04 11:28:22 gfs_controld run protocol from nodeid 5
Aug 04 11:28:22 gfs_controld daemon run 1.1.1 max 1.1.1 kernel run 1.1.1 max 1.1.1
Aug 04 11:28:22 gfs_controld gfs:controld conf 5 1 0 memb 3 5 6 7 8 join 8 left
Aug 04 11:28:22 gfs_controld gfs:controld conf 6 1 0 memb 2 3 5 6 7 8 join 2 left
Aug 04 11:28:22 gfs_controld gfs:controld conf 7 1 0 memb 2 3 4 5 6 7 8 join 4 left
Aug 04 11:28:22 gfs_controld gfs:controld conf 8 1 0 memb 1 2 3 4 5 6 7 8 join 1 left
Aug 04 11:28:40 gfs_controld client connection 5 fd 16
Aug 04 11:28:40 gfs_controld join: /mnt gfs2 lock_dlm fabbione:gfs2 rw /dev/vdb2
Aug 04 11:28:40 gfs_controld gfs2 join: cluster name matches: fabbione
Aug 04 11:28:40 gfs_controld gfs2 process_dlmcontrol register 0
Aug 04 11:28:40 gfs_controld gfs:mount:gfs2 conf 7 1 0 memb 1 2 3 5 6 7 8 join 3 left
Aug 04 11:28:40 gfs_controld gfs2 add_change cg 1 joined nodeid 3
Aug 04 11:28:40 gfs_controld gfs2 add_change cg 1 we joined
Aug 04 11:28:40 gfs_controld gfs2 add_change cg 1 counts member 7 joined 1 remove 0 failed 0
Aug 04 11:28:40 gfs_controld gfs2 wait_conditions skip for zero started_count
Aug 04 11:28:40 gfs_controld gfs2 send_start cg 1 id_count 7 om 0 nm 7 oj 0 nj 0
Aug 04 11:28:40 gfs_controld gfs:mount:gfs2 conf 8 1 0 memb 1 2 3 4 5 6 7 8 join 4 left
Aug 04 11:28:40 gfs_controld gfs2 add_change cg 2 joined nodeid 4
Aug 04 11:28:40 gfs_controld gfs2 add_change cg 2 counts member 8 joined 1 remove 0 failed 0
Aug 04 11:28:40 gfs_controld gfs2 wait_conditions skip for zero started_count
Aug 04 11:28:40 gfs_controld gfs2 send_start cg 2 id_count 8 om 0 nm 8 oj 0 nj 0
Aug 04 11:28:40 gfs_controld gfs2 receive_start 5:1 len 104
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:1 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:1 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 5:1 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 8 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 5:2 len 116
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:2 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:2 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 5:2 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 8 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 5:3 len 128
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:3 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:3 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 5:3 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 8 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 5:4 len 140
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:4 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:4 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 5:4 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 8 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 5:5 len 152
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:5 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:5 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 5:5 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 8 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 5:6 len 164
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:6 matches cg 1
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 8 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 6:1 len 116
Aug 04 11:28:40 gfs_controld gfs2 match_change 6:1 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 6:1 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 6:1 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 8 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 6:2 len 128
Aug 04 11:28:40 gfs_controld gfs2 match_change 6:2 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 6:2 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 6:2 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 8 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 6:3 len 140
Aug 04 11:28:40 gfs_controld gfs2 match_change 6:3 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 6:3 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 6:3 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 8 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 6:4 len 152
Aug 04 11:28:40 gfs_controld gfs2 match_change 6:4 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 6:4 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 6:4 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 8 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 6:5 len 164
Aug 04 11:28:40 gfs_controld gfs2 match_change 6:5 matches cg 1
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 8 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 6:6 len 176
Aug 04 11:28:40 gfs_controld gfs2 match_change 6:6 skip 1 already start
Aug 04 11:28:40 gfs_controld gfs2 match_change 6:6 matches cg 2
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 7 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 7:1 len 128
Aug 04 11:28:40 gfs_controld gfs2 match_change 7:1 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 7:1 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 7:1 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 7 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 7:2 len 140
Aug 04 11:28:40 gfs_controld gfs2 match_change 7:2 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 7:2 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 7:2 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 7 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 7:3 len 152
Aug 04 11:28:40 gfs_controld gfs2 match_change 7:3 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 7:3 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 7:3 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 7 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 7:4 len 164
Aug 04 11:28:40 gfs_controld gfs2 match_change 7:4 matches cg 1
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 7 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 7:5 len 176
Aug 04 11:28:40 gfs_controld gfs2 match_change 7:5 skip 1 already start
Aug 04 11:28:40 gfs_controld gfs2 match_change 7:5 matches cg 2
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 6 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 8:1 len 140
Aug 04 11:28:40 gfs_controld gfs2 match_change 8:1 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 8:1 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 8:1 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 6 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 8:2 len 152
Aug 04 11:28:40 gfs_controld gfs2 match_change 8:2 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 8:2 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 8:2 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 6 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 8:3 len 164
Aug 04 11:28:40 gfs_controld gfs2 match_change 8:3 matches cg 1
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 6 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 8:4 len 176
Aug 04 11:28:40 gfs_controld gfs2 match_change 8:4 skip 1 already start
Aug 04 11:28:40 gfs_controld gfs2 match_change 8:4 matches cg 2
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 5 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 1:1 len 152
Aug 04 11:28:40 gfs_controld gfs2 match_change 1:1 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 1:1 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 1:1 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 5 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 1:2 len 164
Aug 04 11:28:40 gfs_controld gfs2 match_change 1:2 matches cg 1
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 5 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 1:3 len 176
Aug 04 11:28:40 gfs_controld gfs2 match_change 1:3 skip 1 already start
Aug 04 11:28:40 gfs_controld gfs2 match_change 1:3 matches cg 2
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 4 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 2:6 len 152
Aug 04 11:28:40 gfs_controld gfs2 match_change 2:6 skip cg 1 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 match_change 2:6 skip cg 2 we are not in members
Aug 04 11:28:40 gfs_controld gfs2 find_change 2:6 no match
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 4 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 2:7 len 164
Aug 04 11:28:40 gfs_controld gfs2 match_change 2:7 matches cg 1
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 4 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 2:8 len 176
Aug 04 11:28:40 gfs_controld gfs2 match_change 2:8 skip 1 already start
Aug 04 11:28:40 gfs_controld gfs2 match_change 2:8 matches cg 2
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 3 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 3:1 len 164
Aug 04 11:28:40 gfs_controld gfs2 match_change 3:1 matches cg 1
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 3 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 3:2 len 176
Aug 04 11:28:40 gfs_controld gfs2 match_change 3:2 skip 1 already start
Aug 04 11:28:40 gfs_controld gfs2 match_change 3:2 matches cg 2
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 2 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 4:1 len 176
Aug 04 11:28:40 gfs_controld gfs2 match_change 4:1 skip cg 1 sender not member
Aug 04 11:28:40 gfs_controld gfs2 match_change 4:1 matches cg 2
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 need 1 of 8
Aug 04 11:28:40 gfs_controld gfs2 receive_start 5:7 len 176
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:7 skip 1 already start
Aug 04 11:28:40 gfs_controld gfs2 match_change 5:7 matches cg 2
Aug 04 11:28:40 gfs_controld gfs2 wait_messages cg 2 got all 8
Aug 04 11:28:40 gfs_controld gfs2 pick_first_recovery_master low 1 old 0
Aug 04 11:28:40 gfs_controld gfs2 sync_state all_nodes_new first_recovery_needed master 1
Aug 04 11:28:40 gfs_controld gfs2 create_old_nodes all new
Aug 04 11:28:40 gfs_controld gfs2 create_new_nodes 1 ro 0 spect 0
Aug 04 11:28:40 gfs_controld gfs2 create_new_nodes 2 ro 0 spect 0
Aug 04 11:28:40 gfs_controld gfs2 create_new_nodes 3 ro 0 spect 0
Aug 04 11:28:40 gfs_controld gfs2 create_new_nodes 4 ro 0 spect 0
Aug 04 11:28:40 gfs_controld gfs2 create_new_nodes 5 ro 0 spect 0
Aug 04 11:28:40 gfs_controld gfs2 create_new_nodes 6 ro 0 spect 0
Aug 04 11:28:40 gfs_controld gfs2 create_new_nodes 7 ro 0 spect 0
Aug 04 11:28:40 gfs_controld gfs2 create_new_nodes 8 ro 0 spect 0
Aug 04 11:28:40 gfs_controld gfs2 create_failed_journals all new
Aug 04 11:28:40 gfs_controld gfs2 create_new_journals 1 gets jid 0
Aug 04 11:28:40 gfs_controld gfs2 create_new_journals 2 gets jid 1
Aug 04 11:28:40 gfs_controld gfs2 create_new_journals 3 gets jid 2
Aug 04 11:28:40 gfs_controld gfs2 create_new_journals 4 gets jid 3
Aug 04 11:28:40 gfs_controld gfs2 create_new_journals 5 gets jid 4
Aug 04 11:28:40 gfs_controld gfs2 create_new_journals 6 gets jid 5
Aug 04 11:28:40 gfs_controld gfs2 create_new_journals 7 gets jid 6
Aug 04 11:28:40 gfs_controld gfs2 create_new_journals 8 gets jid 7
Aug 04 11:28:40 gfs_controld gfs2 receive_first_recovery_done from 1 master 1 mount_client_notified 0
Aug 04 11:28:40 gfs_controld gfs2 start_kernel cg 2 member_count 8
Aug 04 11:28:40 gfs_controld gfs2 set /sys/fs/gfs2/fabbione:gfs2/lock_module/block to 0
Aug 04 11:28:40 gfs_controld gfs2 set open /sys/fs/gfs2/fabbione:gfs2/lock_module/block error -1 2
Aug 04 11:28:40 gfs_controld gfs2 client_reply_join_full ci 5 result 0 hostdata=jid=2:id=1953800822:first=0
Aug 04 11:28:40 gfs_controld client_reply_join gfs2 ci 5 result 0
Aug 04 11:28:40 gfs_controld gfs2 wait_recoveries done
Aug 04 11:28:40 gfs_controld gfs2 receive_mount_done from 1 result 0
Aug 04 11:28:40 gfs_controld gfs2 wait_recoveries done
Aug 04 11:28:40 gfs_controld uevent add gfs2 /fs/gfs2/fabbione:gfs2
Aug 04 11:28:40 gfs_controld gfs2 ping_kernel_mount 0
Aug 04 11:28:41 gfs_controld gfs2 receive_mount_done from 2 result 0
Aug 04 11:28:41 gfs_controld gfs2 wait_recoveries done
Aug 04 11:28:41 gfs_controld uevent change gfs2 /fs/gfs2/fabbione:gfs2
Aug 04 11:28:41 gfs_controld gfs2 recovery_uevent jid 2 ignore
Aug 04 11:28:41 gfs_controld uevent online gfs2 /fs/gfs2/fabbione:gfs2
Aug 04 11:28:41 gfs_controld gfs2 ping_kernel_mount 0
Aug 04 11:28:41 gfs_controld mount_done: gfs2 result 0
Aug 04 11:28:41 gfs_controld connection 5 read error -1
Aug 04 11:28:41 gfs_controld gfs2 receive_mount_done from 3 result 0
Aug 04 11:28:41 gfs_controld gfs2 wait_recoveries done
Aug 04 11:28:41 gfs_controld gfs2 receive_mount_done from 4 result 0
Aug 04 11:28:41 gfs_controld gfs2 wait_recoveries done
Aug 04 11:28:41 gfs_controld gfs2 receive_mount_done from 5 result 0
Aug 04 11:28:41 gfs_controld gfs2 wait_recoveries done
Aug 04 11:28:42 gfs_controld gfs2 receive_mount_done from 6 result 0
Aug 04 11:28:42 gfs_controld gfs2 wait_recoveries done
Aug 04 11:28:42 gfs_controld gfs2 receive_mount_done from 7 result 0
Aug 04 11:28:42 gfs_controld gfs2 wait_recoveries done
Aug 04 11:28:42 gfs_controld gfs2 receive_mount_done from 8 result 0
Aug 04 11:28:42 gfs_controld gfs2 wait_recoveries done
Aug 04 11:31:07 gfs_controld cluster node 1 removed
Aug 04 11:31:07 gfs_controld cluster node 5 removed
Aug 04 11:31:07 gfs_controld cluster node 6 removed
Aug 04 11:31:07 gfs_controld cluster node 7 removed
Aug 04 11:31:23 gfs_controld cluster node 5 added
Aug 04 11:31:23 gfs_controld cluster node 6 added
Aug 04 11:31:23 gfs_controld cluster node 7 added
Aug 04 11:31:24 gfs_controld cluster node 1 added
Aug 04 11:31:33 gfs_controld gfs:controld conf 7 0 1 memb 1 3 4 5 6 7 8 join left 2
Aug 04 11:31:33 gfs_controld gfs:controld conf 6 0 1 memb 1 4 5 6 7 8 join left 3
Aug 04 11:31:33 gfs_controld gfs:mount:gfs2 conf 7 0 1 memb 1 3 4 5 6 7 8 join left 2
Aug 04 11:31:33 gfs_controld gfs2 add_change cg 3 remove nodeid 2 reason 3
Aug 04 11:31:33 gfs_controld gfs2 add_change cg 3 counts member 7 joined 0 remove 1 failed 1
Aug 04 11:31:33 gfs_controld gfs2 stop_kernel
Aug 04 11:31:33 gfs_controld gfs2 set /sys/fs/gfs2/fabbione:gfs2/lock_module/block to 1
Aug 04 11:31:33 gfs_controld gfs2 check_dlm_notify nodeid 2 begin
Aug 04 11:31:33 gfs_controld gfs:mount:gfs2 conf 6 0 1 memb 1 4 5 6 7 8 join left 3
Aug 04 11:31:33 gfs_controld gfs2 add_change cg 4 remove nodeid 3 reason 3
Aug 04 11:31:33 gfs_controld gfs2 add_change cg 4 counts member 6 joined 0 remove 1 failed 1
Aug 04 11:31:33 gfs_controld gfs2 process_dlmcontrol notified nodeid 2 result 0
Aug 04 11:31:33 gfs_controld gfs2 check_dlm_notify nodeid 3 begin
Aug 04 11:31:33 gfs_controld gfs2 process_dlmcontrol notified nodeid 3 result 0
Aug 04 11:31:33 gfs_controld gfs2 check_dlm_notify done
Aug 04 11:31:33 gfs_controld gfs2 send_start cg 4 id_count 8 om 6 nm 0 oj 0 nj 2
Aug 04 11:31:33 gfs_controld cpg_mcast_joined retry 100 start
Aug 04 11:31:33 gfs_controld cpg_mcast_joined error 12 handle 836c40e00000001 start