2012:09:20-08:25:01 abkasg-2 ha_daemon[3650]: id="38A0" severity="info" sys="System" sub="ha" name="--- Node is disabled ---"
2012:09:20-08:25:01 abkasg-2 ha_daemon[3650]: id="38A0" severity="info" sys="System" sub="ha" name="HA daemon shutting down"
2012:09:20-08:25:01 abkasg-2 slon_control[7738]: Exiting...
2012:09:20-08:25:01 abkasg-2 slon_control[7738]: Killing slon reporting [7849]
2012:09:20-08:27:44 abkasg-2 ha_daemon[3677]: id="38A0" severity="info" sys="System" sub="ha" name="Reading cluster configuration"
2012:09:20-08:27:44 abkasg-2 ha_daemon[3677]: id="38A0" severity="info" sys="System" sub="ha" name="Set ASG version to 9.002012"
2012:09:20-08:27:44 abkasg-2 ha_daemon[3677]: id="38A0" severity="info" sys="System" sub="ha" name="Set ASG appliance to 120"
2012:09:20-08:27:44 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Starting ASG HA daemon v1.0.0 in universal time-sharing mode on interface eth3 with name Second_Unten_2"
2012:09:20-08:27:44 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="--- Node is disabled ---"
2012:09:20-08:27:44 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Monitoring interfaces for link beat: eth0 eth1 "
2012:09:20-08:27:49 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Found no master node, taking over!"
2012:09:20-08:27:49 abkasg-2 ha_daemon[3680]: id="38B0" severity="info" sys="System" sub="ha" name="Switching to Master mode"
2012:09:20-08:27:49 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Initdead time over"
2012:09:20-08:27:49 abkasg-2 slon_control[3722]: Dropping privileges to user postgres with user ID 999 and group ID 999
2012:09:20-08:27:49 abkasg-2 slon_control[3727]: Starting ASG slon control on Node 2
2012:09:20-08:27:53 abkasg-2 slon_control[3727]: Slonik error, process exited with value 255
2012:09:20-08:27:53 abkasg-2 slon_control[3727]: Failed to drop slony schemas for reporting, process exited with value 2!
2012:09:20-08:27:53 abkasg-2 slon_control[3727]: Slonik error, process exited with value 255
2012:09:20-08:27:53 abkasg-2 slon_control[3727]: Failed to drop slony schemas for pop3, process exited with value 2!
2012:09:20-08:27:53 abkasg-2 slon_control[3727]: Slonik error, process exited with value 255
2012:09:20-08:27:53 abkasg-2 slon_control[3727]: Failed to drop slony schemas for hotspot, process exited with value 2!
2012:09:20-08:27:53 abkasg-2 slon_control[3727]: Slonik error, process exited with value 255
2012:09:20-08:27:53 abkasg-2 slon_control[3727]: Failed to drop slony schemas for epp, process exited with value 2!
2012:09:20-08:27:54 abkasg-2 slon_control[3727]: PostgreSQL down!
2012:09:20-08:27:54 abkasg-2 slon_control[3727]: PostgreSQL down!
2012:09:20-08:27:54 abkasg-2 slon_control[3727]: PostgreSQL down!
2012:09:20-08:27:54 abkasg-2 slon_control[3727]: PostgreSQL down!
2012:09:20-08:27:54 abkasg-2 slon_control[3727]: Set mode to MASTER
2012:09:20-08:27:54 abkasg-2 slon_control[3727]: Slonik error, process exited with value 255
2012:09:20-08:27:54 abkasg-2 slon_control[3727]: Failed to drop slony schemas for reporting, process exited with value 2!
2012:09:20-08:27:54 abkasg-2 slon_control[3727]: PostgreSQL down!
2012:09:20-08:27:54 abkasg-2 slon_control[3727]: PostgreSQL down!
2012:09:20-08:27:54 abkasg-2 slon_control[3727]: PostgreSQL down!
2012:09:20-08:27:54 abkasg-2 slon_control[3727]: PostgreSQL down!
2012:09:20-08:28:04 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Reading cluster configuration"
2012:09:20-08:28:04 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Reading cluster configuration"
2012:09:20-08:28:04 abkasg-2 conntrack-tools[4398]: using user-space event filtering
2012:09:20-08:28:04 abkasg-2 conntrack-tools[4398]: netlink event socket buffer size has been set to 2097152 bytes
2012:09:20-08:28:04 abkasg-2 conntrack-tools[4398]: initialization completed
2012:09:20-08:28:04 abkasg-2 conntrack-tools[4399]: -- starting in daemon mode --
2012:09:20-08:28:04 abkasg-2 conntrack-tools[4399]: committing external cache
2012:09:20-08:28:04 abkasg-2 conntrack-tools[4399]: Committed 0 new entries
2012:09:20-08:28:04 abkasg-2 conntrack-tools[4399]: commit has taken 0.000581 seconds
2012:09:20-08:28:04 abkasg-2 conntrack-tools[4399]: flushing caches
2012:09:20-08:28:04 abkasg-2 conntrack-tools[4399]: resync with master table
2012:09:20-08:28:06 abkasg-2 ha_proxy[4442]: Initializing tinyproxy ...
2012:09:20-08:28:06 abkasg-2 ha_proxy[4442]: Reloading config file
2012:09:20-08:28:06 abkasg-2 ha_proxy[4442]: Listening on IP 0.0.0.0
2012:09:20-08:28:06 abkasg-2 ha_proxy[4442]: Setting "Via" header to 'Astaro HA Proxy'
2012:09:20-08:28:06 abkasg-2 ha_proxy[4442]: Adding Port [443] to the list allowed by CONNECT
2012:09:20-08:28:06 abkasg-2 ha_proxy[4442]: Now running as group "nogroup".
2012:09:20-08:28:06 abkasg-2 ha_proxy[4442]: Now running as user "nobody".
2012:09:20-08:28:06 abkasg-2 ha_proxy[4445]: Creating child number 1 of 1 ...
2012:09:20-08:28:06 abkasg-2 ha_proxy[4445]: Finished creating all children.
2012:09:20-08:28:06 abkasg-2 ha_proxy[4445]: Setting the various signals.
2012:09:20-08:28:06 abkasg-2 ha_proxy[4445]: Starting main loop. Accepting connections.
2012:09:20-08:28:08 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Lost link beat on eth0!"
2012:09:20-08:28:28 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Monitoring interfaces for link beat: eth0 eth1 "
2012:09:20-08:28:28 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Lost link beat on eth1!"
2012:09:20-08:28:28 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Found link beat on eth0 again!"
2012:09:20-08:28:29 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Found link beat on eth1 again!"
2012:09:20-08:29:44 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Monitoring interfaces for link beat: eth0 eth1 "
2012:09:20-08:32:14 abkasg-2 conntrack-tools[4399]: no dedicated links available!
2012:09:20-08:32:14 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Lost link beat on eth3!"
2012:09:20-11:37:58 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Found link beat on eth3 again!"
2012:09:20-11:37:59 abkasg-2 conntrack-tools[4399]: no dedicated links available!
2012:09:20-11:37:59 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Lost link beat on eth3!"
2012:09:20-11:38:02 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Found link beat on eth3 again!"
2012:09:20-11:38:13 abkasg-2 conntrack-tools[4399]: no dedicated links available!
2012:09:20-11:38:13 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Lost link beat on eth3!"
2012:09:20-11:38:15 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Found link beat on eth3 again!"
2012:09:20-11:38:56 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Autojoin of 198.19.250.102 granted! Seaching for unused node ID..."
2012:09:20-11:38:56 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Found unused node id 1!"
2012:09:20-11:38:56 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Node 1 joined cluster"
2012:09:20-11:38:59 abkasg-2 conntrack-tools[4399]: no dedicated links available!
2012:09:20-11:38:59 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Lost link beat on eth3!"
2012:09:20-11:39:01 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Found link beat on eth3 again!"
2012:09:20-11:39:07 abkasg-2 conntrack-tools[4399]: no dedicated links available!
2012:09:20-11:39:07 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Lost link beat on eth3!"
2012:09:20-11:39:08 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Found link beat on eth3 again!"
2012:09:20-11:39:12 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Access granted to remote node 1!"
2012:09:20-11:39:15 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Node 1 joined with version 9.002012"
2012:09:20-11:39:15 abkasg-2 ha_daemon[3680]: id="38C0" severity="info" sys="System" sub="ha" name="Node 1 is alive!"
2012:09:20-11:39:15 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Node 1 changed state: DEAD -> SYNCING"
2012:09:20-11:39:16 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Activating sync process for database on node 1"
2012:09:20-11:39:18 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Activating sync process for config on node 1"
2012:09:20-11:39:21 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Deactivating sync process for config on node 1"
2012:09:20-11:39:21 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Reading cluster configuration"
2012:09:20-11:39:31 abkasg-2 slon_control[3727]: Started slon process 31685 for reporting
2012:09:20-11:40:23 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Monitoring interfaces for link beat: eth0 eth1 "
2012:09:20-11:54:27 abkasg-1 slon_control[4271]: Selfcheck for reporting with lag -1, sync 0
2012:09:20-11:54:29 abkasg-1 slon_control[4271]: Slonik error, process exited with value 255
2012:09:20-11:54:29 abkasg-1 slon_control[4271]: Resetting reporting
2012:09:20-11:54:29 abkasg-1 slon_control[4271]: Starting replication from Node 2 to 1
2012:09:20-11:54:29 abkasg-1 slon_control[4271]: Found following tables in reporting: endpoint_users endpoint_lookup webanon_clients webanon_users dpt_lookup mailanon_domains mailanon_addrs accounting auth confd_sessions confd_nodes confd_objects vpn vpn_options ipscount ips appcontrol mailsec pfilter websec_categories websec_reqcat websec_reqdpt websecurity websec_sessions websec_visits websec_searches waf waf_events
2012:09:20-11:54:29 abkasg-1 slon_control[4271]: Found following sequences in reporting: endpoint_users_id_seq webanon_clients__rowno_seq webanon_users__rowno_seq dpt_lookup__rowno_seq mailanon_domains__rowno_seq mailanon_addrs__rowno_seq accounting__rowno_seq auth__rowno_seq confd_sessions__rowno_seq confd_nodes__rowno_seq confd_objects__rowno_seq vpn__rowno_seq vpn_options__rowno_seq ipscount__rowno_seq ips__rowno_seq appcontrol__rowno_seq mailsec__rowno_seq pfilter__rowno_seq websec_reqcat__rowno_seq websec_reqdpt__rowno_seq websecurity__rowno_seq websec_sessions__rowno_seq websec_visits__rowno_seq websec_searches__rowno_seq waf__rowno_seq waf_events__rowno_seq
2012:09:20-11:54:45 abkasg-1 slon_control[4271]: Started slon process 9321 for reporting
2012:09:20-11:59:36 abkasg-2 slon_control[3727]: Initial synchronization for node 1 finished!
2012:09:20-11:59:36 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Deactivating sync process for database on node 1"
2012:09:20-11:59:51 abkasg-1 ha_daemon[4123]: id="38A0" severity="info" sys="System" sub="ha" name="Initial synchronization finished!"
2012:09:20-11:59:52 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Node 1 changed state: SYNCING -> ACTIVE"
2012:09:20-12:05:18 abkasg-1 ha_daemon[4123]: id="38A0" severity="info" sys="System" sub="ha" name="Reading cluster configuration"
2012:09:20-12:06:11 abkasg-1 ha_daemon[4123]: id="38A0" severity="info" sys="System" sub="ha" name="Monitoring interfaces for link beat: eth0 eth1 "
2012:09:20-13:03:51 abkasg-2 ha_daemon[3680]: id="38C1" severity="info" sys="System" sub="ha" name="Node 1 is dead, received no heart beats!"
2012:09:20-13:03:51 abkasg-2 ha_daemon[3680]: id="38A0" severity="info" sys="System" sub="ha" name="Activating sync process for database on node 1"
2012:09:20-13:31:04 abkasg-2 conntrack-tools[4399]: no dedicated links available!
2012:09:20-13:31:04 abkasg-2 ha_daemon[3680]: id="38A3" severity="debug" sys="System" sub="ha" name="Netlink: Lost link beat on eth3!"