Guest User!

You are not Sophos Staff.

This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

XG 125 Unresponsive / Hang

I have XG 125 SFOS 18.0.5 MR-5-Build586 in around 40 users office.

Everyday it stops responding randomly. No Ping , No SSH no Internet.

I tried to capture console port logs and found these kind or message.

[45119.297653] watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [swapper/3:0]
[45119.297657] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [swapper/0:0]
[45119.297663] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [ksoftirqd/1:16]
[45119.298429] Kernel panic - not syncing: softlockup: hung tasks
[45119.378730] Modules linked in: nf_conntrack_ipslb nfnetmap_queue(O) xt_masterconn xt_xfrmpolicy drbg ansi_cprng echainiv xfrm6_mode_tunnel ah4 qat_api(O) usdm_drv(O) qat_c3xxx(O) intel_qat(O) xt_addrtype vfp_firewall(O) debug_cntrs(O) nf_nat_ftp nf_conntrack_ftp xt_CT ebtable_filter ebtable_nat ebtables ip6t_MASQUERADE xt_muser xt_conntrack xt_LBS ip6table_filter iptable_filter xt_DNAT xt_SNAT nf_nat_masquerade_ipv6 xt_nat_lookup xt_UST xt_ust xt_firewall nat_rules sfos_rules_framework firewall ip_set_hash_mlmwsticky ip_set_hash_sslvpn iptable_mangle ip_set_hash_mac ip_set_hash_bw nf_conntrack_dns nf_nat_sip nf_conntrack_sip nf_nat_irc nf_conntrack_irc nf_nat_tftp nf_conntrack_tftp nf_nat_h323 nf_conntrack_h323 nf_nat_pptp nf_conntrack_pptp cfg80211 usbhid hid_generic hid ohci_pci ohci_hcd xhci_pci
[45119.590564]  xhci_hcd uhci_hcd ehci_pci ehci_hcd fw_handle_ngfw_notification fp2sp_api fp_notifier bonding lzo lzo_compress lzo_decompress cifs red red2 appdev nf_conntrack_netlink nf_nat_proto_gre nf_conntrack_proto_gre set_sessiontbl sessiontbl ip_gre gre ipcomp xfrm_ipcomp esp4 xfrm4_mode_transport xfrm4_mode_tunnel xfrm4_tunnel xfrm_user af_key xfrm_algo aesni_intel glue_helper aes_x86_64 crypto_simd cryptd cls_u32 act_mirred sch_ingress ifb sch_hfsc sch_leafprio sch_headprio sch_sfq sch_htb xt_MULTISET xt_MLM xt_SRCNETMAP xt_MARKROUTE xt_CONTINUE xt_LOGDROP xt_ULOG xt_TCPMSS xt_REDIRECT nf_nat_redirect ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_OUT_OUTDEV ip6t_rpfilter ipt_rpfilter ebt_nflog ebt_pkttype xt_serviceset xt_appset xt_hostset xt_pkttype xt_recent xt_state xt_status xt_cet xt_OUTDEV
[45119.801979]  xt_iprange xt_limit xt_hashlimit xt_tcpudp xt_multiport nf_conntrack_relate xt_IPMACFILTER xt_RANGENAT xt_VHDNAT ip_set_bitmap_vhost xt_FWSET xt_set ip_set_hash_maciface_fp ip_set_hash_ipiface_fp ip_set_bitmap_hotspotuser ip_set_hash_hotspotmac ip_set_bitmap_tlsrule ip_set_bitmap_appset ip_set_bitmap_fwrule ip_set_bitmap_ctrxss ip_set_bitmap_user sp2fp_api ip_set_bitmap_userpolicy ip_set_hash_ipuser ip_set_bitmap_service ip_set_bitmap_host ip_set_hash_ipmaciface ip_set_hash_l2mac ip_set_hash_ipmac ip_set_hash_ip ip_set arptable_filter arp_tables e1000e_nm(O) igb_nm(O) i2c_algo_bit ixgbe_nm(O) vxlan udp_tunnel ip6_udp_tunnel ptp pps_core mdio i2c_i801 i2c_dev i2c_core netmap(O) ip6table_nat nf_nat_ipv6 ip6table_mangle ip6table_raw iptable_nat iptable_raw nf_nat_ipv4 xt_dscp nf_nat ip6_tables
[45120.015277]  ip_tables tun af_packet 8021q nf_conntrack_ipv6 nf_defrag_ipv6 nf_conntrack_ipv4 ip6_tunnel tunnel6 sit ip_tunnel tunnel4 ppdev parport_pc parport nf_conntrack lineartable bitmap_api br_netfilter bridge nf_defrag_ipv4 ipv6 stp llc x_tables nfnetlink button evdev [last unloaded: nfnetmap_queue]
[45120.096597] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G           O L  4.14.38 #2
[45120.118327] Hardware name: Sophos XG/Default string, BIOS 5.13 (Z162-011) 01/22/2020
[45120.141612] task: ffff88017b0d1700 task.stack: ffffc90000080000
[45120.159428] RIP: 0010:adf_send_message+0xd/0xa0 [intel_qat]
[45120.176203] RSP: 0000:ffff88017fd83ae0 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff10
[45120.198962] RAX: 0000000000000101 RBX: 00000000fffffff5 RCX: ffff88003df65000
[45120.220409] RDX: ffff88016f286300 RSI: ffff88001e8e1e30 RDI: ffff880149658090
[45120.241848] RBP: ffff88017fd83b30 R08: 0000000000000000 R09: 0000000000000000
[45120.263287] R10: ffffffff81270730 R11: ffffffff81270730 R12: ffff880178701600
[45120.284724] R13: ffff88001e8e1e30 R14: ffff88017b3ff098 R15: ffff88017b3ff000
[45120.306163] FS:  0000000000000000(0000) GS:ffff88017fd80000(0000) knlGS:0000000000000000
[45120.330480] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[45120.347765] CR2: 000000000a829574 CR3: 0000000001c0a000 CR4: 00000000001406e0
[45120.369204] Call Trace:
[45120.376605]  <IRQ>
[45120.382713]  qat_crypto_unregister+0x1f51/0x2cc0 [intel_qat]
[45120.399742]  crypto_authenc_encrypt+0x9e/0x190
[45120.4131



This thread was automatically locked due to age.
Parents
  • FormerMember
    0 FormerMember

    Hi , Thanks for reaching out to Sophos Community.

    From this Console output upon failure, It seems to be a scenario of CPU exhaustion. Could you share Hardware utilization snapshots?

    You can navigate to Diagnostics > System Graphs. Change the live graph to display weekly or last 48 hours.

  • Hi DeveshM,

    Attached 48 Hours CPU and Memory Report.

    Blank Area in report is the period of non-response from XG Firewall.

  • FormerMember
    0 FormerMember in reply to Dharmesh Vegad

    ==> Request to share the output of below commands:

    Login to SSH > 5. Device Management > 3. Advanced Shell

    # df -kh

    # free

    # ls -lah /var/cores

    # cat /log/syslog.log | grep -i "segfault"

    # cat /log/syslog.log | grep -i "CPU"

    # top

    ==> Please take an observation by disabling firewall-acceleration

    Login to SSH > 4. Device Console

    => To check firewall-acceleration status:

    console> system firewall-acceleration show

    => To disable firewall-acceleration:

    console> system firewall-acceleration disable

    => Also, enable auto-reboot-on-hang

    console> system auto-reboot-on-hang enable

  • Hi Yash,

    Thanks for helping

    Here are outputs of given commands in advanced shell.

    XG125_XN03_SFOS 18.0.5 MR-5-Build586# df -kh
    Filesystem                Size      Used Available Use% Mounted on
    none                    234.2M      4.5M    213.5M   2% /
    none                      1.9G     24.0K      1.9G   0% /dev
    none                      1.9G     12.3M      1.9G   1% /tmp
    none                      1.9G     14.6M      1.9G   1% /dev/shm
    /dev/boot               127.7M     38.2M     86.8M  31% /boot
    /dev/mapper/mountconf
                            385.4M     71.8M    309.6M  19% /conf
    /dev/content              5.4G    553.8M      4.9G  10% /content
    /dev/var                 46.5G     10.5G     36.0G  23% /var
    XG125_XN03_SFOS 18.0.5 MR-5-Build586# free
                 total         used         free       shared      buffers
    Mem:       4013876      3702936       310940       134648       165256
    -/+ buffers:            3537680       476196
    Swap:      2039744            0      2039744
    XG125_XN03_SFOS 18.0.5 MR-5-Build586#  ls -lah /var/cores
    drwxrwxrwt    2 root     0           4.0K Dec  3 17:09 .
    drwxr-xr-x   41 root     0           4.0K May 29 00:09 ..
    XG125_XN03_SFOS 18.0.5 MR-5-Build586#

    no output for # cat /log/syslog.log | grep -i "segfault"

    XG125_XN03_SFOS 18.0.5 MR-5-Build586# 
    XG125_XN03_SFOS 18.0.5 MR-5-Build586# cat /log/syslog.log | grep -i "CPU"
    Dec  3 11:39:58 (none) user.info kernel: [    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
    Dec  3 11:39:58 (none) user.warn kernel: [    0.000000] ACPI: SSDT 000000007e4d24d8 001901 (v02  PmRef    CpuPm 00003000 INTL 20061109)
    Dec  3 11:39:58 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    Dec  3 11:39:58 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:48 nr_cpumask_bits:48 nr_cpu_ids:4 nr_node_ids:1
    Dec  3 11:39:58 (none) user.info kernel: [    0.000000] PERCPU: Embedded 25 pages/cpu @ffff88017fc00000 s73024 r8192 d21184 u524288
    Dec  3 11:39:58 (none) user.debug kernel: [    0.000000] pcpu-alloc: s73024 r8192 d21184 u524288 alloc=1*2097152
    Dec  3 11:39:58 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    Dec  3 11:39:58 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    Dec  3 11:39:58 (none) user.info kernel: [    0.000000] 	Additional per-CPU info printed with stalls.
    Dec  3 11:39:58 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=48 to nr_cpu_ids=4.
    Dec  3 11:39:58 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    Dec  3 11:39:58 (none) user.info kernel: [    0.005585] CPU: Physical Processor ID: 0
    Dec  3 11:39:58 (none) user.info kernel: [    0.005588] CPU: Processor Core ID: 2
    Dec  3 11:39:58 (none) user.info kernel: [    0.005598] mce: CPU supports 9 MCE banks
    Dec  3 11:39:58 (none) user.info kernel: [    0.005661] CPU0: Thermal monitoring enabled (TM1)
    Dec  3 11:39:58 (none) user.info kernel: [    0.046420] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (fam: 06, model: 5f, stepping: 01)
    Dec  3 11:39:58 (none) user.info kernel: [    0.046754] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
    Dec  3 11:39:58 (none) user.info kernel: [    0.046844] .... node  #0, CPUs:      #1
    Dec  3 11:39:58 (none) user.debug kernel: [    0.057864] CPU1: Thermal monitoring handled by SMI
    Dec  3 11:39:58 (none) user.debug kernel: [    0.071115] CPU2: Thermal monitoring handled by SMI
    Dec  3 11:39:58 (none) user.debug kernel: [    0.084352] CPU3: Thermal monitoring handled by SMI
    Dec  3 11:39:58 (none) user.info kernel: [    0.086501] x86: Booted up 1 node, 4 CPUs
    Dec  3 11:41:57 (none) user.err kernel: [  203.068970] nf_conntrack_pktq : loaded with queuenum 100 qnum 4 mode 0 cpunum 4
    Mar  9 08:23:07 (none) user.info kernel: [    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
    Mar  9 08:23:07 (none) user.warn kernel: [    0.000000] ACPI: SSDT 000000007e4d24d8 001901 (v02  PmRef    CpuPm 00003000 INTL 20061109)
    Mar  9 08:23:07 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    Mar  9 08:23:07 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:48 nr_cpumask_bits:48 nr_cpu_ids:4 nr_node_ids:1
    Mar  9 08:23:07 (none) user.info kernel: [    0.000000] PERCPU: Embedded 25 pages/cpu @ffff88017fc00000 s73024 r8192 d21184 u524288
    Mar  9 08:23:07 (none) user.debug kernel: [    0.000000] pcpu-alloc: s73024 r8192 d21184 u524288 alloc=1*2097152
    Mar  9 08:23:07 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    Mar  9 08:23:07 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    Mar  9 08:23:07 (none) user.info kernel: [    0.000000] 	Additional per-CPU info printed with stalls.
    Mar  9 08:23:07 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=48 to nr_cpu_ids=4.
    Mar  9 08:23:07 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    Mar  9 08:23:07 (none) user.info kernel: [    0.005584] CPU: Physical Processor ID: 0
    Mar  9 08:23:07 (none) user.info kernel: [    0.005587] CPU: Processor Core ID: 2
    Mar  9 08:23:07 (none) user.info kernel: [    0.005597] mce: CPU supports 9 MCE banks
    Mar  9 08:23:07 (none) user.info kernel: [    0.005659] CPU0: Thermal monitoring enabled (TM1)
    Mar  9 08:23:07 (none) user.info kernel: [    0.046412] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (fam: 06, model: 5f, stepping: 01)
    Mar  9 08:23:07 (none) user.info kernel: [    0.046743] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
    Mar  9 08:23:07 (none) user.info kernel: [    0.046828] .... node  #0, CPUs:      #1
    Mar  9 08:23:07 (none) user.debug kernel: [    0.057848] CPU1: Thermal monitoring handled by SMI
    Mar  9 08:23:07 (none) user.debug kernel: [    0.071096] CPU2: Thermal monitoring handled by SMI
    Mar  9 08:23:07 (none) user.debug kernel: [    0.084335] CPU3: Thermal monitoring handled by SMI
    Mar  9 08:23:07 (none) user.info kernel: [    0.086485] x86: Booted up 1 node, 4 CPUs
    Mar  9 08:24:56 (none) user.err kernel: [  115.306273] nf_conntrack_pktq : loaded with queuenum 100 qnum 4 mode 0 cpunum 4
    Mar  9 14:05:26 (none) user.info kernel: [    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
    Mar  9 14:05:26 (none) user.warn kernel: [    0.000000] ACPI: SSDT 000000007e4d24d8 001901 (v02  PmRef    CpuPm 00003000 INTL 20061109)
    Mar  9 14:05:26 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    Mar  9 14:05:26 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:48 nr_cpumask_bits:48 nr_cpu_ids:4 nr_node_ids:1
    Mar  9 14:05:26 (none) user.info kernel: [    0.000000] PERCPU: Embedded 25 pages/cpu @ffff88017fc00000 s73024 r8192 d21184 u524288
    Mar  9 14:05:26 (none) user.debug kernel: [    0.000000] pcpu-alloc: s73024 r8192 d21184 u524288 alloc=1*2097152
    Mar  9 14:05:26 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    Mar  9 14:05:26 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    Mar  9 14:05:26 (none) user.info kernel: [    0.000000] 	Additional per-CPU info printed with stalls.
    Mar  9 14:05:26 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=48 to nr_cpu_ids=4.
    Mar  9 14:05:26 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    Mar  9 14:05:26 (none) user.info kernel: [    0.005584] CPU: Physical Processor ID: 0
    Mar  9 14:05:26 (none) user.info kernel: [    0.005586] CPU: Processor Core ID: 2
    Mar  9 14:05:26 (none) user.info kernel: [    0.005596] mce: CPU supports 9 MCE banks
    Mar  9 14:05:26 (none) user.info kernel: [    0.005658] CPU0: Thermal monitoring enabled (TM1)
    Mar  9 14:05:26 (none) user.info kernel: [    0.046416] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (fam: 06, model: 5f, stepping: 01)
    Mar  9 14:05:26 (none) user.info kernel: [    0.046752] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
    Mar  9 14:05:26 (none) user.info kernel: [    0.046839] .... node  #0, CPUs:      #1
    Mar  9 14:05:26 (none) user.debug kernel: [    0.057858] CPU1: Thermal monitoring handled by SMI
    Mar  9 14:05:26 (none) user.debug kernel: [    0.071107] CPU2: Thermal monitoring handled by SMI
    Mar  9 14:05:26 (none) user.debug kernel: [    0.084345] CPU3: Thermal monitoring handled by SMI
    Mar  9 14:05:26 (none) user.info kernel: [    0.086494] x86: Booted up 1 node, 4 CPUs
    Mar  9 14:08:24 (none) user.err kernel: [  182.685935] nf_conntrack_pktq : loaded with queuenum 100 qnum 4 mode 0 cpunum 4
    Mar  9 15:18:11 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    Mar  9 15:18:11 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    Mar  9 15:18:11 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    Mar  9 15:18:11 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    Mar  9 15:18:11 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    Mar  9 15:18:11 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    Mar  9 15:18:11 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    Mar  9 15:18:11 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    Mar  9 15:18:11 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    Mar  9 15:18:11 (none) user.info kernel: [    0.016789] CPU: Physical Processor ID: 0
    Mar  9 15:18:11 (none) user.info kernel: [    0.016790] CPU: Processor Core ID: 2
    Mar  9 15:18:11 (none) user.info kernel: [    0.016802] mce: CPU supports 9 MCE banks
    Mar  9 15:18:11 (none) user.info kernel: [    0.016833] CPU0: Thermal monitoring enabled (TM1)
    Mar  9 15:18:11 (none) user.info kernel: [    0.057878] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    Mar  9 15:18:11 (none) user.info kernel: [    0.058555] smp: Bringing up secondary CPUs ...
    Mar  9 15:18:11 (none) user.info kernel: [    0.058660] .... node  #0, CPUs:      #1 #2 #3
    Mar  9 15:18:11 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    Mar  9 15:21:46 (none) user.err kernel: [  325.296013] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Mar 10 08:39:41 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    Mar 10 08:39:41 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    Mar 10 08:39:41 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    Mar 10 08:39:41 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    Mar 10 08:39:41 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    Mar 10 08:39:41 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    Mar 10 08:39:41 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    Mar 10 08:39:41 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    Mar 10 08:39:41 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    Mar 10 08:39:41 (none) user.info kernel: [    0.016791] CPU: Physical Processor ID: 0
    Mar 10 08:39:41 (none) user.info kernel: [    0.016792] CPU: Processor Core ID: 2
    Mar 10 08:39:41 (none) user.info kernel: [    0.016804] mce: CPU supports 9 MCE banks
    Mar 10 08:39:41 (none) user.info kernel: [    0.016834] CPU0: Thermal monitoring enabled (TM1)
    Mar 10 08:39:41 (none) user.info kernel: [    0.057870] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    Mar 10 08:39:41 (none) user.info kernel: [    0.058546] smp: Bringing up secondary CPUs ...
    Mar 10 08:39:41 (none) user.info kernel: [    0.058651] .... node  #0, CPUs:      #1 #2 #3
    Mar 10 08:39:41 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    Mar 10 08:42:48 (none) user.err kernel: [  194.392015] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Mar 10 10:44:51 (none) user.err kernel: [ 7516.728022] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Mar 11 08:43:42 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    Mar 11 08:43:42 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    Mar 11 08:43:42 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    Mar 11 08:43:42 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    Mar 11 08:43:42 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    Mar 11 08:43:42 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    Mar 11 08:43:42 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    Mar 11 08:43:42 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    Mar 11 08:43:42 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    Mar 11 08:43:42 (none) user.info kernel: [    0.016788] CPU: Physical Processor ID: 0
    Mar 11 08:43:42 (none) user.info kernel: [    0.016789] CPU: Processor Core ID: 2
    Mar 11 08:43:42 (none) user.info kernel: [    0.016802] mce: CPU supports 9 MCE banks
    Mar 11 08:43:42 (none) user.info kernel: [    0.016833] CPU0: Thermal monitoring enabled (TM1)
    Mar 11 08:43:42 (none) user.info kernel: [    0.057869] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    Mar 11 08:43:42 (none) user.info kernel: [    0.058543] smp: Bringing up secondary CPUs ...
    Mar 11 08:43:42 (none) user.info kernel: [    0.058647] .... node  #0, CPUs:      #1 #2 #3
    Mar 11 08:43:42 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    Mar 11 08:46:47 (none) user.err kernel: [  191.976012] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Mar 11 20:48:51 (none) user.err kernel: [43515.692025] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Mar 15 08:40:32 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    Mar 15 08:40:32 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    Mar 15 08:40:32 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    Mar 15 08:40:32 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    Mar 15 08:40:32 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    Mar 15 08:40:32 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    Mar 15 08:40:32 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    Mar 15 08:40:32 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    Mar 15 08:40:32 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    Mar 15 08:40:32 (none) user.info kernel: [    0.016790] CPU: Physical Processor ID: 0
    Mar 15 08:40:32 (none) user.info kernel: [    0.016791] CPU: Processor Core ID: 2
    Mar 15 08:40:32 (none) user.info kernel: [    0.016803] mce: CPU supports 9 MCE banks
    Mar 15 08:40:32 (none) user.info kernel: [    0.016834] CPU0: Thermal monitoring enabled (TM1)
    Mar 15 08:40:32 (none) user.info kernel: [    0.057871] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    Mar 15 08:40:32 (none) user.info kernel: [    0.058548] smp: Bringing up secondary CPUs ...
    Mar 15 08:40:32 (none) user.info kernel: [    0.058653] .... node  #0, CPUs:      #1 #2 #3
    Mar 15 08:40:32 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    Mar 15 08:43:37 (none) user.err kernel: [  192.524014] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Mar 15 22:45:56 (none) user.err kernel: [50730.932013] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Mar 17 18:01:29 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    Mar 17 18:01:29 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    Mar 17 18:01:29 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    Mar 17 18:01:29 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    Mar 17 18:01:29 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    Mar 17 18:01:29 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    Mar 17 18:01:29 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    Mar 17 18:01:29 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    Mar 17 18:01:29 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    Mar 17 18:01:29 (none) user.info kernel: [    0.016791] CPU: Physical Processor ID: 0
    Mar 17 18:01:29 (none) user.info kernel: [    0.016792] CPU: Processor Core ID: 2
    Mar 17 18:01:29 (none) user.info kernel: [    0.016804] mce: CPU supports 9 MCE banks
    Mar 17 18:01:29 (none) user.info kernel: [    0.016835] CPU0: Thermal monitoring enabled (TM1)
    Mar 17 18:01:29 (none) user.info kernel: [    0.057877] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    Mar 17 18:01:29 (none) user.info kernel: [    0.058557] smp: Bringing up secondary CPUs ...
    Mar 17 18:01:29 (none) user.info kernel: [    0.058661] .... node  #0, CPUs:      #1 #2 #3
    Mar 17 18:01:29 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    Mar 17 18:04:39 (none) user.err kernel: [  196.644012] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Mar 18 14:07:52 (none) user.err kernel: [72389.596012] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Mar 22 16:21:07 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    Mar 22 16:21:07 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    Mar 22 16:21:07 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    Mar 22 16:21:07 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    Mar 22 16:21:07 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    Mar 22 16:21:07 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    Mar 22 16:21:07 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    Mar 22 16:21:07 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    Mar 22 16:21:07 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    Mar 22 16:21:07 (none) user.info kernel: [    0.016787] CPU: Physical Processor ID: 0
    Mar 22 16:21:07 (none) user.info kernel: [    0.016788] CPU: Processor Core ID: 2
    Mar 22 16:21:07 (none) user.info kernel: [    0.016800] mce: CPU supports 9 MCE banks
    Mar 22 16:21:07 (none) user.info kernel: [    0.016831] CPU0: Thermal monitoring enabled (TM1)
    Mar 22 16:21:07 (none) user.info kernel: [    0.057866] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    Mar 22 16:21:07 (none) user.info kernel: [    0.058543] smp: Bringing up secondary CPUs ...
    Mar 22 16:21:07 (none) user.info kernel: [    0.058647] .... node  #0, CPUs:      #1 #2 #3
    Mar 22 16:21:07 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    Mar 22 16:24:31 (none) user.err kernel: [  212.364117] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Apr 23 18:19:16 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    Apr 23 18:19:16 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    Apr 23 18:19:16 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    Apr 23 18:19:16 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    Apr 23 18:19:16 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    Apr 23 18:19:16 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    Apr 23 18:19:16 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    Apr 23 18:19:16 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    Apr 23 18:19:16 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    Apr 23 18:19:16 (none) user.info kernel: [    0.016790] CPU: Physical Processor ID: 0
    Apr 23 18:19:16 (none) user.info kernel: [    0.016791] CPU: Processor Core ID: 2
    Apr 23 18:19:16 (none) user.info kernel: [    0.016803] mce: CPU supports 9 MCE banks
    Apr 23 18:19:16 (none) user.info kernel: [    0.016835] CPU0: Thermal monitoring enabled (TM1)
    Apr 23 18:19:16 (none) user.info kernel: [    0.057868] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    Apr 23 18:19:16 (none) user.info kernel: [    0.058545] smp: Bringing up secondary CPUs ...
    Apr 23 18:19:16 (none) user.info kernel: [    0.058649] .... node  #0, CPUs:      #1 #2 #3
    Apr 23 18:19:16 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    Apr 23 18:22:32 (none) user.err kernel: [  211.106680] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Apr 23 18:27:04 (none) user.err kernel: [  497.999996] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Apr 24 11:20:52 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    Apr 24 11:20:52 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    Apr 24 11:20:52 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    Apr 24 11:20:52 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    Apr 24 11:20:52 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    Apr 24 11:20:52 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    Apr 24 11:20:52 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    Apr 24 11:20:52 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    Apr 24 11:20:52 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    Apr 24 11:20:52 (none) user.info kernel: [    0.016789] CPU: Physical Processor ID: 0
    Apr 24 11:20:52 (none) user.info kernel: [    0.016790] CPU: Processor Core ID: 2
    Apr 24 11:20:52 (none) user.info kernel: [    0.016802] mce: CPU supports 9 MCE banks
    Apr 24 11:20:52 (none) user.info kernel: [    0.016833] CPU0: Thermal monitoring enabled (TM1)
    Apr 24 11:20:52 (none) user.info kernel: [    0.057876] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    Apr 24 11:20:52 (none) user.info kernel: [    0.058556] smp: Bringing up secondary CPUs ...
    Apr 24 11:20:52 (none) user.info kernel: [    0.058662] .... node  #0, CPUs:      #1 #2 #3
    Apr 24 11:20:52 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    Apr 24 11:24:17 (none) user.err kernel: [  212.524020] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Apr 27 17:28:03 (none) user.err kernel: [281240.863800] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    Apr 29 19:29:56 (none) user.err kernel: [461356.497865] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May  4 15:32:35 (none) user.err kernel: [879121.133716] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May  6 23:33:41 (none) user.err kernel: [1080789.978760] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May  8 10:41:43 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May  8 10:41:43 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May  8 10:41:43 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May  8 10:41:43 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May  8 10:41:43 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May  8 10:41:43 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May  8 10:41:43 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May  8 10:41:43 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May  8 10:41:43 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May  8 10:41:43 (none) user.info kernel: [    0.016788] CPU: Physical Processor ID: 0
    May  8 10:41:43 (none) user.info kernel: [    0.016789] CPU: Processor Core ID: 2
    May  8 10:41:43 (none) user.info kernel: [    0.016801] mce: CPU supports 9 MCE banks
    May  8 10:41:43 (none) user.info kernel: [    0.016832] CPU0: Thermal monitoring enabled (TM1)
    May  8 10:41:43 (none) user.info kernel: [    0.057875] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May  8 10:41:43 (none) user.info kernel: [    0.058554] smp: Bringing up secondary CPUs ...
    May  8 10:41:43 (none) user.info kernel: [    0.058659] .... node  #0, CPUs:      #1 #2 #3
    May  8 10:41:43 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May  8 10:45:13 (none) user.err kernel: [  216.471979] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 10 20:49:00 (none) user.err kernel: [209245.467942] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 11 11:26:02 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 11 11:26:02 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 11 11:26:02 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 11 11:26:02 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 11 11:26:02 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 11 11:26:02 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 11 11:26:02 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 11 11:26:02 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 11 11:26:02 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 11 11:26:02 (none) user.info kernel: [    0.016790] CPU: Physical Processor ID: 0
    May 11 11:26:02 (none) user.info kernel: [    0.016791] CPU: Processor Core ID: 2
    May 11 11:26:02 (none) user.info kernel: [    0.016803] mce: CPU supports 9 MCE banks
    May 11 11:26:02 (none) user.info kernel: [    0.016834] CPU0: Thermal monitoring enabled (TM1)
    May 11 11:26:02 (none) user.info kernel: [    0.057878] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 11 11:26:02 (none) user.info kernel: [    0.058556] smp: Bringing up secondary CPUs ...
    May 11 11:26:02 (none) user.info kernel: [    0.058661] .... node  #0, CPUs:      #1 #2 #3
    May 11 11:26:02 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 11 11:29:44 (none) user.err kernel: [  228.768023] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 12 09:32:02 (none) user.err kernel: [79567.278895] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 13 16:41:21 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 13 16:41:21 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 13 16:41:21 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 13 16:41:21 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 13 16:41:21 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 13 16:41:21 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 13 16:41:21 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 13 16:41:21 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 13 16:41:21 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 13 16:41:21 (none) user.info kernel: [    0.016827] CPU: Physical Processor ID: 0
    May 13 16:41:21 (none) user.info kernel: [    0.016828] CPU: Processor Core ID: 2
    May 13 16:41:21 (none) user.info kernel: [    0.016847] mce: CPU supports 9 MCE banks
    May 13 16:41:21 (none) user.info kernel: [    0.016879] CPU0: Thermal monitoring enabled (TM1)
    May 13 16:41:21 (none) user.info kernel: [    0.057925] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 13 16:41:21 (none) user.info kernel: [    0.058724] smp: Bringing up secondary CPUs ...
    May 13 16:41:21 (none) user.info kernel: [    0.058833] .... node  #0, CPUs:      #1 #2 #3
    May 13 16:41:21 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 13 16:44:59 (none) user.err kernel: [  316.727633] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 13 16:48:44 (none) user.err kernel: [  542.267627] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 18 14:50:01 (none) user.err kernel: [425424.221569] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 20 14:50:38 (none) user.err kernel: [598264.170905] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 20 15:23:03 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 20 15:23:03 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 20 15:23:03 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 20 15:23:03 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 20 15:23:03 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 20 15:23:03 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 20 15:23:03 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 20 15:23:03 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 20 15:23:03 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 20 15:23:03 (none) user.info kernel: [    0.016821] CPU: Physical Processor ID: 0
    May 20 15:23:03 (none) user.info kernel: [    0.016822] CPU: Processor Core ID: 2
    May 20 15:23:03 (none) user.info kernel: [    0.016841] mce: CPU supports 9 MCE banks
    May 20 15:23:03 (none) user.info kernel: [    0.016872] CPU0: Thermal monitoring enabled (TM1)
    May 20 15:23:03 (none) user.info kernel: [    0.057920] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 20 15:23:03 (none) user.info kernel: [    0.058718] smp: Bringing up secondary CPUs ...
    May 20 15:23:03 (none) user.info kernel: [    0.058828] .... node  #0, CPUs:      #1 #2 #3
    May 20 15:23:03 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 20 15:26:39 (none) user.err kernel: [  221.716023] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 24 09:27:31 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 24 09:27:31 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 24 09:27:31 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 24 09:27:31 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 24 09:27:31 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 24 09:27:31 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 24 09:27:31 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 24 09:27:31 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 24 09:27:31 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 24 09:27:31 (none) user.info kernel: [    0.016826] CPU: Physical Processor ID: 0
    May 24 09:27:31 (none) user.info kernel: [    0.016827] CPU: Processor Core ID: 2
    May 24 09:27:31 (none) user.info kernel: [    0.016846] mce: CPU supports 9 MCE banks
    May 24 09:27:31 (none) user.info kernel: [    0.016878] CPU0: Thermal monitoring enabled (TM1)
    May 24 09:27:31 (none) user.info kernel: [    0.057924] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 24 09:27:31 (none) user.info kernel: [    0.058721] smp: Bringing up secondary CPUs ...
    May 24 09:27:31 (none) user.info kernel: [    0.058831] .... node  #0, CPUs:      #1 #2 #3
    May 24 09:27:31 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 24 09:31:15 (none) user.err kernel: [  229.452197] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 24 17:19:58 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 24 17:19:58 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 24 17:19:58 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 24 17:19:58 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 24 17:19:58 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 24 17:19:58 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 24 17:19:58 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 24 17:19:58 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 24 17:19:58 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 24 17:19:58 (none) user.info kernel: [    0.016825] CPU: Physical Processor ID: 0
    May 24 17:19:58 (none) user.info kernel: [    0.016826] CPU: Processor Core ID: 2
    May 24 17:19:58 (none) user.info kernel: [    0.016846] mce: CPU supports 9 MCE banks
    May 24 17:19:58 (none) user.info kernel: [    0.016878] CPU0: Thermal monitoring enabled (TM1)
    May 24 17:19:58 (none) user.info kernel: [    0.057924] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 24 17:19:58 (none) user.info kernel: [    0.058726] smp: Bringing up secondary CPUs ...
    May 24 17:19:58 (none) user.info kernel: [    0.058836] .... node  #0, CPUs:      #1 #2 #3
    May 24 17:19:58 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 24 17:23:39 (none) user.err kernel: [  227.359986] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 25 15:26:01 (none) user.err kernel: [79569.528999] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 25 17:07:55 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 25 17:07:55 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 25 17:07:55 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 25 17:07:55 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 25 17:07:55 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 25 17:07:55 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 25 17:07:55 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 25 17:07:55 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 25 17:07:55 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 25 17:07:55 (none) user.info kernel: [    0.016828] CPU: Physical Processor ID: 0
    May 25 17:07:55 (none) user.info kernel: [    0.016829] CPU: Processor Core ID: 2
    May 25 17:07:55 (none) user.info kernel: [    0.016847] mce: CPU supports 9 MCE banks
    May 25 17:07:55 (none) user.info kernel: [    0.016880] CPU0: Thermal monitoring enabled (TM1)
    May 25 17:07:55 (none) user.info kernel: [    0.057926] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 25 17:07:55 (none) user.info kernel: [    0.058727] smp: Bringing up secondary CPUs ...
    May 25 17:07:55 (none) user.info kernel: [    0.058836] .... node  #0, CPUs:      #1 #2 #3
    May 25 17:07:55 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 25 17:11:40 (none) user.err kernel: [  229.964153] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 26 09:32:35 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 26 09:32:35 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 26 09:32:35 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 26 09:32:35 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 26 09:32:35 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 26 09:32:35 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 26 09:32:35 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 26 09:32:35 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 26 09:32:35 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 26 09:32:35 (none) user.info kernel: [    0.016830] CPU: Physical Processor ID: 0
    May 26 09:32:35 (none) user.info kernel: [    0.016831] CPU: Processor Core ID: 2
    May 26 09:32:35 (none) user.info kernel: [    0.016849] mce: CPU supports 9 MCE banks
    May 26 09:32:35 (none) user.info kernel: [    0.016881] CPU0: Thermal monitoring enabled (TM1)
    May 26 09:32:35 (none) user.info kernel: [    0.057926] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 26 09:32:35 (none) user.info kernel: [    0.058726] smp: Bringing up secondary CPUs ...
    May 26 09:32:35 (none) user.info kernel: [    0.058835] .... node  #0, CPUs:      #1 #2 #3
    May 26 09:32:35 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 26 09:36:12 (none) user.err kernel: [  223.188000] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 27 09:29:15 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 27 09:29:15 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 27 09:29:15 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 27 09:29:15 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 27 09:29:15 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 27 09:29:15 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 27 09:29:15 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 27 09:29:15 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 27 09:29:15 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 27 09:29:15 (none) user.info kernel: [    0.016821] CPU: Physical Processor ID: 0
    May 27 09:29:15 (none) user.info kernel: [    0.016822] CPU: Processor Core ID: 2
    May 27 09:29:15 (none) user.info kernel: [    0.016840] mce: CPU supports 9 MCE banks
    May 27 09:29:15 (none) user.info kernel: [    0.016873] CPU0: Thermal monitoring enabled (TM1)
    May 27 09:29:15 (none) user.info kernel: [    0.057917] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 27 09:29:15 (none) user.info kernel: [    0.058716] smp: Bringing up secondary CPUs ...
    May 27 09:29:15 (none) user.info kernel: [    0.058825] .... node  #0, CPUs:      #1 #2 #3
    May 27 09:29:15 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 27 09:32:59 (none) user.err kernel: [  230.056049] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 27 10:04:59 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 27 10:04:59 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 27 10:04:59 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 27 10:04:59 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 27 10:04:59 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 27 10:04:59 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 27 10:04:59 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 27 10:04:59 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 27 10:04:59 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 27 10:04:59 (none) user.info kernel: [    0.016827] CPU: Physical Processor ID: 0
    May 27 10:04:59 (none) user.info kernel: [    0.016829] CPU: Processor Core ID: 2
    May 27 10:04:59 (none) user.info kernel: [    0.016847] mce: CPU supports 9 MCE banks
    May 27 10:04:59 (none) user.info kernel: [    0.016880] CPU0: Thermal monitoring enabled (TM1)
    May 27 10:04:59 (none) user.info kernel: [    0.057927] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 27 10:04:59 (none) user.info kernel: [    0.058731] smp: Bringing up secondary CPUs ...
    May 27 10:04:59 (none) user.info kernel: [    0.058842] .... node  #0, CPUs:      #1 #2 #3
    May 27 10:04:59 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 27 10:06:20 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 27 10:06:20 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 27 10:06:20 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 27 10:06:20 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 27 10:06:20 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 27 10:06:20 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 27 10:06:20 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 27 10:06:20 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 27 10:06:20 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 27 10:06:20 (none) user.info kernel: [    0.016825] CPU: Physical Processor ID: 0
    May 27 10:06:20 (none) user.info kernel: [    0.016826] CPU: Processor Core ID: 2
    May 27 10:06:20 (none) user.info kernel: [    0.016845] mce: CPU supports 9 MCE banks
    May 27 10:06:20 (none) user.info kernel: [    0.016877] CPU0: Thermal monitoring enabled (TM1)
    May 27 10:06:20 (none) user.info kernel: [    0.057923] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 27 10:06:20 (none) user.info kernel: [    0.058721] smp: Bringing up secondary CPUs ...
    May 27 10:06:20 (none) user.info kernel: [    0.058830] .... node  #0, CPUs:      #1 #2 #3
    May 27 10:06:20 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 27 10:10:04 (none) user.err kernel: [  231.448030] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 27 11:06:54 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 27 11:06:54 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 27 11:06:54 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 27 11:06:54 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 27 11:06:54 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 27 11:06:54 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 27 11:06:54 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 27 11:06:54 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 27 11:06:54 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 27 11:06:54 (none) user.info kernel: [    0.016823] CPU: Physical Processor ID: 0
    May 27 11:06:54 (none) user.info kernel: [    0.016824] CPU: Processor Core ID: 2
    May 27 11:06:54 (none) user.info kernel: [    0.016843] mce: CPU supports 9 MCE banks
    May 27 11:06:54 (none) user.info kernel: [    0.016875] CPU0: Thermal monitoring enabled (TM1)
    May 27 11:06:54 (none) user.info kernel: [    0.057920] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 27 11:06:54 (none) user.info kernel: [    0.058722] smp: Bringing up secondary CPUs ...
    May 27 11:06:54 (none) user.info kernel: [    0.058832] .... node  #0, CPUs:      #1 #2 #3
    May 27 11:06:54 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 27 11:10:34 (none) user.err kernel: [  227.244035] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 27 15:12:03 (none) user.err kernel: [14715.446875] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 27 17:06:25 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 27 17:06:25 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 27 17:06:25 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 27 17:06:25 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 27 17:06:25 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 27 17:06:25 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 27 17:06:25 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 27 17:06:25 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 27 17:06:25 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 27 17:06:25 (none) user.info kernel: [    0.016823] CPU: Physical Processor ID: 0
    May 27 17:06:25 (none) user.info kernel: [    0.016824] CPU: Processor Core ID: 2
    May 27 17:06:25 (none) user.info kernel: [    0.016843] mce: CPU supports 9 MCE banks
    May 27 17:06:25 (none) user.info kernel: [    0.016875] CPU0: Thermal monitoring enabled (TM1)
    May 27 17:06:25 (none) user.info kernel: [    0.057920] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 27 17:06:25 (none) user.info kernel: [    0.058723] smp: Bringing up secondary CPUs ...
    May 27 17:06:25 (none) user.info kernel: [    0.058833] .... node  #0, CPUs:      #1 #2 #3
    May 27 17:06:25 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 27 17:10:00 (none) user.err kernel: [  221.264029] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 28 08:41:18 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 28 08:41:18 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 28 08:41:18 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 28 08:41:18 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 28 08:41:18 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 28 08:41:18 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 28 08:41:18 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 28 08:41:18 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 28 08:41:18 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 28 08:41:18 (none) user.info kernel: [    0.016825] CPU: Physical Processor ID: 0
    May 28 08:41:18 (none) user.info kernel: [    0.016827] CPU: Processor Core ID: 2
    May 28 08:41:18 (none) user.info kernel: [    0.016845] mce: CPU supports 9 MCE banks
    May 28 08:41:18 (none) user.info kernel: [    0.016877] CPU0: Thermal monitoring enabled (TM1)
    May 28 08:41:18 (none) user.info kernel: [    0.057923] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 28 08:41:18 (none) user.info kernel: [    0.058724] smp: Bringing up secondary CPUs ...
    May 28 08:41:18 (none) user.info kernel: [    0.058834] .... node  #0, CPUs:      #1 #2 #3
    May 28 08:41:18 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 28 08:44:52 (none) user.err kernel: [  220.868021] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 28 09:06:32 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 28 09:06:32 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 28 09:06:32 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 28 09:06:32 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 28 09:06:32 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 28 09:06:32 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 28 09:06:32 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 28 09:06:32 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 28 09:06:32 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 28 09:06:32 (none) user.info kernel: [    0.016826] CPU: Physical Processor ID: 0
    May 28 09:06:32 (none) user.info kernel: [    0.016827] CPU: Processor Core ID: 2
    May 28 09:06:32 (none) user.info kernel: [    0.016845] mce: CPU supports 9 MCE banks
    May 28 09:06:32 (none) user.info kernel: [    0.016878] CPU0: Thermal monitoring enabled (TM1)
    May 28 09:06:32 (none) user.info kernel: [    0.057923] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 28 09:06:32 (none) user.info kernel: [    0.058725] smp: Bringing up secondary CPUs ...
    May 28 09:06:32 (none) user.info kernel: [    0.058834] .... node  #0, CPUs:      #1 #2 #3
    May 28 09:06:32 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 28 09:10:04 (none) user.err kernel: [  218.300016] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 28 09:20:09 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 28 09:20:09 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 28 09:20:09 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 28 09:20:09 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 28 09:20:09 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 28 09:20:09 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 28 09:20:09 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 28 09:20:09 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 28 09:20:09 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 28 09:20:09 (none) user.info kernel: [    0.016830] CPU: Physical Processor ID: 0
    May 28 09:20:09 (none) user.info kernel: [    0.016831] CPU: Processor Core ID: 2
    May 28 09:20:09 (none) user.info kernel: [    0.016850] mce: CPU supports 9 MCE banks
    May 28 09:20:09 (none) user.info kernel: [    0.016882] CPU0: Thermal monitoring enabled (TM1)
    May 28 09:20:09 (none) user.info kernel: [    0.057929] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 28 09:20:09 (none) user.info kernel: [    0.058731] smp: Bringing up secondary CPUs ...
    May 28 09:20:09 (none) user.info kernel: [    0.058840] .... node  #0, CPUs:      #1 #2 #3
    May 28 09:20:09 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 28 09:23:42 (none) user.err kernel: [  220.440023] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 28 17:59:35 (none) user.info kernel: [    0.000000] ACPI: SSDT 0x000000007E4D24D8 001901 (v02 PmRef  CpuPm    00003000 INTL 20061109)
    May 28 17:59:35 (none) user.info kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
    May 28 17:59:35 (none) user.info kernel: [    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1
    May 28 17:59:35 (none) user.info kernel: [    0.000000] percpu: Embedded 40 pages/cpu @ffff88017fc00000 s126232 r8192 d29416 u524288
    May 28 17:59:35 (none) user.debug kernel: [    0.000000] pcpu-alloc: s126232 r8192 d29416 u524288 alloc=1*2097152
    May 28 17:59:35 (none) user.debug kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
    May 28 17:59:35 (none) user.info kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    May 28 17:59:35 (none) user.info kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
    May 28 17:59:35 (none) user.info kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    May 28 17:59:35 (none) user.info kernel: [    0.016824] CPU: Physical Processor ID: 0
    May 28 17:59:35 (none) user.info kernel: [    0.016825] CPU: Processor Core ID: 2
    May 28 17:59:35 (none) user.info kernel: [    0.016843] mce: CPU supports 9 MCE banks
    May 28 17:59:35 (none) user.info kernel: [    0.016875] CPU0: Thermal monitoring enabled (TM1)
    May 28 17:59:35 (none) user.info kernel: [    0.057912] smpboot: CPU0: Intel(R) Atom(TM) CPU C3508 @ 1.60GHz (family: 0x6, model: 0x5f, stepping: 0x1)
    May 28 17:59:35 (none) user.info kernel: [    0.058714] smp: Bringing up secondary CPUs ...
    May 28 17:59:35 (none) user.info kernel: [    0.058823] .... node  #0, CPUs:      #1 #2 #3
    May 28 17:59:35 (none) user.info kernel: [    0.060000] smp: Brought up 1 node, 4 CPUs
    May 28 18:02:55 (none) user.err kernel: [  207.040011] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    May 28 18:11:10 (none) user.err kernel: [  702.384010] nf_conntrack_ipslb : loaded with q_start 0 q_end 3 lb_algo(0: Round Robin, 1: CPU fan-out)  0
    XG125_XN03_SFOS 18.0.5 MR-5-Build586# 
    top - 09:17:33 up 15:18,  1 user,  load average: 0.16, 0.13, 0.10
    Tasks: 390 total,   1 running, 321 sleeping,   0 stopped,   0 zombie
    Cpu(s):  0.3%us,  0.5%sy,  0.0%ni, 99.1%id,  0.1%wa,  0.0%hi,  0.0%si,  0.0%st
    Mem:   4013876k total,  3703884k used,   309992k free,   165640k buffers
    Swap:  2039744k total,        0k used,  2039744k free,  1034928k cached
    
      PID  PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
     3434  20   0 34584  21m 3016 S  1.3  0.5   9:24.98 dnscache
    21018  20   0 13524 2320 1876 R  1.0  0.1   0:00.16 top
    12074  20   0 1636m 302m  15m S  0.7  7.7   3:10.31 snort
    12076  20   0 1636m 302m  15m S  0.7  7.7   3:11.21 snort
       41  20   0     0    0    0 I  0.3  0.0   0:57.72 kworker/0:1
     1855  20   0 46640 9976 9628 S  0.3  0.2   0:16.21 postgres
     6273  20   0 23372 3300 2768 S  0.3  0.1   1:43.55 fqdnd
     8250  20   0  231m 6748 3792 S  0.3  0.2   0:05.38 httpd
    12073  20   0 1636m 302m  15m S  0.3  7.7   3:19.27 snort
    12075  20   0 1636m 302m  15m S  0.3  7.7   3:11.96 snort
        1  20   0 23312 2392 2184 S  0.0  0.1   0:01.36 init
        2  20   0     0    0    0 S  0.0  0.0   0:00.00 kthreadd
        3  20   0     0    0    0 I  0.0  0.0   0:00.00 kworker/0:0
        4   0 -20     0    0    0 I  0.0  0.0   0:00.00 kworker/0:0H
        6   0 -20     0    0    0 I  0.0  0.0   0:00.00 mm_percpu_wq
        7  20   0     0    0    0 S  0.0  0.0   0:00.52 ksoftirqd/0
        8  20   0     0    0    0 I  0.0  0.0   0:22.77 rcu_sched
    
    XG125_XN03_SFOS 18.0.5 MR-5-Build586#
    

    # top was run during no load hours, thus it may be misleading.

    -

    # system firewall-acceleration show [Was enabled]

    so I disabled it by

    # system firewall-acceleration disable

    console> system auto-reboot-on-hang show
    Auto reboot system when kernel gets into a hang state is enabled
    console>
    
    

    auto reboot on hang is enabled but isn't working.

  • FormerMember
    0 FormerMember in reply to Dharmesh Vegad

    Log seems ok.

    I'd suggest opening a support case along with the above log output and console output. Also, please share the case ID in PM.

Reply Children
No Data