Thread Info
  • State Not Answered
  • Locked Locked
  • Replies 18 replies
  • Subscribers 1 subscriber
  • Views 7695 views
  • Users 0 members are here
Options
Suggested
This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

httpproxy hangs

Remuflon
Pretty much every day we wake up to no internet.  The httpproxy service hangs on my UTM server.  Other connectivity continues to function, but no proxy.

We are running UTM home, 9.004-34 on a i3 with 8 gigs of RAM.  Intel nics.

I'm looking at various logs, but I don't see anything striking.  Can anyone suggest a starting point?

Restarting the httpproxy on the server restores operation, for an unknown amount of time...


This thread was automatically locked due to age.
Parents
  • 0
    You are correct.  I found the point where we lost it.
    Right after it tries to do that DNS lookup, it never recovers.

    I checked the logs on the domain controllers and DNS servers.  There are no reported problems.  (and they are in the same rack as UTM).

    2013:01:13-07:43:22 basil httpproxy[30798]: id="0001" severity="info" sys="SecureWeb" sub="http" name="http access" action="pass" method="GET" srcip="192.168.0.28" dstip="50.17.238.167" user="" statuscode="200" cached="0" profile="REF_HttProServers (Linux Servers)" filteraction="REF_HttCffLinuxServe (Linux Servers)" size="4187" request="0x76d76878" url="http://www.mysqueezebox.com/api/v1/players" exceptions="" error="" content-type="text/x-json" application="itunes"
    2013:01:13-07:43:48 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 1)"
    2013:01:13-07:43:53 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 2)"
    2013:01:13-07:44:08 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 1)"
    2013:01:13-07:44:13 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 2)"
    2013:01:13-07:44:28 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 1)"
    2013:01:13-07:44:33 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 2)"
    2013:01:13-07:44:48 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 1)"
    2013:01:13-07:44:53 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 2)"
    2013:01:13-07:45:08 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 1)"
    2013:01:13-07:45:13 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 2)"
    2013:01:13-07:48:06 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="saviscanner_log" file="saviscanner.c" line="153" message="Reloading SAVI threat data"
    2013:01:13-07:48:10 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="saviscanner_log" file="saviscanner.c" line="153" message="Reloading SAVI threat data finished, engine 3.37.2, threat data 4.83 from 5/11/2012 (4208268 detected threats)"
    2013:01:13-07:50:50 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs23.astaro.com' access time: 54ms"
    2013:01:13-07:50:50 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs13.astaro.com' access time: 48ms"
    2013:01:13-07:50:50 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs03.astaro.com' access time: 79ms"
    2013:01:13-07:50:50 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs06.astaro.com' access time: 96ms"
    2013:01:13-07:50:51 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs07.astaro.com' access time: 123ms"
    2013:01:13-07:50:51 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs14.astaro.com' access time: 188ms"
    2013:01:13-07:50:51 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs25.astaro.com' access time: 187ms"
    2013:01:13-07:50:51 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs24.astaro.com' access time: 185ms"
    2013:01:13-07:50:51 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs18.astaro.com' access time: 189ms"
    2013:01:13-07:50:52 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs20.astaro.com' access time: 210ms"
    2013:01:13-07:50:52 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs05.astaro.com' access time: 209ms"
    2013:01:13-07:50:52 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs22.astaro.com' access time: 210ms"
    2013:01:13-07:50:52 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs04.astaro.com' access time: 216ms"
Reply
  • 0
    You are correct.  I found the point where we lost it.
    Right after it tries to do that DNS lookup, it never recovers.

    I checked the logs on the domain controllers and DNS servers.  There are no reported problems.  (and they are in the same rack as UTM).

    2013:01:13-07:43:22 basil httpproxy[30798]: id="0001" severity="info" sys="SecureWeb" sub="http" name="http access" action="pass" method="GET" srcip="192.168.0.28" dstip="50.17.238.167" user="" statuscode="200" cached="0" profile="REF_HttProServers (Linux Servers)" filteraction="REF_HttCffLinuxServe (Linux Servers)" size="4187" request="0x76d76878" url="http://www.mysqueezebox.com/api/v1/players" exceptions="" error="" content-type="text/x-json" application="itunes"
    2013:01:13-07:43:48 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 1)"
    2013:01:13-07:43:53 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 2)"
    2013:01:13-07:44:08 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 1)"
    2013:01:13-07:44:13 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 2)"
    2013:01:13-07:44:28 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 1)"
    2013:01:13-07:44:33 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 2)"
    2013:01:13-07:44:48 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 1)"
    2013:01:13-07:44:53 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 2)"
    2013:01:13-07:45:08 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 1)"
    2013:01:13-07:45:13 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="dns_expire" file="dns.c" line="151" message="dns query timed out, retransmitting (retry 2)"
    2013:01:13-07:48:06 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="saviscanner_log" file="saviscanner.c" line="153" message="Reloading SAVI threat data"
    2013:01:13-07:48:10 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="saviscanner_log" file="saviscanner.c" line="153" message="Reloading SAVI threat data finished, engine 3.37.2, threat data 4.83 from 5/11/2012 (4208268 detected threats)"
    2013:01:13-07:50:50 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs23.astaro.com' access time: 54ms"
    2013:01:13-07:50:50 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs13.astaro.com' access time: 48ms"
    2013:01:13-07:50:50 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs03.astaro.com' access time: 79ms"
    2013:01:13-07:50:50 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs06.astaro.com' access time: 96ms"
    2013:01:13-07:50:51 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs07.astaro.com' access time: 123ms"
    2013:01:13-07:50:51 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs14.astaro.com' access time: 188ms"
    2013:01:13-07:50:51 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs25.astaro.com' access time: 187ms"
    2013:01:13-07:50:51 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs24.astaro.com' access time: 185ms"
    2013:01:13-07:50:51 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs18.astaro.com' access time: 189ms"
    2013:01:13-07:50:52 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs20.astaro.com' access time: 210ms"
    2013:01:13-07:50:52 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs05.astaro.com' access time: 209ms"
    2013:01:13-07:50:52 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs22.astaro.com' access time: 210ms"
    2013:01:13-07:50:52 basil httpproxy[30798]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="702" message="server 'cffs04.astaro.com' access time: 216ms"
Children
No Data