Thread Info
  • State Not Answered
  • Locked Locked
  • Replies 1 reply
  • Subscribers 1 subscriber
  • Views 632 views
  • Users 0 members are here
Options
Suggested
This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

URL Filtering, how does it work behind the scene?

x-cimo
I found out that the small/medium speed decrease to load a webpage was mostly caused by URL Filtering.

This seem to be caused by the overhead to check with astaro for a categorization of the URL.

The time to get to thoses server seem fair on my network. 

2010:07:25-10:05:50 plasmashield httpproxy[4439]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="724" message="server 'cffs07.astaro.com' access time: 93ms"

2010:07:25-10:05:50 plasmashield httpproxy[4439]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="724" message="server 'cffs06.astaro.com' access time: 121ms"

2010:07:25-10:05:50 plasmashield httpproxy[4439]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="724" message="server 'cffs04.astaro.com' access time: 260ms"

2010:07:25-10:05:50 plasmashield httpproxy[4439]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="724" message="server 'cffs02.astaro.com' access time: 288ms"

2010:07:25-10:05:51 plasmashield httpproxy[4439]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="724" message="server 'cffs05.astaro.com' access time: 282ms"

2010:07:25-10:05:51 plasmashield httpproxy[4439]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="724" message="server 'cffs11.astaro.com' access time: 283ms"

2010:07:25-10:05:51 plasmashield httpproxy[4439]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="724" message="server 'cffs01.astaro.com' access time: 316ms"

2010:07:25-10:05:52 plasmashield httpproxy[4439]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="724" message="server 'cffs10.astaro.com' access time: 499ms"

2010:07:25-10:05:52 plasmashield httpproxy[4439]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="724" message="server 'cffs08.astaro.com' access time: 509ms"

2010:07:25-10:05:53 plasmashield httpproxy[4439]: id="0003" severity="info" sys="SecureWeb" sub="http" request="(nil)" function="sc_check_servers" file="scr_scanner.c" line="724" message="server 'cffs03.astaro.com' access time: 646ms"


So I am just wondering if there is any kind of optimization done for this, such as caching previously checked URL (for some time). Or is every single get, generating a request to astaro? And choosing the best cffs from the list?

When browsing google map, I can see the slowdown, between URL filtering enable or not.. Unless I'm wrong, I should see a speed increase if there was some kind of caching, since all request go to google.com, but I don't.

I whitelisted google.com for URL filtering and googlemap is now rocket fast all the time. 

Thanks


This thread was automatically locked due to age.
Parents
  • 0
    The lines you show above are from the test your Astaro runs every 10 (I think) minutes to see which categorization server responds the quickest; that server is the one used until replaced by another server that's faster in a subsequent test.

    Like you, my experience is that these requests are not cached.  Gert proposed a feature that doesn't have many votes, and you might want to vote for it: Local Content Filter Database.

    Cheers - Bob
     
    Sophos UTM Community Moderator
    Sophos Certified Architect - UTM
    Sophos Certified Engineer - XG
    Gold Solution Partner since 2005
    MediaSoft, Inc. USA
Reply
  • 0
    The lines you show above are from the test your Astaro runs every 10 (I think) minutes to see which categorization server responds the quickest; that server is the one used until replaced by another server that's faster in a subsequent test.

    Like you, my experience is that these requests are not cached.  Gert proposed a feature that doesn't have many votes, and you might want to vote for it: Local Content Filter Database.

    Cheers - Bob
     
    Sophos UTM Community Moderator
    Sophos Certified Architect - UTM
    Sophos Certified Engineer - XG
    Gold Solution Partner since 2005
    MediaSoft, Inc. USA
Children
No Data