When I turn on HTTP Scanning most all web pages stop loading, used online scan tools to scan the urls and they do not have any malware.

I have the same Problem,

When enabling http scanning in my webfilter rule no http:// site is displayed in any browser

When enabling https scanning in my webfilter rule no https:// site is displayed in any browser

root certificate is deployed via ad and is correctly importet on the client site.

What could be the Problem?

Philip,

can you share screenshot of your XG Policy rules? I am using "scan http" from months and no problem at all.

Philip,

I think you re enabling SCAN HTTP on Policy ID 1, right? What dns are your devices using?

XG or external DNS?

Right,

all clients have DC as primary and XG as secondary dns. 

Ok. Create an above rule where DNS traffic is allowed from AD DNS server to public, then enable the SCAN HTTP on rule id 1.

AD DNS server has unrestricted internet access bypassing the xg at the moment

AD DNS server has unrestricted internet access bypassing the xg at the moment

I'd like to report the same issue, when i enable either HTTP or HTTPS malware scanning, almost all sites are blocked apart from a few including sophos.com and google.com. Sites such as bbc.co.uk are various others are blocked, but the block messages say the sites are blocked due to there being malware on the page. This is definitely an issue with malware scanning as I'm pretty sure sites such as BBC.co.uk and the various others I've tried, aren't riddled with malware. :P

I reported this via tech support over a week ago  and provided some pcaps and whatnot, but have heard nothing back yet. I cant do much testing at the moment as this system is in production and i cant really break Internet access for my users without notice!

For clarification, all PC's look to AD for DNS, and the XG has a firewall rule in place to allow the AD server unrestricted access, so it shouldnt be a DNS issue. 

Many Thanks

Hi Josh,

Can you DM me the ticket# of the reported case to Support. I will check the progress and try to conclude something. You can accept my request and send me a personal message. 

Thanks

Sachin Gurung

Hi Philip,

Checked your Ticket # and the instance is awaiting update from our Dev. Team. You will be updated soon.

Thanks for your patience.

Regards

Sachin Gurung

Hi Josh,

After going through your ticket# I suggest you if you can please clear browsing history in your Web browser. Next, restart Web Proxy services by navigating through

System
Diagnostics
Services
Web Proxy - Restart.
This will restart the httpproxy service in XG.

The learn more about the packet capture facility in XG, you can refer the link here: community.sophos.com/.../123189

I hope restarting Web Proxy helps when http requests are blocked after applying scanning.

Thanks

Sachin Gurung

I did the restart and cleared the browsers data.

nothing changed

Same Here, no change.  However, I havent updated the box to MR2 yet so I dont know if there are any fixes in the update? How about you Philip?

I turned on both and set up the web proxy port of the utm in my browsers lan settings. Now all pages load but the webfilter rule does not work anymore.