Firefox plugin for spider emulation & checking for malware on websites
There was a thread back in 2008 where someone was considering writing a Firefox Plugin that would emulate a search engine spider. I could used that for my hobby blog, but I also have a professional interest. I do incident response for a university.
I have a slightly different application of a web browser plugin. We have had a website that was compromised and began to host malware. The developers for the site asked me to scan it. But I only have a vulnerability scanner. They looked at the web pages in the mySql database, but they would really like a scan of the site for malware. I know that Finjan (now M86) Secure Browsing and the Dr Web Firefox plugins do some sort of page analysis before they show the page. I thought that if I combined them with a website spider plugin, that I would get an understanding of the health of the website. If this is too convoluted, and there is an easier way, I will confess to being no web expert, and plead ignorance.
Tags for this Thread