Hi guys. You know I am new to all this crawling things and felt confused today. Googlebot and yahoo's Slurp used to visit my site frequently especially slurp. And my logs were always saying that they were visiting the index page only. Today I found that slurp has crawled every single page in my site in ~1 hour.(bytheway I am not able to track link clicks because of slurp 302)
What is this. Is this normal?
If they add all these pages to their index, what happens when I update a page? Will slurp crawl the whole site again soon? like in a month? Because I was planning to change a lot of onpage elements and want to be sure that yahoo gets the updated versions of my site.
BTW I do not know what to do with google!! Getting all these spammy links does not make me happy(although they work on google). I had 3 new emails yesterday to exchange links(although my
PR is 0) but did not accept as the sites were really bad just looking to build a million links or so. I am currently happy and satisfied with a link(yes one link) from a pr6 site very relevant to mine.This site is number 4 on google for the word(poker).
Another thing: today I filled the spam reports of google and yahoo and emailed a hosting company accomodating many redirection-only and doorway pages informing them that I reported their pages to the search engines. The free webhost is greatnow.com. They do not only host pages related to poker but also viagra and other things you know.
Sorry for the lengthy post. Lot of things.I am a daydreamer. seriously, did not sleep yet. 36 hours.
Thank you.
Contact Us
Forum Rules
Search
Archive
How frequent does yahoo crowl a site like............
Linear Mode
