Unknown robot (identified by 'robot')

[chandrika]

Quite a few Unknown robots spider my sites which is usual, however last few days there is one that has spidered 10000s of pages which is somehwat unusual as the only spiders usually I get spidering everything are the larger SEs that identify themselves.

Does anyone know if this can be any kind of problem if you see an
Unknown robot (identified by 'robot')
in the stats that appears to be going thorugh everything? Or is this normal and just something I hadnt had before?

[incrediblehelp]

Pretty normal. Lots of junk bots and scrappers visit my websites all of the time. If you want feel free to block them by IP.

[AVC]

You see that in your logs all the time, not much you can do about it unless block them by .htaccess or figure out the IP's, it could be GigaBlast, a University crawler or SnapBot.

Some of these guys need to be pressured to resolve to a host name by webmasters or they should be banned.

[khurramali]

if you are disturbed by them, and want to keep away the scraper bots, I suggest that you block all other bots expect the ones you know, which identify themselves.