WebProWorld Part of WebProNews.com
Page One Link To Us Edit Profile Private Messages Archives FAQ RSS Feeds  
 

Go Back   WebProWorld > Webmaster, IT and Security Discussion > Webmaster Resources Discussion Forum
Subscribe to the Newsletter FREE!


Register FAQ Members List Calendar Arcade Chatbox Mark Forums Read

Webmaster Resources Discussion Forum Sitemaps and robots and logfiles -- Oh My! If you have any questions, comments, concerns and/or ideas about the tools currently available to webmasters to make their lives... 'easier'. Here's where you need to be. Know of a good tool? Post it here. Got something funny in your logfiles? Maybe we can help.

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 01-23-2006, 12:08 PM
Robban's Avatar
WebProWorld Pro
 

Join Date: Dec 2003
Location: San Francisco & Columbus
Posts: 250
Robban RepRank 0
Default what is unwanted lines in the logfile

What does this mean in my website stats.

"unwanted lines in the logfile"

I got about 6000 of them so I'd thought it be a good idea what it means.

I host with GoDaddy and they are part of my free stats.

Cheers,
__________________
www.fleege.com - Domainer | AD & CW - www.DomainParkingGuru.com
ViralJunction.com See: iBUY.org GuruIndex.com SwapDomains.com GoMYSQL.com URLguru.com InstantWiz.com ViralJunction.com
Reply With Quote
  #2 (permalink)  
Old 01-23-2006, 06:11 PM
WebProWorld New Member
 

Join Date: Jul 2003
Location: Colorado, USA
Posts: 16
GlowHost.com RepRank 1
Default

You should contact their support to see what exactly it means, that is if they have someone who knows who can answer it for you.

It sounds like a misconfiguration in their stats program. Stats programs typically scan a log file then generate reports based on what it finds.

Most programs would truncate, or not include whatever it considered to be "unwanted" instead of displaying them to you.

However, that may actually be part of the way the stats program runs. The docs for the program should be able to tell you more, but without knowing which brand of stats they use, I am only speculating.

I think I saw something like this with Analog stats before.
Reply With Quote
  #3 (permalink)  
Old 01-23-2006, 11:08 PM
Andilinks's Avatar
WebProWorld Veteran
 

Join Date: Feb 2004
Location: NM, USA
Posts: 779
Andilinks RepRank 0
Default

Raw logs direct from the server contain many very long queries from automated hacking/cracking programs that can be easily identified as such and deleted.

There are worms that generate queries of hundreds of the same character in succession and will hammer the server hundreds of times with the same query. Could be really evil people or just teens with time on their hands, who knows?

But this rubbish follows a pattern that the people who compile stats categorize into profiles and routinely remove from log files.

I don't know if that's exactly what GoDaddy is doing in this instance but it is something that happens regularly and is likely.

Andi
__________________
...the Rockies may tumble, Gibralter may crumble... G & I Gershwin, 1937
Reply With Quote
  #4 (permalink)  
Old 01-24-2006, 12:13 PM
kgun's Avatar
WebProWorld 1,000+ Club
 

Join Date: May 2005
Location: Norway
Posts: 5,066
kgun RepRank 3kgun RepRank 3
Default

What is this:
http://www.fleege.com/robots.txt


Block as may as you can:

Examples:

http://multifinanceit.com/robots.txt

.htacces examples.
http://multifinanceit.com/htaccess.txt
http://multifinanceit.com/htaccess1.txt

If you implement these, may be your log files will be easier to read.

What about a spider trap?

The simplest spider trap is a folder that is blocked for good boots. Then if a Bot visits that folder, it is per definition a bad or an amateur programmer's bot. I have written more about how that can be automatized here at WPW.

Googling:
KW's: kgun + spider(trap) site:webproworld.com

or variants of that.
Reply With Quote
Reply

  WebProWorld > Webmaster, IT and Security Discussion > Webmaster Resources Discussion Forum
Tags: , ,



Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Search Engine Optimization by vBSEO 3.2.0