I say speed speed! gimme what I need "billy idol"

[arpecop]

I work alot about my php skills last time ... somewhere in your pages you have to put ... long scripts that displays poor data for google spider ... some stuped example ... get time from www.clock.com + your zodiacal sign count it and display your lucky number :P it's alot of writing and all that slowing access for spiders like googlebot I find a solution to refresh once page .. and output a public_html/cache/cached_page_from_last_refresh.txt that I am including in my pages ... the question that wondering me is for how exactly time googlebot crawls one of my pages .... probably most of users here know about WGET in linux ... i thing googlebot is something like wgeter :) that downloads the source code ... and after that the experts have to know how filter it .. this is not the question now ... the question is for tool like a "ping" in DOS but from google machines ... it's too complicated ... I've got lot of question like this but please excuse my

BAD ENGLISH CONTENT WARNING :)

cause I am sure that SERP rankings and quality of the sites factor is ... FAST ACCESS from the bots

best regards: Rudi

[Faglork]

Originally Posted by arpecop

... the question that wondering me is for how exactly time googlebot crawls one of my pages ....

Maybe this helps:

<?
if(eregi("googlebot",$HTTP_USER_AGENT))
  {
  if ($QUERY_STRING != "")
    {$url = "http://".$SERVER_NAME.$PHP_SELF.'?'.$QUERY_STRING;}
  else
    {$url = "http://".$SERVER_NAME.$PHP_SELF;}
  $today = date("F j, Y, g:i a");
  mail("info@xxxxxxx.com", "Googlebot detected on http://$SERVER_NAME", "$today - Google crawled $url");
  }
?>

copy & paste that code into an ASCII editor, replace info@xxxxxxx.com with your e-mail-address and save it as googlebot.php

I include it via SSI in the pages I want to monitor:

Syntax may differ, depending on your server. You may also simply include this in PHP if your pages are based on PHP.

Everytime Googlebot crawls one of those pages, you get an E-Mail with time and URL information. Can be easily adapted to other or even multiple bots.


hth,
Alex

[arpecop]

thanks alot you have great skills writing php
but the counter for me doing the same work
so ... I heard about googlebot deep crawls .. if you have :

1st. slow server
2nd. Bad writed script like 100rows code

there will be not so "deep" crawl :)
i think googlebot is like "user" that visit pages and that's exactly true ... the difference is that Google ISP is powered by very fast connection ... try to download tryal version of Adobe Photoshop using SSH from your hosting company .. I get it for less a minute with more than 300k per second faglork
googlebot comes and get your page for 0.001 seconds
when bot comes come to my page it get it for 0.28 seconds ... that is just example how we can track the time ... like sitting behind google cluster server and pinging our pages ... seeing that they are slow for google and rewrite them


so the question again is ... if we have mirrored pages with you ...

[MathsIsFun]

If I understand you correctly, arpecop, you are saying "my php code is slowing down the page - would this mean that Googlebot dislikes me, and what can I do about it?"

Well, there are two things to consider. 1) Google doesn't want you to show it something different to what the user sees. It considers this as cheating the search engines; and 2) Robots ARE different and you need to treat them as special visitors.

So, faglork's "if(eregi("googlebot",$HTTP_USER_AGENT)) {" code example is quite common, just don't use it for cheating.

One legitimate example is to remove "session codes" that track users. A session code can make the robots think that every time it visits it finds new pages, so removing this code is making things clearer, and helping the robots.

So, you could probably code things so that instead of doing time-consuming look-ups, you just have some standard values to present to the robots. This way the page looks the same to people and robots. After all, the robots don't care what starsign they are!

[arpecop]

my php code is slowing down the page - would this mean that Googlebot dislikes me, and what can I do about it

that's exactly what I mean ... btw I am using BBClone 0.4.7 that tracks robots and visitors with simple .htaccess function

I have very fast internet connection and visiting my sites ... loaded well ... but I am sure they can be more fastest. the thing I need is a tracker that tracks the time needed loading page(or download it) - somewhere in california will be good (if i am not wrong there are the google servers)
php is language that is flexible but the difference betwean good and bad programmer is that bad programmer write more unnecessery rows that slows spiders and people with modems

10x to reply math

[Faglork]

mabe this helps:

http://www.websiteoptimization.com/s...yze/index.html

[arpecop]

big thanks faglork ... with correct phrases I found other interesting article

http://developers.evrsoft.com/articl...ge-speed.shtml

best regards. end of topic :)

[brian.mark]

We use GlobalNetWatch.com to test the speed of our site from about 10 locations throughout the US. It has helped us identify some network issues and tells us when we need to look at upgrades. There are others that do services like this as well, but they're all going to charge a similar amount per month. We liked the fact that GNW had an ofice locally, so we talked to someone local about what we were trying to accomplish and they made something that really suited our needs.

If you need any more names, let me know. I still have a few that I think are doing this service. We've been pleased.

Brian.