View Full Version : Can crawlers read databases
drifter69
01-21-2004, 12:41 PM
I visited keyworddensity.com and it shows I have a very low density. When I search the home page it comes back with 0. I think most of our pages are pulled from a database, when I set up the administrator panel the web developer wrote this;
'What I can do is add several fields to the administration panel which will allow you to add the meta tag into the database. Then when someone/search engine crawler views a particular course page the meta tags are pulled from the database along with the other information'
will this method still work?
Thanks in advance for your help.
netman4ttm
01-22-2004, 02:17 PM
I use lynx (found in Linux) to view my web pages. This will give you a good idea of what a web crawler will see.
cyanide
01-28-2004, 01:43 AM
Hi drifter69,
How about a link to your site?
It helps if we can have a look.
Well, SE bots don't read databases per se, but will read the information that is called from it.
But, it depends alot on the way the pages are called. Some ways are badly done and some work quite well.
drifter69
01-28-2004, 04:47 AM
Cyanide,
If you use the (www) box below my question it links to our site. How would I find out how the info is called and if its a good way or a bad way?
drifter69
cyanide
01-28-2004, 12:18 PM
Cyanide,
If you use the (www) box below my question it links to our site. How would I find out how the info is called and if its a good way or a bad way?
drifter69
Hi drifter69,
I had a look at your site.
When talking about dynamic sites like yours, the one thing you want to look for is the URL as far as bot-crawling is concerned.
If it contains more than 2 or three variables then the bots will stumble. But you clearly have less, so you shouldn't have any problems.
As a tip, you should put in a sitemap that links to all your pages.
icb01co2
02-03-2004, 06:44 PM
Hi all,
cyanide Wrote:
When talking about dynamic sites like yours, the
one thing you want to look for is the URL as far
as bot-crawling is concerned.
If it contains more than 2 or three variables
then the bots will stumble.
I have a problem, my CMS system needs to pass several bits of information through the URL how can i overcome the SEO problem with long URLs? Isn't there something to do with URL re-writing? All vey confusing to me.
Thanks, Chris.
bob_99
02-11-2004, 01:03 PM
Hi Chris,
Here is a good tutorial on using .htaccess to make URLs friendly:
Make dynamic URLs friendly (http://www.searchenginepromotionhelp.com/m/articles/search-engine-optimization/dynamic-content-promotion.php)
I hope this helps,
Bob
Hi all,
cyanide Wrote:
When talking about dynamic sites like yours, the
one thing you want to look for is the URL as far
as bot-crawling is concerned.
If it contains more than 2 or three variables
then the bots will stumble.
I have a problem, my CMS system needs to pass several bits of information through the URL how can i overcome the SEO problem with long URLs? Isn't there something to do with URL re-writing? All vey confusing to me.
Thanks, Chris.