Register or have you forgotten your password?
Get the most out of Surmunity, read our tips here! Need an interesting blog to read? You've got to read the Surpass Blog!
| Welcome! Please register to access all of our features.
October 12th, 2005, 8:51 PM
|
#1 (permalink) |
|
Registered User
Comfy Contributor
Joined in Sep 2005
Hosted on sh84
117 posts
Gave thanks: 0
Thanked 0 times
|
CPanel Statistics
I'm trying to learn more about the tools in the cpanel and I'm wondering if someone can answer something. When looking at statistics, I came across "Robots/Spider" visitors. Now, I'm an newbie, but I'm guessing that this is probably not a good thing. Cany anyone give me a brief explanation of what this is?
Thanks
__________________
datadoggie.com | Server: SH84 Bike Odometer: 140 miles |
|
    
|
|
October 12th, 2005, 9:00 PM
|
#2 (permalink) |
|
Skittles
Super #1
Joined in Aug 2004
Lives in a space ship
Hosted on dedi
6,815 posts
Gave thanks: 101
Thanked 199 times
|
Robots and spiders are things that crawl the web and follow links... All of the search engines send out spiders to follow links and index your website into their database. There are bad robots too though, such as spambots, that harvest email addresses. A good thing to have on your site is a robots.txt file, which will tell the robots what parts of the site they can access, and what parts they can't. Here is some information on one of those files: http://www.searchengineworld.com/rob...s_tutorial.htm and http://www.robotstxt.org/wc/norobots.html
__________________
Mountain Dew Knight
People should not be afraid of their governments. Governments should be afraid of their people. |
|
|
|
