robots.txt

[Thomas Arman]

The web crawlers (robots) roam the web gathering info on web sites.  If you
have a robots.txt in the root of your site, then the crawlers are supposed
to leave your site alone.

Tom

-----Original Message-----
From: xtensionlist-bounces at shed.com [mailto:xtensionlist-bounces at shed.com]
On Behalf Of Jerry
Sent: Monday, February 07, 2005 12:15 PM
To: xtensionlist at shed.com
Subject: robots.txt

Folks,

Any idea what this file is?

I'm getting requests on my website for this file.  I assume it's a PC 
file and somone is looking for access?

TIA!

Jp