September 2006
New Robots.txt Syntax Checker: a validator for robots.txt files
by parmentierf & 7 othersThis robots.txt checker is a "validator" that analyzes the syntax of a robots.txt file to see if its format is valid as established by Robot Exclusion Standard (please read the documentation and the tutorial to learn the basics) or if it contains errors.
June 2006
Robots.txt Generator - McAnerin Networks Inc.
by parmentierf & 3 others (via)Robot Control Code Generation Tool
1
(2 marks)