Blogmarks.net is a social bookmarking service.

Founded in late 2003 and heartquartered in France, we are non-profit and independant.

We believe in the open web, think internet services should be sustainable, build for the long term.

While we are re-launching the service, we only accept new members through invitation.

PUBLIC MARKS from jedi58 with tag engine

09 October 2006 06:30

Robots and Spiders

For the majority of websites, a robot or spider (both technically the same) will crawl your site almost daily, whether it be from Google, MSN, Yahoo, or some other search engine such as Alexa. Sometimes you don't want all your pages, or your images to be indexed. This guide covers that and more.

slurp engine search seo alexa msn yahoo google googlebot spiders robots

1 (1 marks)

Blogmarks.net is a social bookmarking service.

Already an user?

PUBLIC MARKS from jedi58 with tag engine

09 October 2006 06:30

Robots and Spiders

jedi58's TAGS related to tag engine