Logo

Search The World

Search Norway

Home      Catalog      Shopping      Entertainment

boitho.com-robot boitho.com's Web Crawler
The boitho.com-robot is a distributed crawler that downloads web pages to build the database used by boitho.com to search in.

How to avoid being indexed
If you do not wish to be crawled please inform our crawler by either:

Ad the user agent boitho.com-robot to your robots.txt according to the The Robots Exclusion Protocol

example:
User-agent: boitho.com-robot
Disallow: /


Or use a META tag according to the Robots META tag specification

example:
<META NAME="boitho.com-robot" CONTENT="NOINDEX, NOFOLLOW">

 

IP addresses

The boitho robot is currently using the IP addresses 213.179.58.90 - 213.179.58.10 and 208.122.26.130 - 208.122.26.139 for the crawling cluster used in production. IP addresses 80.202.212.14 and 212.71.72.75 is used for the testing and development server.

We did previous use addresses 217.118.38.218 - 217.118.38.226.

 

Contact us
If you cannot find the information about Boitho You need, wish to work for Boitho, or want to come with a general
comment to Boitho please mail and we will get back to you as soon as possible.

Affiliate contact
All comments from our affiliates please send to this address

Pay Per Click contact
Questions from our customers and companies wanting to advertise with us, or general comments about Boitho´s
Pay Per Click centre please send to


Make Boitho My Homepage - Affiliate Centre - Pay-Per Click Centre - Submit Your URL - About Boitho

© Copyright Boitho 2007