Getthit Web Crawler Bot

What does the Getthit Bot do?

The Getthit Bot is a distributed “Site Crawler” that downloads web pages for domains, websites, and links submitted through our exchange application and collects words, content, material, and files in order to scan for unlawful, spam, and scam content.

There is no IP range for the Getthit Bot.

What is a bot in general?

A bot (also known as a web crawler or spider) is a type of computer software that crawls the Internet in a systematic and automated fashion to collect data, which can be used to support some services (for example, search engines like Google).

What exactly is a site crawler?

A site crawler is typically referred to as "Spidering" because it crawls the whole site at once, starting with the home page and continuing till the end page.

How can I prevent this bot from visiting my website?

We engineered our crawler to be as "polite" as possible by sending a minimum number of requests as reasonable to your site.

If it causes you any difficulties or issues, please let us know via the contact us form and kindly provide us with any additional information that may be helpful.

How safe is my website's crawled data?

It's completely safe. We do not share your information with anyone else. Please take a look at our Privacy Policy.