WorldCamLinkChecker

WorldCamLinkChecker is a bot that checks the availability of websites listed in the WorldCam directory. The bot is operated by GemsNet, the company behind worldcam.eu and worldcam.pl.

The bot helps identify outdated links, redirects, and website availability issues. It checks URLs listed in our directory, as well as the destination URLs of any redirects.

During these checks, we record technical information, including the URL, HTTP response status code, check timestamp, response time, and the reason for any error or skipped check. The bot is not used to copy or republish content from the websites it visits.

The bot identifies itself using the following User-Agent header:

`WorldCamLinkChecker/1.0 (+https://worldcam.eu/worldcam-link-checker)`

Before checking a URL, the bot reads the website's robots.txt file and follows the rules specified for its User-Agent or, if no specific rules are defined, the general rules. It supports Allow, Disallow, Crawl-delay, and Request-rate directives.

The bot limits the frequency of requests to each website. It does not attempt to bypass login requirements or anti-bot verification challenges.

If you own or administer a website and would like to exclude it from our checks or report an issue, please contact us at info@worldcam.eu. Include the domain name and a description of your request. For technical issues, providing the date and time of the request, along with its request ID (if available), will also be helpful.

Domains added to our exclusion list, including all their subdomains, will not be checked until the exclusion is removed.