Report Suspected Abuse
- Email us at [email protected]
- Provide details, including:
- Your domain(s)
- Logfile details, or similar data, from your server, including IP address(es), timestamp, complete URL, and other particulars of crawl activity
Our users must agree to and comply with our Terms in regard to configuring our application. As a broad-based change monitoring solution, we provide 1000s of users with sophisticated change monitoring. We’ve been doing this for 10+ years. As such, we’ve developed dozens of configuration options and flexibility to meet various change monitoring use cases.
While we insist our customers understand and agree to our Terms, and ensure their compliance, we apply guardrails to minimize the potential abuse of our system. For any given use case, our goal is to monitor content only as much necessary; to crawl at an overall per-domain frequency and touch equivalent to or less than other crawlers, such as Googlebot, and to visit sites where we’re not unwelcome.
Users who are looking for high-frequency monitoring are advised to look elsewhere. Our goal is sustainable, reasonable, and optimized crawling.