BrenwyBot

Identifying requests

Our crawler identifies itself as BrenwyBot/0.1, with a link to this information page in its user-agent. A user-agent alone is not proof of who sent a request.

We fetch public pages without signing in, submitting forms or executing page JavaScript. Requests are limited per website, and we back off when a site asks us to slow down.

Controlling access

We check robots.txt before fetching pages. To block BrenwyBot, add the following rules to your site’s robots.txt:

User-agent: BrenwyBot
Disallow: /

We also honour supported noindex and nofollow instructions when we fetch a page. A newly added instruction takes effect when we next check it; contact us to request removal of previously collected content.

Crawl records and removal

Crawl records can include page URLs, extracted text, link references and crawl decisions. They support search evaluation and operation; submission or crawling does not guarantee inclusion or ranking.

We can remove stored page content and block further crawling of a reported URL. Minimal URL exclusion records may be retained so that removed pages are not fetched again.

Your website in Brenwy Search

Use Webmaster Tools to verify control of your domain.

Verify your domain and manage website and sitemap submissions through Webmaster Tools.

Contact and reports

For crawl problems, removal requests or suspected impersonation, email support@team.brenwy.com.

Include the affected URL, the approximate time and source IP of the request if available, and what you would like us to review. Please do not send passwords or private page content.