Web Crawler

InterwowBot

InterwowBot is the web crawler operated by Interwow. It indexes the public pages of a website so that website's own AI support assistant can answer visitor questions accurately from that site's content (retrieval-augmented generation).

InterwowBot/2.0 (+https://interwow.com/bot)

What InterwowBot does

  • Crawls a site only after the site owner has installed Interwow and explicitly requested that their own website be indexed for their AI assistant.
  • Reads publicly accessible HTML page text to build a knowledge base for that site's assistant.
  • Stays on the requested domain, follows links and sitemap.xml, and respects depth and page limits.

What InterwowBot does not do

  • It does not crawl third-party sites unrelated to an Interwow customer's own property.
  • It does not submit forms, log in, execute purchases, or perform any state-changing actions.
  • It does not collect personal data; it indexes page content for the site owner's support assistant.
  • It does not ignore robots.txt.

How to identify InterwowBot

Requests use this User-Agent (and link back to this page):

InterwowBot/2.0 (+https://interwow.com/bot)

How to control or block InterwowBot

InterwowBot obeys the Robots Exclusion Protocol. Add rules to your site's /robots.txt using the token InterwowBot.

Block the entire site:

User-agent: InterwowBot Disallow: /

Block only specific sections, and set a polite crawl delay:

User-agent: InterwowBot Disallow: /admin/ Disallow: /checkout/ Crawl-delay: 5

Changes to robots.txt are picked up on the next crawl. InterwowBot honors Crawl-delay and rate-limits itself per host.

How the data is used

Crawled page text is split into passages, converted into embeddings, and stored only for the site owner who requested the crawl, to power their own AI support assistant. It is not sold and not used to train third-party foundation models. A site owner can delete their indexed content at any time from their dashboard, which removes the associated passages and embeddings.

Frequently asked questions

Why is InterwowBot visiting my site?
Either you (or your team) added the Interwow widget and requested indexing of your site, or a site you own is configured with an Interwow AI assistant. If you did not expect it, block it via robots.txt as shown above and contact us.
Does it affect my SEO or analytics?
InterwowBot identifies itself clearly so you can filter it from your analytics, and it crawls politely to avoid load.
Will it slow down my server?
No — it limits concurrency and spacing per host and honors Crawl-delay.

Contact

Questions or to report unwanted crawling: [email protected].

Last updated: October 2026.