Knowledge guide
How BazBots crawls your website and builds knowledge
BazBots builds context from public pages on the website you provide. The current crawler follows eligible same-site links and stores text from up to 15 pages per bot.
What the crawler reads
The crawl begins at the website URL you enter and follows links that stay on that website. Public, text-based pages with clear product, service, pricing, and policy information give the bot the most useful source material.
The current knowledge limit
Each crawl processes up to 15 website pages. That is a page count, not a promise that every URL on a large site will be included.
- Put important buyer information on clearly linked pages.
- Use descriptive page headings and plain text.
- Keep key facts consistent across your site.
When to recrawl
Recrawl after meaningful website changes so the stored context reflects the current public content. BazBots answers from crawled website text; it should not be treated as a source for information that is absent from those pages.
Frequently asked questions
How many pages does BazBots crawl?
The current crawler processes up to 15 pages for each bot.
Can BazBots read private or logged-in pages?
BazBots is designed to crawl publicly reachable website pages. Content behind a login should not be assumed to be available.
Does the bot know facts that are not on my website?
You should provide important business facts on the pages BazBots crawls. Its business-specific context comes from that website content.