Last updated:
A website crawler that lets you choose the pages
Training on a website no longer means one page at a time. intoCHAT finds the pages on your site, lets you choose which ones to use and counts crawls against a monthly allowance per plan.
- NewPaste your website address and intoCHAT lists up to 500 pages it finds through your sitemap and links.
- NewSelect the pages to train on and leave out the rest.
- NewSkip whole sections, such as a blog or tag archive, with exclude patterns.
- ImprovedCrawled pages are read as main content, without navigation menus and other page clutter.
- NewEach plan includes a monthly number of website crawls: one on Free, 9 on Starter and 20 on Pro.
Earlier versions read a single address and a handful of linked pages. The new crawler starts from your website address, checks your sitemap, maps the links on your site and lists the pages it found, already marking the ones your chatbot knows.
From that list you choose what the chatbot should learn. Untick pages that don't help visitors, or add exclude patterns such as /blog or /tag to drop whole sections before crawling. intoCHAT then reads each selected page and adds it to the chatbot's knowledge.
Crawling counts toward a monthly allowance that depends on your plan: one crawl a month on Free, 9 on Starter and 20 on Pro. The allowance resets every month, and pages you already crawled stay in your knowledge until you remove them.