Skip to main content

Creating and Uploading a Custom Sitemap using CSV

Overview​

Use a custom sitemap when you need to batch upload URLs and their associated content. While the "Add Website" feature supports filtering and is typically more efficient, the custom sitemap method is beneficial for specific bulk upload needs.

Sitemap CSV Format​

This CSV format lets you upload web URLs, functioning like a sitemap. Once uploaded, the system ingests all the web content linked to these URLs.

Example CSV:

CSV file as example to upload

url,mode
https://www.ai12z.com/,auto
https://ai12z.com/about/,auto
https://ai12z.com/contact/,auto
https://ai12z.com/education/,auto

Parameters​

  • url column of urls
  • mode Options are auto, sync,async or advanceCrawl. Default is auto. For most cases (99%) you should be set to auto.