> For the complete documentation index, see [llms.txt](https://docs.botdistrikt.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.botdistrikt.com/features/sources/websites.md).

# Websites

### **Websites**

<figure><img src="/files/eTPhudxOwrnlqcCs0oE2" alt=""><figcaption><p>Add Website and Document Sources</p></figcaption></figure>

To add a website, click on **Websites --> New Source Website**

<figure><img src="/files/df7gLmzJU59SY2QwvIoe" alt=""><figcaption><p>Add New Source Website</p></figcaption></figure>

1. Enter a **Crawl Base URL** (base URL that the chatbot will crawl to find responses)
2. Click **Crawl**
3. Or enter your website's **Sitemap**
4. Click **Load Sitemap** - you will see a list of the URLs available on the website:

<figure><img src="/files/UnOjBn5RsgYRkqaaqbES" alt=""><figcaption><p>List of Sample Sitemap</p></figcaption></figure>

Some URLs have viewable responses that you can inspect. Click ![](/files/RtlksLApmpfqnwnA7NLl)beside each URL to inspect. You can view the configuration below the list:

<figure><img src="/files/9PU2ic70Z1jjb4iFJqZ3" alt=""><figcaption><p>Sample Configuration of Each URL</p></figcaption></figure>

5. Click **Add** to add individual resources, or&#x20;
6. **Bulk Add** to add resources in bulk.

Click on **Train Added Resources** at the end of the list to add the current loaded URLs to your bot's knowledge base.

You will be redirected to your **Sources** dashboard. The added resources are viewable as a list under **Websites.**

<figure><img src="/files/oCQuEFcX5xSXsFY8hwep" alt=""><figcaption><p>Added Website Resources</p></figcaption></figure>

You can toggle the resource as **Active**, view the current **Training** status, view **Responses, Update** a resource, or **Delete** a UR&#x4C;**.**

**Troubleshooting**:

* If a file is stuck at queued, ensure that your account has not exceeded the respective tier Response Repo limit.
* If a file is stuck at the training phase, click on **Resync Source** <img src="/files/psv4kOM4sjnjgLoPXlUo" alt="" data-size="line">
* If embeddings are not created, ensure that your AI integrated account has not exceeded its token limit.
