# Crawling Settings

The **Crawling Settings** section gives you precise control over how Zipchat AI processes your website content. By customizing these settings, you ensure the AI focuses on relevant data, improving its responses and creating a better user experience.

<figure><img src="https://2043605213-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FvYpZDb6HsnLHFu8ZygCS%2Fuploads%2FFN7a9pGYPTooA7PJD9c6%2FScreenshot%202024-11-23%20at%2018.28.16.png?alt=media&#x26;token=2c9a4932-8efc-476e-9d22-8fbb81c00fba" alt=""><figcaption></figcaption></figure>

### Customization Options

**1. Manage Out-of-Stock Products**

* **Include/Exclude Out-of-Stock Products**\
  Choose whether to crawl and index out-of-stock products. Excluding them prevents the AI from suggesting unavailable items, improving customer satisfaction.
* **Out-of-Stock Keyphrase**\
  Identify the keyphrase or HTML element unique to out-of-stock items, like *"Out of Stock"*. Zipchat uses this to accurately skip these pages.

**2. Ignore Irrelevant Page Elements**

* **Add or Remove Elements**\
  Specify parts of your website, like footers, headers, or banners, that the AI should skip when crawling. This ensures it focuses on meaningful content.
* **Use CSS Selectors**\
  Pinpoint elements to ignore using simple CSS syntax:
  * **Tags**: `header` or `footer`
  * **Classes**: `[class*="footer"]`
  * **IDs**: `[id*="promo-banner"]`

**3. Default Ignored Elements**

Zipchat may preconfigure certain elements to be ignored, such as:

* **Footers**: `[id*="footer"]` or `[class*="footer"]`
* **Headers or Navigation Bars**

You can adjust these defaults to better suit your site’s layout.

***

### Why Crawling Settings Matter

1. **Improved Relevance**: Focuses the AI on essential content, ensuring responses are accurate and useful.
2. **Better Shopping Experience**: Avoids suggesting out-of-stock products, reducing customer frustration.
3. **Efficient Performance**: Ignoring unnecessary elements speeds up crawling and enhances AI processing.

***

### Example Use Case

* **Out-of-Stock Products**: Exclude pages with the banner *"Currently Unavailable"*.
* **Ignore Elements**: Skip promotional banners and footers to keep responses clean and focused.

***

### Optimize Your AI for Success

Fine-tuning the **Crawling Settings** ensures that Zipchat AI gathers the most relevant information from your website. By focusing on what matters and ignoring distractions, you create a smarter, more efficient chatbot that delivers exceptional customer support and boosts satisfaction. 🚀