Instructions For Robots.txt File

This is just an instructional page. Do not actually use this for your site. The Robots.txt code goes in the domain settings when connecting your domain to your account. Below the screenshot is an example of exactly what your code should look like. Be sure to include your sitemap URL (also found in the domain settings after it's connected).

Robots.txt Code Example

Use "Allow" for the page paths that you want to be indexed and visible in search results. Use "Disallow" for pages you do NOT want indexed.

Sitemap: https://your-domain/sitemap.xml

User-agent: *

Allow: /home

Allow: /about

Allow: /services

Allow: /contact

Allow: /booking-appointment

Allow: /service1

Allow: /service2

Allow: /service3

Allow: /service4

Allow: /service5

Allow: /service6

Allow: /service1-city1

Allow: /service1-city2

Allow: /service1-city3

Allow: /blog

Allow: /blog-article-1

Allow: /blog-article-2

Allow: /blog-article-3

Disallow: /contact-thank-you

Disallow: /booking-thank-you

Disallow: /pricing

Disallow: /robotstxt-example