• View this example site here
• This example site is accompanied by a guide in the Netlify developer hub

This example prevents AI bots from crawling your site content by populating a robots.txt file and also, since not all bots play nicely, filtering requests using an Edge Function.

Deploy your own version of this example site, by clicking the button below. This will automatically:

• Clone a copy of this example from the examples repo to your own GitHub account
• Create a new project in your Netlify account, linked to your new repo
• Create an automated deployment pipeline to watch for changes on your repo
• Build and deploy your new site

Explore other examples of using the Netlify platform and primitives (with or without a framework) in this examples repo.