# robots.txt for www.natsett.com (DRAFT) # Default: all crawlers, including search engines and AI search/assistant crawlers, may read the site. User-agent: * Disallow: /thanks.html Disallow: /thanks Disallow: /connect.html Disallow: /connect Disallow: /closing-video.html Disallow: /closing-video Disallow: /seller-intro-video.html Disallow: /seller-intro-video Disallow: /buyer-intro-video.html Disallow: /buyer-intro-video Disallow: /emd.html Disallow: /emd Disallow: /zachs-signature.html Disallow: /zachs-signature # Optional decision for the owner: to opt out of AI model TRAINING (but stay visible in search # and in assistants that browse on a user's behalf), uncomment the groups below. # Each AI company documents these tokens: GPTBot (OpenAI), ClaudeBot (Anthropic), # Google-Extended (Google). Search and user-triggered bots (OAI-SearchBot, ChatGPT-User, # Claude-SearchBot, Claude-User, Googlebot) are intentionally NOT blocked. # User-agent: GPTBot # Disallow: / # User-agent: ClaudeBot # Disallow: / # User-agent: Google-Extended # Disallow: / Sitemap: https://www.natsett.com/sitemap.xml