# SyberJet Aircraft - robots.txt User-agent: * Allow: / # Sitemap location Sitemap: https://syberjet.com/sitemap.xml # Disallow admin and portal areas Disallow: /Admin Disallow: /ServicePortal Disallow: /api/ # NOTE (SB-511): unlisted pages are deliberately NOT listed here. This file is # public, so naming a path advertises it — which is harmless for the auth-gated # areas above, but would hand out the URL of an ungated one. A Disallow would also # be self-defeating: it stops the crawler FETCHING the page, so the page's own # `noindex` meta tag is never seen, and the URL can still be indexed if anything # links to it. Unlisted pages rely on `noindex` plus no inbound links instead.