# Rooftop Website # https://rooftopapp.com # ============================================================================== # Google Search & Shopping Crawlers (Landing Pages & Product Images) # ============================================================================== User-agent: Googlebot User-agent: Googlebot-Image User-agent: Storebot-Google User-agent: Google-StoreBot Allow: / Allow: /provider$ # Block development/staging & private paths Disallow: /provider/ Disallow: /checkout Disallow: /profile Disallow: /api/ Disallow: /staging/ Disallow: /dev/ Disallow: /environments/ Disallow: /node_modules/ # ============================================================================== # All Other Web Crawlers # ============================================================================== User-agent: * Allow: / Allow: /provider$ # Block development/staging & private paths Disallow: /provider/ Disallow: /checkout Disallow: /profile Disallow: /api/ Disallow: /staging/ Disallow: /dev/ Disallow: /environments/ Disallow: /node_modules/ # Sitemap Sitemap: https://cdn.rooftopapp.com/sitemap.xml # LLM and AI discovery # Sitemap: https://rooftopapp.com/llms.txt