# --- General Rules for All Search Engines & AI --- User-agent: * Allow: / # --- Security & Privacy (Keep these blocked!) --- Disallow: /api/ Disallow: /admin/ Disallow: /account-settings Disallow: /profile/ Disallow: /reset-password Disallow: /verify-email/ Disallow: /billing/ # --- Optimize Crawl Budget (Block useless generated pages) --- Disallow: /*?search= Disallow: /*?category= Disallow: /*?sortBy= Disallow: /*?ref= # --- Explicitly Allow Assets (Critical for React SEO) --- Allow: /assets/ Allow: /favicon.ico Allow: /og-image.jpg # --- Sitemap --- Sitemap: https://aivlo.ai/sitemap.xml