# ===================================== # Robots.txt for energytraining.ae # SEO-safe for WordPress training website # ===================================== User-agent: * Allow: / # ------------------------------------- # WordPress admin (standard) # ------------------------------------- Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # ------------------------------------- # Block technical endpoints # ------------------------------------- Disallow: /wp-json/ # ------------------------------------- # Block internal search results (safe) # ------------------------------------- Disallow: /?s= Disallow: /*?s= # ------------------------------------- # Block common low-value parameters # ------------------------------------- Disallow: /*?replytocom= Disallow: /*?attachment_id= # ------------------------------------- # Optional: block tracking parameters (recommended) # ------------------------------------- Disallow: /*?utm_ Disallow: /*?fbclid= Disallow: /*?gclid= # ------------------------------------- # If you use an import/export plugin and want to hide its uploads # ------------------------------------- Disallow: /wp-content/uploads/wp-import-export-lite/ # ------------------------------------- # Sitemap # ------------------------------------- Sitemap: https://energytraining.ae/sitemap_index.xml # ------------------------------------- # Block useless / harmful bots # ------------------------------------- User-agent: Nuclei User-agent: WikiDo User-agent: Riddler User-agent: Zoominfobot User-agent: Go-http-client User-agent: Node/simplecrawler User-agent: CazoodleBot User-agent: dotbot User-agent: Gigabot User-agent: Barkrowler User-agent: BLEXBot User-agent: magpie-crawler Disallow: /