# Robots.txt for Agri Herbs Pvt Ltd # Website: https://agriherbals.com User-agent: * Allow: / # Prevent crawling of technical or non-content paths Disallow: /cgi-bin/ Disallow: /scratch/ # Search Engine Sitemap Sitemap: https://agriherbals.com/sitemap.xml