# Allow all search engines to crawl everything except admin and API User-agent: * Disallow: /admin/ Disallow: /api/ Disallow: /config/ Disallow: /includes/ Disallow: /robots.txt Disallow: /?page= # Sitemap location Sitemap: https://blog.powerlineresearchpublication.com/sitemap.xml # Crawl delay (optional, in seconds) Crawl-delay: 5