# robots.txt for readmaududi.com User-agent: * Allow: / Disallow: /api/ Disallow: /auth/ Disallow: /profile Disallow: /subscribe # Sitemap Sitemap: https://readmaududi.com/sitemap.xml # Legacy WordPress Sitemaps Sitemap: https://www1.readmaududi.com/wp-sitemap-posts-post-1.xml Sitemap: https://www1.readmaududi.com/wp-sitemap-posts-page-1.xml Sitemap: https://www1.readmaududi.com/wp-sitemap-taxonomies-category-1.xml Sitemap: https://www1.readmaududi.com/wp-sitemap-taxonomies-post_tag-1.xml Sitemap: https://www1.readmaududi.com/wp-sitemap-taxonomies-post_format-1.xml Sitemap: https://www1.readmaududi.com/wp-sitemap-users-1.xml # Crawl-delay (optional, helps prevent server overload) Crawl-delay: 1