robots.txt
Copy the content below and save it as robots.txt in your domain root.
User-agent: * Allow: / # Sitemap Sitemap: https://musicvortex.net/sitemap.xml # Disallow admin pages Disallow: /admin Disallow: /admin-* # Allow all music content Allow: /browse-songs Allow: /artist/* Allow: /song/* Allow: /playlist/* # Crawl-delay for politeness Crawl-delay: 1
Note: This file should be accessible at https://musicvortex.net/robots.txt