The robots.txt file informs search engines which pages on your website should be crawled. This can easily be edited with the Rank Math SEO plugin. If you aren’t already using Rank Math on your website – learn more & get started here.
In this tutorial, we’ll show you how you can edit your robots.txt file with the help of Rank Math. In order for you to be able to edit your robots.txt file using Rank Math, you’ll need to delete the actual robots.txt file (if any) from your website’s root folder using an FTP client.
1. Log in to your WordPress website. Make sure you have enabled the Advanced Mode. Go to your WordPress Dashboard > Rank Math > General Settings > Edit robots.txt.
2. Save your changes by clicking on Save Changes once you have made the necessary changes to the file.
You can also create an actual robots.txt file in the root folder of your website (on your server). If you are not sure where you need to upload the file then you can contact your web host for further assistance.
Please be careful while making any major or minor changes to your website via robots.txt. While these changes can improve your search traffic, they can also do more harm than good if you are not careful.
Was this article helpful?
Still need help?
Submit Your Question
Please give us the details, our support team will get back to you.