1. Home
  2. Knowledge Base
  3. Why Google Hasn’t Indexed Your Post, Page, and/or Website?

Why Google Hasn’t Indexed Your Post, Page, and/or Website?

Does it feel like you have done everything right, yet your website still isn’t showing up in search?

If you want your site to show up in the search results, then it has to be indexed. However, you do not want your site to be indexed just once – you want to make sure that search engines can recrawl and continuously index the pages of your website (including new ones you publish).

Well, search engines like Google don’t always instantly update their index to reflect actual changes on websites. As a matter of fact, Google might take days or even weeks to index your site. Simply put, it is absolutely normal for a newly published post/page/website to take some time before it gets crawled or indexed by Google.

There are various factors that Google considers while indexing. Your frequency of posting and your site’s domain authority are just two of the many factors Google considers when indexing new webpages.

Google assigns a crawl budget to your website depending on these factors (especially these two) and that has a direct effect on how soon (i.e. how efficiently) your content can be indexed.

Also, we have found that barring any issues like copied/DMCA/low-quality content issues – Google usually indexes posts within a week or two. So, we request you to kindly wait, as this is something they have confirmed in an official statement on their support website.

To get started, here’s a list of things to start checking to ensure there’s nothing preventing Google from indexing your entire website or a specific webpage on your site:

1 Double Check That Your URL Definitely Hasn’t Been Indexed

Before we dive in, it’s important to check whether or not your webpage actually isn’t indexed or just isn’t ranking for the search terms you’re checking for.

Bing Indexing API

There is a distinct difference, and one quick way of checking this is shown in the image above. Simply enter the URL of the page you want to check in Google search and in this case the URL entered is clearly indexed.

Fortunately, Rank Math has made it extremely easy to take advantage of the Google Instant Indexing API as well as the Bing Instant Indexing / URL Submission API – meaning that once configured, you no longer need to worry about getting search engines to crawl & re-crawl your URLs as soon as you publish or update them.

2 Ensure Your Post, Page & Website DO Not Have The Noindex Attribute Present

There is a possibility that even a small-overlooked detail can leave a big impact.

Googlebot visits a site in order to determine which pages are either nofollow or no-index. In other words, It informs the search engines about the pages that they can visit and the pages that they can’t visit.

You need to ensure that you haven’t set your posts, pages or entire website to nofollow as this would prevent search engines from indexing your website.

3 Check Your WordPress Global Settings

If there is noindex, then check the global settings at WordPress Dashboard > Rank Math > Titles & Meta > Posts/Pages/Products/CPTs.

Also, ensure the Discourage Search engines… option is not enabled at WordPress Dashboard > Settings > Reading

A lot of web developers choose the above option to prevent Google from indexing a site during the development process (on staging websites) but forget to remove it before publishing.

4 Ensure Your Robots.txt Rules Allow Your Website To Be Indexed

The Disallow tag (in your website’s robots.txt file) blocks Google from crawling all the pages on your site. You can check for the disallow tag and make sure that there is no such tag present in the robots.txt that is preventing your page from being indexed.

If there is a disallow tag, then change that using robots.txt editor in Rank Math at WordPress Dashboard > Rank Math > General Settings > Edit Robots.txt

Robot.txt

Related: If you want to learn even more about Robots.txt files and how they work, ContentKing’s extensive guide on Robots.txt files is an excellent read.

Manual Indexing Request

If you’ve checked all of the above, but your website still hasn’t been indexed even weeks after trying – we recommend submitting a manual indexing request.

However, it is important to note that John Mueller from Google has stated that if your website relies on manual index submission for normal content, this is a sign that you need to significantly improve your website. The Google Search Console can’t fix your site, you need to do that yourself.

With that being said, in terms of next steps that you can take – here’s a good article from the team over at Ahrefs on how to ensure that your website gets indexed regularly.

Was this article helpful?

Still need help?

?

Submit Your Question

Please give us the details, our support team will get back to you.

Open Ticket