Published: June 20, 2023
60
27
233

Right then - what are we all doing about 'Crawled - currently not indexed' pages? It's never been an issue for me, but with this new AI site of mine Google is saying nope to about 1 in 3 pages. Is the content just not good enough? Share your strategies please 👀

Image in tweet by Niche Site Lady

@NicheSiteLady The best strategy I've found is to use an indexing tool like #ae243 class="text-blue-500 hover:underline" target="_blank" rel="noopener noreferrer">https://indexmenow.com/en/#ae2... (aff link) If your pages don't get indexed, try changing the title tag and resubmitting. I've had good success with that for stubborn pages that don't get indexed!

@iannuttall Thanks Ian! I'll check it out.

@NicheSiteLady This site is still very young, right? That’s usually the issue. Having a couple of internal links to those pages will help in time.

@MintedEmpire Yeah really young. It has internal links, so just wait it out?

@NicheSiteLady Push all your sites through CloudFlare and enable this. CloudFlare has tons of other performance features too

Image in tweet by Niche Site Lady

@shanejones Done! Thanks 🙌

@NicheSiteLady For a new site, it takes time. But if an old site with trust starts seeing this number increasing, it’s content that needs improvement

@navdeepsoni Good to know thanks.

@NicheSiteLady Completely AI written or has a human touch as well?

@htiqbal human edited

@NicheSiteLady rankmath instant indexer plugin is sick, do you have it installed?

@NicheSiteLady . 2010 has called, and said this might be useful? https://docs.google.com/docume... (ignore the horrendous typo's etc., these things were literally smashed out due to sheer volume of repeat questions in the GWMF) >>>

@NicheSiteLady Internal links and an indexing tool like TagParrot or Omega Indexer With this I managed to get some stubborn pages indexed in about 48h after weeks of waiting.

@NicheSiteLady I’ve seen this issue come up a number of times recently, especially for new sites going 0 to 100 on AI content. If we can detect AI generated content reasonably well at @GoPositional with our 3 person eng team, I’d like to think that Google could pretty easily detect it too.

@NicheSiteLady Mine are 100% indexed, usually within an hour from publishing. Building backlinks helps to speed up indexing. Also, I have some content that's updated daily by my VA. This forces Google crawler to come back to your site more often.

Image in tweet by Niche Site Lady

@NicheSiteLady I’ve had similar issues with my niche website back then (and other times), so: - Google API with a simple script will usually get you acceptable results (not 100% indexing but a good chunk), 2 mins to do it - Indexmenow / Omega - Paid but extremely solid, didn’t test in depth

@NicheSiteLady @indexmenow is what I use. Contrary to what others say, they never get de-indexed either.

@NicheSiteLady With new sites is usually a page rank issue. Sounds a bit mad but if you link to them all from the footer it will help. The indexing tools mentioned won’t do anything as it’s already been crawled so you can rule out discoverability.

@NicheSiteLady Other, similar question: What to do with pages where GSC says they are indexed but even a search for the KW with “site” parameter Leads to no results at Google? It’s like a “shadow ban” 😅 and they are basically not indexed. Why? How to fix?

@NicheSiteLady This thread got me thinking. I have a site in a similar situation. Google is not indexing it and submitting in GSC is not working. I did some research this evening and started playing around with the Google indexing API. 2 and a half hours later and all the pages I submitted via

@NicheSiteLady Easiest way to jolt those pages into getting indexed is by building a backlink to them; guest posting. OR... There is an awesome article here from @MattWoodwardUK about which indexing tools he has used and triumphed with 👇 https://www.searchlogistics.co...

@NicheSiteLady Try: site:URL (of the apparently not indexed page). If it shows up its indexed. I had 100+ posts “crawled -not indexed”, re-did many ot them, photos etc. a month later they were still only crawled. Upon looking up half of them with “site:URL” i found 90% were actually indexed

@NicheSiteLady This thread is so awesome, learned so much from the answers, and my Cloudflare is top-notch now đŸ€©

@NicheSiteLady https://www.seroundtable.com/c... Bottom line: usually quality issue which is deeper than just on the surface content changes.

@NicheSiteLady Indexed through Rank math extension, API quick indexing, that will index very quickly no matter AI written content..

@NicheSiteLady Try 'Test Live URL' then 'Submit For Indexing' that page manually. Usually gets indexed within 24 hours.

@NicheSiteLady In my case only pages created with an AI tool have these issue. I ended up reworking all of these pages without using the AI tool and they all got accepted right away. Apparently Google does not like content created with AI tools 😐.

@NicheSiteLady I have faced this issue. I had updated my pages; added or removed content at page level, added visuals and internally linked. And almost all done. I have 4 remaining out of 110. But I'm not much caring about them.

Image in tweet by Niche Site Lady

@NicheSiteLady for blog content I find EEAT signals and readability improvements help the most. Author bio, last updated stamp, table of contents, related resources etc

@NicheSiteLady Changing the URL/permalink works like magic for me

Share this thread

Read on Twitter

View original thread

Navigate thread

1/32