Discuss Discovered Currently not Indexed by Google SE



The Summary of Discussion 2: Discuss Discovered Currently not Indexed by Google SE
Abby
Anyone knows how I can get a new site indexed by google? I've read the guidelines and all, allowed robots.txt, web pages are accessible, basically, no problem for Google to not index my site, yet not even crawled. It's been 3-4 weeks since, and still no show on google
Suggestions?
3 👍🏽336 💬🗨

📰👈

discuss discovered currently not indexed by google se
🔗🏹

📰👈

📰👈

Kieran
Try and submit the URLS manually and create more content which is a bit of a pain. Try and get some clicks from other folks through backlinks or social. rinse and repeat

Abby ✍️ » Kieran
It's a new website, a photography course, and at the moment, the only content we can create is the course and the home page.
I had a website few months back, only 1 article and it got indexed fast, so not sure about creating more content before it gets indexed


Ammon Johns 🎓
The single biggest thing you can do to get a site indexed is to start out with at least one page on it that can earn a few links, and then get it seen by a few people who may provide those links.
Google figure that if a website can't get even one single user, customer, partner, or supplier, to care about it enough to link to it, then the chances anyone else will be interested in it are slim to none.
Bogdan
Start with sitemaps, improve your internal linking flow to make your main pages look important, make sure your content is solid, original and of true value to your potential readers. Doesn't hurt to push some social shares too. Then wait. But while you wait, build some new content, but for quality, not quantity. Then keep on doing that. And then… some people say start building links. Personally, I don't see how an unknown page could get such things, but I never looked for success in 3 weeks, so I simply never tried early linking

Ammon Johns 🎓 » Bogdan
Nobody should be an 'unknown person' really. If you expect to have the skills and knowledge to succeed in an online venture then surely you have friends, family, and contacts already online? How bad would a site need to be that its developers wouldn't link to it as an example of their work? Are your suppliers ashamed to say they deal with you? Is there a local Chamber of Commerce you belong to and do they have a website?
Anyone should be able to get a few links based on their connections, reputation, etc. and just a few is all you need to at least show Google your site is a real thing, not the dreamed up nothing of some kid in a basement with no real-world credibility, right?
If you really struggle, having not a single online contact, no family or friends with webpages that can be crawled, then you can always turn to your expertise. Write some great article for somewhere else that draws on your knowledge or unique experiences and in your byline put yourself down as Owner/Chief Executive Officer (CEO)/Whatever of the site with a link. The original form of guest posting, trading your knowledge to get in front of someone else's built audience.
💟2
Bogdan » Ammon Johns
Now, is unknown. How to make it known before Google found out about it – your ideas are gold. But my idea is – make it known somehow before getting the links (opposed to the usual "start buying them")


Aasim
Well it's astonishing. Hearing first time that Google is not indexing a website. Here are two things which I suggest (not from experience):
1. Submit it to Bing.
2. Buy 1-2 expired domains and redirect them to your website or migrate your site to an expired domain and see.
Micha
What topics does the site cover? Is this health-related?

Abby ✍️ » Micha
Food photography*
Micha » Abby
Is it mostly a gallery of pictures? How much text are you including in the captions/articles?
Abby ✍️
It's a course website, basically just a home page about the course, and 3-4 articles
then you have to signup/buy the course.
I checked other similar sites (other sites hosted on teachable as well) although they are locked and can't access if not a member, it's still ranking
what my client wants, is to be able to index just the couple of pages to be able to search for the name of the site, but then how can I do that without being able to index just a page?
Micha » Abby
You should confirm that Googlebot is actually visiting the site by reviewing the server log file.
You should familiarize yourself with Googlebot's legitimate IP address ranges. Also, the Mobile-friendly Test Tool and PageSpeed Insights tools have their own ranges.
DEVELOPERS.GOOGLE.COM
Googlebot and other Google crawler Verification | Google Search Central | Google Developers
💟
Abby ✍️ » Micha
Thank you!
and I'm guessing I'll have to access the hosting to access the server log file?
And if i see that Google is not visiting my site, what do you suggest I should do other than requesting it on Google Search Console (GSC)
Micha » Abby
Yes, you need access to the Webhosting dashboard.
If Googlebot is not visiting the site, you'll need to run through a list of possible reasons. The Webhosting company could be blocking it, for example.

📰👈


The Summary of Discussion 1: Discuss Discovered Currently not Indexed by Google SE
Ryan
Ok, Search Engine Optimization (SEO) masterminds – I've asked this question before but I'm still stuck on it.
i have a website that has woo commerce and all the shopping pages are showing in the search console as "Discovered – currently not indexed"
we have literally followed every instruction we can find on the subject – we have also optimised the page speed and all Google lightbox data and it still won't index … any suggestions anyone?
3 👍🏽35 💬🗨

📰👈

Perez
If ALL your pages are not indexed. I'd definitely start by looking at general settings at the site-level. Are you using a cms? Make sure any plugins you have aren't blocking these pages or their parental categories. Are there noindex tags at the page-level? Is the content original, are the meta Titles and description duplicates from other websites? If so, how old is your site? Do you have any robot files outside of your cms install? It could be a million things… Dig deeper

Ryan ✍️ » Perez
cms WordPress – content is original the meta tags are also original the site is old these pages are news the robots file looks correct.
Aboouda the url
only the woo commerce pages under the hire sections are not indexing – really stuck


Daniel
Yep share the URL and it will get solved.

Ryan ✍️ » Daniel
URL is above
Ryan ✍️
Hire
4HEALTHCARE.COM.AU
Hire
Daniel » Ryan
Right away I can tell you your site performance is not where it needs to be … I can tell your using a site side cache system but what do you have on the server side? That's where it really counts when it comes to "Robots," they don't care about site side "browser caching tech" it's your origin server metrics especially when it comes to Google Core Web Vitals (CWV) that matters. Now, once the page loads and it's cached on my browser its fine on refresh, so if a 1st time user waits the 10 seconds to load then you can get some User Experience (UX) factors happening but then again I will wager they will not wait another 10 seconds to allow the next page to cache in the browser and instead its a 1 page view bounce … I'm pretty certain this sitewide issue is the issue and likely especially gets bad for those pages Google refuses to index. I bet you can confirm by looking at your UX metrics in SC, or Analytics. You will see a lot of 1 page view visits, but that's it. This is on 1st glance … I look a bit more deeply to see if there's really anything else that I can find without access to all backend software.
I know you said you did a bunch of performance work but I can also tell you that you cant go nuts trying all kinds of stuff out because your database gets messed up, and it usually takes you backwards. It's tricky this site when it comes to preformance opt … this is not a boring site its very nice. That however means your DEV style may be an issue as well …
Ryan ✍️ » Daniel
Dev Style?
Daniel » Ryan
You might try getting rid of Yoast for Rank Math as well … Yoast has been known to cause indexing issues … I see some Cascading Style Sheets (CSS) is in line so I see you're trying …
Ryan ✍️ » Daniel
Rank math isn't active, but what ill do is convert to rank math.
Daniel » Ryan
WP Rocket is good stuff … it may just be some config issues …
Yeah about the DEV style, it looks like your using woo blocks yes?
Ah yes Beaver Builder …
This source code looks like its been through A LOT of changes and seen many plugins …
Ryan ✍️ » Daniel
Yeah we have been trying to get it to index
Daniel » Ryan
About Yoast, right your using it, but RM seems to be the choice on right now as that Chief Executive Officer (CEO) is on fire. It could very well be that simple … switch to RM, I did a couple years ago and never looked back. But this is a multifaceted issue for which you will find no one answer. Hopefully you just get enough feedback or bring n a real pro to optimize your code.
Ryan ✍️ » Daniel
Any suggestions on where to start
Daniel » Ryan
How many plugins you rockin? I hope you have only used BB, and WOO, but if you are on top of that using other page builders even just to accomplish a slider or something that's not good. Beaver Builder, WP Backery, Slider Rev, but don't mix match … btw SR is the lightest and cleanest of those but that would be way to big of a change for you.
Ryan ✍️ » Daniel
We can do that – can we chat in messanger easier?
Daniel » Ryan
ACTUALLY IT'S NOT LOADING TERRIBLE RIGHT NOW … YOUR DEFINETLY ON A SHARED HOSTING PLAN …sry caps, that could be why it was tanking for a minute there. So that's looking OK after all … hmmm
Ryan ✍️ » Daniel
So your saying moved to non shared
Daniel » Ryan
That's why its best if you can to get on a Virtual Private Server (VPS). I would check you server I/O, and Resources to see how often you hit the ceiling because it was hitting the ceiling when I first looked. You are not using a Content Delivery Network (CDN) either that I can see right? Let me do a trace in Network and see
Ryan ✍️ » Daniel
Server resources – look fine to us from the hosting side.

📰👈

discuss discovered currently not indexed by google se
🔗🏹

Daniel » Ryan
Got to be carefull using all these 3rd party scripts … you also have 1 CSS style sheet 404 and a .js 403 going on in here.
Last thing for now … how your Cumulative Layout Shift (CLS) is 0 = another possible candidate indicating issues. That score is for people that straight hard code sites, in order for you to be clocking a 0 CLS, it means something is broken … IMO. Well I hope you get something out of all that. This is a tough one I can tell and like I said you may be better off bring someone in to optimize this for or do a real TECH audit. It looks like you have poured your heart and soul into this … a lot of work. So its very nice you just got to solve this riddle. let me know if anything else … would love to learn what else you find out.
Ryan ✍️
any suggestions on who?
Daniel » Ryan
See here is a screen shot of the network inspect elm … a good place to find trouble but yours loads literally 4 times more things then my waterfall … you have WAY TOO much going on with these 3rd parties. You will also find those 400 errors I mentioned in there …

📰👈

📰👈

Daniel » Ryan
Ok done lol … let me know. For real would like to see how this pans out for you.
Ryan ✍️ » Daniel
Thanks
Daniel » Ryan
Yeah but what's the historic and where's this view from? You want to go to cpanel and have a look at this historically not a snapshot. Because the whole point is that it's the spikes from whatever third parties that are also being hosted that cause a temporary bottleneck and what is experiences what I experienced five pages they were all loading in like 10 seconds. But then that stopped on incognito and everything. And it doesn't look like you have a CDN so I wasn't caching CDN nodes. Hell for all I know it could be content orientated I just did a brief tech SEO tech performance high view if you will for you. The s*** can get real deep dude … I would definitely try and have a look at your server's history and see if there are any spikes.
In the end time is money anyway so you might like I said whant to higher someone to do an audit. I would recommend Cody from Search Bloom. He'll get you sorted. I can do it too but I am buried right now in six different sites.
Do try everything else everyone else is talking about man that's what troubleshooting is just roll it all out until you finally find what it is and in this case I'm pretty sure it's multifaceted.
Ryan ✍️ » Daniel
I've already done the rank math change.
Ill be putting the site on the demo server tonight and changing the beaver builder – to Slider Rev
Daniel » Ryan
OK on demo server try it out … its a completely different beast though. However, if your good with Adobe products I think you will pick it up pretty fast. It works just like PSD, layer based and while you can deploy block and column structures, you are also free to completely paint on a viewport canvas as you please, and then drop to the next one and style shift layout manually … some could call it extra work but if you want 100% control over your designs SR is pretty bad ass. And preforms well. But I pointed out earlier that it's not good to put a site through so many massive changes because your database is getting wrecked. Sure you can get a plug in like WP Optimize which is very good at optimizing a database for a plugin, but what have you then done? Added yet another plugin that in this case I know leaves trainsiants, code snippets and even looks a .js minify folder on you and if you don't know this look at the trouble you get into… I'm here to help as much as I can my friend. Keep me informed.
Ryan ✍️ » Daniel
Is it worth cleaning up the db?
Daniel » Ryan
Not just the DB, but like I said you have a LOT of 3rd party scripts going on. Your waterfall is 4 times bigger then mine and I build full on custom Creative sites with videos and all kinds of dynamics, so that's also a part of old shit that is not only database related but, in your files there is some transient code f*cking you up right now I bet; numerous. This is what I meant by DEV style. You need to find your Secret Sauce and hone it in, so that when you build a site, the only real consistent changes that happen have simply to do with content, but when you put a site through all kinds of theme's, plugins, ESPECIALLY PREFORMANCE plugins, 3rd party Application Programming Interface (API)'s, Page Builders, on and on you try, the worse it can all get. So this can be cleaned up I know. Whether some free help from us is enough I do not know, but at some point you got to under stand how valuable your time is and truly qualified person will cost you, but solution you will get, and move on you will. Not trying to get a client here, nor refer because of an agenda like when I mentioned Codey from Searchbloom. I only recommend him because I can vouge for him is all. There are many qualified persons out there so whoever … this might be your best route my friend. Or who know maybe its one simple thing ,,, crazy right the truth about what we do. I love it. THE ULTIMATE CHESS GAME.
Ryan ✍️ » Daniel
This one is a hard one – hardest one I've done
💟1
Daniel » Ryan
Therefore it is the most valuable one you have ever done, the experience you are gaining!! 💯😎
Ryan ✍️ » Daniel
Just trying to get better at the craft every day
💟1
Daniel » Ryan
And you're doing it and this is how you do it. Life is a journey man just build fail strategize analyze and coming data deploy strategy analyze fail try again until you hit but no that the journey continues and more riddles await that's life you're on the journey brother.
You know I was half a sleep when it hit me … link maps, crawl budget and site hierarchy = your problem. Amongst others but this is the one messing the indexing of your site up. 100% certain of it. So I jumped up "couldn't sleep anyway, and random answers often come into my mind like that" and had a look and sure enough this is your problem. It's crawl budget, hierarchy, link maps, and click depths may be involved but I haven't seen that yet. Did you know while product search works for anything in "Products" it fails for everything in "Hire?" If it fails so to are the bots. I will have some visuals that will blow your mind coming up. About "Link Map."
This is your sites "Link Map" "Hiearchy" "Crawl Budget = paths the bots take"

📰👈

📰👈

Daniel
Now to keep this simple another term that comes into play is "Orphaned Pages." this is a page not in the main navi but that cannot be gotten to by any follow links originating from your main navi … this is happening on your site because you permalinks are really messed up in the Hire section which is that giant cluster … take not most of those outer dots are actually cart items … that shouldn't be there either. But more clearly … you cant go from —-> —–> then all the sudden click one of the actual product's on that page and you go to ——–> … this is your issue my friend – solved. At least you know what's going on now. I've exhausted my pro bono time per week lol so maybe now armed with the issue you can get this fixed but someone else needs to take it from here lol. Good luck!
Medical Equipment Hire Perth | Huge Range | 4 Healthcare
4HEALTHCARE.COM.AU
Medical Equipment Hire Perth | Huge Range | 4 Healthcare
Daniel » Ryan
But this is also why the search fails when in the Hire section.
So you would be asking around for a site hierarchy audit. Which is a tech Search Engine Optimization (SEO) issue.
One way to confirm this is go ahead and have a look and I bet you will find the indexing ends at that click depth 2 page, but for blog post sections and e-commerce sections you can go click depth 3, just in case that's why you tried to make this work with only two clicks. Site pages hierarchy should be no more than two deep.
This is what will solve your issue URL needs to be https://4healthcare.com.au/hire-products/bathroom-toilet/classic-bedside-commode/
Medical & Disability Equipment Supply Perth, WA | 4 Healthcare
Ryan ✍️ » Daniel
Ok re read this a couple of time so your saying i need better interlinking?? or are you saying that because there is a hire section and a product section that its confuisng to Google bots?
Daniel
/ hire / product types / product / )<—- that is the proper hierarchy. What you have done with the Hire section is this: ( / hire / product types /?? ) this is how the BOTS SEE it. Because you change your click depth 1 extension on that 3rd click to ( / products / product / ) You break the chain, the crawl by doing this and confuse the hell out of the search engines, this is why it's discovered but not indexed. They are telling you we see it but it doesn't make sense.
Ryan ✍️
right so your saying if if i change the url structure for the hire section.
Daniel » Ryan
Yup all you got to do is restructure your sites hierarchy for the Hire section. If its a Hire product keep the prior 2 extensions, and simply make the next click/extension the exact Hire product creating your 3rd depth, and I grantee all this goes away.
Ryan ✍️
how do i segregate the 2 different sections the hire section and the purchase only section? the
so currently – this is set out like this
purchase only
(this is indexing)
(product name) this is not indexing
so for this, the above URL needs to be changed to
this is my first question? Is this correct
Daniel » Ryan
Just as you go forward trying to find help with this … make sure to point out that you think your having a site hierarchy TECH SEO issue with your cats, products, and also some permalink structures. Like for instance this looks like a discrepancy to me in this image that is also connected to this topic and is creating too much confusion the bots cant make sense of it. There is going to be a lot more to this then the tip of the iceberg which is where I'm talking from … those examples just show how it has to look when the robots come and crawl, however making that happen can be done in many ways, but it's not happening because as you said the actual product page is not getting indexed. But the bots are seeing the page "Discovered" not indexed = but it doesn't make sense so we wont index this.

📰👈

📰👈


Aboouda
i looked at the website performance, still need to be optimized.
– As you mentioned, all sub directories under : /hire-products/ , are not indexed yet, i don't if you tried the next test :
1- add in your Google Search Console (GSC) sitemap's list : "in parallel with the main sitemap"
2- Disable the rocketloader
3- add a new page under "/hire-products/" with only a text content" don't include any product.
4- comment the "robots" tag, and let Google crawlers decide
5- include : in your robots file
6- submit the new created page for index.
4HEALTHCARE.COM.AU
4healthcare.com.au

Daniel » Aboouda
Definitely some good recommendations but I honestly believe I did solve it. Is hire section is basically an orphaned section. Hence Google's discovering it but they will not indexed orphaned pages. The long explanation including a visual link map showing hierarchy issues is in my reply. See what you think of it. This solution you've given him I don't think quite applies now that I discovered the issue, this is more for when Google is bugging out like they have often been lately, or about fixing some of his site performance issues and is good stuff. But this is a hierarchy issue. Or a link map or a crawl budget issue. Quite a few phrases can fit.
Oh you know what you pointing out the site map is definitely related to what I'm talking about. See that can be a second part of it.

📰👈



Leave a Reply

Your email address will not be published. Required fields are marked *