ARTICLE AD BOX
What Is Noindex?
Noindex is simply a regularisation that tells hunt engines similar Google not to scale a fixed webpage—to forestall it from being stored successful a database that’s drawn from to amusement hunt results.
This means that erstwhile you noindex a page, hunt engines won’t prevention that page. And it won't amusement up successful hunt results erstwhile radical look for accusation online.
You mightiness noindex pages you don't privation the nationalist to see. Like backstage contented oregon PDF pages connected your site.
In this post, we'll screen everything you request to cognize astir utilizing the noindex regularisation effectively.
But first, let’s spell implicit wherefore you should attraction astir the noindex directive successful the archetypal place.
Why Is Noindexing Important successful SEO?
The noindex regularisation helps you power which pages are indexed by hunt engines. And that allows you to interaction your site's hunt motor optimization (SEO) performance.
For example, let’s accidental you person bladed pages (those that connection small value) that you’re incapable to region for 1 crushed oregon another.
Using noindex rules connected these low-quality pages tin forestall them from negatively impacting your site's SEO performance. And alternatively absorption hunt engines' attraction connected other, much important pages.
That said, you don’t privation to accidentally noindex immoderate important pages connected your site. If you do, they won’t fertile successful hunt results. Harming your visibility and traffic.
So, ever double-check your noindex implementation.
When to Use the Noindex Directive
Various types of contented are premier candidates for utilizing the noindex rule. These include:
- Thin pages: These pages don't connection overmuch worth to users, truthful they tin harm your SEO performance
- Pages successful a staging environment: These pages aren't meant for the nationalist to spot oregon use. They're meant for your squad to marque updates and cheque things.
- Internal admin pages: These pages are meant for you and your team. So, you don’t privation them to look successful hunt results.
- Thank you pages: These pages are displayed to users aft they’ve completed an enactment similar downloading thing oregon making a purchase. You don't privation radical uncovering these pages straight from hunt results due to the fact that it mightiness confuse them.
- Downloadable content: These pages are resources that users are meant to entree by filling retired a form. So, you don’t privation imaginable prospects uncovering them without having to supply their interaction information.
How to Noindex a Page
Now that you cognize which pages request to beryllium noindexed, it’s clip to get to the existent implementation.
There are 2 ways to instrumentality the noindex rule:
- As an X-Robots-Tag successful the HTTP effect header, which is utile for non-HTML files similar PDFs, images, and videos
- As a meta tag successful your HTML, which is utile for astir webpages
Implementing a noindex regularisation via the HTTP header method is rather method and requires server-level changes.
Basically, you request to adhd a enactment of codification to 1 of your server configuration files (usually .htaccess).
For Apache servers (one of the astir wide utilized web servers), the codification looks similar this if you privation to noindex each PDF files crossed your full website.
<Files ~ "\.pdf$">
Header set X-Robots-Tag "noindex"
</Files>
Given the complexity and imaginable risks involved, we urge seeking assistance from a developer. Because adjacent a tiny syntax mistake tin interruption your website.
As for the meta tag noindex method, it's comparatively simpler and tin beryllium implemented straight successful your pages’ HTML.
The tag goes successful the <head> conception and looks similar this:
<meta name="robots" content="noindex">
If you're utilizing a contented absorption strategy (CMS) similar WordPress, you tin often usage SEO plugins to instrumentality noindex meta tags without straight editing code.
To bash that utilizing the Yoast SEO plugin, unfastened the leafage you privation to noindex successful the editor, scroll down to the Yoast SEO section, and click the “Advanced” tab.
Under “Allow hunt engines to amusement this contented successful hunt results?,” prime “No” from the drop-down.
Then, prevention the post.
To usage the Rank Math SEO plugin, unfastened the leafage you privation to modify successful the editor, spell to the Rank Math SEO section, and click the “Advanced” tab.
Under "Robots Meta," uncheck the container adjacent to "Index" and cheque the 1 adjacent to "No Index" instead.
Save the station to update your settings.
Best Practices for Using Noindex Rules
Here are immoderate champion practices to support successful caput portion you’re moving with noindex directives.
1. Don’t Noindex Pages You Want to Appear successful Search Results
The noindex regularisation prevents a leafage from getting indexed and shown successful hunt results. So, if you privation a leafage to beryllium recovered done search, don't noindex it.
Use Semrush’s Site Audit instrumentality to marque definite you haven’t accidentally noindexed important pages.
Open the tool, participate your domain name, and click “Start Audit.”
Follow the prompts to configure your settings.
When you’re done, click “Start Site Audit.”
After the audit is complete, caput to the “Issues” tab. And usage the hunt barroom to participate “noindex.”
You’ll spot the fig of pages blocked by noindex tags oregon robots.txt (this record tells hunt engines which pages should and shouldn’t beryllium crawled). You’ll besides spot whether immoderate pages are noindexed utilizing the X-Robots-Tag method.
Click the bluish fig successful either contented to presumption the database of affected pages. And verify that nary of those pages person accidentally been noindexed.
2. Don’t Try to Prevent Indexing Using Your Robots.txt File
The robots.txt record tells hunt engines which pages to crawl—not which pages to index.
Even if you artifact a leafage successful robots.txt, hunt engines mightiness inactive scale it if they find links to it from different pages.
Plus, you really request hunt engines to beryllium capable to crawl your pages for them to spot the noindex tag.
Check your robots.txt record to marque definite it's not blocking pages you privation to noindex.
You tin bash this by visiting “[yourdomain.com]/robots.txt.”
Look for the "Disallow" directives successful your robots.txt file.
These archer hunt engines which pages oregon directories they shouldn't access. So, marque definite the pages you privation to noindex aren't listed here.
3. Take Steps to Address Nofollow Issues That Might Arise
Noindexing tin harm your SEO if the webpages you’re blocking from appearing successful hunt results are among the lone links pointing to immoderate of your different pages.
How?
Search engines volition lone travel links connected a noindexed leafage for a while. And yet dainty those links arsenic nofollow (i.e., that they shouldn’t beryllium followed oregon walk ranking strength).
If determination are different pages connected your tract with fewer interior links and immoderate of those links are from your noindexed content, it tin go much hard for hunt engines to find those different pages.
So, they whitethorn not look successful hunt results. Even if you privation them to.
Use Site Audit to look for the “# pages person lone 1 incoming interior link” announcement and click the bluish number.
You’ll past spot the affected pages.
Work to incorporated much links to these pages crossed your site.
This is simply a bully thought adjacent if the lone incoming interior nexus isn’t from a noindexed page.
4. Don’t Use a Noindex Directive for Duplicate Content
Duplicate content is erstwhile you person 2 oregon much pages that person precisely the aforesaid oregon precise akin content. Which makes it hard for hunt engines to determine which mentation to scale and fertile successful hunt results.
It mightiness look similar utilizing noindex tags connected duplicate pages is simply a bully option, but this isn’t the champion solution.
Instead, see utilizing canonical tags.
They archer hunt engines which mentation of a leafage is the main 1 and should beryllium indexed. Most importantly, they besides consolidate ranking spot from each versions to the main page.
5. Request a Recrawl if Noindexed Pages Still Appear successful Search Results
Noindexed pages mightiness inactive look successful hunt results if Google hasn’t recrawled the leafage since you added the noindex tag. But you tin velocity up the process by manually requesting a recrawl.
To bash this, usage Google Search Console (GSC).
Log successful to GSC and click “URL inspection” successful the left-hand menu.
Now, paste the URL of the leafage you privation Google to recrawl. And deed return.
And click "Request Indexing."
Google volition past recrawl this page.
6. Regularly Review Your Noindexed Pages
It's important to cheque your noindexed pages from clip to time. Because mistakes tin hap without you noticing. Like if idiosyncratic connected your squad accidentally noindexed a page.
By monitoring your noindexed pages regularly, you tin find and hole these mistakes quickly. So you don’t spot a dip successful performance.
Keep way of your noindexed pages utilizing the Site Audit tool.
To marque things adjacent easier, docket regular scans.
Just spell to the “Schedule” tab during setup. And prime the enactment to show your website connected a play ground earlier clicking “Start Site Audit.”
This audit volition tally connected a play basis. So you tin enactment connected apical of immoderate issues that mightiness harvest up successful the future.
English (US)