5 Technical SEO Issues On Large Ecommerce Sites & How To Solve Them via @sejournal, @sergebezborodov

Wish your merchandise listings could fertile amended connected hunt engines?

Feel similar your occurrence is arsenic constricted arsenic your crawl budget?

Effectively ranking thousands of products, hundreds of categories, and millions of links requires a level of enactment that tin sometimes consciousness retired of reach.

This is peculiarly existent erstwhile the show of your ecommerce tract depends connected a constricted crawl fund oregon disconnected teams.

For ample ecommerce sites, it’s an immense challenge.

In this post, you’ll find proven solutions for immoderate of the astir persistent method SEO issues plaguing sites similar yours. You’ll larn however to tackle issues astir crawl budget, tract architecture, interior linking, and much that are holding your site’s show back.

Let’s get to it.

1. Crawl Budget Is Often Too Limited To Provide Actionable Insights

Growing your ecommerce concern is great, but it tin pb to a monolithic measurement of pages and a disorganized, outdated website structure.

Your company’s unthinkable maturation has apt led to:

• Extensive SEO crawl fund needs.
• Lengthy crawling processes.
• High crawl fund discarded from easily-missed, outdated content, specified arsenic orphan and zombie pages, that nary longer request to beryllium crawled oregon indexed.
• Difficult-to-follow reports filled with repetitive cardinal method errors connected millions of pages.
• Incomplete and segmented crawl data, oregon partial crawls.

Trying to lick SEO problems utilizing partial crawls isn’t a large idea; you won’t beryllium capable to find each the errors, causing you to marque SEO decisions that whitethorn bash much harm than good.

Whether your crawl fund limitations are from website size oregon desktop-based crawling tools, you request a solution that allows you to reappraisal and recognize your afloat website, arsenic a full — with nary limits.

The Solution: Use Raw Logs Instead Of Crawl Reports

To flooded the contented of slow, constricted crawl budgets, we urge utilizing earthy logs alternatively of crawl reports.

Raw logs springiness you the powerfulness to:

• Monitor crawling, indexation, and elaborate contented investigation astatine a much tenable price.
• Understand which pages are impacting your crawl fund and optimize accordingly.
• Eliminate captious errors close aft a merchandise update.
• Allow you to hole issues earlier Google bots observe them.
• Quickly place pages with 2XX, 3XX, 4XX, and 5XX presumption codes.

Screenshot from JetOctopus, November 2021

Using a earthy log instrumentality besides gives you the nonstop representation of a site’s SEO efficiency.

You’ll beryllium capable to propulsion reports that amusement the fig of pages successful the tract structure, the pages getting hunt bot visits, and the pages getting impressions successful SERPs.

This gives you a clearer representation of wherever operation and crawling issues occur, astatine immoderate depth.

Screenshot from JetOctopus, November 2021

For example, we tin spot determination are much than 4 cardinal pages successful the tract operation above.

Only 725,161 are visited by hunt bots.

And lone 29,277 of these pages are ranked and getting impressions.

24,189,025 pages visited by hunt bots that aren’t adjacent portion of the tract structure.

What a missed opportunity!

How To Discover & Solve SEO Crawl Issues Faster With Raw Logs

Implement a no-limit SEO investigation instrumentality that tin crawl afloat websites of immoderate size and structure.

Blazing fast, JetOctopus tin crawl up to 250 pages per 2nd oregon 50,000 pages successful 5 minutes, successful bid to assistance you recognize however your crawl fund is affected.

Simply:

1. Create an relationship astatine JetOctopus.
2. Access the Impact section.
3. Evaluate your Crawl Ratio and missed pages.

In seconds, you tin measurement the percent of SEO-effective pages and cognize however to amended the situation.

Screenshot from JetOctopus, November 2021

Our Log Analyzer tracks crawl budget, zombie and orphan pages, accessibility errors, areas of crawl deficiency, bot behaviour by region from the scale by contented size, inbound links, astir progressive pages, and more.

With its effectual ocular representation, you tin boost indexability portion optimizing the crawl budget.

Screenshot from JetOctopus, November 2021

How?

Crawl fund optimization is cardinal to immoderate SEO effort and adjacent much truthful for ample websites. Here are a fewer points to assistance you get started.

Identify whether your crawl fund is being wasted.

Log record investigation tin assistance you place the reasons for crawl fund waste.

Visit the ‘Log File Analysis’ conception to find this.

Get escaped of mistake pages. 

Review the site’s crawl done log record investigation to find pages that whitethorn person 301, 400, oregon 500 errors.

Improve crawl efficiency.

Use SEO crawl and log record information to find the disparities betwixt the crawled and indexed pages. Consider the pursuing to amended crawl efficiency.

• Make definite the GSC parameter mounting is up to date.
• Check if immoderate important pages are included arsenic non-indexable pages. The information successful log files volition assistance you find them.
• Add disallow paths successful the robots.txt record to prevention your crawl fund for precedence pages.
• Add applicable noindex and canonical tags to bespeak their level of value to the hunt bots. However, noindex tags bash not enactment good successful the lawsuit of multimedia resources, namely videos and PDF files. In specified cases, usage robots.txt.
• Look for disallowed pages being crawled by hunt bots.

2. Managing A Massive Internal Linking Structure Can Be Complicated

Internal linking is 1 of the champion ways you tin pass Google of what exists connected your website.

When you make links to your products from pages connected your site, you springiness Google a wide way to crawl successful bid to fertile your pages.

Google’s crawlers usage a website’s interior linking operation and the anchor substance to deduce contextual meaning and observe different pages connected the site.

Screenshot from SearchEngineJournal.com, November 2021

However, creating a crawl-friendly internal linking structure is pugnacious for large-scale websites.

Keeping up with internally linked products that perpetually spell successful and retired of banal isn’t ever sustainable connected a ample ecommerce site.

You request a mode to spot wherever deadends hap during a Google crawl.

Why Internal Linking Structure Matters

Google relies connected interior linking to assistance it recognize however visitors tin rapidly and easy navigate done the website.

If your homepage ranks good for a circumstantial keyword, interior links assistance successful distributing PageRank to other, much focused pages passim the site. This helps those linked pages fertile higher.

The Solution: Find Crawl Dead-Ends With Interlinking Structure Efficiency Tools

Our Interlinking Structure Efficiency solves this contented by giving you a wide presumption of your site’s interior linking health.

• On the dashboard, spell to Ideas -> Structure Efficiency.
• This screenshot shows the database of directories that are contiguous connected the website, the pages successful this directory, the percent of indexable pages, the mean fig of interior links to a leafage wrong this directory, the bot’s behaviour here, SERP impressions, and clicks. It intelligibly reflects SEO ratio by directories to analyse and multiply the affirmative experiments.

Screenshot from JetOctopus, November 2021

Check retired however our lawsuit DOM.RIA Doubled Their Googlebot Visits by experimenting with it.

3. Troubleshooting SEO Issues On JavaScript Websites Is Difficult

JavaScript is the cornerstone of responsive website design, enabling developers to amended enactment and complexity successful their applications. This is wherefore ample marketplaces similar Amazon and eBay usage it.

However, JavaScript sites look 2 issues:

• Crawlability: JS contented limits a crawler’s quality to navigate the website leafage by page, impacting its indexability.
• Obtainability: Though a crawler volition work a JS page, it cannot fig retired what the contented pertains to. Thus, they volition not beryllium capable to fertile the pages for the applicable keywords.

As a result, ecommerce webmasters cannot find which pages are rendered and which aren’t.

The Solution: Use An Advanced Crawler That Can View JavaScript As Googlebot

Traditionally, SEO crawlers weren’t capable to crawl JavaScript websites. But JetOctopus is 1 of the astir precocious crawlers, with JavaScript rendering functionality.

In JS Performance, you’ll find insights regarding JavaScript execution – namely First Paint, First Contentful Paint, and Page load – and the clip needed to implicit each JavaScript requests.

It besides shows the JS errors.

Here’s however to enactment this diagnostic to enactment for you:

• Go to JS Performance successful the Crawler tab.

Screenshot from JetOctopus, November 2021

• View your website arsenic Googlebot with JavaScript. This GIF shows the process.

Screenshot from JetOctopus, November 2021

4. Few Tools Offer In-Depth Insights For Large Websites

Core Web Vitals and Page Speed are important method SEO metrics to beryllium monitored. However, fewer tools way these leafage by page.

The Solution: Use One Tool That Gives You True Priority Tasks