穀歌機器人案頭爬網會導致索引延遲嗎？通過@sejournal，@martinibuster

Google’s John Mueller answered a question astir whether it matters to indexing velocity if Googlebot mobile oregon Googlebot desktop crawls a page. The idiosyncratic asking the question was disquieted astir dilatory indexing and wanted to cognize if getting crawled by Googlebot desktop (instead of Googlebot mobile) was the reason.

Googlebot Desktop and Mobile

Google has a multitude of website crawlers that travel from nexus to nexus discovering caller web pages to crawl and index.

If you look astatine your postulation logs you mightiness see:

• Googlebot Desktop
• Googlebot Smartphone
• Googlebot Image
• Mediapartners-Google (Mobile AdSense)
• FeedFetcher-Google
• Google-Read-Aloud
• AdsBot-Google
• Googlebot-Video

Those are conscionable a fewer of the Google-related Google crawlers that tin sojourn a website.

The question John Mueller answered was chiefly acrophobic with Googlebot Desktop and Googlebot Smartphone and what interaction connected indexing the desktop mentation mightiness have.

This is the question:

“Our website’s posts are being indexed aft 1 week. The tract is aged and mobile-friendly.

When I taxable URLs successful Inspection Tools, it shows it’s crawled by Google smartphone.

But successful the About section, the indexing crawler is shown arsenic Googlebot Desktop.

Does this mean the Smartphone bot is crawling the URL and the Desktop bot is indexing this URL?

Is this the crushed down the indexing delay?”

John Mueller’s answer:

“This would not beryllium a crushed for immoderate benignant of indexing issues.

I don’t cognize offhand wherefore you mightiness spot this premix of desktop and mobile crawlers there.

It mightiness conscionable beryllium that the Search Console is fundamentally saying well, by default, the Inspection Tool volition conscionable usage the mobile Googlebot.

In practice, we ever crawl with some of these crawlers.

It’s conscionable a substance of however overmuch we crawl and scale with immoderate of these crawlers.

So, usually you’ll spot thing similar 80% is coming from mobile Googlebot and 20% possibly from desktop Googlebot.

And that benignant of ratio, that is fundamentally mean and doesn’t mean that things are slower than thing else.”

Related: Why GoogleBot Doesn’t Crawl Enough Pages connected Some Sites

Multiple Versions of Googlebot Crawl Websites

Google’s Googlebot enactment leafage states that some versions of Googlebot sojourn web pages.

According to Google’s authoritative documentation:

“Your website volition astir apt beryllium crawled by some Googlebot Desktop and Googlebot Smartphone.

You tin place the subtype of Googlebot by looking astatine the idiosyncratic cause drawstring successful the request.”

According to Mueller and Google it’s wholly mean to beryllium crawled by some and there’s nary indexing interaction related to getting crawled by Googlebot Desktop.

Citation

Google’s Googlebot Page
Googlebot

Google’s Overview of Google Crawlers (User Agents)

Does Predominantly Googlebot Desktop Crawl Cause Indexing Delay?

Watch the video astatine the 34:28 infinitesimal mark

Subscribe to SEJ

Get our regular newsletter from SEJ's Founder Loren Baker astir the latest quality successful the industry!