Volume Update! Why Semrush Search Volume is the Most Accurate on the Market (Study)

2 years ago 350
ARTICLE AD BOX

The contents of this nonfiction see a survey of SEO platforms' keyword information successful the US portion ran by Semrush successful Q4-Q1 2021-2022

As a marketer, your occurrence depends highly connected the prime of the information you usage to marque decisions. 

At Semrush, it's our occupation to springiness you the highest prime information we tin provide.

So, a small implicit a twelvemonth agone we acceptable ourselves a goal. We wanted to absorption connected our hunt measurement metric and importantly boost its reliability, making it arsenic close arsenic possible. 

After a twelvemonth of listening to your feedback, putting successful the hard work, and assembling a squad of 20 information scientists, we’re arrogant to accidental that we’ve yet deed our goal. 

As of today, the update is afloat rolled retired to the US and Australian databases, with much databases to beryllium updated successful the future.

The survey conducted by america successful Q4-Q1 2021-2022 shows that astatine this time, the Semrush US database:

  • Provides the astir close Search Volume erstwhile compared to different industry-known tools connected the market
  • Grew its full fig of keywords successful the US database by 19% 
  • Can find information connected astir 98% of each actively searched keywords connected Google successful the US

What does a amended hunt measurement mean for you? A lot. 

It means you tin person much assurance than ever successful your SEO plans. Your postulation forecasts volition beryllium much on-point and you tin marque razor-sharp predictions based connected the measurement of keywords, questions, and topics successful your market. 

More close information = much assured selling decisions.

Want to cognize however we did it, and however we cognize it's much close than immoderate different tool? 

Read on!

Search Volume Comparison Study

To trial our hunt measurement accuracy, we ran a competitory survey betwixt our keyword information and the information of apical industry-known SEO platforms connected the marketplace utilizing keyword information successful the US region. 

The competing platforms successful the survey were: 

  • Google Keyword Planner
  • Semrush
  • Moz
  • Mangools
  • Ahrefs 
  • Serpstat
  • Sistrix

To justice the accuracy, the “true” hunt measurement notation worth was established based connected anonymized Google Search Console data. 

To find the existent measurement for each keyword, we collected the fig of impressions received by URLs that were instantly disposable connected the keyword’s hunt results page. Using this method, we tin accidental that, successful astir cases, X fig of impressions = X fig of searches for that keyword.

The survey consisted of 2 stages: a examination of measurement prime (accuracy) and database coverage.

View the study’s methodology and parameters here.

Part 1. Volume Quality 

First, we compared each 7 tools astatine once. For each keyword successful our illustration of 10,000, we named the victor based connected the level whose worth was closest to the notation worth from GSC. From these comparisons, Semrush was astir often the winner.

1XzvO-zEbjb6IelPvzPxIqzAKQz158ub4vGnHl1_npmNJNy_cdyIg0YBOq7y9WA9YRW55Wrr6pvteUmHmoCVYqigdOP6zyRLDqawrj6Zb5H8VBwHVYE8kBuDczGqP2nO9F5Npp2j

The sum of each results is not adjacent to 100%, due to the fact that determination were situations wherever respective tools showed the aforesaid hunt volume. In those cases, each tools were considered winners.

Semrush had the highest percent of keyword hunt volumes that were closest to GSC worth (the higher the better).

Then, we besides ran a bid of head-to-head comparisons to measure however our hunt measurement compared to each level one-on-one. 

popEyJD4Uab0phtSD2IuL-sBT5t9VqhOM3aF3w-Hu61usa99uuCNQitkN343l2IOOybTQoZFDN5B_ZWJIZ01yhfzXJIspZTlqkNqO8J9zGLMtecl4oyDc2KTYRNknY2DVhidr9_a

In each cases, Semrush won these head-to-heads by a ample margin.

As we dug deeper into the data, we recovered a fewer reasons wherefore different tools performed truthful overmuch worse than Semrush. One crushed was inaccurate measurement for trending keywords. 

Trending keywords are being searched for the archetypal clip owed to existent events, oregon successful seasonal waves. News, sports, and amusement are communal categories wherever you'd spot trending keywords.

Here’s a breakdown:

wTowuf3O-7q0gHTLSmC7UPpmAOi9P9_A4-RPcWnvgVaXSwDWFC3krzK0xgAsGfNoslPrLk4eOSOa17Y4l4DwFVmctNjBy-bocpTz5NmsYvrw-PYwWY3YGMOH-aygI6SrNxAUrDnF

While these platforms mightiness person definite trending presumption successful their database, their hunt measurement was not adjacent to our benchmark existent value. 

We deliberation accuracy among trending keywords is different large indicator of a database’s relevancy, showing you however up-to-date the database is successful general. 

Not lone that, but targeting trending keywords could beryllium immense for your SEO, truthful you’ll request to person close information to capitalize.

Part 2. Database Coverage

Secondly, we wanted to estimation keyword sum for each tool. To bash this, we checked which tools had the lowest fig of “not found” keywords successful their database, from the illustration of 10,000. 

ZXCom_iWfJQZ47p2ls77B54KvpdKWCMtopVmPAG-P0lKq0VWoxqE9Qf4JR0RAtcJXVn-fwNmaqoR0AFt1D_e2N4iXYlAHB6oLQ9AvB7wq4qqmlRbHZqyT8jeztx1OcPLgtl8WiGw

Again, successful presumption of coverage, Semrush’s keyword database won by a coagulated borderline compared to different keyword tools.

What does this archer us? With the caller improvements to our instrumentality learning algorithm, you tin get an close representation of what radical are searching for successful your market–for some existing keywords and caller topics.

You’ll beryllium capable to find much invaluable keywords successful our database than anyplace else, and the hunt measurement information volition beryllium highly accurate. 

Why We Changed our Search Volume Algorithm

Right present determination are a batch of options for however 1 could find hunt measurement data—and SEOs don’t hold connected a azygous root of truth.

What we aimed for and achieved was a solution that could harvester each of the advantages of the keyword investigation tools already retired successful the marketplace portion avoiding the pitfalls. 

So first, let’s speech astir the astir communal tools and their pros and cons:

Google Keyword Planner

Google designed Google Keyword Planner to assistance businesses prime keywords for advertizing campaigns and motorboat their ads. However, it besides has a mates of nuances to beryllium alert of.

Pros

Cons

  • Google autochthonal tool
  • Able to find hunt volumes for keywords successful astir immoderate region
  • GKP was built to assistance negociate paid campaigns and is truthful not the champion acceptable for SEO
  • A batch of keywords are missing owed to circumstantial policies, for example, medicine category
  • GKP aggregates volumes of hunt queries with akin meaning and groups plural versions unneurotic (i.e. subject book, subject books)

Google Search Console

You won’t find keyword volume, hunt volume, oregon thing containing the connection “volume” successful Google Search Console. There is simply a metric precise adjacent to it though—impressions. Impressions successful GSC archer you precisely however galore times your hunt effect was seen connected a circumstantial keyword’s SERP. 

With that being said, if your domain’s leafage ranks astatine the precise apical of a SERP, past 1 content = 1 search. From that information, you tin measurement the nonstop hunt measurement of a keyword. 

Pros

Cons

  • Google autochthonal tool
  • If you fertile high, you tin spot the nonstop fig of clicks for a presumption and analyse however galore radical saw your leafage successful the SERP (impressions)
  • You tin lone analyse keywords wherever your domain is ranking for a hunt query
  • You tin lone trust connected GSC metrics wherever you’re ranking precocious enough

Since it’s imaginable to measurement a keyword’s existent measurement based connected the top-ranking page’s fig of impressions reported successful GSC, we chose to usage that worth (impressions of the apical position) arsenic the benchmark of close hunt measurement successful our study. More details are recovered successful our methodology blog post.

3rd enactment platforms (like Semrush, Moz, Ahrefs, and others)

Lastly, platforms similar Semrush, Moz, oregon Ahrefs connection hunt measurement arsenic a metric done tools and reports to probe keywords successful their databases. With these tools, you tin look up stats connected a keyword adjacent if your tract isn’t ranking for it, and you tin observe keywords that your competitor’s tract is ranking for.

Pros

Cons

  • You tin analyse a immense magnitude of keywords successful immoderate class and look for caller topics
  • You tin analyse your competitors’ show and get an estimation of imaginable postulation that a keyword tin bring
  • These tools foretell hunt measurement based connected clickstream information and the prime of this estimation tin vary

To sum it up, the cons of your existent options see missing keywords, akin keywords aggregated unneurotic arsenic 1 volume, and unreliable estimations from clickstream data.

We are gladsome to denote that acknowledgment to our caller update, our information is adjacent much reliable than before.

Based connected our survey of the apical SaaS companies successful the market, we recovered that Semrush consistently presented the astir close hunt measurement among industry-known SEO platforms, for some aged and caller keywords, ample and small. 

For keywords that are intimately related and plural variations, we’re capable to supply you with a unsocial and close measurement for each query actively searched for connected the internet.

For example, Google Keyword Planner volition statement each these presumption arsenic the aforesaid volume:

g5Xo-1G8w6G3wpGdbIIqtZOzQkNyGhwMJhTGcg2a81pfvin0O34gWJ84Ncl7wr1CURGrEVgwjNfZfHYFLdwkcw_L5rSBRHjGkkn4v5uQJQW90DC9bDGsUJpAOtajIdj6r6vZTgz1

Meanwhile, Semrush tin study each unsocial term’s unsocial volume:

V6mlpsqaa7kfRs62xvu_TGYstrp94_TQTJ8AeSPrSDDqaawfv2AGwWfj1gnLEc50BPhLwC7sKlDiAQ941f9ePKImnG8Af2CwNr-f74hfTs7wTjOhPHsxN7hnKA5bSxJrEJysUo6d

What We Changed: New Data Sources Added to the Machine Learning Algorithm

To bring unneurotic each of the strengths of what’s retired there, we accrued our information sources and added a fewer caller algorithms to the mechanics.

Machine learning is similar Pac-Man, the much information it consumes, the stronger it becomes. And past it reaches higher levels! 

Here’s what’s new:

  • Five times arsenic galore information sources arsenic the erstwhile algorithm
  • The summation of a Natural Language Processing (NLP) algorithm that defines popularity and trends of antithetic topics
  • The summation of an Anomaly Detection algorithm that validates high-quality information from our information providers. 

Now, with much information sources to enactment with, our algorithm identifies much patterns and yet performs astatine a higher level.

The champion portion of a instrumentality learning algorithm is that it keeps learning! 

Each month, the algorithm grows much applicable and understands much trends. Any unpredictable events of the past period are lessons that pass the algorithm going forward.

But, that benignant of happening is simply a batch easier said than done! 

In bid to beryllium capable to process information and bid the model, we spent thousands of GPU hours and tens of servers connected this ngo alone. 

Basically, these computers were moving for the equivalent of listening to the Daft Punk opus “ Harder, Better, Faster, Stronger” connected repetition 131,000 times.

Conclusion

Astronauts can’t onshore connected the satellite without the enactment of ngo control. 

In the aforesaid way, your selling needs a reliable information instauration to sprout for the stars! 

With this caller algorithm, you tin beryllium adjacent much assured successful each of your data-driven selling decisions. 

Check retired the caller and improved hunt measurement successful immoderate keyword study connected Semrush, oregon look for “Total Volume” of a taxable successful the Keyword Magic Tool.

The champion quality is that we’re ne'er done improving! As we proceed to service you and perceive to your feedback, we’ll proceed to amended our information and algorithms further and faster.