Back to Blog
AI WritingApril 20, 202614 min read

Keyword Research Guide SEO: A Step-by-Step Workflow

Dipflowby Ivaylo, with help from Dipflow

Most “keyword research guide seo” advice fails for a boring reason: it starts with a tool export instead of a decision. We have watched smart teams crank out 2,000-keyword spreadsheets, publish for months, and then quietly admit the traffic was either irrelevant or impossible to convert. Not because SEO is mysterious. Because they never decided what a win looks like.

We do this work the hard way: we pick a goal, we sanity-check intent in the SERP, we choose a page type that can actually rank, then we score opportunities like adults who have been burned before. It is less romantic. It works.

The real starting line: decide what success is

Before we touch a keyword tool, we write down three things on a sticky note: our business goal, our audience, and the handful of conversion actions that matter. Not “traffic.” Actions.

Examples that are specific enough to guide keyword choices: “book a demo,” “start a free trial,” “request a quote,” “buy the starter kit,” “subscribe to the newsletter,” “download the spec sheet.” That’s it. If you cannot name the action, you will chase queries that read well in a report and do nothing in a bank account.

One sentence of friction you should take seriously: if you pick keywords first, you will end up trying to force an informational query onto a product page (or vice versa), and the SERP will ignore you.

Seed keyword architecture that scales (without turning into noise)

Seed keywords are supposed to be simple. The annoying part is that most teams treat seeds like “categories,” which is how you get garbage suggestions and a list that cannot be filtered.

What works better is a seed map built from three buckets we can expand cleanly:

Products (what you sell), Problems (what pain it solves), Personas (who feels that pain). We keep them separate on purpose. Then we intentionally create crossovers.

Here’s a concrete example for a B2B scheduling tool:

Products: “appointment scheduling software,” “booking widget,” “calendar sync.”

Problems: “no-show rate,” “back-and-forth scheduling,” “double booked appointments.”

Personas: “salon owner,” “clinic receptionist,” “field service dispatcher.”

Now the crossover seeds write themselves: “reduce no-show rate scheduling,” “booking widget for salons,” “appointment scheduling for clinics,” “calendar sync for field service.” These are already closer to long-tail keywords (often 3+ words) that tend to have lower competition and stronger intent.

What trips people up: seeds that are too broad (“marketing,” “software,” “health”) generate tool suggestions that look impressive and are mostly irrelevant. If your seed is a department name, it is probably not a seed.

Our quick rule: a seed should imply a page type. “Appointment scheduling software” implies a product or category page. “How to reduce no-shows” implies a guide. If your seed could be anything, it will become everything.

We also cap the first pass. Ten to twenty seeds per bucket is enough. When we have seen lists balloon to hundreds of seeds, it is usually procrastination disguised as rigor.

Keyword research guide SEO reality check: intent is the whole job

Everyone says “match intent.” Almost nobody tells you how to verify it quickly, or what to do when the SERP is mixed.

We learned this the embarrassing way. Years ago, we tried to rank a product page for a query that was clearly informational once you looked at the results. We kept rewriting copy, adding FAQ blocks, tweaking titles, and watching impressions rise while clicks stayed flat. We were proud of our “iteration.” The SERP was politely telling us we built the wrong thing.

Intent matching is not philosophy. It is a visual inspection.

The SERP intent audit checklist (our repeatable pass-fail)

We run this audit for every keyword we plan to target. It takes 3 to 7 minutes if you do not overthink it.

Look at the top 10 results and answer four questions:

First, what page types dominate: product pages, category pages, blog guides, templates, tools, forums, local listings? If 7 out of 10 are the same type, Google is making the rules.

Second, what content format is implied: “how-to,” “best X,” “X vs Y,” “pricing,” “definition,” “template,” “calculator,” “near me”? Your page has to play that game.

Third, what SERP features show up: Shopping results, local pack, featured snippet, People Also Ask, video carousel, forums. These features are intent signals. They are not decoration.

Fourth, can we realistically publish the same page type and be better, or do we need to pick a different query?

Our pass-fail rule: if the dominant page type does not match what we can publish (or what we want to publish), we abandon the keyword or we change the page plan. We do not “try anyway.” Trying anyway is how time disappears.

Three mini case studies where volume lies to you

These are the kinds of keywords that look great in a tool. In practice, they waste weeks.

“CRM” (high volume, useless as a target)

The SERP is a mess: definitions, brand homepages, Wikipedia, “best CRM” lists, and sometimes login pages. The intent is ambiguous because the query is too short. You do not know if the searcher wants a definition, a comparison, or to reach a specific brand.

Better targets that align to a page you can actually build:

A comparison page: “best CRM for small law firms.”

A pricing-intent page: “CRM pricing for small business.”

A migration guide: “switch from spreadsheets to CRM.”

Those long-tail queries are narrower, usually lower competition, and they let you meet a clear need.

“email marketing” (big number, mixed intent)

You will often see beginner guides, tool roundups, and sometimes course pages. If you are a software company trying to rank a product page here, the SERP will fight you. If you are a publisher trying to rank a beginner guide, you are competing with brands that have spent a decade building authority.

Better targets:

“email marketing checklist for ecommerce” (informational, actionable).

“email marketing automation examples” (mid-funnel, tends to pull in People Also Ask).

“email marketing software for Shopify” (product-fit, clearer page type).

“project management” (head term, unclear job-to-be-done)

The SERP commonly splits between definitions, “best tools,” and methodology content. If your business goal is trials, you want intent that suggests the user is shopping or comparing, not reading a history lesson.

Better targets:

“project management tool for architects” (persona-specific).

“asana vs trello for small team” (comparison intent).

“project status report template” (template intent that can feed into software adoption).

The pattern is the point: head terms hide too many intents. Long-tail queries expose them.

One more SERP reality check: sometimes you can be topically relevant and still wrong. A “pricing” query usually demands a pricing page or at least pricing transparency. A “template” query usually demands a downloadable asset. If you show up with a generic blog post, you will rank weakly even if your writing is good.

Opportunity scoring beyond search volume (and why one page ranks for keywords you never wrote)

Search volume is not worthless. It is just easy to misunderstand.

What nobody mentions until you’ve wasted time: the same “volume” can represent wildly different outcomes depending on how many related queries a top page captures. This is why tools like Ahrefs talk about Traffic Potential, which looks at the top-ranking page’s total estimated search traffic, not just the exact query’s volume.

We use a simple scoring model because we need decisions, not debates.

Our 3-part scoring model (simple on purpose)

We score each candidate keyword or topic from 1 to 5 on three dimensions:

Intent fit: will the query be satisfied by the page type we can publish, and does it support a conversion action?

Feasibility: can we rank given the SERP competition, our site strength, and the link/brand gap?

Business value: if we rank, are the visitors likely to take our conversion action, or is it mostly curiosity traffic?

Total score is 3 to 15. We do not pretend it is science. It is a forcing function.

Where this falls apart: teams treat keyword difficulty as a veto. Difficulty is a hint, not a judge. A “hard” query can still be worth it if it is a core money term and you can win through a better page type, stronger proof, or a different angle.

How we use Traffic Potential vs search volume

If a keyword has modest volume but the top page is pulling traffic from dozens of variants, that topic is usually bigger than the number suggests.

Our rule of thumb: if the topic’s Traffic Potential is 3x or more the keyword’s volume, we treat it like a topic page opportunity, not a single-keyword opportunity. We plan a page that covers the cluster.

That is also why pages can rank for keywords not explicitly used in the text. If you cover the topic thoroughly, you pick up semantic variants and sub-questions. You do not need to repeat exact-match phrases until the copy sounds broken. Google stopped rewarding that years ago, and updates like Panda, Penguin, and Hummingbird were a big part of why.

Long-tail strategy that is not just “pick longer phrases”

Long-tail keywords are typically 3+ words, more specific, and often lower volume and lower competition. The conversion rate tends to be better because the searcher told you what they want.

But the real win is architecture: long-tail queries often map cleanly to a page type and a funnel stage. “best X for Y” is comparison. “how to X” is educational. “X pricing” is commercial. This makes planning sane.

Avoiding “no-demand publishing” (the quiet killer)

Ahrefs has cited a study that roughly 90% (often quoted as 90.63%) of pages get no organic traffic from Google. Whether the exact number is 90 or 87 is not the lesson. The lesson is that you can work hard on something nobody searches.

Our minimum-demand threshold depends on the site, but for most new content we want at least one of these to be true:

The query (or cluster) shows measurable impressions already in Google Search Console.

A tool shows meaningful volume or Traffic Potential.

We can validate demand through multiple sources, like autocomplete, People Also Ask repetition, and competitor pages getting search traffic.

If none of those show demand, we treat it as brand content, not SEO content. Different scoreboard.

Non-linear keyword discovery loop (GSC, tools, and messy human sources)

Keyword discovery is not a single export. It is a loop.

We usually start with what the site already ranks for because it is the closest thing to real market feedback. Google Search Console is the workhorse here, with one caveat people miss: it only shows the top set of queries, and many SEOs reference the practical limitation as the top 1,000 keywords. That means long-tail can be underrepresented, especially for larger sites.

So we use GSC to find patterns, not to declare the list complete.

Then we expand.

Ahrefs’ Free Keyword Generator is a solid starting point when budgets are tight. It typically returns 20 related keywords and 20 related questions per seed keyword, so 40 ideas. That is not enough to build a whole strategy, but it is enough to find wording you did not think of and to spot intent splits.

We also mine “human mess” sources because they reveal language that tools flatten:

Google autocomplete and People Also Ask show phrasing that real users type.

Reddit and forums show pain, objections, and edge cases that become subtopics.

YouTube suggestions are gold for “how-to” wording.

Amazon is underrated for physical products because it exposes attribute language, like size, compatibility, and use context.

We sometimes use ChatGPT for brainstorming seed ideas when we are stuck, especially for persona-specific phrasing. The catch is simple: it cannot give you realistic SEO metrics. It is a creative partner, not a measurement tool. Every idea still gets validated in GSC or an SEO platform.

Tool choice matters less than process. We have used Ahrefs, Moz, and Semrush. Each has its own marketing claims, giant indices, and sales pages. What we care about is whether the tool helps us answer two questions fast: “what is the SERP intent?” and “is there real demand?”

One tangent before we get back to work: we once lost an hour arguing about whether a keyword was “informational” or “commercial” while the SERP had a shopping carousel and a local pack. We deserved that L.

From keyword list to publishing plan (so you stop cannibalizing yourself)

A keyword list is not a plan. A plan has pages.

We cluster keywords by shared intent and shared answer. Not by “similar words.” Two queries can share vocabulary and want different things. “best budgeting app” and “budgeting app template” are not the same job.

Mapping clusters to site architecture

We map clusters to one of a few page types:

Money pages: product, category, pricing, comparison, integration pages.

Support pages: docs, troubleshooting, setup.

Education pages: guides, templates, definitions.

Then we decide the primary target for each page and list secondary variants the page should naturally cover.

Friction to watch for: creating multiple pages that target the same intent. This is how you cannibalize rankings, dilute links, and end up “rotating” URLs in and out of the SERP.

Our rule: one intent, one page. If two pages want the same query, we pick a winner and merge.

Content brief that prevents scope creep

We keep briefs short but strict. A good brief tells a writer what not to do.

It includes: target intent, the dominant SERP page type, the “must answer” questions, and the conversion action. It also includes proof requirements. If the SERP is full of listicles with “best tools,” you will not win with vague claims. You need screenshots, pricing notes, constraints, and opinions you can defend.

We also add an internal linking note: what existing pages should link to this new page, and where this page should link out. Internal links are the difference between a page that ranks and a page that floats.

Measurement and iteration (the part people abandon)

We track three things post-publish: impressions, CTR, and conversions. Rankings are a supporting metric. Not the goal.

We look for “striking distance” queries in GSC: terms where a page is getting impressions and sitting around positions 8 to 20. Those are often faster wins than starting a brand-new page.

When performance is weak, we do not randomly rewrite. We pick a hypothesis:

If impressions are low, the page may not match intent or the topic may have no demand.

If impressions are decent but CTR is low, the title and snippet may be mismatched to the SERP, or the page type is wrong.

If clicks are fine but conversions are low, the page may be attracting the wrong audience, or the conversion action is too big a jump.

Sometimes the right move is brutal: refresh, merge, or kill the page. Keeping everything “because we wrote it” is how sites get bloated and confused.

If you want a single mindset to keep from wasting months: treat keyword research as product thinking. The SERP is the market. Intent is the spec. Your page is the build. Then you ship, measure, and fix what the data tells you, not what the spreadsheet promised.

FAQ

What is keyword research in SEO, really?

Keyword research is deciding which search queries to target with specific pages, based on intent, demand, and business value. The output is a publishing plan, not a spreadsheet.

How do you tell search intent quickly?

Check the top 10 results for dominant page type, implied format (how-to, best, pricing, template), and SERP features like People Also Ask or a local pack. If you cannot publish the page type Google is rewarding, do not target the query.

Are long-tail keywords better for SEO?

They are often easier to rank for and convert better because they are more specific. They also map more cleanly to a page type, which reduces intent mismatch.

How do you avoid keyword cannibalization?

Cluster keywords by shared intent, then assign one primary page per intent. If two pages target the same intent, merge them and consolidate internal links to the winner.

keyword clusteringlong tail keywordssearch console dataserp intenttraffic potential
Keyword Research Guide SEO: Workflow - Dipflow | Dipflow