Field note

Where do ChatGPT's product recommendations come from? What a 13,000-citation study suggests

A 2026 master's-thesis study captured 1,650 prompt iterations across GPT-5.2 to 5.5 and Gemini and traced 13,000+ citations behind the answers. The headline: roughly 80% of recommended products trace straight back to search rank, and ChatGPT's Business tier leans on Bing's top ten. Here's what the data shows, what corroborates it, and what to do about it, with the caveats stated up front.

Buffy Editorial2026-06-25 · 6 min read

For product and brand recommendations, ChatGPT mostly recommends what already ranks. A 2026 master's-thesis study that captured 1,650 prompt iterations across GPT-5.2, 5.3 and 5.5 plus Gemini: and traced the 13,000+ citations behind the answers. Found that roughly 80% of recommended products traced straight back to search rank, and that ChatGPT's Business tier grounded its answers in Bing's top ten. The honest conclusion from the researcher: for product recommendations, SEO is not dead. It is the baseline requirement.

This piece reports what that study found, what independently corroborates it, and what it means for getting recommended in ChatGPT, with the caveats stated first, because the specifics are single-study.

What was the study, and how solid is it?

A single-author study, scoped to one domain, with rich internal detail. Directional, not definitive. The work was conducted by Ali Şan Kaya (co-founder of an AI speech-and-translation company) as a master's thesis, and shared publicly in June 2026. Its scope and limits matter as much as its numbers:

  • What it covered: 1,650 prompt iterations across GPT-5.2, 5.3, 5.5 and Gemini; 370,000+ search results and 13,000+ citations captured behind the answers.
  • What it was scoped to: a single domain the author knows well (AI speech and translation tools), so the findings are deep but narrow.
  • How to treat it: single-author, self-reported, one product category, observed over early-2026 model versions. The figures are one study's; the direction is what carries weight, especially where other research agrees.

State that scope up front and the rest of the data becomes usable rather than overclaimed.

What did the study find about where recommendations come from?

That retrieval, not mystery, drives most product recommendations, and that the retrieval source differs by ChatGPT tier. The reported findings:

Finding What the study reported How to read it
Rank is the baseline ~80% of recommended products traced straight back to search rank The dominant lever for being recommended
Business grounds on Bing Business-tier citations skewed to Bing's top ten A Bing top-ten spot is close to a prerequisite
Plus reads Google Plus tier appeared to read scraped Google results, looking deeper than the top ten Tier choice changes the source pool
A non-search channel exists ~12-15% arrived via a channel the study labels "labrador". Wikipedia, arXiv, tech press Authority sources get cited outside ranked search
Listicles dominate The #1 listicle item was picked ~2.5× more than chance Independent roundups remain a primary medium

The researcher reported that GPT-5.5 exposed its retrieval source through a parameter the study calls result_source (with values such as bing, serp, and labrador) and a rank position the study calls ref_index. Treat those parameter names as one researcher's observation of model behaviour at a point in time. They are exactly the kind of volatile detail that can change between versions. The durable point underneath them does not change: the engine retrieves from ranked search, so ranking in that search is how you become eligible to be recommended.

Does anything independent corroborate this?

Yes. The core "Bing rank shapes ChatGPT recommendations" finding is corroborated by separate work, which is what lifts it above a single anecdote. Seer Interactive reported that roughly 87% of ChatGPT citations align with Bing's top results. A Search Engine Land case study (Nogami and Tannenbaum, 2026) examined 68 iterations of a hotels prompt and found that the property winning more of Bing's top URLs appeared in ChatGPT far more often than a comparably-rated competitor that won on Google. Different methods, same direction: for ChatGPT, Bing visibility predicts citation better than Google visibility does.

Three independent studies in 2026 point the same way: for product recommendations, AI does not invent a new winner. It mostly surfaces whoever already ranks, and for ChatGPT that increasingly means Bing. SEO didn't die; it became the entry fee.

One honest caveat travels with all of it: there is a live debate about whether search rank shapes the answer or merely supports a recommendation the model already leaned toward from training. The practical advice is the same either way, but don't overstate causation from correlation. The same discipline that applies to reading any visibility case study.

Why are dated listicles becoming the dominant citation medium?

Because the models increasingly search with the year in the query, and year-stamped roundups are what match. The study reported that on GPT-5.2 in early 2026, only about 5% of the models' fan-out searches carried a year token; by GPT-5.5 in May 2026 that had risen to roughly 80% ("best transcription tools 2026" rather than "best transcription tools"). As the searches got year-stamped, the share of listicles among cited URLs rose to become the dominant medium: because freshly-dated "best of 2026" roundups are exactly what those queries return.

That matches what we already knew: AI engines lean on independent roundups for commercial-intent queries, and the position you hold inside a cited list shapes whether you are recommended. The reported 2.5× edge for the number-one slot is the listicle effect quantified for products.

What should brands actually do about it?

Treat strong classic search rank as the price of entry, then layer the AI-specific moves on top. In priority order:

  1. Earn the ranked spot. Especially on Bing. If Business-tier ChatGPT grounds on Bing's top ten, then Bing rank for your category and its fan-out branches is foundational. This is the clearest evidence yet that ecommerce SEO still matters for AI search.
  2. Pursue earned placement in independent, dated roundups. Get into the genuinely third-party "best of 2026" lists. Never a self-serving roundup naming yourself first. The how-to for cited best-lists is the method.
  3. Build the authority channel too. The "labrador" findings. Wikipedia, arXiv, reputable tech press. Say entity authority gets you cited outside ranked search. Corroboration across the web is the slow, durable lever.
  4. Keep dated content fresh. With ~80% of fan-outs now year-stamped, a "best 2025" page quietly drops out of a "2026" query. Freshness is no longer cosmetic; it decides eligibility.
  5. Measure where it actually happens. Track citations and recommendations per engine, including the retrieval-augmented Bing pipeline ChatGPT leans on. The answer-level metrics, not just rank.

The synthesis lines up with the six factors that make AI recommend a product: reachability and rank get you retrieved, corroboration and freshness keep you cited, specificity gets you picked. This study is strong evidence that the first link in that chain. Ranked, retrievable, especially on Bing. Is doing more of the work than most AI-visibility advice admits.

Knowing your products mostly trace back to search rank is only useful if you can see, per engine and over time, which ones surface and which fall out. Measuring that. Across ChatGPT, Gemini, Perplexity and Google's AI surfaces. Is exactly what Buffy Intel does. Questions: [email protected].

Frequently asked

Does ChatGPT recommend products based on search rankings?

Largely, yes, for product and brand recommendations. A 2026 master's-thesis study by Ali Şan Kaya, scoped to one domain, reported that roughly 80% of the products the models recommended traced straight back to search rank, and that ChatGPT's Business tier grounded its answers in Bing, where citations skewed heavily to Bing's top ten results. Seer Interactive independently reported that about 87% of ChatGPT citations align with Bing's top results. Treat the exact figures as single-study, directional evidence, but the direction is corroborated: classic search rank is the baseline for being recommended.

Does ChatGPT use Bing or Google to ground its answers?

According to the 2026 study, it depends on the tier. The Business tier grounded answers using Bing, while the Plus tier appeared to read scraped Google results. The researcher reported that on GPT-5.5 the model exposed its retrieval source through a parameter the study calls result_source, with values such as bing, serp, and a third channel labelled labrador, which mostly surfaced Wikipedia, arXiv, and tech press. These are one researcher's observations of model internals and may change between versions, so hedge them; the durable takeaway is that being in the engine's top search results is what gets you retrieved.

Are listicles still effective for AI product recommendations?

The evidence says yes, with care. The 2026 study reported that the number-one item in a 'best tools' listicle was picked roughly 2.5 times more often than chance, and that as the models added year tokens to their searches (for example 'best transcription tools 2026'), the share of listicles among cited URLs rose to become the dominant citation medium. That matches earlier findings that AI engines lean on independent roundups for commercial queries. The play is earned placement in genuinely independent lists, not a self-serving roundup that names yourself first.