Skip to content
8ight.AI
Study 02Which HVAC companies do ChatGPT, Gemini and Claude recommend, and why.The HVAC companies AI picks
8ight.AI / Research / Study 01
8ight research · Study 01

Ask an AI for a roofer.

What ChatGPT and Claude recommend when people ask for a local business, which sources they read, and how often the list changes.

Answers collected 10 to 30 September 2026; recurring questions 1 July to 5 October 2026 Published 5 October 2026 The queries

When someone asks an AI assistant "who is the best roofer in Phoenix?", it does not return a page of links. It returns a short list of businesses: in our data, a median of at least five names from ChatGPT and seven from Claude (we stored up to eight per answer). F2b We asked ChatGPT, Claude and Gemini that question for 39 trades in 49 cities, towns and city districts in the United States and the Greater Toronto Area. Then we compared the answers with 2,976 local businesses found through Google Maps searches for the same trades and places.

ChatGPT answered almost every question. Claude and Gemini answered far fewer, for reasons on our side that we explain under what failed, so the findings rest on ChatGPT and Claude.

Key findings

  1. The two engines read different sources.Claude cited Yelp in 93% of its local answers (202 of 218). ChatGPT cited Yelp in none of 1,412. ChatGPT leaned instead on the Better Business Bureau (39% of its answers) and on government sites (25%), most of them licensing or contractor-registration pages. Reddit was cited in 6 of the 1,630 answers, all six by ChatGPT; a citation is a link shown with the answer, not everything a model has read. P1F4G1
  2. Reviews help, but they do not guarantee a place.ChatGPT named 3.4% of the businesses with fewer than 25 Google reviews and 22.2% of those with 1,000 or more. Yet the business with the most reviews among those we checked in a city (where we checked four or more) was left off ChatGPT's list about three times out of four. Star ratings did not help: the businesses named and the rest both had a median of 4.9 stars. F5
  3. The engines disagree.Of the businesses from our sample that ChatGPT or Claude recommended, 28% were recommended by both. Across the lists of names each engine gave, a median 12% of names were shared, and for 24% of the questions the two lists had no business in common. F2F2b
  4. Ask again and the list changes.When ChatGPT got the same question twice, a median 39 minutes apart, a median 29% of all the businesses named in either answer were named in both. F3

1. What we did

The question. For each trade and place we asked, word for word: "Who is the best {trade} in {city}? Name specific businesses." We asked it through each company's API with web search turned on.

The engines and models. Almost every fresh answer came from two models. ChatGPT: 1,398 answers from OpenAI gpt-5.6-terra, plus 14 from gpt-5.6-sol on 30 September. Claude: 200 answers from Anthropic Claude Sonnet 4.6, plus 18 from three other Claude models our checks used later in September. Gemini (gemini-2.5-flash) answered 20 times. S2 These are the models behind each company's API. A person using the app may get a different answer.

The businesses. The businesses come from Google Maps results for "{trade} in {city}" (up to the first 100 results, through DataForSEO's Google Maps data). We traced 2,903 of the 2,976 by name to those Google Maps searches, and each of those has its own website with public contact details; for the other 73 we hold no search record. On average there are about six businesses per trade and place. It is a selection, not every business Maps shows and not a random draw from them. Then we checked whether each AI answer named them. No business is named in this study. S4

BusinessesTrade-and-place pairsTradesPlaces
United States2,2274223432
Greater Toronto Area74994917
Total2,9765163949

The sample. S1 "Places" counts cities, towns and city districts (three of the Toronto-area places are districts of Toronto, and one is a community that spans two cities). One of the 39 trades is a fitness franchise searched by its name.

What "named" means. A business counts as named when its name, or a plain short form of it, appears in the engine's answer as a name: written with capitals, and not running on into a longer name (a different branch of the same chain does not count). Words scattered across a sentence do not count. The rule is code, the same for every answer, and it is published (matcher.py). We checked it by hand before publishing; see hand checks.

Sources. A source is the website domain of a link the engine cited with its answer. Gemini's links come back as Google redirect addresses, so Gemini is left out of every source figure.

Recurring questions. Separately, we ask a set of questions about local services in Toronto and nearby Ontario towns on a schedule. The set grew over time: 120 questions in all, 84 of them first asked on or after 22 September. That gives 2,527 ChatGPT and Claude answers from 1 July (ChatGPT from 23 August) to 5 October 2026. T3T4 We use them only for how much the cited sources change between runs, and for one Reddit count. Only pooled figures appear here: no question, no business, no list.

Dates. One-off answers: 10 to 30 September 2026. Nearly all fresh answers were collected on 10 and 11 September (1,391 of ChatGPT's 1,412 and 199 of Claude's 218). S3

2. Findings

2.1 Where the engines read

Share of fresh local answers that cite each platform at least once: P1

PlatformChatGPT
(1,412 answers)
Claude
(218 answers)
Yelp0.0% (0)92.7% (202)
Better Business Bureau38.7%6.4%
A government or licensing site25.1%0.0%
Expertise.com16.3%22.0%
Angi11.8%25.2%
Thumbtack3.7%19.3%
HomeGuide0.1%23.4%
ClassPass (fitness only)1.3%30.3%
Yellow Pages0.2%12.4%
Facebook0.0%8.7%
Reddit0.4% (6)0.0% (0)
Google Maps or Google business pages0.2%0.5%

By kind of source F4: ChatGPT cited the website of at least one business we had found on Google Maps in 68.1% of its answers; Claude in 45.0%. Claude cited a directory or review site in 99.5% of its answers; ChatGPT in 65.3%. Social networks: 0.6% of ChatGPT answers, 11.0% of Claude's. The most-cited of the rest are national franchise brands' own sites, manufacturers' certified-contractor pages, a tree-care association, local businesses we had not found on Google Maps, smaller directories and ranking sites our list does not include, and encyclopaedia and news pages. F4b

Three things a reader would not guess:

What a citation is, and is not. A citation is the link an engine shows with its answer. It is not everything the model has read: a model can have learned from Reddit, or from any other site, during training and show no link to it. These figures measure the links the engines returned through their APIs, not what the models know, and not what their apps show.

2.2 Reviews help, but do not guarantee a place

ChatGPT, by the business's Google review count when we found it: F5

Google reviewsBusinessesNamed by ChatGPTShare
under 25435153.4%
25 to 999039010.0%
100 to 24977510813.9%
250 to 99952711020.9%
1,000 or more1353022.2%

Review counts come from the Google Maps search that found the business, and are on file for 2,775 of the 2,975 businesses ChatGPT answered for. "Most reviewed" means most reviewed among the businesses we checked in that place, not among every business on Google Maps.

2.3 The shortlist is short

EngineBusinesses it answered forNamedShare
ChatGPT2,97536912.4%
Claude1,77619811.1%
Gemini232177.3%

F1 Gemini answered too few questions to compare with the other two.

This does not mean the AI "ignores" nearly nine businesses in ten. The AI gives a shortlist (where both engines answered, a median of at least 5 names from ChatGPT and 7 from Claude F2b), and Google Maps gives a long list.

By trade, the fairer measure is how often ChatGPT named at least one of the Google Maps businesses we checked in a place: F6

Trade (12 or more places)PlacesBusinesses checkedAt least one namedEach business named
Pilates studios2120690.5%16.5%
Women's fitness gyms1517080.0%9.4%
Towing148264.3%19.5%
Moving companies139361.5%15.1%
Garage door repair1913257.9%12.9%
Electricians1911557.9%12.2%
Appliance repair186650.0%16.7%
Roofing contractors2014950.0%9.4%
Painting contractors2110247.6%17.6%
Plumbers1923047.4%8.3%
Landscaping1711247.1%8.9%
HVAC contractors2012545.0%7.2%
Fencing contractors125441.7%16.7%
Window cleaning135638.5%12.5%
Junk removal2111138.1%9.0%
Tree services199036.8%8.9%
Pest control177529.4%6.7%
House cleaning158526.7%4.7%
Barre studios125716.7%7.0%
Boutique fitness studios16506.3%2.0%

The more businesses we checked in a place, the likelier one of them was named, and that number differs by trade (from about 3 to 12 per place on average). Read the gaps between trades as a direction, not a ranking.

2.4 The engines disagree

On the 1,775 businesses where ChatGPT and Claude answered the same question at the same moment: F2

Comparing the lists of names, including businesses we did not check (our check stored up to the first eight names it found in each answer): across 214 questions in 211 trade-and-place pairs, a median 12% of all the businesses named by either engine were named by both, and for 24% of the 214 questions the two lists had none in common. F2b Names were cleaned by a published script (lists.py), which dropped 18.9% of the 11,393 stored entries as not a business: an address, a directory, a summary line.

2.5 Ask again and the list changes

In 267 trade-and-place pairs ChatGPT got the same question twice, a median 39 minutes apart (61% within an hour). A median 29% of all the businesses named in either answer were named in both; for 9% of pairs the two answers had none in common. F3

The recurring questions show the same for sources. When ChatGPT answered the same question on consecutive runs, a median one day apart, a median 29% of the sources cited in either answer were cited in both (1,073 pairs). Claude, on one model (Sonnet 4.6), was steadier: 78% (805 pairs). T2

3. What this means for a local business

Each point says what the data shows, and what it does not.

  1. Each engine has its own sources. For Claude, Yelp was close to unavoidable in September (93% of local answers, mostly from Claude Sonnet 4.6). For ChatGPT, the Better Business Bureau (39%) and government sites (25%), mostly licensing records, came up more often than any review platform (Expertise.com 16%, Angi 12%, Yelp none). We did not test whether improving a profile on any of these changes the answer. This shows where the engines read, not what moves them.
  2. Keep the public record straight. ChatGPT cited a government site in one answer in four, most often a licensing board or licence look-up. A lapsed licence or an old business name in a public registry sits on the kind of page ChatGPT cites.
  3. Reviews count, up to a point. More reviews went with being named more often, but the most-reviewed business we checked in a place was still left out about three times in four. A higher star rating did not go with being named more often.
  4. One check is one sample. An hour later the list may be different. A single screenshot, yours or a vendor's, proves little. Ask how many times a question was asked, on which engine, on which date.
  5. Check each engine separately. Of the businesses we checked that ChatGPT or Claude recommended, nearly three in four (213 of 294) were recommended by only one of them.

4. Methods, limits and what failed

What failed

Limits

Hand checks before publishing

Exclusions

Disclosure. 8ight sells services that help businesses appear in AI answers, so we have an interest in this subject. That is why every figure from the data links to the query or script behind it.

5. The queries and scripts

Every figure from the data links to the query or script behind it; the hand-check counts are described in the text. The published copy is the SQL as run, with internal table names replaced by descriptive ones and our internal exclusion lists shown by name only. All queries were re-run before publishing, between 01:31 and 02:15 UTC on 6 October 2026 (the evening of 5 October in Toronto).

Corrections. None. A published study is not edited; a correction is added here as a dated note.

How to cite. 8ight research, "Ask an AI for a roofer", 5 October 2026, https://8ight.ai/research/how-ai-recommends-local-businesses/

All 8ight research