Explore research

Methodology

How NZBrands.ai studies work

The rules every study on this site follows: how we write the questions, which AI assistants we ask, how we use Onsomble to collect the answers, and how we count and compare what comes back. Each study has its own method page showing what these rules produced.

01

What a study is for

To show what AI assistants tell people, so anyone can see it and check it.

More people now ask an AI assistant before they choose a product, a service or a vote. A study asks the assistants the questions people actually ask, saves what they say, and reports it: who gets mentioned, what is said about them, and where the information comes from.

We report what the assistants said. We take no view on any business, party or policy, and no one pays to be included or left out.

02

How we write questions

Each question is written as a particular person would ask it, in their own words.

We start with people, not topics. For each study we describe the situations of the people it is about, then write the questions someone in each situation would plausibly ask, including their circumstances when they would mention them. The wording is plain and does not lead the assistant towards any answer.

The people are designed situations. Their priorities are our assumptions for that situation, not findings about a whole group, and the number of questions on each topic follows what those people would ask, not how much the topic matters to the public.

03

The assistants we cover

The assistants people use, asked the way people use them.

Each study names the assistants it covers. We ask them through their ordinary consumer apps, the way a person would, rather than through developer access. Each question is a new conversation, so we capture the first answer a person would see.

Where a question depends on place, we can ask it from more than one location. Every assistant gets identical wording.

04

Working with Onsomble

Onsomble asks the questions and records the answers. We design the study and do the analysis.

NZBrands.ai runs its studies on Onsomble, the platform that asks AI assistants questions at scale and records what they say. For each study we set out in Onsomble the subject, the questions and the people they are written as, the businesses or parties to track, the assistants, and the locations. A study about a subject, such as an election, has no focal entity, so everything tracked is treated alike.

Onsomble saves every answer in full and records the claims each answer makes, what each claim is about, and the sources behind it. We download the complete record after each run and build every published figure from it ourselves, with scripts that can rebuild the tables from the saved files.

05

Counting rules and definitions

What each number on the site counts.

Answer
The full text saved for one question, from one assistant, in one location.
Named
A business or party is named when its name, short name or a known alias appears in the answer. It counts once per answer, however often it appears.
Claim
A statement picked out of an answer, with what it is about and whether it is positive, neutral, negative or mixed. One answer can hold many claims.
Source
A website connected to an answer. It counts once per answer. Links shown in the answer are counted separately from sources recorded against claims.
Checked statement
A factual statement we compared with an official source. We say how many we checked; a check is not a verdict on every claim.

06

Comparison rules

We compare like with like.

Assistants are compared only on the questions every one of them answered, so a missing answer never changes what is being compared. Locations are compared only on identical questions. Counts about people or topics describe the study's coverage, not the public.

When an answer is missing, we say so and leave the gap. We never fill it with an estimate.

07

Editions and dating

Some studies are repeated, with the same questions, on a published schedule.

Each run is an edition, dated by the day the answers were collected. Every figure belongs to an edition, and the page says which one. We keep the questions the same between editions so that changes in the answers can be seen. If we have to change a question, we say so on the method page.

08

Limitations

What a study can and cannot show.

A study records what the assistants said on the day. AI answers vary, so the same question asked again can produce a different answer; one run shows what a person could have seen, not what they will always see. The people in a study are designed situations, not a sample of the population.

A study shows what was said and lets anyone check it. It does not show what anyone did because of it, or why an assistant answered as it did. Each study's method page sets out its own limits.

09

Independence and corrections

No one pays to appear, and we correct mistakes in the open.

NZBrands.ai is a research publication from Onsomble. Businesses and parties cannot pay to be included, excluded or described differently. If we find an error in a figure or a claim, we correct it and note what changed and when.