Measurement Sources and Limits

Why API Measurements Are Not Fixed Consumer Rankings

APIs, models, search configurations, and consumer interfaces are different surfaces. One API response is evidence for one disclosed request, not a permanent ranking.

GrayRhino AI Methodology and Research2 min read

Publisher: GrayRhino AI · Owner: Methodology and content owner · Review: Fact and methodology reviewer · Reviewed 2026-09-22

An API result describes one explicit request

External fact

Baidu documents Intelligent Search Generation and the separate web_summary interface, while Google says its AI features can use different models and techniques. Different interfaces, configurations, and times cannot be collapsed into one fixed consumer ranking.

GrayRhino AI method

GrayRhino AI records each API surface as a specific measurement source together with the model, question, configuration, and time.

Consumer experiences include additional product context

Limitation

Login state, personalization, region, interface behavior, experiments, and undisclosed settings may affect consumer experiences. API evidence does not cover those conditions and is not platform endorsement. Reporting an API answer as 'first place in Baidu Search' or 'visible to every user' exceeds the recorded evidence.

Before comparing two requests, inspect the interface, search configuration, model, market, language, question text, and time. Even interfaces from the same vendor should not be collapsed into a single measurement source.

Two observations from one vendor need not agree

Synthetic example

Synthetic teaching example: a standard Intelligent Search Generation API response mentions a brand for one discovery question. A colleague does not see it in a consumer interface. Neither observation invalidates the other: their surfaces, context, and timing differ. The defensible claim identifies the exact API, configuration, question, and stored answer, not a fixed rank.

If a separate web_summary interface is later added, it needs its own source identity and comparability review. The word 'high-performance' in its documentation is not a configuration of the currently measured standard endpoint. Both observations here are hypothetical.

How GrayRhino AI measures this issue

GrayRhino AI method

Reports disclose the API name and explain that its result is not a consumer-product experience or fixed ranking. Unknown providers retain their stored name to prevent mislabeling. Immutable answer evidence keeps a stable source ID even if a display label is later localized.

A defensible conclusion

Limitation

A report may say that a brand appeared for one question, source, and time. It cannot claim a permanent platform position or promise that the next answer will match.

Sources

Related reading