Firefox Suggest

Introduction

Firefox Suggest is a monetizable feature in the Firefox urlbar. Suggest provides real-time recommendations as users type in the urlbar. The recommendations include URLs from the user's browsing history, open tabs and bookmarks, as well as URLs for sponsored and non-sponsored content from third party partners like Ad Marketplace and Wikipedia.

Firefox Suggestions compete directly with Search Engine Suggestions for user attention and clicks in the urlbar. A holistic analysis of the urlbar should include data from all the sources providing recommendations to the urlbar, including Firefox Suggestions, Search Engine Suggestions, auto-fill, etc.

This section will include information about Firefox Suggest data. See Search Datasets for documentation on Search Engine Data.

Data Collection

Firefox Suggestions may be served to the urlbar from Firefox itself, or by a Mozilla-owned service called Merino. When users opt in to sharing their search query data, Firefox sends the search queries to Merino, and Merino responds with recommendations.

In addition to the search queries, we collect Category 1 and 2 telemetry data from Firefox about how users are interacting with Suggest.

Interactions data (Cat 1 and 2)

Interactions data related to Firefox Suggest is collected in the following ways.

  1. Interactions with Firefox Suggestions in the urlbar (i.e., clicks, impressions, blocks, clicks on help links) are collected using the standard (legacy) Telemetry system as Scalars and Events. Full documentation of the probes is here. The Scalars are available in Clients Daily.

  2. Interactions with Firefox Suggestions in the urlbar (i.e., clicks, impressions, blocks) are collected using Custom Contextual Services Pings. The Custom Contextual Services Pings contain additional information not available in the standard Scalars and Events, such as the advertiser that provided the recommendation, if any. This data has a much shorter retention period than the data collecting in (1) above. It also does not contain the Firefox Desktop Client ID, and is not join-able by design to any datasets outside of Contextual Services. Full documentation of the probes is here.

  3. Preference Settings are collected using the standard (legacy) Telemetry system in the Environment. Full documentation of the probes is here. The Preferences are available in Clients Daily. Choices users made on opt-in modals (which propagate to Preferences) are also recorded in the Environment.

  4. Exposure Events for experiments are recorded using the standard Nimbus system. Full documentation of the probes is here.

Search queries and Merino

  1. Search queries sent to Merino by Firefox are logged by Merino. Full documentation of the probes is here. For more information about the much shorter retention periods, security and access controls on this data, see the Search Terms Data Access Policy (Mozilla internal only).

  2. Merino responses as seen from Firefox. We collect data about Merino's response times and response types in Firefox using the standard (legacy) Telemetry system as Histograms. Full documentation of the probes is here.

  3. Service and operational data on Merino We also collect data about Merino as a service from Merino directly. Full documentation of the data is here.

Big Query Tables and Looker Explores

Note: gotchas with historical Suggest revenue data are outlined here.

Access-restriction(s)Big Query TableLooker ExploreDescription
All Mozillianstelemetry.suggest_clients_dailyFirefox Desktop > Suggest Clients DailyWorkhorse dataset for Suggest, includes desktop data. All new Suggest metrics are added to this table. Does not include advertiser data.
Contextual Servicescontextual_services.event_aggregatesContextual Services > Event AggregatesDataset with Sponsored Tiles and Suggest analyses by advertiser. No longer maintained. Instead use the derived event_aggregates_[product] datasets.
Contextual Servicescontextual_services.event_aggregates_suggestContextual Services > Event Aggregates SuggestWorkhorse dataset for Suggest analyses by advertiser.
Contextual Servicescontextual_services_derived.adm_forecastingContextual Services > AdM ForecastingDataset with required components for Sponsored Tiles and Suggest revenue forecasts.
Contextual Services, Revenuecontextual_services.event_aggregates x revenue.revenue_dataRevenue > AdM Revenue with TelemetryRevenue information combined with usage metrics. This dataset is useful for CPC analyses.