Skip to main content

Overview

OneSignal records metrics for each step of a message’s journey. This journey starts in OneSignal, moves to a third-party provider, and ends with delivery to the recipient device or inbox. This document is intended to illuminate the different metrics we capture in a message’s lifecycle and how those metrics are represented across the various touch points in the OneSignal ecosystem for each channel. Use these definitions when reconciling numbers between sources or building internal reports. This glossary is broken down by channel. Each section includes the following:
  1. Terms: This is where we establish a common glossary of metrics and their definitions.
  2. Delivery lifecycle: This is where we visually represent the metrics captured at each stage of the delivery journey.
  3. Metrics mapping: This is where we tie metric names across all of the OneSignal touch points.

Channel metrics comparison

Different channels contain different delivery states and user engagement metrics. The table below lists the different metrics for each channel.
ChannelSentDeliveredFailedRejectedRemainingClickedOpenedBouncedReadUnsubscribedReported as SpamSuppressedFrequency Capped
Push
Email
SMS
In-app
Live Activity

Push terms

  1. Sent: The number of messages successfully sent from OneSignal to the provider.
  2. Total Attempted: The number of messages we attempted to send. This includes messages successfully sent to the push provider and failures. This is a derived metric and is a sum of successes, failures and errors while attempting to send to the provider.
  3. Audience: The number of subscriptions in the targeted segment(s).
  4. Delivered: The number of push subscriptions that are confirmed to receive the notification.
  5. Unsubscribed: The number of push subscriptions that did not receive the message because they uninstalled the app, cleared browser data, or opted out of push and have not opened the app since. We will not attempt to send to these subscriptions in future messages.
  6. Failed: The number of push subscriptions that did not receive a notification because of an error. We will attempt to send to these subscriptions in future messages.
  7. Clicked: The number of clicks on a notification.
  8. Frequency Capped: The number of push subscriptions that the notification was not sent to due to frequency cap settings.

Push lifecycle

Push metrics mapping

TermDashboard - Delivery Report Stat CardsDashboard - Delivery Report Timeseries ChartDashboard - Journey Node Report Stat CardDashboard - Journey Node Report Timeseries ChartDashboard - Audience ActivityDashboard - Engagement TrendsView Message(s) API1Notifications CSVEvent Streams
SentSent, DeliveredDeliveredDeliveredSentDeliveredsuccessfulsuccessfulmessage.push.sent
Total AttemptedTotal SentSent
AudienceAudience
DeliveredConfirmedConfirmed DeliveryConfirmedConfirmedConfirmed Deliveryreceivedreceivedmessage.push.received
UnsubscribedUnsubscribedUnsubscribedUnsubscribedUnsubscribedUnsubscribedfailedfailedmessage.push.unsubscribed
FailedFailedFailedFailedFailederrorederroredmessage.push.failed
ClickedClickedClicksClickedClickedClickedconvertedconvertedmessage.push.clicked
Frequency CappedCappedCappedCappedfrequency_cappedfrequency_capped
1 We also include per-platform metrics in the API for all metrics besides ‘remaining’ (e.g., ios_converted, android_converted).

Email terms

  1. Sent: The number of emails successfully sent to the provider.
  2. Audience: The number of subscriptions in the targeted segment(s).
  3. Delivered: The number of emails confirmed as delivered to subscriptions’ email server.
  4. Failed: The number of emails unable to be delivered to the inbox, excluding bounces. This may include failures reported by the ESP or OneSignal delivery failures.
  5. Suppressed: The number of emails blocked due to prior bounces or spam reports to protect sender reputation. This metric is only recorded for apps configured to use OneSignal email.
  6. Bounced: The number of emails rejected due to invalid addresses, full inboxes, sender reputation, or DMARC issues. These addresses are added to a Suppression List, either managed by OneSignal or a third party ESP.
  7. Reported as Spam: The number of recipients who marked the email as spam. These addresses are added to a Suppression List, either managed by OneSignal or a third party ESP.
  8. Unsubscribed: The number of recipients who opted out of receiving emails.
  9. Total Opens: Total number of times the email was opened, including repeats.
  10. Total Clicks: Total number of times links were clicked in an email, including repeats.
  11. Unique Opens: Count of individual recipients who opened the email. This metric is used with confirmed deliveries to determine open rate.
  12. Unique Clicks: Count of individual recipients who clicked the email. This metric is used with confirmed deliveries to determine click rate.
Why do we differentiate between total and unique clicks or opens? Unique clicks and opens are only counted once per subscriber, regardless of how many times that subscriber opens or clicks the same email. Total clicks and opens track are not unique per subscriber and count every time an email is clicked or opened.

Email lifecycle

Email metrics mapping

TermDashboard - Delivery Report Stat CardsDashboard - Delivery Report Timeseries ChartDashboard - Journey Node Report Stat CardDashboard - Journey Node Report Timeseries ChartDashboard - Audience ActivityDashboard - Engagement TrendsView Message(s) APINotifications CSVEvent Streams
SentSentSentSentSentplatform_delivery_stats.email.successfulsuccessfulmessage.email.sent
AudienceAudience
DeliveredDeliveredDeliveredDeliveredDeliveredDeliveredDeliveredplatform_delivery_stats.email.receivedemail_deliveredmessage.email.received
FailedFailedFailedFailedFailedFailedplatform_delivery_stats.email.failedemail_failedmessage.email.failed
SuppressedSuppressedSuppressedSuppressedSuppressedSuppressedplatform_delivery_stats.email.suppressedmessage.email.suppressed
BouncedBouncedBouncedBouncedBouncedBouncedplatform_delivery_stats.email.bouncedemail_bouncedmessage.email.hardbounced
Reported as SpamReported as SpamSpamReported as SpamSpamComplainedplatform_delivery_stats.email.reported_spamemail_reported_spammessage.email.reported_as_spam
UnsubscribedUnsubscribedUnsubscribedUnsubscribedUnsubscribedUnsubscribedUnsubscribedplatform_delivery_stats.email.unsubscribedemail_unsubscribedmessage.email.unsubscribed
Total OpensTotal OpensTotal OpensTotal OpensTotal Opensplatform_delivery_stats.email.openedemail_openedmessage.email.opened
Total ClicksTotal ClicksTotal ClicksTotal ClicksTotal Clicksplatform_delivery_stats.email.clickedemail_clickedmessage.email.clicked
Unique OpensUnique OpensUnique OpensUnique OpensUnique OpensOpenedOpenedplatform_delivery_stats.email.unique_opensemail_unique_opens
Unique ClicksUnique ClicksUnique ClicksUnique ClicksUnique ClicksClickedClickedplatform_delivery_stats.email.unique_clicksemail_unique_clicks

SMS terms

  1. Sent: The number of messages successfully sent to Twilio.
  2. Total Attempted: The number of phone numbers we attempted to send to. This includes messages successfully sent to Twilio, as well as failures. This is a derived metric and is a sum of successes, failures and errors while attempting to send to the provider. This is a subset of the audience, as it does not include suppressed messages.
  3. Audience: The number of subscriptions in the targeted segment(s).
  4. Delivered: The number of successful delivery of messages reported by Twilio. Confirmed Delivery metrics are categorized further to distinguish between SMS/MMS and RCS.
  5. Failed: The number of messages that failed to be sent to Twilio.
  6. Suppressed: The number of messages not sent to the recipient because they opted out of receiving messages from the sender.
  7. Rejected: The number of messages not delivered by the carrier due to number blockage, velocity blockage, or the recipient is on a block list. This is a derived metric and is a sum of provider errors and provider failures.
  8. Provider Errored: This number counts the phone numbers for which Twilio failed to send the message.
  9. Provider Undelivered: This counts the phone numbers for which Twilio sent the message, but failed to deliver it.
  10. Read: The number of recipients that read an RCS message.
  11. Total Clicks: Total number of times a link in the message was clicked. Includes when a single link was clicked multiple times.
  12. Unique Clicks: The number of unique link clicks across all links in the message. These are unique per subscriber.
  13. Replied: The number of keywords that have been received by OneSignal excluding consent keywords.
  14. Unsubscribed: The number of opt-out keywords that have been received by OneSignal.

SMS lifecycle

SMS metrics mapping

TermDashboard - Delivery Report Stat CardsDashboard - Delivery Report Timeseries ChartDashboard - Journey Node Report Stat CardDashboard - Journey Node Report Timeseries ChartDashboard - Audience ActivityDashboard - Engagement TrendsView Message(s) APINotifications CSVEvent Streams
SentSentSentSentplatform_delivery_stats.sms.successfulsuccessfulmessage.sms.sent
Total AttemptedSent1Sent1
AudienceAudience
DeliveredDeliveredDeliveredDeliveredDeliveredDeliveredDeliveredplatform_delivery_stats.sms.provider_successfulmessage.sms.delivered
FailedFailedFailedFailed & Rejectedplatform_delivery_stats.sms.failed, platform_delivery_stats.sms.errored2failed, errored2message.sms.failed
SuppressedSuppressedSuppressedSuppressedplatform_delivery_stats.sms.suppressed
RejectedRejectedRejectedFailed & Rejected
Provider ErroredFailed (Errored)Failed (Errored)platform_delivery_stats.sms.provider_errored
Provider UndeliveredFailed (Undelivered)Failed (Undelivered)platform_delivery_stats.sms.provider_failedmessage.sms.undelivered
ReadReadReadReadReadReadRead
Total ClicksTotal ClicksTotal Clicks
Unique ClicksUnique ClicksUnique Clicks
RepliedReplied (keywords)
UnsubscribedUnsubscribed
1 The OneSignal dashboard interprets this as total attempted and sums the number of notifications that were sent out of OneSignal, along with those that either failed or errored within OneSignal’s internal system. 2 The sum of failed and errored, which are both recorded in OneSignal’s internal system when attempting to send to Twilio, result in Failed.

In-app terms

  1. Impression: The number of times a message successfully displayed on a device.
  2. Card Impressions: The number of times a carousel displayed on a device. Only applies to carousels.
  3. Total Clicks: The number of times a button block, image block, or background was clicked.
  4. Unique Clicks: The first time a button block, image block, or background was clicked. It does not include the “Close Button” clicks.

In-app lifecycle

There is no delivery lifecycle to consider. All metrics captured for an in-app message are from the device through the OneSignal SDK.

In-app metrics mapping

TermDashboard - Delivery Report Stat CardsDashboard - Journey Node Report Stat CardDashboard - Journey Node Report Timeseries ChartDashboard - Audience ActivityDashboard - Engagement TrendsEvent Streams
ImpressionsImpressionsImpressionsImpressionsImpressionImpressionsdisplayed
Card ImpressionsCard ImpressionsCard Impressionspagedisplay
Total ClicksTotal Clicks1Total Clicks1clicked
Unique Clicks22ClickedClicked
1 We filter out “Close Button” clicks out of Total Clicks on the IAM Delivery Report stat card. 2 While we don’t have a label on the dashboard for unique clicks, we show unique clicks count alongside the CTR.

Live Activities terms

  1. Sent: The number of messages successfully sent from OneSignal to the provider.
  2. Total Attempted: The number of messages we attempted to send. This includes messages successfully sent to the push provider and failures. This is a derived metric and is a sum of successes, failures and errors while attempting to send to the provider.
  3. Delivered: The number of push subscriptions that are confirmed to receive the notification.
  4. Unsubscribed: The number of push subscriptions that did not receive the message because they uninstalled the app, cleared browser data, or opted out of push and have not opened the app since. We will not attempt to send to these subscriptions in future messages.
  5. Failed: The number of push subscriptions that did not receive a notification because of an error. We will attempt to send to these subscriptions in future messages.

Live Activities lifecycle

Live Activities metrics mapping

TermDashboard - Delivery Report Stat CardsDashboard - Audience ActivityDashboard - Engagement TrendsView Message(s) APINotifications CSVEvent Streams
Total AttemptedSent
SentDeliveredDeliveredDeliveredsuccessfulsuccessful
DeliveredConfirmed
FailedFailedFailedFailederrorederrored
UnsubscribedUnsubscribedUnsubscribedUnsubscribedfailedfailed