Analyzing Push Overview

Once you have launched a few Push campaigns through the channel or journeys, you will be able to analyze their collective impact on user engagement, conversions, and revenue through Push Overview.

🚧

What Kind of Data is Shown Here?

You will see cumulative stats based on user-campaign interactions that occur within the selected time frame.

How to Access

As shown below, this section can be accessed from the central hub of Push by selecting Overview from the navigation bar.

So without much ado, let's dig in!

Select a Time Frame of Analysis

By default, Push Overview shows you the overall impact of all campaigns for the Last 7 days against key performance indicators like Clicks, Conversions, Revenue, Deliveries, Failures and so on.

As shown above, using the filter placed on the top right, you can choose to analyze the channel's performance for the following durations:

• Yesterday
• Last 7 Days
• Last 30 Days

How to Analyze

Now, let's show you how you can gain valuable insights into the collective impact of Push campaigns on user engagement, conversions, and revenue.

🚧

Get all this data delivered to your inbox!

You can analyze the collective impact of all Push campaigns by scheduling reports for your entire team! Head over to Settings> Scheduled Reports in your dashboard to set it up.

Overview

This section provides a comprehensive overview of the channel's performance against broad metrics like Channel Reachability, New Users added, Users Engaged and Total Revenue generated.

Let's go over each card:

Reachability

Reachability is a measure of whether or not a user can be reached through the various channels of engagement. Thus, this card indicates the number of users that can be engaged via Push Notifications, at present.

• The number is further broken down by iOS and Android, indicating your users' device preferences.

• Reachability Percentage: As highlighted in the visual above, the Push reachability of your entire user base is also indicated as a percentage value, helping you gauge the viability of leveraging this channel to engage all your users.

🚧

Please Note

1. Channel reachability is calculated over the entire lifetime of your users and is updated daily to factor in the reachability of new users and the changing channel preferences of existing users. For the same reason, Reachability cannot be analyzed for a particular time frame.

2. A sum of the reachability numbers shown against each OS may exceed the total. This is because users who are reachable on both Android and iOS are counted towards the _Overall Reachability _only once, but are added towards the reachability numbers of both OS.

Detailed Read

New Users

All users who have installed your app on a device with push notifications enabled, within the selected time frame, are considered towards the total number of New Users.

This number is bifurcated into iOS and Android, indicating your users' device preferences.

Users Engaged

Indicates unique users that have received at least one Push campaign within the selected time frame. If a user gets multiple _Push Notifications, they will be counted towards the total number of _Users Engaged* only once to avoid double counting.

Revenue

Indicates a sum of the revenue generated by the Total Conversions tracked for all the Push campaigns within the selected time frame.

Revenue numbers are always shown in the currency selected by you while setting up Revenue Mapping.

🚧

Please Note

If you have not specified a Conversion Event for a campaign while creating it, or if the specified Conversion Event is not mapped as a Revenue Event, then Revenue will not be tracked for it.

Detailed read on how Revenue tracking works.

Tags

Tags help you organize your campaigns and access them quickly. The below shows the tag-based performance per campaign.

As you can see the tag buyback was a part of 85% of campaigns that were delivered. While the buyback tag was involved in the campaigns that contributed to 63% revenue, campaigns with the retargeting tag had the most conversions.

Control Group Report

This section indicates overall campaign performance v/s control groups for the campaigns where either Universal or Custom control groups have been added.

Based on the 'Conversions' in your Target Group (users who were not part of the CG) and the selected Control Group, you will be able to see the overall Uplift (or downlift) that your campaigns are having. Conversion Uplift is calculated using this formula:

Conversion Uplift = [(Unique Conversion Rate of TG/ Unique Conversion Rate of CG) x 100] - 100

In addition to conversion uplift, you can also calculate the revenue increment through Revenue and Order Uplift.

Formula to calculate Revenue Uplift :

• CG projected total revenue = CG(Total Revenue / Total Sent Count) X TG Total Sent Count
• Revenue Uplift (absolute value) = [TG Revenue - CG Revenue (Projected to TG Volume)]
• Revenue Uplift %= [TG Revenue / CG Revenue (Projected to TG Volume) X 100] - 100

Formula to calculate Order Uplift

• Order Uplift (absolute value)= (TG Order Rate - CG Order Rate) X TG Total Sent Count
• Order Uplift % = (TG Order Rate / CG Order Rate X 100) - 100

🚧

Please Note

• Control Group report is Visible only when you have created a Universal Control Group or Custom Control Group. Click here to learn how to create one.

• Campaigns in which a conversion event is added and selected control group is attached along are only taken into consideration for this analysis.

Campaign Comparison

The most insightful section of Push Overview, Campaign Comparison helps you analyze the collective impact of all your campaigns and identify trends of user-channel interactions against key metrics, split by campaign types.

It has been divided into two subsections to facilitate multi-dimensional analysis:

• Top Panel
• Graph

By default, Campaign Comparison shows you the overall performance of all push campaigns for the selected time frame. You can further customize the data by selecting a campaign type.

Here's how you can go about it:

Apply Filter

Select a Campaign Type

As discussed under Campaigns and Its Types, messages sent through the various channels of engagement are called campaigns and can be of the following types: One-Time, Triggered, Recurring, Transactional, Journey, and Relay.

Using the navigation bar highlighted above, you can select a campaign type to narrow down the scope of analysis.

📘

The following options can be selected here:

• All: The default option selected here, it helps you analyze the channel's performance on the basis of all types of campaigns sent through it.

• One-time: Helps you analyze the channel's performance only on the basis of its one-time campaigns.

• Triggered: Helps you analyze the channel's performance only on the basis of its triggered campaigns.

• Recurring: Helps you analyze the channel's performance only on the basis of its recurring campaigns.

• Transactional: Helps you analyze the channel's performance only on the basis of its transactional campaigns.

• Journey: Helps you analyze the channel's performance only on the basis of its journey campaigns.

• Relay: Helps you analyze the channel's performance only on the basis of its relay campaigns.

Tags

Tags are the keywords that you associate with the campaign while creating a campaign. Tags help you analyze campaign results for a group of campaigns that belong to a tag. From the drop-down, select the tags you want to analyze.

Split By

You can choose to analyze the result to split by Channels, Type, or Tags.

Now let's get you acquainted with each subsection:

Top Panel

Here you can analyze the performance of Push as a channel against broad metrics and collect valuable insights.

👍

Analyzing Channel Performance

In the visual above, we see that 1734 Campaigns were sent to all users, out of which 0.09% users converted (Unique Conversions) and contributed to over Rs. 27M in Revenue.

Such insights not only help you gauge ROI but also help determine the viability of engaging users through the channel in the long run.

Let's quickly go over the performance indicator shown here:

Campaigns: Indicates the total number of campaigns sent within the selected time frame, for the chosen campaign type.

Users Engaged: Indicates unique users that received at least one push campaign within the selected time frame, for the chosen campaign type.

Delivered: Indicates the total number of campaigns delivered to all users within the selected time frame, for the chosen campaign type. It includes multiple campaign deliveries to a user, and is thus, significantly higher than the number of Users Engaged.

Unique Clicks: Calculated against Delivered messages, it indicates the percentage of users that clicked on a Push campaign within the selected time frame, for the chosen campaign type.

Unique Conversions: Calculated against Delivered messages, it indicates the percentage of users that performed the Conversion Event of a Push campaign within its Conversion Deadline, in the selected time frame, for the chosen campaign type.

Revenue: Indicates a sum of the revenue generated by the Total Conversions tracked for all the Push campaigns within the selected time frame, for the chosen campaign type. Detailed read on how revenue tracking works.

🚧

Related Read

Please refer to Campaign and Channel Performance Indicators for a comprehensive list of all the metrics tracked for Push campaigns.

Select a Data Format (Optional)

Using the overflow menu highlighted below, you can choose to analyze Clicks and Conversions as a numerical value (by selecting #), or as a percentage value (by selecting %).

Graph

Here you can analyze the correlation between campaign Deliveries, Unique Clicks, and Unique Conversions as trend graphs, split by days, for the selected time frame and campaign type.

We will need to dig deeper into the following aspects to find our answers:

• How many Push Notifications were sent on these days?

• Who was the target audience of each campaign?

• What were the campaigns about? (message, layout, links, campaign type and so on)

• Did all these campaigns have a Conversion Event attached to them? (If a Conversion Event was not specified while creating the campaign, then conversions will not be tracked for it. This is an important factor that could skew your insights.)

Similarly, you can individually analyze the performance of all your One-time, Triggered, Recurring, Transactional, Journey, and Relay campaigns to assess what works the best for your users.

Select the Format of Visualization (Optional)

Lastly, while the default format of visualization is a Line Graph, using the overflow menu highlighted below, you can choose to analyze data as a Bar Graph.

🚧

Why do I see 'No Data to Display' in this section?

The message indicates that campaigns of the selected type do not exist. This usually occurs if:

• The campaigns were deleted
• No campaigns were sent within the selected time frame
• No data was tracked for the selected campaign type within the chosen time frame

For example, let's say that you select One-time as the campaign type and choose to analyze the user-channel interactions that occurred Yesterday.

However, instead of data, you are shown No Data to Display. This means that no data was collected for One-time Push campaigns within the selected time frame.

Delivery Failure & Uninstall Trends

This section helps you analyze all the campaign failures and app uninstalls that have occurred within the selected time frame. Let's go over the various trends and metrics shown here:

Delivery Failures Against Days: Indicates campaign failure trends for the selected time frame, against days, the number of devices for which push notifications failed, and the respective reasons for failure.

🚧

Related Read

Here's a complete list of all the reasons due to which a Push campaign could fail to get delivered to your users.

Number of Push Notifications Before Uninstall: Indicates the total number of Push Notifications sent to the users before they uninstalled your app.

Days from First Push Notification to Uninstall: Indicates the total number of days within which users uninstalled your app, after receiving the first Push Notification.

🚧

Related Read

All users who have uninstalled your app can be further analyzed through the Uninstalls section of your dashboard.

Engagement Trends

This section helps you analyze user engagement trends for all Push Notifications as per the selected time frame against the most crucial performance indicators - Clicks and Conversions.

Given the short lifespan of Push Notifications, the drastic difference between Click and Conversion trends indicates that most users delayed their decision to convert. We will need to dig deeper into all the Push campaigns sent on Sunday, Monday, and Wednesday to fully understand the behavior.

Now, let's get you acquainted with the various metrics shown here:

Clicks Against Days and Time: Indicates Unique Click trends for each day of the week against the following durations, for the selected time frame:

• 12 am to 4 am
• 4 am to 8 am
• 8 am to 12 pm
• 12 pm to 4 pm
• 4 pm to 8 pm
• 8 pm to 12 am

Clicks against Device Type: Indicates Unique Click trends for the selected time frame, as per the devices (mobile, tablet) on which the users received your Push Notifications.

Conversions Against Days and Time: Indicates Unique Conversion trends for each day of the week against the following durations, for the selected time frame:

• 12 am to 4 am
• 4 am to 8 am
• 8 am to 12 pm
• 12 pm to 4 pm
• 4 pm to 8 pm
• 8 pm to 12 am

🚧

Related Read

Please refer to Campaign and Channel Performance Indicators for a complete list of all the metrics tracked for Push campaigns.

We hope this gives you a good idea of how you can analyze the collective impact of your Push campaigns on driving user engagement and revenue. Please feel free to drop in a few lines at [email protected] in case you have any further queries. We're always just an email away!