Multi-use rewards reporting

This reporting update replaces the existing campaign reporting for campaigns that use multi-use rewards. Here's what's new and why:

Proper counts for campaigns that issue multiple rewards

These campaigns do something new: they give multiple rewards out when they send a message. Prior reporting expected rewards to be issued with the message and for there to be only one. This new reporting tells the complete story of campaigns that use multi-use incentives. As a simple example, this report tells the story of Redemptions per user showing how many people redeemed 1 reward, 2, 3, and so on.

Revenue impact up-front

This reporting is only for campaigns that issue rewards (by definition) so it starts with Redemption Revenue. Not “how much did recipients spend” but “how much did redeemers spend when redeeming.” This is a much more impact-oriented expression and is a preview of what’s to come in our campaign reporting.

Improved A/B/Control methodology

We’ve improved how we calculate the relative impact of A/B/Control comparisons by eliminating some of the assumptions in the old campaign reporting. The result is that this new reporting logic more clearly tells the impact of variants relative to each other, where the old version tended to normalize them together making the winning variant is much more apparent.

What’s to come

We are actively exploring ways to tell the impact stories of the campaigns our customers more clearly and have plans to bring many of the improvements listed above to all campaign reporting soon.