Measuring results for digital direct response campaigns, intended to convert existing in-market demand, is well established. What about campaigns targeted to desirable prospects earlier in the purchase cycle? These campaigns influence new customers you wouldn’t otherwise reach and drive them down the funnel toward purchase. However, complex buy cycles and multiple, cross-device consumer touch points render existing tracking and measurement mechanisms incomplete to demonstrate this impact. How can you provide a real ROI to your executive team to understand the impact your campaigns are having on business growth? Attend this Tech Talk to hear a case study of how one marketer has adopted a test and learn approach for digital campaign measurement. Learn how they are driving profitable business growth using digital media — regardless of sales channel or path to purchase.
7. Challenge: Measuring ROI for Demand Creation
Confidential & Proprietary
Demand creation requires repeated exposure to the
same audience over a period of weeks
Once the initial interest is created, consumers will
follow many different paths to conversion
Influence of Prospecting
10%
9%
37%
9%
15%
20%
% of view-through conversions by
last-click channel source
4
Monday, December 9, 13
Search
Call Center
Retargeting
Branch Visit
Mobile CTC
Prospecting
Prospecting fuels all
other channels
10% of conversions were
from last click-through
Remaining 90% were
driven through other
channels
8. What is Net Incrementality?
Confidential & Proprietary
Net Incrementality is the measurement of new customers
acquired by a specific digital campaign who would not have
converted in the absence of the campaign.
Net Incrementality Analysis
answers the question:
“If I spend $10,000 on this
campaign, exactly how many net
new customers will I acquire?
5
Monday, December 9, 13
9. NIA Part I: Audience Division
Confidential & Proprietary
Phase 1
Divide advertiser audience into two truly
random subgroups for A/B testing
T
C
9
8
9
9
8
9
8
9
9
9
9
8
8
9
9
9
9
All Users
8
Test Group
9
9
9
9
9
8
9
8
9
9
9
8
8
9
9
9
9
8
Control Group
6
Monday, December 9, 13
9
10. NIA Part II: Execution
Confidential & Proprietary
Phase 2
Launch Test Campaign to Test Group
All new customer sales data
is collected during campaign period
T
C
9
8
9
9
9
9
8
9
9
7
Monday, December 9, 13
Phone
Search
Direct Mail
TV
Sales!
8
8
9
Test Campaign
Ad
8
9
9
9
9
9
9
In-Store
Website
8
In all other aspects Test and Control group
members are treated identically, including exposure
to your other marketing campaigns.
New Customer
CRM Database
11. NIA Part III: Analysis
Confidential & Proprietary
Phase 3
TruSignal Matches New Customers
to Control and Test Groups
T
C
9
8
9
9
8
8
9
150 new customers
matched to original test group
9
9
New Customer Data
from CRM
9
8
8
9
9
8
112 new customers
matched to original control group
8
Monday, December 9, 13
Net Incrementality Analysis
answers the question:
How many of my new customers
would not have converted without
the test campaign?
12. Case Study: NIA for Education Client
Confidential & Proprietary
Client Overview:
‣ Top
10 for-profit education client with bachelor’s programs
‣ Bottom-funnel
strategies tapped out: search, retargeting, behavioral, lead buying
‣ Enrollments
secured via various channels: online, lead sellers, affiliates, TV, radio, call
centers, and campus recruiting
Challenges Presented:
‣ How
to reach potentially profitable students who aren’t currently seeking a bachelor’s program?
‣ How
to measure the impact of demand creation on new enrollments?
TruSignal Solution:
‣ Built
custom enrollment propensity audience based on existing students
‣ Executed
30-day RTB bidded display campaign using DSP platform
‣ Performed
Monday, December 9, 13
Net Incrementality Analysis (NIA) using a carefully controlled A/B test
13. Case Study: Education Demand Campaign NIA
Confidential & Proprietary
Results
‣ Test
group produced better quality (2.4% vs 2.8% enrollment rate)
‣ Test
campaign generated 34 incremental enrollments
Population
Size
Leads
Enrollments
Enroll Rate
Control
2,500,000
6895
170
2.4%
Test
2,500,000
7211
204
2.8%
316
34
Incremental
Cost per incremental enrollment = $1,765 < $3,000 (target)
10
Monday, December 9, 13
14. Thank You!
Confidential & Proprietary
Discover Your Ideal Audience
Jeremy Longinotti
CRO
www.tru-signal.com
jlonginotti@tru-signal.com
Monday, December 9, 13
twitter: @ trusignal