Consumer Heterogeneity and Paid Search Effectiveness: A Large Scale Field Experiment

Working Paper: NBER ID: w20171

Authors: Tom Blake; Chris Nosko; Steven Tadelis

Abstract: Internet advertising has been the fastest growing advertising channel in recent years with paid search ads comprising the bulk of this revenue. We present results from a series of large scale field experiments done at eBay that were designed to measure the causal effectiveness of paid search ads. Because search clicks and purchase behavior are correlated, we show that returns from paid search are a fraction of conventional non-experimental estimates. As an extreme case, we show that brand-keyword ads have no measurable short-term benefits. For non-brand keywords we find that new and infrequent users are positively influenced by ads but that more frequent users whose purchasing behavior is not influenced by ads account for most of the advertising expenses, resulting in average returns that are negative.

Keywords: paid search; consumer behavior; advertising effectiveness; field experiment

JEL Codes: C93; D22; L10; L20; L81; M37


Causal Claims Network Graph

Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.


Causal Claims

CauseEffect
Removal of paid ads (M38)Substitution with organic search traffic (C69)
Frequent users (D16)Attributed sales (L14)
SEM effectiveness (C52)Consumer prior knowledge and engagement (D18)
Paid search advertising (M38)Sales (L81)
SEM (C87)New user acquisition (O36)
SEM (C87)Purchases by infrequent users (D16)
SEM (C87)Purchasing behavior of frequent users (D12)

Back to index