Working Paper: NBER ID: w20171
Authors: Tom Blake; Chris Nosko; Steven Tadelis
Abstract: Internet advertising has been the fastest growing advertising channel in recent years with paid search ads comprising the bulk of this revenue. We present results from a series of large scale field experiments done at eBay that were designed to measure the causal effectiveness of paid search ads. Because search clicks and purchase behavior are correlated, we show that returns from paid search are a fraction of conventional non-experimental estimates. As an extreme case, we show that brand-keyword ads have no measurable short-term benefits. For non-brand keywords we find that new and infrequent users are positively influenced by ads but that more frequent users whose purchasing behavior is not influenced by ads account for most of the advertising expenses, resulting in average returns that are negative.
Keywords: paid search; consumer behavior; advertising effectiveness; field experiment
JEL Codes: C93; D22; L10; L20; L81; M37
Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.
Cause | Effect |
---|---|
Removal of paid ads (M38) | Substitution with organic search traffic (C69) |
Frequent users (D16) | Attributed sales (L14) |
SEM effectiveness (C52) | Consumer prior knowledge and engagement (D18) |
Paid search advertising (M38) | Sales (L81) |
SEM (C87) | New user acquisition (O36) |
SEM (C87) | Purchases by infrequent users (D16) |
SEM (C87) | Purchasing behavior of frequent users (D12) |