Sponsored Search Auctions
Sponsored search (per-click pricing, per-query continuous auctions, slots, impressions vs clicks); click-through rates alpha_ij, weights and scores, rank-by-bid vs rank-by-revenue, the generalized second price (GSP) and generalized first price (GFP) auctions; the static model and its four strong assumptions; Myerson revenue-optimal auction as VCG on virtual values; efficient allocation as a maximum-weight assignment LP with VCG prices from the minimal optimal dual; assortative (Northwest corner) assignment; why multi-slot VCG differs from GSP (worked two-slot example); ranking auctions and the truthful payment rule; GFP symmetric Bayes-Nash efficiency and bid fluctuation; locally envy-free assignments = optimal assignments (Theorem 28.1); GSP full-information equilibrium implementing VCG (Theorem 28.2); condominium auctions; bid rotation and vindictive bidding; online budgeted allocation, LP with budget shadow prices, greedy 1/2-competitive, budget smoothing with phi(x) = 1 - e^(x-1), optimal 1 - 1/e competitive ratio (Theorem 28.3, Lemma 28.4); open issues (soft budgets, pay per action, competing search engines, syndication, CTR learning)
Motivation: auctioning attention next to search results
Offline, advertising is sold by negotiation or posted price. Online, search engines auction space beside their algorithmic results. When a user searches “ipod,” Apple or Best Buy may appear in the sponsored listings.
DefinitionSponsored search
- Sponsored listings appear above or beside the results, in the same format (title, text, link). Each position is a slot, and higher slots get more attention and more clicks.
- Advertisers pay per click: nothing for a display that isn’t clicked.
- Each query has its own auction. HostRocket bidding 40¢ on “Web hosting” means paying up to 40¢ per click.
- Auctions are continuous and dynamic. Bids change at any time (raise “buy flowers” before Valentine’s Day), and a new auction clears on every search.
- Advertisers can set daily or monthly budgets.
WarningImpressions, not clicks
Bids are per click, but the engine can only allocate impressions (placements on the screen). Clicks follow only stochastically.
NoteScale (2005 figures, as reported)
About $7B in revenue, nearly doubling yearly for five years; $5.1B in the US, which was 41% of US online ad revenue. About 85% of Google’s $4.1B and 45% of Yahoo!‘s $3.7B. As many as 17% of Google searches produce a paid click, earning about 9¢ per query. Overture (GoTo.com, later Yahoo!) pioneered the model.
IntuitionThe central question
Search engines sell ordered slots whose value differs by position, to bidders with private per-click values, millions of times a day under budget constraints. How do the mechanisms actually used compare with what theory says is efficient or revenue-optimal — and how should budgets be handled online?
Why per click rather than per impression? Traditional media sell exposure because effectiveness is hard to measure. The Web can track clicks, and direct marketers prefer to pay for them. The next step, paying per action or conversion, is discussed under Open questions.
Existing mechanisms
Advertisers submit keyword–bid pairs plus a budget. On each search, the interested advertisers with budget remaining enter an auction.
DefinitionClick-through rates, weights, scores
- bidders and slots.
- CTR is the probability a user clicks slot when bidder occupies it, with (higher slots are better for everyone).
- Each advertiser has a weight (relevance or quality) and a score .
- Slots are allocated in decreasing score order. Number bidders so bidder gets slot .
- Slot pays per click the lowest bid that keeps its position:
| Mechanism | Weights | Price per click |
|---|---|---|
| GSP, rank by bid (Overture/Yahoo!) | next bid | |
| GSP, rank by revenue (Google) | ||
| GFP (Yahoo! before 2004) | rank by bid | your own bid |
NoteWhy decaying CTRs matter
Monotone CTR decay means every bidder ranks slots identically. This is much more structure than general multi-item auctions have, and it enables sharper equilibrium analysis.
graph TD B1["Slot 1: highest score"] -->|"pays next score / own weight"| B2["Slot 2"] B2 -->|"pays next score / own weight"| B3["Slot 3"] B3 -->|"sets slot 3's price"| B4["First excluded bidder"]
The static model
DefinitionStatic model
Bidder has a private, one-dimensional value per click , and gets without a slot. Bidders are risk-neutral with quasilinear money.
Four assumptions need salt:
| Assumption | Reality check |
|---|---|
| static (one-shot) | auctions recur constantly; the chapter accepts this for tractability |
| value per click is slot-independent | some claim top-slot clicks convert worse (errors, less serious users); tracking data (Isobar) says the top slot converts about as well |
| no externalities between bidders | Avis may value Hertz being absent |
| CTRs are common knowledge | engines learn CTRs from rich context (a hard ML problem with an explore/exploit trade-off); bidders know less; CTRs fluctuate |
Revenue maximization and efficiency
In the static model, the optimal designs are already known.
TheoremRevenue-optimal auction
Apply Myerson directly (see revenue-maximization), with the allocation variable reinterpreted as the expected CTR of a bidder bidding . The optimum is the generalized Vickrey auction on virtual values, i.e. VCG with reserve prices.
FormulaEfficient allocation: maximum-weight assignment
With if bidder gets slot ( slots):
This is bipartite maximum-weight matching, solvable in polynomial time. The constraint matrix is totally unimodular, so there is an integral optimum (an assignment).
FormulaThe dual gives VCG prices
With for the slot constraints and for the bidder constraints:
is the expected payment for slot (CTR times price per click), and is bidder ‘s profit. Among all optimal duals, the one minimizing gives the generalized Vickrey prices.
IntuitionOne LP, both answers
The primal chooses the allocation. The dual splits the total surplus into seller revenue and buyer profits. The VCG split is the one that gives bidders as much as possible, i.e. the seller as little as possible, consistent with stability.
DefinitionAssortative assignment (Northwest corner rule)
If CTRs are bidder-independent, , the efficient assignment gives the highest the top slot, the next highest the next slot, and so on.
NoteAscending versions
If sealed bids are objectionable, ascending implementations of the generalized Vickrey auction exist.
GSP is not VCG
Warning“Based on Vickrey” is not “truthful”
Neither GFP nor GSP has truthful bidding as an equilibrium. Google’s promotional material called its auction a generalization of Vickrey’s single-item auction (true), and concluded that sincere bidding is optimal (false). The same mistake was made about Hambrecht’s IPO auctions. A design that reduces to Vickrey for one unit need not inherit Vickrey’s properties for many units. (The chapter’s analogy is the “freshman binomial theorem,” : true for only.)
ExampleTwo slots, three bidders: how a second slot lowers the top price
Values and CTRs .
Top slot alone, by English auction: bidder stays while , so the price ends at .
With slot 2 available (currently priced at 0): bidder stays in the top-slot auction only while that slot beats the free lower slot:
So the top-slot price ends at .
The second slot is an outside option that lowers what a bidder will pay for the first. VCG builds this in. GSP charges the top bidder the next bid, per click if everyone is truthful, so the top bidder overpays and wants to shade.
DerivationExact VCG prices in this example
Bidder 1’s externality: without her, bidders 2 and 3 get . With her, bidder 2 gets and bidder 3 gets nothing. So she pays which is per click. Bidder 2 pays , i.e. per click.
(The chapter states bidder 1’s VCG price as . That matches its sequential-auction story, where slot 2 is priced at 0. The full externality adds the term. This computation is mine.)
Ranking auctions
DefinitionRanking auction
Weight the bids (with weights independent of the bids), rank them, and give slots in rank order. GSP and GFP are both ranking auctions. The allocation is monotone in one’s own bid.
FormulaThe truthful payment for a ranking allocation
Monotonicity guarantees that some payment rule makes truth-telling an equilibrium (see mechanism-design). With bidder ‘s expected CTR at bid :
GSP’s and GFP’s payments are not this rule. Ranking auctions are in general neither efficient nor revenue-maximizing.
Equilibrium properties
Not being truthful doesn’t settle efficiency or revenue. The equilibria might still be good.
TheoremGFP: efficient in Bayesian equilibrium
GFP has no pure full-information equilibrium, but it has a symmetric Bayes-Nash equilibrium in monotone bid functions (as in the single-item first-price auction). Monotone bids reproduce the efficient allocation, and revenue equivalence gives the same revenue as VCG.
WarningThe static assumption bites
With no pure full-information equilibrium, repeated GFP bidders keep adjusting bids period after period. The resulting fluctuations are argued to cause significant inefficiency, and Yahoo! abandoned GFP.
NoteGSP’s Bayesian equilibrium is unknown
The chapter analyses GSP only under full information, with and . Separable CTRs with general weights are left as exercises.
DefinitionLocally envy-free assignment
An assignment with slot prices (total expected payments) is locally envy-free if every bidder in slot weakly prefers her slot to the slots immediately above and below:
TheoremTheorem 28.1 — locally envy-free ⟺ optimal
An assignment is optimal iff it is locally envy-free.
ProofAdjacent-swap inequalities give assortativity; LP duality gives the converse
(⇒ optimal) It suffices to show assortativity. Let hold slot and hold slot . Local envy-freeness for each, toward the other’s slot:
Adding them cancels the prices: . Since , we get .
(⇐ locally envy-free) Take an optimal dual . For , complementary slackness and dual feasibility give
The dual prices are in fact globally envy-free.
∎
NoteWhat “optimal” needs here
Local envy-freeness constrains only assigned bidders relative to neighbouring slots. So the (⇒) direction shows the assigned bidders are correctly ordered; optimality also requires that the top- values are the ones assigned. (This caveat is mine; it holds in the construction below.)
TheoremTheorem 28.2 — GSP implements VCG in full-information equilibrium
GSP has a full-information equilibrium whose allocation is locally envy-free, hence efficient, with every bidder paying her VCG price.
ProofBid the VCG price of the slot above, scaled by its CTR
Order values , and let be the Vickrey total price of slot .
Step 1: The bids. Bidder 1 bids . Each bidder bids . Under GSP, slot pays the next bid per click, for a total of : exactly the VCG price.
Step 2: Bids are decreasing, so GSP assigns efficiently. Local envy-freeness of the VCG outcome for bidder looking up gives . VCG profits are nonnegative, so . Combining,
For : . So bidder gets slot . Bidders beyond pay nothing.
Step 3: No profitable deviation. Each bidder receives her efficient slot at her VCG price, and the prices are envy-free (Theorem 28.1). The chapter concludes that no one wants to change her bid.
(Step 2’s cleaned-up inequality chain is mine; the printed version has shifted indices. Step 3 is the chapter’s brief argument.)
∎
ImportantGSP is not truthful, but can be as good as VCG
In the full-information equilibrium built from VCG prices, GSP gives the efficient allocation and VCG revenue. The failure is truthfulness, not outcomes (at least in this equilibrium).
RemarkCondominium auctions
Setting aside repetition, keyword auctions are condominium auctions in which everyone ranks units identically (everyone wants a higher floor).
Dynamic aspects
These auctions are really repeated games of incomplete information, which have rich equilibrium sets. Two phenomena stand out:
DefinitionBid rotation
Competitors take turns winning, e.g. alternating in the top slot. This is harmless with short-lived bidders, but with persistent ones it lowers revenue.
DefinitionVindictive bidding
In GSP, your bid sets the price of the bidder above you, not your own. So you can raise a budget-limited competitor’s costs at no cost to yourself. In a dynamic setting this drives constant bid adjustment, to inflict or dodge damage.
Online allocation with budgets
Even without strategy, budgets across keywords make efficient allocation an online problem.
DefinitionOnline budgeted allocation model
advertisers and keywords. Advertiser bids on keyword , with budget , and . Queries arrive over the day. Each page has one slot, and the winner pays its bid per impression (unlike practice). Scaling bids by CTR gives pay per click. The goal is to maximize revenue within budgets.
FormulaOffline benchmark: known query volumes
with dual
Allocation rule from complementary slackness: give each query to the maximizing .
| Component | Detail |
|---|---|
| shadow price of advertiser ‘s budget: extra revenue per extra dollar of | |
| opportunity cost of spending of ‘s budget now | |
| net value of allocating query to |
IntuitionDiscount bids by budget scarcity
A bidder with a nearly binding budget should get fewer queries now, so its money is available later for queries only it values. The optimal offline rule scales each bid down by .
Online: the query frequencies are unknown, and queries must be allocated as they arrive. Performance is measured by competitive ratio against the offline optimum of (28.11) (see online-mechanisms).
AlgorithmGreedy
Give each query to the highest bidder with budget remaining. This amounts to setting every .
ExampleGreedy gets only half
Two bidders, each with budget $2, and two queries. Bidder 1 bids 2 on query 1 and on query 2. Bidder 2 bids 2 on query 1 and on query 2.
- Greedy: query 1 arrives first and goes to bidder 1 (tie), which exhausts her budget. Query 2 goes to bidder 2 for . Revenue .
- Optimum: query 1 to bidder 2 and query 2 to bidder 1. Revenue about .
Greedy ignores the opportunity cost of bidder 1’s budget.
TheoremGreedy is 1/2-competitive
Greedy’s revenue is always at least half the optimum, and the example shows this is tight.
AlgorithmAlgorithm 1 — budget smoothing (tradeoff function)
Let be the fraction of ‘s budget spent so far, and Give each arriving query to the bidder maximizing . This is an online estimate of the shadow price, .
IntuitionSpend budgets evenly
As a bidder spends more, falls from toward 0, so her effective bid shrinks. Queries shift toward bidders with more budget left, spreading expenditure over time. Search engines sell this as budget smoothing.
TheoremTheorem 28.3 — optimal competitive ratio
Algorithm 1’s revenue is at least of the optimum, and no deterministic or randomized online algorithm does better.
Proof ideas. Discretize budgets into levels. A bidder is of type if she has spent a fraction in of her budget. Let be the total budget of bidders ending at type , and the money spent from the -th slice of bidders’ budgets. Use the discrete tradeoff
which is decreasing in . Assume OPT exhausts all budgets, so .
LemmaLemma 28.4
At the end, . (28.13)
ProofCharge each query to OPT’s choice
Step 1: Compare at one query. When query arrives, let OPT give it to a bidder of current type (final type ), earning . The algorithm gives it to a bidder of type , earning .
- (a) is decreasing and .
- (b) The algorithm maximizes (discretized) .
Step 2: Sum over queries. The left side, weighted by each bidder’s final type, sums to . The right side, weighted by the type at the moment of spending, sums to .
∎
NoteFinishing the theorem
One then uses , swaps the order of summation, and sums the geometric series. The remaining terms give as . The printed chain of inequalities is garbled in the source, so only this outline is reproduced here. The lower bound, that no algorithm beats , is stated without proof.
RemarkExtensions and unknowns
The same algorithm handles multiple slots per page and advertisers arriving at different times. Its equilibrium properties are unknown.
Open questions
NoteBudgets and richer bids
Budgets seem soft: bidders adjust them often, and can “expand” a budget by bidding lower. Budgets may proxy for other goals (limiting exposure, spreading ads over time). Richer languages would let bidders express diminishing marginal value for clicks, or value by region or demographic. They would improve efficiency at computational and elicitation cost.
NoteClick fraud and pay per action
Per-click pricing invites robot clicks, spam clicks, competitors’ cost-imposing clicks, and affiliates profiting from clicks. Pay per action or conversion is the leading alternative, but it raises incentive problems around tracking sales.
NoteCompetition between search engines
Models assume a monopoly engine with a fixed user base. In fact advertisers multi-home cheaply (both Google and Yahoo!, or via marketing agencies), and users switch at essentially zero cost. Blind tests show little quality difference, and brand drives loyalty. Competition may push engines toward retaining advertisers and users over extracting revenue. Keyword auctions in competition are unstudied.
NoteSyndication, CTR learning, the bidder’s side
- Syndication (e.g., AdSense to AOL, MySpace) complicates the meaning of bids and allocation.
- CTRs are learned from bidder, ad, user and page context. This is an explore/exploit trade-off, and the engine’s estimates differ from bidders’.
- The advertiser’s bid optimization problem is its own major research and commercial area.
Quick reference
| Object | Statement | Note |
|---|---|---|
| Sponsored search | per-query continuous auctions for ordered slots | pay per click |
| CTR | , decreasing in slot | everyone ranks slots alike |
| Score | ; rank by score | |
| GSP price per click | rank by bid () / by revenue () | |
| GFP | pay your own bid | no pure full-info equilibrium |
| Static model | private per click; CTRs known | four strong assumptions |
| Revenue optimum | VCG on virtual values (reserves) | Myerson with = expected CTR |
| Efficiency LP (28.1) | max-weight assignment | totally unimodular ⇒ integral |
| Dual (28.5) | VCG = optimal dual minimizing | |
| Assortative | ⇒ sort by | Northwest corner rule |
| Two-slot example | top price | lower slot is an outside option |
| Truthful ranking payment (28.8) | GSP and GFP don’t use it | |
| GFP Bayes-Nash | symmetric, monotone ⇒ efficient | bid cycling when repeated |
| Locally envy-free (28.9–28.10) | no envy toward adjacent slots | |
| Thm 28.1 | optimal ⟺ locally envy-free | adjacent swap + duality |
| Thm 28.2 | GSP equilibrium with gives VCG | efficient, VCG revenue |
| Bid rotation / vindictive bidding | repeated-game pathologies | your bid prices the slot above |
| Online LP (28.11) | budgets , volumes | allocate to |
| budget shadow price, i.e. opportunity cost | ||
| Greedy | -competitive, tight | ignores opportunity cost |
| Algorithm 1 | maximize | budget smoothing |
| Thm 28.3 | , optimal | Lemma 28.4 charging argument |
Facts to keep to hand
- LP duality prices everything here. VCG payments are the seller-minimal optimal dual of the assignment LP. Envy-free prices are dual solutions (Theorem 28.1). The online rule discounts bids by the budget constraint’s dual variable.
- Reducing to Vickrey for one item proves nothing for many. A second slot is an outside option that lowers willingness to pay for the first. VCG accounts for this and GSP doesn’t, so truthful GSP bidding overpays at the top.
- Non-truthful mechanisms can have good equilibria. GFP (Bayesian) and GSP (full information, locally envy-free) both reach efficient allocations, and GSP’s constructed equilibrium matches VCG revenue exactly. Truthfulness is sufficient for good outcomes, not necessary.
- Static equilibria can mislead dynamically. GFP’s lack of a pure full-information equilibrium became bid cycling in practice. GSP’s “price-setting from below” enables vindictive bidding. Repeated play enables rotation.
- Budgets make allocation online, and opportunity cost is the fix. Greedy spends the wrong budgets first (1/2). Pricing budget depletion with spreads spending and achieves the best possible .
- keeps appearing. Greedy for monotone submodular maximization (cascading-behavior-in-networks) and optimal online budgeted allocation share the same constant. It is the signature of “diminishing marginal value, handled online or greedily.”
- Monotone CTR decay is the structural gift. Identical slot rankings make keyword auctions condominium auctions: efficient assignment is just sorting, and local envy-freeness implies global.
References
- Nisan, Roughgarden, Tardos, Vazirani, Algorithmic Game Theory — chapter 28 (Lahaie, Pennock, Saberi, Vohra)